OpenAI, the AI analysis agency behind ChatGPT, has launched a brand new software to differentiate between AI-generated and human-generated textual content.
Even although it’s unattainable to detect AI-written textual content with 100% accuracy, OpenAI believes its new software can assist to mitigate false claims that people wrote AI-generated content material.
In an announcement, OpenAI says its new AI Text Classifier can restrict the power to run automated misinformation campaigns, use AI instruments for tutorial fraud, and impersonate people with chatbots.
When examined on a set of English texts, the software may accurately say if the textual content was written by AI 26% of the time. But it additionally wrongly thought that human-written textual content was written by AI 9% of the time.
OpenAI says its software works higher the longer the textual content is, which could possibly be why it requires a minimal of 1,000 characters to run a take a look at.
Other limitations of the brand new OpenAI Text Classifier embody the next:
- Can mislabel each AI-generated and human-written textual content.
- AI-generated textual content can evade the classifier with minor edits.
- Can get issues mistaken with textual content written by kids and on textual content not in English as a result of it was primarily skilled on English content material written by adults.
With that in thoughts, let’s have a look at the way it performs.
Using OpenAI’s AI Text Classifier
The AI Text Classifier from OpenAI is easy to make use of.
Log in, paste the textual content you wish to take a look at, and hit the submit button.
The software will price the chance that AI generated the textual content you submitted. Results vary from the next:
- Very unlikely
- Unlikely
- Unclear whether it is
- Possibly
- Likely
I examined it by asking ChatGPT to put in writing an essay about search engine optimization, then submitting the textual content verbatim to the AI Text Classifier.
It rated the ChatGPT-generated essay as presumably generated by AI, which is a robust however unsure indicator.
Screenshot from: platform.openai.com/ai-text-classifier, January 2023
This outcome illustrates the software’s limitations, because it couldn’t say with a excessive diploma of certainty that the ChatGPT-generated textual content was written by AI.
By making use of minor edits prompt by Grammarly, I diminished the score from presumably to unclear.
OpenAI is appropriate in stating that it’s straightforward to evade the classifier. However, it’s not meant to be the one proof that AI wrote one thing.
In a FAQ part on the backside of the web page, OpenAI states:
“Our supposed use for the AI Text Classifier is to foster dialog concerning the distinction between human-written and AI-generated content material. The outcomes could assist, however shouldn’t be the only real proof when deciding whether or not a doc was generated with AI. The mannequin is skilled on human-written textual content from a wide range of sources, which will not be consultant of every kind of human-written textual content.”
OpenAI provides that the software hasn’t been totally examined to detect content material containing a mixture of AI and human-written textual content.
Ultimately, the AI Text Classifier could be a beneficial useful resource for flagging probably AI-generated textual content, however it shouldn’t be used as a definitive measure for making a verdict.
Featured Image: IB Photography/Shutterstock