Scientists at ITMO University in St. Petersburg have developed an artificial intelligence-based tool that determines with up to 94% accuracy whether a text was written by a human or AI. The system is also capable of editing texts, reducing their "machine origin," and is already available in a demo version.
The new tool, created in ITMO's Computer Technologies Laboratory, analyzes the style and content of the text, identifying whether it was created by a human, AI, or paraphrased by AI. The algorithm successfully distinguished authorship in 94% of cases when tested on 5,500 Russian-language texts. For texts paraphrased by AI, the accuracy was 80%. The system uses two large language models that compare how "surprising" or "unexpected" the text is for them, and also analyzes linguistic features: word length, sentence structure, lexical diversity, and readability.
To train the classifier, the scientists created a corpus of more than 4,000 texts in Russian, including scientific articles, essays, news, paraphrased texts, and materials generated by AI, such as ChatGPT and Gemini. Additionally, an "obfuscator" was developed — a tool that edits the text, eliminating traces of AI while preserving meaning and readability. It can be used to test the stability of detectors or prepare texts for publication.
A demo version of the tool is available on the Hugging Face Spaces platform, where any user can test their text. In the future, the scientists plan to implement the service at ITMO to check student work and develop the project with the involvement of new researchers. The tool can be used in education, media, and business to label AI content and verify documents.
Read more on this topic:
The State Duma Has Defined the Concept of "Artificial Intelligence"
Helping Teachers!: "Znanie" Launches a Course on How to Detect AI in Homework Assignments
Now on home
Герой России Гарнаев: никто из профессионалов о возобновлении производства на КАЗ всерьёз не говорит
Система отслеживает спутники на высотах до 50 000 км и ведёт за ними наблюдение
The armored vehicle is equipped with a KamAZ-740.35-400 diesel engine with a power of 400 hp.
Constant improvements in avionics, weapons and tactical capabilities will make the aircraft a flexible response to future challenges
The exterior of the KamAZ-54901 features fairings on the cab and chassis for fuel economy
Fighters are in demand both domestically and abroad
Tyazhpromexport and Venezuela Agree on Plant Revival
The company not only completed the state order, but also quickly mastered the production of AK-12K for special forces
Experts have developed a photogrammetric complex with a resolution of less than 1 cm
