Russian scientists have created an AI system that recognizes mathematical formulas in speech and converts them into text. Specialists from the Artificial Intelligence Research Institute (AIRI), Innopolis University, MTUCI, HSE University, and Moscow State University worked on the project. This was reported by the AIRI press service.
The solution allows a person to pronounce a formula or an entire sentence with mathematical expressions, and receive structured text in LaTeX format as output.
The LaTeX standard is used in scientific articles, educational materials, and digital editors like Overleaf.
The scientists used an open dataset prepared by volunteer mathematicians. They voiced most of the mathematical formulas, while the rest were generated.
The Russian AI system surpassed its counterparts in accuracy by 36%. Dmitry Korzh, a researcher at AIRI, stated that their development would be useful for solving a wide range of tasks, including speech recognition, audio signal analysis, and speech characteristics. It is expected to become an assistant for mathematicians and simplify the preparation of scientific publications.