Students at the Moscow Institute of Physics and Technology (MIPT) have developed an innovative Audio2MIDI service that uses artificial intelligence to convert audio recordings of piano music into sheet music. This service solves a problem faced by musicians and composers, as creating scores manually requires significant effort and time. Modern AI models for music are not always effective due to the limited amount of high-quality data in MIDI format.

Audio2MIDI operates via Telegram. To use it, simply launch the bot and select the desired task (e.g., recognize notes from a song, separate a song into vocals and accompaniment, or retrieve song lyrics by keywords). The main feature is the high accuracy of conversion, even for complex polyphonic works. The service promises a significant reduction in the time it takes to create scores — now, playing the piano requires only a few moments to obtain the necessary notation.

The service can be useful for music platforms and stores, offering an API for generating sheet music data and improving the training of generative music models. It can also be used to verify the originality of musical compositions and analyze tracks for plagiarism, which is relevant in cases of copyright disputes.

In the future, the developers plan to expand the functionality, including creating scores for other instruments and orchestral parts.

Read more on the topic:

Okko Launches New "Music" Section

YandexGPT Neural Network Will Retell Video Clips in Russian

Yandex Neural Network Learns to Follow the Thread of Conversation