Mirelo

Today, together with @kyutai_labs, we’re introducing our new Audio-to-MIDI model. It takes a finished recording, identifies the instruments playing, and returns separate MIDI tracks for each — voice, drums, bass, keys, and more. Unlike most existing solutions, our model works directly from the full mix rather than requiring separate stems. It also detects chords, key, and tempo, giving producers broader musical context. We’ve written more about the model, the problem, and how it works here: mirelo.ai/blog/turning-a…

We're hiring growth interns at @MireloAI Founded by two researchers and passionate musicians, @cjsimongabriel & @flwenz , we are the leading audio research lab backed by @IndexVentures & @a16z. This is a rare opportunity to work at a generative AI lab that builds both its models and its applications, including the viral audio-to-midi model. You'll work directly with our growth team - @lochentos and @AUllen40713 - and Ketty, one of the best growth advisors in the game. If you're hungry, creatively scrappy, and passionate about music & sound, DM me. We'd love be the spring board into your tech career 🔊

@lochentos @kyutai_labs 💪💪💪

Michael is deffo one of the most cracked people I know. Rare to find someone obsessed over both AI and classical music to the level he is. So no wonder how he built our new Audio-to-MIDI model with @kyutai_labs so fast🤯

@entrepeneur4lyf Please share your results! You can now directly share to X :)

Ok... I had uploaded a full 24bit/48000 wav previously. I just uploaded an mp3 and the results are INSANE. Not a simple song... a progressive metal song.... and it's nearly perfect from first review. I am stunned.

@itsthedonhashim @RoundtableSpace We'd love to see what you come up with!

@RoundtableSpace @RoundtableSpace wow, that's insane. gonna save me so much time on remix stuff. always hated separating tracks manually.

Mirelo just launched an Audio-to-MIDI model that splits a finished recording into separate MIDI tracks. > Works directly from the full mix > Separates voice, drums, bass, keys Every sample, record, finished song is now a MIDI file.

@kript0mat @kyutai_labs Reactions like this are why we build. Thanks for being here, @kript0mat

@MireloAI @kyutai_labs whaaaat I am blown away and joyous to see this dream become a reality haha

Today, together with @kyutai_labs, we’re introducing our new Audio-to-MIDI model. It takes a finished recording, identifies the instruments playing, and returns separate MIDI tracks for each — voice, drums, bass, keys, and more. Unlike most existing solutions, our model works directly from the full mix rather than requiring separate stems. It also detects chords, key, and tempo, giving producers broader musical context. We’ve written more about the model, the problem, and how it works here: mirelo.ai/blog/turning-a…

@metadjai @kyutai_labs we'd love to hear what you create @metadjai 🙏

@MireloAI @kyutai_labs Very nice 🎶✨

@azzabazazz @kyutai_labs Love to hear it @azzabazazz! Stay tuned - we're cooking something we think you'll like.

@MireloAI @kyutai_labs Love it! I was just thinking about this the other day! Do you think you'll create an MCP that can be connected with Claude and DAWs so that individual tracks can be iteratively distilled into the closest synth approximation of the original soundwave?

@ismyhc @kyutai_labs Hey @ismyhc! Thanks for asking. The drums come as a consolidated midi stem, so there is still some manual mapping to be done at this stage. Is there a standard, universal mapping for drum plugins?

@MireloAI @kyutai_labs Can it map drum midi to the correct maps for things like Toontrack ezdrummer, addictive drums, Logic Pro drums, etc?

@Refiner_Studio @kyutai_labs Sound drives emotion @Refiner_Studio welcome to our community, keep your great edits coming.

@MireloAI @kyutai_labs Sound/Music is always the soul of my videos! I would want you guys to keep going on with this fantastic project.

@itsshara_ai @kyutai_labs The next wave of production is here! Would love to see what you're creating @itsshara_ai

@MireloAI @kyutai_labs Separating instruments into MIDI tracks is a real production unlock.

@Refiner_Studio @kyutai_labs Thanks for being here with us @Refiner_Studio 🙌

@MireloAI @kyutai_labs This looks very PROMISING!! 🎉🎉🎉🎉🎉🎉🎉 All the best 👍

@chuhang1122 @kyutai_labs The classical music lovers in our team got some pretty exciting results. You should give it a try here: mirelo.ai/models/audio-t… - we'd love to hear your thoughts.

@MireloAI @kyutai_labs This is super interesting. How many separate tracks can it reliably output? Curious if it works on dense recordings too, e.g. a full orchestra.

@armandsumo @kyutai_labs Hey @armandsumo! Cool usecase, feel free to give it a spin for free here: mirelo.ai/models/audio-t….

@MireloAI @kyutai_labs how well does it handle electronic music? because there's something I'd love to use this for:

@reyneill_ @kyutai_labs we hear you! stay tuned.🩶

@MireloAI @kyutai_labs You know something I've been looking? Apparently no service supports music generation based on context for only 3-5-10 seconds forward

@WhatsupFranks @kyutai_labs thanks for the love 🩶

@MireloAI @kyutai_labs You guys are great

@lochentos @kyutai_labs new wave of creative productions underway

@MireloAI @kyutai_labs Crazy team, crazy product, let's change how music gets made🫡

@Dhanvanthesh @kyutai_labs We love putting practical tools in the hands of creatives.

@MireloAI @kyutai_labs It's exciting to see AI becoming a practical tool for musicians, not just a creative one

@SpacklMarketing @kyutai_labs Cool @SpacklMarketing. Awesome to hear that it helps you 'see the notes', great for learning a song or using as a starting point for remixing. Thanks for sharing!

I used the demo to transcribe a musicians backing track they brought into the studio that was a poorly recorded track of a complicated fingerpicking song by a now deceased band member. It converted perfectly and I tested it with the Ample Guitar Taylor midi plug-in. Obviously it wouldn’t replace a real guitar player playing the part, but at least the way is clear to either have someone learn it or just go with it this way depending on what the artist wants to do. Great job! I haven’t found another solution that would solve this particular puzzle.

@louieamart @kyutai_labs we're so happy to put this tool in the hands of people who create

@MireloAI @kyutai_labs holy shit this is brilliant