I share takes on GenAI research and building a startup. CTO/cofounder @MireloAI: building foundation models for music/sound. Ex @GoogleDeepMind, @AWSAI.
Berlin
Joined July 2014
- Tweets551
- Following1.9K
- Followers1.2K
- Likes1.7K
Pinned Tweet
Mirelo SFX 2.0 is live today, and I’m really excited to finally share it with the world!
AI video has gotten remarkably good at pictures, but the sound is still bad: unwanted music, ambience that changes with every cut, sound effects that miss the action, poor sound quality…
→ SFX 2.0 watches your video, cuts the music you never prompted, keeps the dialogue, and builds a full sound design synced to the action and consistent across clips of any length.
Live today through our API, on Runway and Fal. Other platforms coming soon.
I’m extremely proud of our amazing team who pulled this off. And I can tell you, it was a lot of hard work. For a quick tour of our technical breakthroughs, see below. 👇
Florian Wenzel retweeted
Thank you all who came to our GTC booth this week. It was a pleasure to meet you and have you listen to some live SFX 2.0 demos! 👋
This one felt extra special after the announcement of @nvidia planned investment into Mirelo.
We're excited to continue our mission of building the world’s best AI sound designer, expanding from sound effects to the best audio models for video.
#soundon 🔊
Florian Wenzel retweeted
SFX 2.0 is now live on @morphic 🫰
Mirelo SFX 2.0 is now live on @morphic.
Attach a video to build a new soundtrack that follows the action, or describe a sound to generate it from text.
Keep the dialogue, guide the sounds you want, and work with audio or video up to 10 minutes long.
morphic.com/
Florian Wenzel retweeted
BREAKING: Nvidia has now announced 4 investments into German startups 🇩🇪:
@MireloAI - develops AI models that generate sound effects, speech and music for video, helping creators and production teams produce high-quality audio that perfectly matches their visuals on screen.
@AgileRobots - which builds AI-powered robots, from robotic arms to its Agile ONE humanoid, for manufacturing, logistics and healthcare.
@aveliosmed - develops an AI-native hospital information system that serves as the core system of record for clinical and administrative workflows, integrating AI directly into hospital operations to free up doctors and nurses to deliver better patient care.
@reflexaerospace - designs and builds high-performance satellites ready for launch in about 12 months instead of years.
The company has already invested in n8n, Neura Robotics and Black Forest Labs.
Florian Wenzel retweeted
As announced by @JensenHuang yesterday in Berlin, @nvidia is planning to invest in Mirelo 🇩🇪🚀
Come say hello at GTC!
Germany knows how to build, and now it’s bringing that expertise to industrial AI. 🇩🇪
Tonight in Berlin, @JensenHuang and Chancellor @_FriedrichMerz discussed combining German engineering with NVIDIA AI to advance manufacturing and automotive.
We’re also backing Germany’s builders, with new planned investments in Agile Robots SE, @aveliosmed, @MireloAI, and @reflexaerospace, spanning robotics, healthcare, creative tools, and space.
Meet the companies and catch up on today’s news from Berlin: blogs.nvidia.com/blog/german…
Last night in Berlin, @JensenHuang and Chancellor @_FriedrichMerz discussing @nvidia's planned investment into @MireloAI 🚀 Let's go!
Psst... breaking news! Finally we can share this... perfect timing for GTC. Super happy that @nvidia is going to invest in @MireloAI . Looking forward to expanding our partnership. More announcements coming soon.
Excited to share that @nvidia is planning to invest in Mirelo!
As a foundation model company training our own audio models from scratch, we’ve already benefited immensely from @nvidia : their compute, the Inception program, joint events, and great exchanges with their researchers.
This planned investment will help us accelerate our mission to build the world’s best AI sound designer, expanding from sound effects to the best audio models for video.
Stay tuned!
Trying a new look... :-)
I will be at @NVIDIAGTC Berlin this week. @MireloAI will have a booth too.
Drop me a message if you'd like to meet and discuss the future of audio in genAI. Or stop by the booth to meet the team (I will be there too from time to time).
🤖 Made with AI
Very excited to be partnering with @runwayml. You can now use @MireloAI SFX 2.0 to elevate your videos into a new acoustic dimension.
Florian Wenzel retweeted
Elevenlabs said they expand to creative because audio was already solved...
They got cooked.
@FishAudio and now Mirelo are showcasing insane capabilities, far better, which were the staple for Elevenlabs
@FishAudio isn't the only company @ElevenLabs needs to worry about🫶
Don't take our word for it. Just listen.
CJ on his rise on the Guinness benchmark! Beware!
Our CEO @cjsimongabriel is dedicated to beat @elonmusk on The Cheeky Pint Benchmark
Shout out to @etnshow for having us!
If you haven't yet, watch our Thursday segment on our latest SFX 2.0 model release
Florian Wenzel retweeted
Our CEO @cjsimongabriel is dedicated to beat @elonmusk on The Cheeky Pint Benchmark
Shout out to @etnshow for having us!
If you haven't yet, watch our Thursday segment on our latest SFX 2.0 model release
Introducing The Cheeky Pint Benchmark.
We made our intern watch every episode of Cheeky Pint to bring you this breakdown of pints drank by guests to the nearest sixth.
Congratulations to @elonmusk who is currently in the lead with three full pints of Guinness.
Florian Wenzel retweeted
Two of my favorite companies making some noise together! 📢
Let the agents go wild!
Ask your agent to create / edit a video with sounds and prepare to be disappointed.
Make SFX 2.0 your default audio layer to get sound that actually fits your video.
Today the agent ties sound to one video model and loses track of what is on screen.
SFX 2.0 builds sound from the video itself, so your agent can:
> Use any video model for the visuals
> Change the sound without regenerating the video
> Keep dialogue and drop music you did not prompt
> Get consistent sound across a stitched cut
> Advance control to edit or add new sounds
Your agents make your videos look right so make them also sound right.
Florian Wenzel retweeted
Ask your agent to create / edit a video with sounds and prepare to be disappointed.
Make SFX 2.0 your default audio layer to get sound that actually fits your video.
Today the agent ties sound to one video model and loses track of what is on screen.
SFX 2.0 builds sound from the video itself, so your agent can:
> Use any video model for the visuals
> Change the sound without regenerating the video
> Keep dialogue and drop music you did not prompt
> Get consistent sound across a stitched cut
> Advance control to edit or add new sounds
Your agents make your videos look right so make them also sound right.
AI Videos finally sound real.
Introducing Mirelo SFX 2.0.
It watches your video, cuts the music you never prompted, keeps the dialogue, and builds a full sound design synced to the action and consistent across any length clips.
You’ve made it look right. We’ll make it sound right.
Live today through our API, on @runwayml and @fal.
Other platforms coming soon. (Thread)
Florian Wenzel retweeted
99% of AI Video models right now👇
They seem fake because they sound fake.
Visuals is not the problem, sound is….
Till now…. Try @MireloAI SFX: mirelo.ai/
