Pinned Tweet
Muse can hear now - we launched Muse Voice Transcribe today! It is the first streaming audio perception model from MSL which does ASR, diarization and endpointing all in real-time. It supports hour-long audio, 20+ speakers, multilingual, seamless code-switching, and contextual biasing.
We shared detailed design and what makes Muse Voice Transcribe different from other real-time voice models in our blog post. We give full control on when and how long to listen to audio back to the model. And with RL, it learns “adaptive delay” to wait longer only on a few hard words. This is one of the key contributions to achieving the new pareto frontier on speed/accuracy trade-off.
Muse Voice Transcribe is available today via Meta Model API, Meta AI for Mac, and Muse Code. Please give it a try and let us know how you like it: research.meta.ai/blog/introd…
Bowen Cheng retweeted
Now in the Muse app: talk with your Muse in real time. And pick from multiple voices 🗣️
Bowen Cheng retweeted
🚨MUSE FEATURE ALERT 🚨
muse voice is out for everyone in the US!
you can now phone call and video chat with your muse whenever you need.
i personally have a sticky situation today, and asked muse for some advice. sage and calm as always ❤️
Bowen Cheng retweeted
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.
Bowen Cheng retweeted
🍉 🍉 🍉 Muse Wonder and Muse Wonder Full is here. A new series of model where we push hard towards the personal superintelligence mission. The models achieve sota on internal personal and professional agent tasks across domains. Try it out today!
research.meta.ai/blog/muse-w…
Bowen Cheng retweeted
MUSE WONDER
this is the culmination of over a year of research and infrastructure work in msl
since we originally shipped muse spark in april, we have continued to scale our models across pre-training and RL, now reaching the frontier 🏆
see our model's improvements on the artificial analysis index:
Bowen Cheng retweeted
it’s always felt like OpenAI is too focused on winning San Francisco. meanwhile, their competitor Muse is sweeping the rest of the nation and sitting at the top of the app store. this demo is a perfect example of this.
every tech leader wants to show agents booking flights. but more than half of Americans don’t even fly once in a given year. so the primary agent example we keep showing simply doesn’t resonate with half the country.
agent demos should focus on the basics: tax filing, chasing down shipping returns, clearing out inboxes, and bill paying. every day stuff.
sf is very important. especially if you want to win developers. i understand that. but Meta is looking like geniuses focusing on everyone else. and everyone else is a pretty big market. it's the largest one.
The concept of “voice interaction” sounds like a natural next step for personal agents. But in order to make it happen, it has to be orders of magnitude more convenient than typing. The technology is there, however the user experience is still far from close unfortunately. There is a lot of opportunities there similar to what happened with @Muse :)
Nice work pioneering real-time videogen.
Muse Realtime Voice is an absolute beast.
Agentic voice is a whole new level of difficulty. At @AIatMeta we have stellar folks pushing the frontier: @Yukuwu 👑, @ankurbpn 🐐, Johan Schalkwyk 🫡, @mhnt1580 , @clover_chang_ + an incredible team of engineers.
A lot more coming 🚀🎤
Bowen Cheng retweeted
We are shipping voice to Muse!
Voice is just a much more natural and faster way to communicate compared to typing.
You'll be able to talk to it from wherever you want: from desktop, from mobile, and from the glasses.
It's been such an amazing journey, and I'm super proud of the team for delivering this!
Check out the first interaction model from the team, it will be available on @Muse app soon!
Bowen Cheng retweeted
Realtime interaction is the future.
Proud to see our team’s work on stage at Meta Connect today. Congrats to everyone who made it happen!
Muse is a great product!
a week after launch, muse is now the #1 app in the App Store!
it’s been SO exciting to see how much y’all have done with muse. we can’t wait to do more together!
