Benedek Forrai (@forraibotics) profile picture

co-founder and robotics guy @ mimic | ETH Zürich

Zurich, Switzerland
Joined July 2024
Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)Photo by Benedek Forrai (@forraibotics)
Benedek Forrai retweeted
btw robotics will fall to the bitter lesson too
Replying to @claudeai
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do. On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
78
135
24
3,550
261,221
Benedek Forrai retweeted
(part 2) I asked people: "which robotics labs and startups have the highest talent density?" Full list: frontierlist.com/robotics-ta… 1 vote each: - Amazon FAR (@pabbeel, @peterxichen, @rocky_duan) - Antim Labs (@Shreyko, Viswajit Vinod Nair) - Bedrock Robotics (@bsofman, @kevinmpeterson1, Ajay Gummalla, Tom Eliaz) - Build AI (@patrickrim, @eddybuild, @jonathanjia05, @zikangjiang) - Dimensional (@stash_pomichter) - Dream Labs (@jang_yoel + 3 in stealth) - Enact (@jamesw_stevens, @govindchada) - Eye Candy Robotics (@Mankaran32, @_raghuvamsi, Alqama Shaikh) - Foundry Robotics (@adarshkulkarni) - GDM Robotics (@carolina_parada) - Hark (@adcock_brett) - Medra (@michellearning) - microagi (@bercankilic, @YoanIlievX, @antonwontonnn, Nico Nussbaum, Artjem Weissbeck) - Mimic (@stefan_weirich, @elvisnavah, @GravertStephan, @forraibotics) - NVIDIA GEAR Lab (@DrJimFan, @yukez) - Pantograph (@apagajewski, @_kelsey_pool) - Reward AI (@zipengfu, @chenwang_j) - RobbyAnt (Xing Zhu, Yujun Shen, Yongtao Huang) - Runway (GWM) (@c_valenzuelab, @agermanidis, @matamalaortiz) - Somana - Trener Robotics (Asad Tirmizi, Lars Tingelstad) - Ultra (@JonMSchwartz, Max Friefeld, @chetan_, Oliver Ortlieb) - Unitree (Wang Xingxing) - Vision Lab (@JamesKuj_OG, Zhichu Ren, @zwbgood6) - Walden Robotics (@RussTedrake, @Ben_Burchfiel, Siyuan Feng, @RaresAmbrus, @adnothing, Kerri Fetzer-Borelli, Dave Johnson) - Watney Robotics (@rgannon_, Sean Cheong) - Xaba (Massimiliano "Max" Moruzzi)
3
7
27
5,068
Benedek Forrai retweeted
Replying to @bercankilic
I wonder who can do it
1
1
6
496
Benedek Forrai retweeted
I remember when we started working on this, it seemed so far-fetched. Now FLUX-mimic, built together with @bfl_ml, is being tested and deployed with @AudiOfficial
2
7
19
1,316
Benedek Forrai retweeted
Introducing FLUX-mimic, a next-generation Video-Action Model for general purpose dexterity, developed in partnership with @bfl_ai. Late last year we published mimic-video and introduced Video-Action Models (VAM): a new family of robotics foundation models built on top of video generation models. We showed that robot control reduces to visual prediction, and that robot capability is downstream of improvements in video modeling accuracy. The obvious implication was that advances in the video modeling frontier would directly translate to increased capabilities in end-to-end robot learning. FLUX-mimic is that thesis at frontier scale: We've applied our VAM architecture to the strongest video backbone available today, FLUX 3 from Black Forest Labs, and trained it on data from our own robots and wearables. General-purpose dexterity, running on a single GPU on premises. Because the model already understands world dynamics, it needs far fewer demonstrations to learn a new task. This is game-changing for our mission to deploy robots to factory floors, where industrial robot data is scarce and expensive to collect. We're now testing and deploying FLUX-mimic with manufacturing leaders like @Audi, on complex, multi-step manipulation long considered impossible for conventional automation.
26
96
27
600
120,674
Benedek Forrai retweeted
Stat monster
From day one, mimic has been focused on a single goal: general-purpose dexterous manipulation. Today we're proud to announce the mimic hand M1 and the mimic wearable U1. We believe the only way to solve dexterous manipulation at scale is by going full-stack at the frontier of physical AI, building every layer ourselves around one fixed point, the human hand. The M1 is a highly backdrivable, tendon-driven hand that covers the full range of human capability, from heavy payloads to fine manipulation.
2
2
20
3,650
Benedek Forrai retweeted
From day one, mimic has been focused on a single goal: general-purpose dexterous manipulation. Today we're proud to announce the mimic hand M1 and the mimic wearable U1. We believe the only way to solve dexterous manipulation at scale is by going full-stack at the frontier of physical AI, building every layer ourselves around one fixed point, the human hand. The M1 is a highly backdrivable, tendon-driven hand that covers the full range of human capability, from heavy payloads to fine manipulation.
18
65
27
516
94,604
Benedek Forrai retweeted
A few months ago, I travelled to Zurich together with @NVIDIArobotics to spend time inside one of Europe's most exciting robotics startups... @mimicrobotics! Their mission? To solve one of the hardest problems in robotics: human-level dexterity. Because before robots can replace physical work, they first need to master the human hand. In this episode, we go behind the scenes with the team building AI-powered robotic manipulation, discuss why dexterity is still one of the biggest bottlenecks in automation, and explore what it will take to bring truly capable robots into factories. Mimic Robotics is part of the NVIDIA Inception, a program for startups and VCs, and is leveraging Cosmos to advance AI-powered robot learning. If you're interested in Physical AI, robotic manipulation, and where this industry is actually heading, I think you'll enjoy this one. Timestamps: 0:00 Inside Mimic Robotics 0:24 Building the future of robot manipulation 1:19 The mission behind Mimic Robotics 1:35 The AI powering autonomous robots 2:14 Why Mimic chose NVIDIA Cosmos 2:34 Video foundation models vs. traditional robotics 2:46 Building a multidisciplinary robotics team 3:24 Bridging customers and cutting-edge AI 4:40 Why Zurich is the perfect robotics hub 5:20 Europe vs. America: Scaling a robotics startup 6:30 Bringing generative AI to factory robots 6:49 The race to build Europe's robotics hyperscaler ♻️ Know someone working in robotics? They'll probably want to see this.
6
8
45
6,432
Benedek Forrai retweeted
Robotics fundamentally involves understanding the dynamics of how things change in the world in response to action and force. This is impossible to learn from static images; instead, it’s far more effective and more data-efficient to learn from video. @elvisnavah joins us to talk about @mimicrobotic. One of the key findings from mimic-video is that pretraining on webscale video allows robots to learn physics priors; as a result, policies train faster, generalize better, and are capable of more impressive dexterity, versus training on static images or image-language pairs as per a VLM. Watch Episode #81 of RoboPapers with @micoolcho and @chris_j_paxton to learn more!
2
10
3
53
49,132
Benedek Forrai retweeted
With mimic-video, we were among the very first to propose Video-Action Models for robotics. Today, we are open-sourcing the recipe.
3
34
8
284
42,836
Benedek Forrai retweeted
Thrilled to announce our $7.2M pre-seed round at @AllonicRobotics – a massive kickstart to build the manufacturing foundation for a completely new class of robots! @martonsn @DadaJudith @weiszbart @smleicht @JacklouisP @GoingBallistic5 @lukas_m_ziegler
9
24
9
95
24,197
Benedek Forrai retweeted
We’re excited to showcase mimic-video, a new class of Video-Action Model, paving the way for scaling robot learning from pure RGB video pretraining. Read more:
Today @mimicrobotics and friends are excited to share mimic-video, a new class of Video-Action Model that elevates video model backbones as first class citizens for robot learning!
1
3
8
1,895
Benedek Forrai retweeted
Newsflash: We raised 16M$ for our seed round 🫡 We're incredibly honored to be partnering with @Elaia_Partners, @speedinvest as well as Founderful (returning!), 1st Kind, 10x Founders, 2100 Ventures and Sequoia Scout Fund.
3
4
18
1,335
Benedek Forrai retweeted
Today, we’re excited to announce our $16M seed funding round, accelerating our mission to deploy frontier physical AI across industries. Led by @Elaia_Partners alongside @speedinvest, with participation from Founderful, 1st Kind, 10x Founders, 2100 Ventures, Sequoia Scout Fund.
6
8
4
42
5,118
Benedek Forrai retweeted
I wrote a fun little article about all the ways to dodge the need for real-world robot data. I think it has a cute title. sergeylevine.substack.com/p/…
28
121
24
819
156,255
Benedek Forrai retweeted
It is my opinion that if you want to learn from human demos, your hardware stack should have human-level dexterity capabilities. Getting there 💪 @mimicrobotics
2
10
99
5,507
Benedek Forrai retweeted
Happy to announce mimic-one: a Scalable Model Recipe for General Purpose Robot Dexterity, the culmination of years of research work in dexterous manipulation with imitation learning.
7
38
7
206
20,562
Benedek Forrai retweeted
The @mimicrobotics hackathon was so fun, we even had a small bi-manual demo sneak peek 👀
10
46
5
416
37,331
You're in Zurich or its zone of influence (Lausanne, Paris, BXL, Munich, London, ...) and like AI + Robots? We (@openai) together with @mimicrobotics, @lokirobotics, and Zurich Builds are organizing a hackathon from Fri 9 May afternoon to Sun 11. Limited spots, more below:
15
18
6
188
34,768