Helping robots learn from the real-world Founder- https://xitter.cf/t.co/EyONynBAXw prev- @CUHKofficial

sz - sf - blr
Joined October 2011
Human skill is the pre-training data for robots. @theopenrobot builds the hardware layer for this collection infrastructure. The Last Apprenticeship explores what happens when that experience scales from millions of hours to billions.
1
1
3
672
If you’re collect ego data across the world. DM. I got something for you. ;)
115
SERENDIPITY can be engineered.
1
59
win + help win.
2
82
Don't sleep on EGO. there have been like 20 times over the past year people saying slop about it. but it keeps winning. LOL.
Human skill is the pre-training data for robots. @theopenrobot builds the hardware layer for this collection infrastructure. The Last Apprenticeship explores what happens when that experience scales from millions of hours to billions.
61
EPIC 💦
We built a robotics data engine with Astra-level performance at 125x lower cost. And we are open-sourcing the weights today! Introducing Flora, a suite of open models to parse the physical world and turn raw footage into rich training signals. Flora already powers our in-house data engine, labeling 200K hours of videos a day on 500 GPUs. We created it to scale the frontier for robot learning. Now you own the weights too. Flora gives you: - High-quality, timestamped captions to curate and filter human egocentric and robot data; - Dense progress rewards for quality control and RL post-training; - Rubrics scoring for real-world benchmarking Try it today, links in thread:
56
who has got the most cost-effective quality UMI? would like to buy 1. @almond_robotics how much is your UMI? do u ship to india?
1
1
137
who has the best stereo-device-game in the world? ranked on- - useful data - operator seamlessness - cost
50
Most AI's including frontier ones are stilll bad at this, and that's why they need humans still to RSImprove.
you are only as good/useful as an engineer/person if you do in-context learning on demand.
54
you are only as good/useful as an engineer/person if you do in-context learning on demand.
1
120
agency is now Commoditized whats needed is- - clear vision + ambition
1
1
98
Over 3M hours of egocentric data now exist: Build AI: Egocentric-1M Midcentury: 2M+ Lightwheel: 100K open Impressive scale. But look at what's inside. Lightwheel's own task mix: 62% is cleaning, tidying, packing and inventory. By my count, under 18% is genuinely hard, skilled-hands work. Frontier models already one-shot easy and medium tasks, and simulation is far ahead in this category. My bet: ~10% of the ego data collected so far is actually useful henceforth for the next gen of models. So ego isn't saturated. It's starting from scratch. The only data that matters now is hard: precise tool control, judgment, fitting to a line, controlling a process. And the price of that data? It goes very high.
3
91
how to build a great early team 101.
CEO of Stripe's advice to young ambitious people:
2
181
down.
we need PeptideBench for frontier models
67
people will use anything, even their dead father for a launch. to sell is to have no shame. WOW.
unavailable
1
5
289
HARK > BOT
2
146
tech does'nt wait for anyone. neither @elonmusk nor @DarioAmodei can pace the frontier. if it were'nt for steve-jobs- someone else wouldve made the macintosh. we give too much importance to individual contribution than complete empowerment to human species as a whole.
1
2
154