Theo Lemay @ CoRL (@theol__) header
Theo Lemay @ CoRL (@theol__) profile picture
Toronto, Ontario
Joined December 2017
Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)Photo by Theo Lemay @ CoRL (@theol__)
Theo Lemay @ CoRL retweeted
The @MeckaAI team and I will be at CoRL for the week - shoot a DM if you’d like to meet up!
3
20
1,223
At @MeckaAI, we spend a ton of calories on building models and human-in-the-loop workflows to achieve capabilities frontier models can't accomplish today. Dense captioning is one of these incredibly hard problems. The talented and sharp Concept team (@tkkong , @philhchen ) did a deep analysis on frontier model performance compared to our internal Mecka model - read more below!
Today, we're sharing results from our partnership with @MeckaAI to see if frontier models can label egocentric videos for robot learning. We had five frontier models caption 200 clips with human grading. GPT-6 Astra which performed the best got 43.5% of clips fully correct.
9
10
2
89
7,043
Theo Lemay @ CoRL retweeted
Frontier models still struggle to accurately understand human video data for robotics The biggest gap is actions: GPT-Astra hits 71.5% accuracy, Meckas custom trained model achieves 94% @tkkong + @philhchen evaluates Meckas video understanding model against the frontier below
Today, we're sharing results from our partnership with @MeckaAI to see if frontier models can label egocentric videos for robot learning. We had five frontier models caption 200 clips with human grading. GPT-6 Astra which performed the best got 43.5% of clips fully correct.
12
19
7
166
20,762
Theo Lemay @ CoRL retweeted
This is the best time to be a builder. Since ChatGPT released in 2022, people talked about the compression of time-to-value. Operating at the speed of thought. That couldn't more true @MeckaAI. We're operating at a speed that many haven't seen before. On top of that, we're one big family. I hate talking about culture as it often feels impractical. But when you have a team that believes in each other, challenges each other to be better and is willing to take on impossible challenges together, you create a surge of energy that is so addicting. Talent density and culture is at the core of what we do. If you want to build with a world-class team that cares about each other and is working towards shared mission, we'd love for you to join us. We have arrived!
14
7
1
50
2,663
Theo Lemay @ CoRL retweeted
excited for @sequoia to partner with @MeckaAI we're hiring across the board dm me
Today @MeckaAI is announcing a $60M Series B from @sequoia to accelerate the advent of general purpose robotics This brings our total funding to over $120M to become the data and deployment layer for physical AI Read more below 🧵
22
3
98
10,263
5 months ago, @joshavata flew me to shenzhen after I shot him a text asking for a summer internship little did I know I was joining the canadian mafia of robotics, and joining a rocketship whose potential and growth kept shocking me on the daily it is not often I find myself in an environment that requires me to muster all the ability I have to operate at my highest capacity and become the best version of myself the energy, culture, and pace of this company is something great. I have full faith in the team to execute on whatever vision it chooses to bring into the world, one that will always be rooted in agency, kindness, and excellence
Today @MeckaAI is announcing a $60M Series B from @sequoia to accelerate the advent of general purpose robotics This brings our total funding to over $120M to become the data and deployment layer for physical AI Read more below 🧵
19
2
74
3,951
Theo Lemay @ CoRL retweeted
Are robots ready to accelerate science labs? We created the WetLabs Benchmark to test 9 critical tasks, from easy to hard, and let 3 leading models take 20 attempts per task Astra leads but it comes close...
25
58
21
336
70,595
Theo Lemay @ CoRL retweeted
Calling all builders in NYC! If you want to participate in a hackathon with the brightest we'd love to see you there. luma.com/caxc4ftw Come say hello to some of our judges @basilyusuf1709 @ogsaurab @itsghvr we're also hiring for roles across software, hardware and operations 😉 mecka.ai/careers
Calling everyone interested in robotics. We're hosting DAY SHIFT with our friends at @modal, Day by Day Ventures and @ElevenLabs. A one-day AI and robotics hackathon in Manhattan on August 15. Doors at 9am, demos at 7pm. Ten hours, one room, prizes for the winners. The last 12 months have moved this field from software to physical AI faster than anyone expected. The products defining the next generation are the ones that touch the world, and the tooling to build them has finally come within reach of a small team on a single Saturday. No age limit. Come with friends, come with cofounders, or come alone and find a team when you get there. Free, teams of 1 to 4. We're still selecting judges. If that sounds like you, reach out. luma.com/caxc4ftw
2
7
21
6,101
Theo Lemay @ CoRL retweeted
Monday thoughts: Since deep learning, there are two “root-level” paradigm shifts in robot learning: Sim2Real for locomotion and Behavior Cloning (BC) for manipulation. 1/
18
77
14
477
79,293
Theo Lemay @ CoRL retweeted
I've been obsessed with robotics for as long as I can remember. That passion led me through exoskeletons, autonomous vehicles, humanoid robotics, and eventually mobile manipulation research during my master at @UWaterloo. Each experience brought me closer to the same question: How do we build general-purpose robots that can interact with the world as naturally as we do? The more I worked on robotics, the more convinced I became that dexterous manipulation is one of the biggest missing pieces. Twenty months ago, we started with a simple belief: dexterous manipulation won't be solved by hardware alone. To build truly capable robotic hands, you need mechanical design, embedded systems, sensing, AI, and large-scale human demonstration data working together as one tightly integrated system. We believe the robot hand and the human demonstration interface should evolve together, not independently. The journey was far from smooth. We faced engineering problems that seemed impossible at first. We rebuilt systems more times than I can count. There were long nights, failed prototypes, manufacturing setbacks, and moments when it felt like we were taking one step forward and two steps back. On top of that, we found ourselves navigating a legal battle that could have distracted or slowed us down. Instead, we stayed focused on building, and I'm grateful that chapter is now behind us. Through every setback, one thing never changed. Everyone on this team believed the problem was worth solving. Today, that belief becomes something tangible. We're officially launching ProHand and ProGlove. Together, they're our first step toward giving robots the hands they've always needed. Today we're also announcing our $11M seed round, led by @firstround, with participation from @BoxGroup and @ycombinator. Looking back, I'm grateful to everyone who believed in us before there was much to show. Our teammates, investors, advisors, early customers, friends, and families made this possible. This launch isn't the finish line. It's a reminder that difficult chapters don't define a company. Resilience, execution, and the people around you do. We're just getting started, and I'm excited for what comes next :) —- 🌐 Website: proception.ai 🎥 Launch Video (@proceptionAI x @osmo_studio): Watch on Youtube 💼 Join Our Team (Legends): proception.ai/careers
20
21
2
144
29,134
Life update, joining Mecka to help accelerate the world's transition to robotics. Will be spending the majority of the summer deployed in Shenzhen. Please reach out if you know ppl I should meet there!
Today @MeckaAI is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world
8
47
5,043
Theo Lemay @ CoRL retweeted
Mecka is excited to power EgoVerse: a growing ecosystem for robot learning from egocentric human data Proven across 4 leading research labs, EgoVerse data consistently boosts robot performance We release the tools for anyone to collect data, inference/train, and contribute! 🧵
23
102
15
677
103,983
been using this for a few weeks, tangibly accelerating my research and ability to quickly understand papers
I built papiers.ai, a new interface for arXiv As we enter an era of accelerated scientific discovery, we need better tools that augment human cognition to help us keep up. Try it: visit papiers ai or swap arxiv -> papiers on any paper URL
1
4
588