Ge Yang (@EpisodeYang) header
Ge Yang (@EpisodeYang) profile picture

I am planting acorns one at a time with policy gradient.

London
Joined November 2011
Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)Photo by Ge Yang (@EpisodeYang)
When I started my PhD, quantum computing gatherings were small. By the time I shifted to AI, they filled conference halls. CoRL this year feels the same. Here are some thoughts on what comes next for robot learning.
2
16
1,648
Robots Learning in a Million Worlds — before entering ours. My essay on where robot learning goes next, and how simulation can scale the research needed to get there. dreamlake.ai/geyang/public/r…
1
298
Here is mine 🥳 @MatthiasCaro
Replying to @MatthiasCaro
Trained entirely in imagination, our policy matches a PPO policy trained in simulation on the same locomotion test (81.8% vs 80.7% command-tracking success), with 7.9× fewer simulator transitions and about half the training time. More results soon 🤫
3
3
59
3,287
People are underestimating the importance of sensorimotor learning. We loved Eka’s demo, and want more people to be able to do the same. so we figured that we should show what a few MIT undergrads are able to do in a week. This video was our first test.
Replying to @EkaRobotics
@EkaRobotics has raised a $150M Series A. Generality v/s Performance is the fundamental tension at the frontier of robotics. Generality without performance is just a prototype. Performance without generality is just a single-purpose tool. Customers shouldn’t have to choose. Eka breaks the tradeoff. Powered by our Vision-Force-Action (VFA) model, we deliver the performance and versatility customers need to put robots to work every day. Eka is built on three convictions: ⚡️Force is the language of manipulation. 🚀 Reinforcement learning is how dexterous manipulation scales. 🎂 System 1—fast, reliable physical execution—is the bottleneck to solve. With this funding, we will scale our model and accelerate customer deployments. Grateful to be building alongside a dream team and investors who share our ambition.
6
134
9,045
You got to take a look at the cut where the arm flew off together with the ball :P A perfect example of how massive closed-loop training can do to physical systems.
Replying to @nolan_fey
2/9 To train it, we reset the simulator to a recorded hardware state, apply the same recorded commands, and learn command corrections so the simulated rollout matches the recorded hardware trajectory. We previously used UAN on a quadruped's arm (uan.csail.mit.edu). But motion with contact was tricky.
1
6
1,425
such insight, delivered in earnest.
Hi, I'm Felix. I'm an eng lead working on Claude. I love watching people take flight and do things they never thought possible. We often describe that as "being more ambitious" when using AI, which is tricky advice to follow. I wrote a tutorial: felixrieseberg.com/how-to-be…
1
483
Introducing LPM 1.0 — a video-based character performance model that speaks, sings, listens, reacts, and emotes in real time. - Generating full-duplex conversation, identity-consistent infinite-length generation, and nuanced human-like performance. - Building across a co-designed data pipeline, Base model, Online model, and streaming inference optimization. - Key advantages over other video generation models: performance quality, emotional conversation, precise lip-sync, identity preservation, and lifelike naturalness. Turning an image into a performance video, LPM 1.0 serves as a visual engine for conversational agents, live streaming characters, and game NPCs. Page: large-performance-model.gith… Arxiv: huggingface.co/papers/2604.0…
14
50
13
293
26,097
This is one of those iconic designs that will go down in history, that is destined to be remembered.
Today, we present a step-change in robotic AI @sundayrobotics. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->
3
7
122
13,827
for the love of robots ❤️
Today, we present a step-change in robotic AI @sundayrobotics. Introducing ACT-1: A frontier robot foundation model trained on zero robot data. - Ultra long-horizon tasks - Zero-shot generalization - Advanced dexterity 🧵->
1
970
Do you know who this is person was? You can see the Green Building and MIT in the background.
2
1,146
Ge Yang retweeted
Spent just over an hour collecting UMI data in Stanford, sent it to @harshgupta in CMU to run drone I've never seen before, and it just works 🤯 I was expecting to iterate on the data a few more times but embodiment guidance is so robust! umi-on-air.github.io/ to learn more!
Replying to @HarshGupta
💾 Data from across the country. 🚁 No access to the drone. 🤖 Still works, zero-shot. UMI-on-Air makes large-scale data collection → real-world deployment possible.
4
15
1
94
19,032
I'm super excited to announce mjlab today! mjlab = Isaac Lab's APIs + best-in-class MuJoCo physics + massively parallel GPU acceleration Built directly on MuJoCo Warp with the abstractions you love.
32
139
18
863
92,596
Excited to share our latest work MaskedManipulator (proc. @SIGGRAPHAsia 2025)! With: Yifeng Jiang, @erwincoumans, @zhengyiluo, @GalChechik, and @xbpeng4
5
35
1
181
16,529
Really cool to see the g1 do this! Was expecting some punching involved 😆
This quoted post is unavailable.
5
2,058
Glad to play a role in driving VisionPro sells ☺️
Learning about active perception with @Haoyu_Xiong_ -- your robot needs a head, and to be able to control where it's looking, in order to perform complex tasks!
1
1
18
5,421
Our crew at 4:30 AM – at Cambridge, MA
8
1,313
It is so cool to see vuer.ai in action
Replying to @Haoyu_Xiong_
Many of today's data collection systems do not capture human perceptual behaviors. The observation mismatch—between what the human sees and what the robot learns from—hinders the learning of effective manipulation policies. To see what the robot sees, we developed a VR interface—Async Teleop, which introduces decoupled view rendering to reduce motion sickness 😵‍💫🥴🤢 — an issue that is insufficiently addressed in prior VR teleop systems. 3/7
2
1
1,315
Check out this awesome demo!
We have been focusing on policy learning for robotics for a while. But can hardware be learned as well? Check out @yswhynot ‘s recent co-design work that learns what a soft gripper should be if we want to do better manipulation.
2
1,338
Meet 𝐀𝐌𝐎 — our universal whole‑body controller that unleashes the 𝐟𝐮𝐥𝐥  kinematic workspace of humanoid robots to the physical world. AMO is a single policy trained with RL + Hybrid Mocap & Trajectory‑Opt. Accepted to #RSS2025. Try our open models & more 👉 amo-humanoid.github.io
23
111
28
569
125,380