🤖🔄🌎 | Senior undergrad, Yao class @Tsinghua_Uni | RA @uwcse | RS @wuji_global | Prev. RA @mldcmu.

Seattle, WA
Joined August 2024
🤖 World Action Models predict the future to act better. However, WAM research remains fragmented in code, ad hoc in design, and unprincipled at scale. 💡 Today, we release 𝗢𝗽𝗲𝗻𝗪𝗔𝗠: 𝗔𝗻 𝗢𝗽𝗲𝗻, 𝗠𝗼𝗱𝘂𝗹𝗮𝗿 𝗘𝘅𝗽𝗹𝗼𝗿𝗮𝘁𝗶𝗼𝗻 𝗧𝗼𝘄𝗮𝗿𝗱𝘀 𝗦𝘆𝘀𝘁𝗲𝗺𝗮𝘁𝗶𝗰 𝗪𝗼𝗿𝗹𝗱–𝗔𝗰𝘁𝗶𝗼𝗻 𝗠𝗼𝗱𝗲𝗹 𝗣𝗿𝗲𝘁𝗿𝗮𝗶𝗻𝗶𝗻𝗴 to change this. 🌐 openwam-official.github.io/ 🧵1/14
7
40
8
273
2,267,313
Thank you @JinWeiyang18434 🥹! Glad to see OpenWAM reaching 1k+ stars⭐️, keep grinding🏋️‍♂️
github.com/OpenWAM-Official/… OpenWAM is the most fascinating open‑source project I have ever taken part in, and it has received the best feedback. It is not merely a single research project; rather, it represents collective creation by the community. We zeroed in on what people care about and built an open‑source platform for everyone to explore freely and get started. There used to be very few unified open‑source repositories related to WAM, so we believed it was necessary to take this step. This may not be all about intelligence, but it is about curiosity and passion. It is also about enabling sustainable growth for this community. When I see first‑ and second‑year undergraduates, as well as junior PhD students aiming to work on embodied intelligence, joining in to help build this project, I realize some endeavours do not need to be driven by utilitarian concerns. Thank you to the OpenWAM Team, and to my friends: @KnightNemo_ @YuranWang_rise. (btw, siqiao is looking for 27fall phd position, if you are interested with his great works, don't forget to discuss with this talent guy!) Congratulations on hitting our milestone of 1k stars! This project would never have succeeded without all of you!
1
17
1,077
Great work by friend @RunhanH ! It is exciting to see how frontier LLMs change the status of long-standing problems in the field, which in this case is the way to explore during "learning while deploying". Code-as-Policies is a start, and a major component of robotics tool-use.
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents? We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration. A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills. The results: • ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control. • +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro. • One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs. The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning. We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it! Project + sessions: robot-agent-exploration.com/ Paper: assets.robot-agent-explorati… GitHub: N Project fully led by @RunhanH and @xczhangxx who are absolutely awesome. How it works, experiments, and robot videos below 🧵 (1/N)
2
1
24
2,414
Siqiao Huang retweeted
Wrist cameras give robots close-up views, but only where the hand happens to be. What if the policy could decide where to look? Introducing FoveaVLA: a VLA that replaces the wrist camera with learned foveation actions. FoveaVLA predicts where it will need to look next, then crops that region from the full-resolution external image. The full view gives context; the foveal crop gives close-up detail. With one external camera and no wrist camera, FoveaVLA reaches 70.8% success on 48 real-world trials, vs. 52.1% for π0.5 with a wrist camera. • No additional demonstrations • No camera calibration • No wrist camera Paper, code, and models are all open 🧵
7
29
7
132
13,942
The level of dexterity emerging from MEGA-scale RL done right is truly astounding! Huge fan!!
(1/5) Everyone says dexterous manipulation needs real-world data. These policies were trained with none. Our robots mesh gears, thread nuts, and insert pegs zero-shot from RGB, and the same recipe works for locomotion across terrains much harder than before. The missing piece wasn't a better RL algorithm, but a small tweak to what the robot practices. Today we're releasing Success-Guided Sampling (SGS), a simple change to the task sampler that unlocks new levels of dexterity and agility with large-scale, end-to-end sim2real RL. No demonstrations, no per-task reward tuning. Just PPO at scale. Check out the policies yourself at sgs-rl.github.io! All videos at 1x speed! 🧵 🔈
4
22
1,543
地道!
I generally find that nobody really cares about papers, so I’m trying to add something a bit more human to my personal website. If you think my research is cooked, at least enjoy some things I actually cooked :) joyemang33.github.io/cooking…
8
5,134
📦 We release OpenWAM as a full stack empowering WAM research: - Modular infrastructure for training, inference, deploy, and eval. - OpenWAM-α pretrained and post-trained weights. - Study checkpoints for exploring the design choices. - Evaluation protocols and data recipes. 🥞 We hope researchers can use the stack to reproduce the results, adapt OpenWAM-α to new tasks and embodiments, and test new ideas for representations, world–action interaction, and embodied pretraining. 🔭 There is much more to explore. We hope OpenWAM-α serves as a strong, reproducible baseline and OpenWAM-Infra makes that next round of experiments easier to build. 🌐 Project: openwam-official.github.io/ 📄 Paper: arxiv.org/abs/2609.07398 💻 Code: github.com/OpenWAM-Official/… 🤗 Models & data: huggingface.co/OpenWAM 🧵13/14
1
1
295
🙏 OpenWAM is a large undertaking, made possible by the dedication and collective effort of the entire team. Thank you to everyone who contributed to this project, couldn't have done it without y'all! 🤞 I’m grateful for the opportunity to have co-lead this project with @YuranWang_rise. Special thanks to the amazing adviors: @zhaohang0124, @linshaonju, @HaoDong123, and @LotusSapphire for their advice and guidance throughout the project. 🧵14/14
2
276