Dan Saunders (@djsaunde) header
Dan Saunders (@djsaunde) profile picture

RL infra, robotics @LumaLabsAI prev @UnslothAI @axolotl_ai @awscloud @UMassAmherst small homestead owner 🐑🐓

Brimfield, MA
Joined December 2008
Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)Photo by Dan Saunders (@djsaunde)
psh, I was RLing John Deere machines back in 2019 🙂‍↔️
Researchers have used reinforcement learning to teach a 5-tonne John Deere skid-steer loader to perform complex acrobatic manoeuvres autonomously. Trained in simulation and transferred to a real machine, the system can balance on two wheels, navigate rough terrain, spin, and control its bucket before landing safely. The research demonstrates the potential of AI-driven automation for heavy construction and industrial machinery. Video Credit: @leggedrobotics / @ETH Paper: wevlv.co/4kltYys #engineering #technology
2
3
257
cannot believe there is a WSP (debunked?) lab already
2
7
496
I call dibs on whatever the next minor twitter clout technique is
3
59
Fable 5.2's launch impressed with strong robot manipulation. How does ZAP, our 27B model, do on the same tasks? We recreated the tasks in sim and ran both through the same harness (the model is the policy, calling robot tools directly). ZAP only trained on sim pick-and-place, so every object and goal is new to it. Task 1, open a bottle: ZAP is 2.5x faster and costs $0.43 vs. Fable's $6.50. It plans the grasp up front, and it pays off: a firm hold and clean turns. Fable drops the bottle, recovers nicely, and still finishes. Sim only for now since I'm at CoRL, but the real robot is waiting back home 👀 🧵 1/4
Astra made robot control look like a job for frontier LLMs. But small VLMs already know what to do. They just don't know how. Turns out, simulation is all you need. Meet ZAP. No real robot data, no frontier teacher. Matches Astra on real tasks, 3× faster, 17× cheaper. 🧵 (1/11)
3
10
46
2,900
opening a 529 account for my newborn daughter, call that angel investing
1
7
234
proof:
I'm doing my part to pace the frontier by going on paternity leave 🫡
8
1
51
1,032
buy VTI
This quoted post is unavailable.
3
293
I'm doing my part to pace the frontier by going on paternity leave 🫡
1
1
18
1,471
Dan Saunders retweeted
Our infra has really improved quite a bit since the last time we released a model - this one took just under 3 days to pretrain! Also, it's quite cheap on Tinker (0.30/1.00/1.50 for in/out/train)! Hope you guys find this model great for customization purposes :)
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. thinkingmachines.ai/news/ink…
41
36
14
821
75,464
lmao
I'm not even sounding the claxon for this it's just horrible. Any text > 256chars is a valid root password, holy shit sshhole.com/
1
134
Luma trained a 27B open model only in simulation. zero real robot data. on a real two-arm robot it ties GPT-6 Astra 🤖 🧠 base Qwen already plans right 95% of the time, but only 36% of its moves are right 🎮 RL on 40 simple sim tasks takes that to 85% ⚡ avg 146 s vs 397 s and $0.29 vs $4.87 per task, same harness why it matters: pretraining knows what, sim teaches how
9
7
1
45
3,291
Proud of this work! This effort combined a lot of performance and systems work on robotics simulators with state of the art async RL methods, training small reasoners to match or beat strong closed source models. Hoping to share more about our performance work soon 👀
Astra made robot control look like a job for frontier LLMs. But small VLMs already know what to do. They just don't know how. Turns out, simulation is all you need. Meet ZAP. No real robot data, no frontier teacher. Matches Astra on real tasks, 3× faster, 17× cheaper. 🧵 (1/11)
1
12
425
Mechanistic interpretability was a huge missed opportunity. Many people wanted to join that effort, assuming it meant a mechanistic understanding of generalization. Instead, it was a bait and switch into an extremely niche, esoteric, and largely ill-conceived effort around understanding the roles of individual neurons. This has often been a challenge in alignment and interpretability: compelling initiatives that ought to be broadly defined, or at least mean what we would expect they mean, end up being restricted to a very narrow and esoteric set of topics. For example, if someone says they work on “interpretability” it does not mean what one would naively assume, e.g., interpretable methods, algorithms, representations, or model deconstruction, understanding the data, etc., but rather sparse autoencoders, influence functions, saliency maps. What a waste!
43
69
11
952
86,388
I've been saying this for ages to anyone who will listen
arxiv.org/abs/2610.40564 Using same objective from pre-training to post-training, only changing the data.
3
26
2,010
Dan Saunders retweeted
i guess we're doing a paper thread for this one...
4
17
5
180
14,168
yeah my bank can barely figure out their login flow, they are ngmi
SCOOP: Major U.S. banks are detecting unauthorized third-party AI agents inside customer accounts, including some attempting to take actions that appear to be independent of user instructions, sources told Axios. The findings have alarmed banking executives, who are racing to restrict access to their systems as AI moves at a velocity faster than financial institutions can respond, multiple industry and bank executives told Axios. Several banks are now preparing for worst-case and even “day after” scenarios, including how to rapidly secure or restore customer accounts if things go wrong, the people said. Several bank executives told Axios they're struggling to distinguish between human users and AI agents. One executive said banks also struggle to determine whether agents are authorized by customers or potentially operating without their permission, more akin to rogue agent behavior. Read my latest for Axios here: axios.com/2026/10/22/ai-agen…
8
439
I should buy some rtx 6000s 😮‍💨
1
3
196
Dan Saunders retweeted
Exact sequence parallelism for packed multimodal masks. It picks ring attention, a sparse all-to-all or Ulysses per layer, matches single-GPU numerics, and beats a FlashMask + Ulysses hybrid in 47 of 48 cases on up to 128 H100s. lumalabs.ai/news/packed-mult…
7
17
4
100
13,267
100%, I staved off LLM work for a while because NLP gave me the ick
I suspect that one of the biggest reasons why almost no one pursued LLMs despite GPT-2's overnight success was surprisingly simple: almost no one was excited to work on language even at OpenAI, people didn't want to leave their cool game environments behind
1
9
474
I love RL, it's so goofy
14
494