Joined February 2024
Richard Lee retweeted
People long believed in human-like computer use. But software (even terminals) is built for humans, not AI agents. Why not let agents build their own? Meet ๐—”๐—ด๐—ฒ๐—ป๐˜ ๐—ฆ๐Ÿฐ, an agent scientist evolving its own interfaces, letting an open 27B model beats GPT-5.5 & Opus 4.8. With its evolved interfaces, the same model improves ๐Ÿฏ.๐Ÿดร— and costs <๐Ÿฑ% as much per task as either frontier model. Agents today read screenshots and act through click, scroll, type, maybe a shell. So an agent fills a spreadsheet cell by cell when one line of code would do, or prints two thousand lines of a file to find one function. Every new app or model release means a human reads trajectories, diagnoses failures, and hand-writes new primitives. Skill-distillation methods can reorder what the interface allows, but they canโ€™t extend it. Agents compensate with more test-time compute instead of a better interface. ๐— ๐—ผ๐—ฑ๐—ฒ๐—น๐˜€ ๐—ถ๐—บ๐—ฝ๐—ฟ๐—ผ๐˜ƒ๐—ฒ; ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ๐˜€ ๐˜€๐˜๐—ฎ๐˜† ๐—ณ๐—ฟ๐—ผ๐˜‡๐—ฒ๐—ป. โ€œWe want AI agents that can discover like we can, not which contain what we have discovered.โ€ โ€” Rich Sutton, The Bitter Lesson Hand-designed interfaces are what we have discovered. Agents can read their own trajectories, spot whatโ€™s missing, and write and test code. ๐—œ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ ๐—ฑ๐—ฒ๐˜€๐—ถ๐—ด๐—ป ๐˜€๐—ต๐—ผ๐˜‚๐—น๐—ฑ ๐—ฏ๐—ฒ ๐—ฎ๐—ป ๐—ฎ๐—ด๐—ฒ๐—ป๐˜ ๐—ฐ๐—ฎ๐—ฝ๐—ฎ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐˜†. Thatโ€™s what Agent S4 does. Agent S4 makes a ๐—ฟ๐—ฒ๐—ฝ๐—ผ๐˜€๐—ถ๐˜๐—ผ๐—ฟ๐˜† ๐—ผ๐—ณ ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ๐˜€ ๐—ฎ๐—ป๐—ฑ ๐˜‚๐˜€๐—ฎ๐—ด๐—ฒ ๐—ธ๐—ป๐—ผ๐˜„๐—น๐—ฒ๐—ฑ๐—ด๐—ฒ the unit of evolution. A task agent attempts synthetic tasks with no success labels or verifiers. A meta-agent studies the trajectories, forms hypotheses about which actions, observations, or knowledge would help, and builds descendants through mutation or crossover. Validation tasks the meta-agent never sees decide which repositories survive. The model and harness stay fixed, and the meta-agent ๐—ป๐—ฒ๐˜ƒ๐—ฒ๐—ฟ ๐˜€๐—ฒ๐—ฒ๐˜€ ๐—ฎ ๐—ฏ๐—ฒ๐—ป๐—ฐ๐—ต๐—บ๐—ฎ๐—ฟ๐—ธ ๐˜๐—ฎ๐˜€๐—ธ. ๐—ข๐—ป๐—น๐˜† ๐˜๐—ต๐—ฒ ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ ๐—ฒ๐˜ƒ๐—ผ๐—น๐˜ƒ๐—ฒ๐˜€. With the evolved repository, Qwen3.8-27B goes from ๐Ÿฑ.๐Ÿฒ% to ๐Ÿฎ๐Ÿญ.๐Ÿฏ% on OSWorld V2, ๐Ÿฏ.๐Ÿดร— the same model with fixed interfaces and a new state of the art for open-source computer-use agents. It beats GPT-5.5 (13.0%, $25.50/task) and edges past Opus 4.8 (20.6%, $72.40/task) at $๐Ÿญ.๐Ÿญ๐Ÿฌ per task. On ScienceBoard, the same model goes from 41.4% to 58.6%. The analysis is the more interesting part. Evolution mostly deepens interfaces the agent already has: 4 new interfaces and 127 extensions. Give the meta-agent a scratch VM to test its code, and it builds 12 new interfaces and 253 extensions, reaching music scores, audio projects, and 3D scenes. The best repository came from crossing two earlier branches. In one case study, the seed agent hand-builds a browser client mid-task and debugs through failure after failure; the evolved agent calls page_text and reaches the same message at tool call ๐Ÿญ๐Ÿญ instead of ๐Ÿฏ๐Ÿณ. Human-like computer use was a starting point, not the destination. The interface an agent acts through is a second axis of improvement, beyond better models and harnesses, and agents can now design it themselves. ๐—˜๐˜ƒ๐—ผ๐—น๐˜ƒ๐—ถ๐—ป๐—ด ๐—ฎ๐—ด๐—ฒ๐—ป๐˜ ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ๐˜€ ๐—ถ๐˜€ ๐—ฎ ๐—ป๐—ฒ๐˜„ ๐—ฑ๐—ถ๐—บ๐—ฒ๐—ป๐˜€๐—ถ๐—ผ๐—ป ๐—ผ๐—ณ ๐—ฎ๐—ด๐—ฒ๐—ป๐˜ ๐˜€๐—ฒ๐—น๐—ณ-๐—ถ๐—บ๐—ฝ๐—ฟ๐—ผ๐˜ƒ๐—ฒ๐—บ๐—ฒ๐—ป๐˜.
14
33
8
105
5,705
Richard Lee retweeted
Enterprises and individuals increasingly find computer-use agents powerful. But the cost of scaling usage weighs on them. That's because these agents call on LLMs to reason every step and repeat. Our CTO Jiachen Yang told @miyadavid at @ISMG_News how we use neuro-symbolic to bring costs down: The agent learns a workflow once, then repeats it with code, so it doesn't run a frontier model on every step. On OSWorld, our @sai_borg was 217x cheaper than Opus alone, with a 72% success rate. Savings start after the third run, and Sai checks before each action. As Jiachen points out, a single LinkedIn recruiting task costs at least 50 cents with today's best models. "If a recruiter wants to do it for thousands of people, I'm pretty sure at some point it will be unjustifiable in terms of the cost." The full story here ๐Ÿ‘‡f.mtr.cool/xyrmkelccm
2
6
17
814
Richard Lee retweeted
Ever wondered what goes into making @sai_borg more reliable? @Richard_simular from @SimularAIโ€™s research team was invited to BayLearn 2026. His presentation explored how computer agents can reuse successful steps and handle repetitive tasks more consistently. For more on how agents learn reusable workflows, read the paper Richard coauthored: arxiv.org/abs/2609.36927 Thanks to Santa Clara University for hosting, and to San Josรฉ State University, UC Berkeley, and UC Santa Cruz for co-organizing the event ๐Ÿ‘ #BayLearn2026 #AIResearch
1
3
12
472
Richard Lee retweeted
๐๐ž๐ญ๐ญ๐ž๐ซ ๐ซ๐ž๐ฌ๐ฎ๐ฅ๐ญ๐ฌ & ๐ฅ๐จ๐ฐ๐ž๐ซ ๐œ๐จ๐ฌ๐ญ, ๐š๐ฌ ๐ฌ๐จ๐จ๐ง ๐š๐ฌ ๐ฒ๐จ๐ฎ ๐ฉ๐ฎ๐ญ ๐Ÿ๐ซ๐จ๐ง๐ญ๐ข๐ž๐ซ ๐š๐ ๐ž๐ง๐ญ๐ฌ ๐จ๐ง ๐‹๐„๐€๐’๐‡! ๐Ÿฆฎ Why use a frontier model at every step when a lightweight agent can handle lots of the work? Introducing ๐‹๐„๐€๐’๐‡: ๐”๐ง๐œ๐ž๐ซ๐ญ๐š๐ข๐ง๐ญ๐ฒ-๐€๐ฐ๐š๐ซ๐ž ๐–๐ž๐š๐ค-๐ญ๐จ-๐’๐ญ๐ซ๐จ๐ง๐  ๐„๐ฌ๐œ๐š๐ฅ๐š๐ญ๐ข๐จ๐ง ๐š๐ง๐ ๐Ž๐ฏ๐ž๐ซ๐ฌ๐ข๐ ๐ก๐ญ. LEASH unleashes the strong agent only when the weak agent's latent uncertainty signals the need, and keeps it on a leash afterward. Two key challenges: 1๏ธโƒฃ ๐–๐ก๐ž๐ง ๐ญ๐จ ๐ž๐ฌ๐œ๐š๐ฅ๐š๐ญ๐ž? Use the weak agent's latent uncertainty as an inexpensive signal that can be monitored at every step. 2๏ธโƒฃ ๐‡๐จ๐ฐ ๐ญ๐จ ๐ฆ๐š๐ข๐ง๐ญ๐š๐ข๐ง ๐จ๐ฏ๐ž๐ซ๐ฌ๐ข๐ ๐ก๐ญ ๐š๐Ÿ๐ญ๐ž๐ซ ๐ž๐ฌ๐œ๐š๐ฅ๐š๐ญ๐ข๐จ๐ง? Even frontier agents can go astray. And when served through black-box APIs, their internal states are inaccessible. LEASH enables continued oversight without accessing the strong agent's internals. ๐“๐ก๐ž ๐ค๐ž๐ฒ ๐ข๐ง๐ฌ๐ข๐ ๐ก๐ญ: Knowing when to escalateโ€”and when to interveneโ€”is just as important as knowing how to act. The future of agentic AI isn't about using the strongest model everywhere. ๐ˆ๐ญ'๐ฌ ๐š๐›๐จ๐ฎ๐ญ ๐๐ž๐ฉ๐ฅ๐จ๐ฒ๐ข๐ง๐  ๐ข๐ง๐ญ๐ž๐ฅ๐ฅ๐ข๐ ๐ž๐ง๐œ๐ž ๐ฐ๐ก๐ž๐ซ๐ž ๐ข๐ญ ๐ฆ๐š๐ญ๐ญ๐ž๐ซ๐ฌ ๐ฆ๐จ๐ฌ๐ญ.
๐Ÿ’ธ For computer-use agents, using a frontier model at every step is expensiveโ€”but relying on a small model alone is risky. LEASH offers a middle ground: let a lightweight agent handle what it can, bring in a stronger model only when needed, and keep monitoring afterward. Put your frontier model on a LEASH !! ๐Ÿฆฎ ๐Ÿ“„ arxiv.org/pdf/2610.22280
4
10
40
2,253
Richard Lee retweeted
Replying to @Richard_simular
@Richard_simular presenting neuro-symbolic computer use agents at @BayLearnOrg today!
2
6
14
642
oops
When a teammate gave up talking to me about reviewing their PRs ..
42
Richard Lee retweeted
Build your own personal agent within 10 minutes, using the Autonomous Computer API by @SimularAI It also self optimizes token usage for repetitive tasks btw youtu.be/doddTcFZMw8?si=YQWPโ€ฆ
3
5
6
22
3,388
Richard Lee retweeted
Our MTS @Richard_simular, part of the team that built @sai_borg, answered 4 critical questions on personal agents on a panel at #SFTechWeek: 1. When should an agent think, when should it just act, and when must it stop and ask โ€” whatโ€™s your decision architecture? Start super strict then slowly relax the guard. User & personal agent have a continual "bonding" process, and people have different preferences so it's never going to a one size fits all 2. Do agents overthink into paralysis? Usually it's not an agent, but a weak model overthinking. Some models do this to benchmaxx so you will see an agent thinks for 4 minutes for a simple task like open google.com. 3. How do we know how much autonomy to give to an agent? Running on sandbox is (almost) always the best approach. Factors: 1. how safe is sandbox 2. how reachable is the request to you 3. how quickly it learns and relax permission 4. With Muse Gadgets and OpenAI Dots launching last week, what does personal-agent decision architecture look like 12 months from now How to give more information to agents. If we can find out a way to send explicit and exact request to agent then we don't need any context. Thanks for having us on!
3
3
18
803
Insights on building reliable agents (they also happen to be very cost effective!)
Three years into making computer use agents, I kept asking myself: Why hasn't CUA reached super intelligence yet? @sai_borg (Sai), which happens to sound like SI, has invented a new way to build computer use agents: not just more reliable, but also 99% cheaper The answer lies in how humans function: build muscle memory to optimize for efficient output over time We released a paper today on this new paradigm, called neuro-symbolic Give it a read here: simular.ai/articles/real-worโ€ฆ
1
68
Richard Lee retweeted
Our @Richard_simular will speak here and tell why your agents shouldnโ€™t overthink too much
Weโ€™re hosting an event about โ€œNew era of Personal Agentโ€ at SF @Techweek_ partner with SEAMATE X @CoreSpeedHQ And we invited๏ผš โ€ข @Richard_simular โ€” @SimularAI โ€ข @ZongZiWang โ€” @harvey โ€ข @haosu_cs โ€” @CoreSpeedHQ โ€ข @samuel_spitz โ€” @Replit ๐Ÿ“ Downtown SF ๐Ÿ—“ Oct 8 ยท 5โ€“8 PM PT See you there. luma.com/seamate-tdd8
2
14
676
Day 1 of assembling my gtm team with Sai agent ๐Ÿ‘€ #SaiFleet #Robosecretary
1
5
118
Richard Lee retweeted
There are plenty of โ€œhuman-pretending-to-be-an-agentโ€ game demos out there. This one is real. Sai + Jev played Minecraft, fought mobs, and spawned mining sub-agentsโ€”all in real time. 1 hour. $0.01. And Sai can spin up 100ร— agents in parallel for under $1 total. #RoboSecretary #SaiFleet
Agent demos fooled you ๐Ÿ‘Ž It trips, it asks for help, and somehow you're the one copying, pasting and running the commands. Meet your #Robosecretary. Meet your #SaiFleet. Sai brings state-of-the-art computer use to your own computer - your apps, your OS, in a floating window that leaves your mouse alone. Need more than one? Spin up to 100 cloud machines, each on the OS you pick, each on a different job. 100x the work, done without you. Sai. The autonomous computer fleet at your command. Free to start โ†’ sai.simular.ai
2
6
5
30
7,456
Richard Lee retweeted
Agent demos fooled you ๐Ÿ‘Ž It trips, it asks for help, and somehow you're the one copying, pasting and running the commands. Meet your #Robosecretary. Meet your #SaiFleet. Sai brings state-of-the-art computer use to your own computer - your apps, your OS, in a floating window that leaves your mouse alone. Need more than one? Spin up to 100 cloud machines, each on the OS you pick, each on a different job. 100x the work, done without you. Sai. The autonomous computer fleet at your command. Free to start โ†’ sai.simular.ai
108
39
123
725
1,049,996
Pretty Serene #robosecretary
Check out my first music video ๐Ÿ–๏ธ Plus, accepting applications for hot (robo)secretaries Want yours?
3
65
Richard Lee retweeted
Check out my first music video ๐Ÿ–๏ธ Plus, accepting applications for hot (robo)secretaries Want yours?
99
51
39
344
142,608
Richard Lee retweeted
Our computer-use agent @sai_borg just beat Opus 5 and GPT-5.6 Sol on OSWorld 2.0. Sai scored 73% on the CUA benchmark where each complex task takes a skilled human over an hour to execute. And Sai did it at about 2/3 the cost per task of Opus and GPT ๐Ÿ’ธ The unlock is our neurosymbolic framework that pairs the exploratory power of neural networks with the logic of symbolic code, resulting in reliability and cost saving. Read the full report: simular.ai/articles/sai-topsโ€ฆ
52
29
34
156
2,280,238
Richard Lee retweeted
Not @Richard_simular telling me @sai_borg's deterministic code replay drops token usage by 90% For a repetitive task our accountant hates ๐Ÿค“
1
2
6
6
1,534
Richard Lee retweeted
Agent S3, the first computer-use agent that surpasses human-level performance in OSWorld v1 benchmark, has now been accepted to @TmlrOrg (Transactions on Machine Learning Research). Congratulations to the @SimularAI team! @chalo2000, vincent, @Richard_simular, jiachen, @xwang_lk Stay tuned for what's next!
๐Ÿš€ Introducing ๐€๐ ๐ž๐ง๐ญ ๐’3, the most advanced computer-use agent, now ๐š๐ฉ๐ฉ๐ซ๐จ๐š๐œ๐ก๐ข๐ง๐  ๐ก๐ฎ๐ฆ๐š๐ง-๐ฅ๐ž๐ฏ๐ž๐ฅ ๐ฉ๐ž๐ซ๐Ÿ๐จ๐ซ๐ฆ๐š๐ง๐œ๐ž๐Ÿง ๐Ÿ’ป Just one year ago, Agent S scored ~20% on OSWorld: SOTA then, but far from human 72%. Today, Agent S3 reaches 6ฬณ9ฬณ.ฬณ9ฬณ%ฬณ (โฌ†10% over prior SOTA), nearly matching humans on computer use. Few imagined this gap could close so fast, but with steady progress and ๐Ÿ๐ข๐ซ๐ฌ๐ญ-๐ฉ๐ซ๐ข๐ง๐œ๐ข๐ฉ๐ฅ๐ž simplicity, @SimularAI did it in just one year. ๐Ÿงช The sฬตeฬตcฬตrฬตeฬตtฬต ๐จ๐ฉ๐ž๐ง ๐ซ๐ž๐œ๐ข๐ฉ๐ž: โ†’ ๐๐ž๐ก๐š๐ฏ๐ข๐จ๐ซ ๐๐ž๐ฌ๐ญ-๐จ๐Ÿ-๐ โ€” scaling agents ๐˜ต๐˜ฉ๐˜ฆ ๐˜ณ๐˜ช๐˜จ๐˜ฉ๐˜ต ๐˜ธ๐˜ข๐˜บ โ†’ Simpler design, stronger baseline โ†’ 100% ๐จ๐ฉ๐ž๐ง ๐ฌ๐จ๐ฎ๐ซ๐œ๐ž (as always) Learn more at simular.ai/articles/agent-s3 & ๐Ÿ‘‡
2
5
13
1,489
Using Sai to judge agent projects made by Simular product suite
Judging time at #Calhacks - who's gonna win our $500 prize? ๐Ÿ‘€
38