
AI DevX at @DecagonAI, prev Ramp/SafetyKit CS @UCLA
SD, LA, SF
Joined February 2025
- Tweets1.6K
- Following669
- Followers886
- Likes15K
Pinned Tweet
Announcement: I'll be joining @DecagonAI tomorrow in San Francisco as an intern on the AI Infra team working on AI DevX!
At Decagon, I'll try to answer the question: "how can we build systems that improve the experience, productivity, and quality of AI use across a company?"
If you're in around in SF, I'd love to chat. Excited to work and see all of you soon!
Tyler Xiao retweeted
marketing team advised that I shitpost less and try to provide some real value to the world, so here's what I've been working on recently!
If you’re a founder or engineer tired of user bug reports and issues flooding your software feed, try @Simulithic and give these guys a quick call!
Shipping code shouldn’t mean hours of manual testing.
@Simulithic (YC F26) sends AI agents through your app like real users, across browsers, devices, and account types. It tells you what broke without you writing a single test script.
The teams that ship fastest will be the ones that can verify as fast as they build.
Get started today: simulithic.com
.@bryan_johnson pay attention to how this guy Satyam de-aged these past years 🫡
Doing a hackathon with @eduardfausgil & @ayushrgarg was the best decision I’ve ever made
I was in India, about to give up on tech back in 2022, met these 2, learned how to build cool things with them, and it changed my life
(Picture below is approximately 4.5 years apart lol)
The lesson we have learned over the past few years is that frontier general intelligence is a game changer, but not a drop in replacement for complex, end-to-end real world tasks.
I still remember last year when OpenAI announced that its general purpose model solved the IMO Gold. Fast forward today and this level of intelligence/problem-solving is available with a prompt costing less than $20.
Even with this level of AI capability, the real world is messy. Building AI-native companies that produce value and solve real issues is still valuable these days :)
value accrual at the model layer is splitting in two. for frontier discovery, it concentrates in a handful of labs. for commoditized workflows, it leaks out to whoever is cheapest or closest to the customer.
the reason is that the value of being one model generation ahead varies enormously by task. for problems with known answers, intelligence eventually becomes abundant. for problems without known or verifiable answers yet, the strongest model can be worth orders of magnitude more than the next best.
frontier discovery is novel research and long-horizon agentic work where nobody knows the answer yet. bio appears to be a large one over the next few years for ex. models are becoming exceptionally strong at prediction, and the value of a single hit dwarfs the cost of the tokens that found it. expect the labs to start running their own experiments, with frontier models choosing what to test. the feedback loop here isn’t just better models producing better predictions. it’s better predictions determining which experiments get run, generating new ground truth that makes the next round of predictions better.
openai and anthropic are best positioned here, with google close behind. buyers of discovery pay for the strongest model, so being a generation behind costs far more than it does anywhere else. the lead compounds given the labs use their best models to accelerate building the next ones, they have the compute to do it at scale, and they keep those models internal long before exposing an api.
commoditized workflows are the long tail of tasks a model one generation old already handles well. quality saturates and cost decides. deepseek and other chinese labs tend to own the cost-quality pareto frontier, partly out of necessity given their relatively compute-constrained conditions, meaning efficiency has become integral to the research agenda. the western frontier labs have their own edge in distillation, as they can leverage the strongest teachers at the logit level, while everyone else distills from a weaker teacher or from sampled text. but they only win this tier if they choose to compete on price.
even the pareto leader doesn’t capture much per task here, because the weights are generally open. anyone can self-host them or finetune them on their own data, and as a result the model layer’s share shrinks to an inference margin. but thin margins on an enormous volume of workflows can still add up to substantial value capture. the model layer becomes a scale business rather than a pricing power business.
cost isn’t the only place value moves. whoever owns the customer relationship also owns the workflow, the context, and increasingly the feedback that determines what good performance actually looks like.
a caveat then is taste. general taste lives in the weights, but most “commodity” workflows are full of judgment calls specific to one business. the ground truth for those comes from outcomes the labs never see. if you’re building on top of the labs, don’t compete on general intelligence. own the loop that turns your customers’ outcomes into a reward signal.
Tyler Xiao retweeted
the builder’s lounge for @vestucla @cognition @warpdotdev and rainfall ventures for @Techweek_!!
thank you to everyone who helped make this happen! we had a packed house of students, founders, and people across the LA startups space in attendance and a waitlist or over 400!
i had a blast organizing this with the team and can’t wait to do more events! if you’re looking to meet people or host with people in the LA tech space, dm me!
Tyler Xiao retweeted
all technical work is becoming evals. your primary job as an engineer is now building loops that make coding agents effective maintainers of the systems you own. models are immensely capable - given clear instructions, the right environment, and a way to verify their work, agents can complete open-ended, long-running tasks. if you still think coding agents are shipping “slop”, it simply means one of these three things is missing.
if you build product, you might need to restructure your codebase and give your agents fast, high-fidelity ways to test changes. if you’re a researcher, you might spend most of your time building pipelines for data synthesis and environment construction - experiments are the bottleneck, not ideas.
the art is translating the real-world problem into the right eval: will the agent understand your exact criteria for when a task is sufficiently complete? and when the frontier shifts, do these criteria change?
every engineer is an AI engineer now. in the long run, the ones who build the machine that builds the machine will be most effective. of course, the best will adapt. but if you’re not actively thinking about how to make agents better at your work, or you’re relying on other people to do it for you, you’re probably ngmi.
Tyler Xiao retweeted
I always knew I was going to do my startup at some point
But it was the layoff from my internship in Canada a year ago (before Bree), that actually paved the path for it
Planning to make more such videos in future :)
Tyler Xiao retweeted
Our take on networking for LA @Techweek_ .
Supported by @cognition and Rainfall Ventures. Featuring @AlexMonahaqyrt .
October 16. RSVP at the link in comments.
@vestucla
I wonder how many modern day benchmarks have plauteaued at 80-90% because of this 🤔
"Our initial evaluation suggested that GPT-6-Astra's score was in the late eighties followed closely by Opus 5.5. But, as we started to investigate the mistakes that the models might have made, the models, especially Astra, insisted that they were right and that it was the expert-supplied answers that were erroneous. When we went back to the experts it turned out, in multiple instances, that that the experts found some subtle errors buried deep inside their calculations. As they revised their answers, Astra's score started to inch up and it finally ended up with 98% (49/50)."
Tyler Xiao retweeted
Meet our Codex Ambassadors 💙
We sat down with a few of our ambassadors from around the world to hear why they joined, what they’re building, and what makes their local communities special. Proud to support them!
Join our Codex Ambassador program: developers.openai.com/commun…
Meet our Codex Ambassadors
Apply if you are excited about community and building with agents! Involving myself inside the community greatly helped me get involved building a ton more and meet awesome people in LA/SF/NYC!
Bonus points if you’re becoming an ambassador for a city that currently doesn’t have an ambassador :), the program is global and reaching the most amount of people will require that 😁
Already showing people what they can build with Codex? Applications to become a Codex Ambassador are open again.
We support you in hosting meetups or sharing what you’ve learned:
developers.openai.com/commun…































