andi schuster (@andischuster) header
andi schuster (@andischuster) profile picture

🍰 TT-shaped product wrangler @Canva, ex @BCG x. Building at the intersection of design, AI and ops. Systems tinkerer. Forever curious.

Joined February 2012
Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)Photo by andi schuster (@andischuster)
andi schuster retweeted
We believe voice is the most natural way to interact with intelligence, so we created Dessa, the most authentic full-duplex speech model ever built. Talking with it feels like talking with a person…full of emotion, nuance, pauses, and a natural cadence. block.xyz/dessa
4,170
7,148
4,758
69,078
13,719,322
andi schuster retweeted
MCP vs CLI for LLMs is the wrong discussion. People are debating at the wrong layer. Both work incredibly well as long as they are run through a repl like environment that can persist state. The funny thing about CLI is that CLI tools are usually accessed through BASH which happens to be a repl with persistent state (the file system), therefore cli works much better than mcp. But this isn't even close to being an intrinsic property of MCP. Just means that we need better harnesses. Right now the best repl for this are: - bash + fs - jupyter kernels - codemode type repls, usually quickjs LLMs understand the concept of forward evolving a system to solve a need very well. This comes from the agentic RL. They understand how to change the state of a codebase or acquire data from databases and then operate on it similarly to humans. But without an execution environment, they actually cannot do this properly. My bet? Sometime soon someone will (or has already?) create a embeddable, sqlite style mini execution environment that parses bash, typescript, or tool calls into a common IL execution plan that's easy to security check before executing. And design this specifically for durable execution environments. Then we will just connect cli, mcp, webmcp, whatever to that and it accepts any of the input modalities as they can all be represented as each other.
248
191
72
3,461
702,372
When the model labs started talking about an “AI slowdown”, I didn’t expect it would arrive via slowed down coding harnesses, shipped together with “fast mode”. It’s excruciating.
37
andi schuster retweeted
how do you fine-tune a decision model on your own data? in these two notebooks, you'll learn: • how to prepare the training data • how to fine-tune our d1-3B decision model • using @UnslothAI and @huggingface TRL all within 30 minutes on a free-tier GPU. unsloth: github.com/Liquid4All/cookbo… TRL: github.com/Liquid4All/cookbo… ps: how adorable are these halloween kitties? 👻
42
242
15
1,984
85,812
un-shipping the org chart may be the single most impactful thing to do in 2027
1
2
73
Chat + feed = Cheet? 100% believe that a mono thread + intelligent UI components + recommender systems could improve engagement and education. Most users don’t know what to prompt!
One of my more controversial bets: the AI feed will be the form factor of 2027! Most people don’t know what to prompt, and they won’t prompt their way into complicated agentic workflows. With chat, we ask users for digital labor: figure out what AI can do, explain the task, provide the context, repeat. That’s a lot to ask if we want billions of people using agents every day. Meanwhile, people already spend hours in feeds. Twitter, Instagram, LinkedIn. They know how to scroll, discover something useful, and act on it. An intelligent system that knows you should bring you the next useful action. Here’s the email you need to answer, already drafted. Here are the latest sales numbers, with an update ready to send to your team. You approve, edit, dismiss, or jump into chat to go deeper. That’s how people will discover what agents can do, without having to invent a prompt first. And you can put ads in a feed, one of the biggest business models on the internet. A system that understands your plans can recommend a relevant restaurant, product, or service, clearly labeled as sponsored. You get a reason to come back every day, useful work ready to approve, and a business model to fund the agents doing it.
1
61
Interesting thoughts on where we’re headed: personal agents as a catalyst of the ‘invisible hand of the market’. Scenarios: 1. Agent is on side of consumer -> better pricing & transparency. 2. Agent is on side of market -> buys more shit we don’t really need.
Assorted things I've been mulling over regarding agents in the economy: • Companies are in some sense the original superintelligence. It's often the case that they can use their amortized cognitive surplus to advance their interests against those of certain consumers: relative to the optimization capacity of companies, consumers can be inattentive, underinformed, irrational, etc. (Think, say, of some of the classic insurance upsells at the end of a booking process, which is typically priced substantially above what a regular policy would cost.) Herbert Simon introduced the idea of bounded rationality, and firms often end up benefiting from it. Thanks to personal agents, we will probably get somewhat more rational in how we engage with companies. • How exactly will outcomes change? Well, certain kinds of price discrimination will work less well (how do coupons work if every agent hunts fastidiously for them?), and certain kinds of customer cross-subsidy will change (today, people who forget to cancel subscriptions subsidize those who don't). Taken across the economy as a whole, I'm not sure what the incidence of all of this will be. • In corporate strategy, people have long debated the relative importance of distribution and product quality. Perhaps you've made something better, but does anyone know about it? Won't people just continue to buy the ACME Corp Mousetraps? Personal agents will, I think, act as a kind of structural subsidy for product quality. How would markets look different if individuals always spent at least 10 hours researching their purchases? On the margin, focusing on making a product better is, I think, going to become a more effective strategy for companies. This is good! • It true, a corollary is that information about product quality will become more important and impactful. Today, most people have very limited ability to aggregate and integrate such data, but agents will have insatiable thirst for such signals. (It's often said that data is becoming more valuable because it helps in the training of models. That's obviously true, but I think there's a secondary way in which it's more valuable simply as a complement to cheaper intelligence.) • A big question is whether agents will increase superstar effects (rational agents all settle on the same product) or increase dispersion (because everyone has slightly different tastes and preferences, which agents are good at eliciting, finally overcoming the artificial clustering we've been subjected to). • Many internet companies have monetized demand routing, which is in turn often predicated on short attention spans. "I'll click on the first thing I see." This has led to some amount of inefficiency, as companies try to propitiate capricious ranking algorithms and incur various placement fees. It's not all deadweight loss (willingness to pay is itself a kind of signal, which is valuable to buyers), but it's not great. How will the nature and value of this routing change in a world of personal agents? I don't know the answer, but I think that the effects might be pretty big. • Much of what I'm writing hinges on the assumption that personal agents will be on the consumer's side. I suspect that that will be the winning strategy, but whether it's true, and what it means to be true, involves a lot of other questions. Taken as a whole, the market is a massively parallelized, decentralized, and highly imperfect value attribution machine, and, taking stock of all of the effects, it seems to me that the quality point may well be the biggest: that agents will change the nature of the backpropagation such that the rewards for better products increase. Maybe this is too optimistic, but I suspect (and hope) that companies that make things that they're proud of will feel that the universe is a little more partisan in their favor.
42
andi schuster retweeted
Assorted things I've been mulling over regarding agents in the economy: • Companies are in some sense the original superintelligence. It's often the case that they can use their amortized cognitive surplus to advance their interests against those of certain consumers: relative to the optimization capacity of companies, consumers can be inattentive, underinformed, irrational, etc. (Think, say, of some of the classic insurance upsells at the end of a booking process, which is typically priced substantially above what a regular policy would cost.) Herbert Simon introduced the idea of bounded rationality, and firms often end up benefiting from it. Thanks to personal agents, we will probably get somewhat more rational in how we engage with companies. • How exactly will outcomes change? Well, certain kinds of price discrimination will work less well (how do coupons work if every agent hunts fastidiously for them?), and certain kinds of customer cross-subsidy will change (today, people who forget to cancel subscriptions subsidize those who don't). Taken across the economy as a whole, I'm not sure what the incidence of all of this will be. • In corporate strategy, people have long debated the relative importance of distribution and product quality. Perhaps you've made something better, but does anyone know about it? Won't people just continue to buy the ACME Corp Mousetraps? Personal agents will, I think, act as a kind of structural subsidy for product quality. How would markets look different if individuals always spent at least 10 hours researching their purchases? On the margin, focusing on making a product better is, I think, going to become a more effective strategy for companies. This is good! • It true, a corollary is that information about product quality will become more important and impactful. Today, most people have very limited ability to aggregate and integrate such data, but agents will have insatiable thirst for such signals. (It's often said that data is becoming more valuable because it helps in the training of models. That's obviously true, but I think there's a secondary way in which it's more valuable simply as a complement to cheaper intelligence.) • A big question is whether agents will increase superstar effects (rational agents all settle on the same product) or increase dispersion (because everyone has slightly different tastes and preferences, which agents are good at eliciting, finally overcoming the artificial clustering we've been subjected to). • Many internet companies have monetized demand routing, which is in turn often predicated on short attention spans. "I'll click on the first thing I see." This has led to some amount of inefficiency, as companies try to propitiate capricious ranking algorithms and incur various placement fees. It's not all deadweight loss (willingness to pay is itself a kind of signal, which is valuable to buyers), but it's not great. How will the nature and value of this routing change in a world of personal agents? I don't know the answer, but I think that the effects might be pretty big. • Much of what I'm writing hinges on the assumption that personal agents will be on the consumer's side. I suspect that that will be the winning strategy, but whether it's true, and what it means to be true, involves a lot of other questions. Taken as a whole, the market is a massively parallelized, decentralized, and highly imperfect value attribution machine, and, taking stock of all of the effects, it seems to me that the quality point may well be the biggest: that agents will change the nature of the backpropagation such that the rewards for better products increase. Maybe this is too optimistic, but I suspect (and hope) that companies that make things that they're proud of will feel that the universe is a little more partisan in their favor.
489
1,031
460
9,640
1,733,914
andi schuster retweeted
We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks: Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better: Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better: Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better: Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work! In summary: - As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding. - Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.
1,705
6,743
1,567
56,636
8,179,213
AI systems design with @aish_reganti @kiritibadam is an absolute goldmine of relevant skills, knowledge and frameworks for AI PMs. Everything is based on first principles combined with relevant case studies form real practicioners. Highly recommend. maven.com/aishwarya-kiriti/g…
39
andi schuster retweeted
"The only way to know if our AI products and workflows are any good is with evals." 💡 If you're using AI to write PRDs, analyze customer feedback, or build customer-facing AI products, you need to understand evals. This guide breaks down what evals actually are and why product teams should be building them. Here's what you'll learn: 🔍 What evals are and why they're different from traditional software testing
📊 How to do error analysis to identify which mistakes matter most
🛠️ Four types of evals: golden datasets, code assertions, LLM-as-a-Judge, and customer feedback
✅ How to choose the right eval for each type of error
🔄 How to run experiments and measure if your changes actually work The key insight: with LLMs, you can't just test once and expect the same result. You need to measure how often your AI gets it right, and that starts with defining what "right" actually looks like for your specific product. Check out the article: producttalk.org/ai-evals/ ❓ What's one error you've noticed in an AI tool you use regularly? Share your thoughts in the comments below.
5
8
1
97
9,028
andi schuster retweeted
my proposal was if you spend a billion tokens in a day you have to answer a quiz about the details of what you built and why if you fail you go on a wall of shame. if you pass you get to be a Token Billionaire for the day still waiting for @ArielleShipper to get back to me on that one...
When our daily @OpenAI credit use jumped 230%, a strict token budget felt like the obvious answer. But our head of ops Arielle Shipper instead chose to manage our tokens through 3 questions instead: What did it cost? What did it buy us? What did we learn? Read the full piece: every.to/p/our-ai-costs-jump…
13
3
100
28,411
andi schuster retweeted
BREAKING: Anthropic just dropped Claude Fable 5—this is Mythos, made safe for public release. It is the best coding model in the world. We've been testing it internally @every for the last week or so across coding, writing, marketing, editing, and more—here's our vibe check: - It broke our benchmarks. Fable scored a 91/100 on our Senior Engineer benchmark—this is human senior engineer level. The previous high score was Opus 4.8 at 63. GPT-5.5 is a 62. - It's a one-shot wonder. You can set it and forget for hours or overnight on huge coding tasks, and come back to completed work. It cleared entire production bug backlogs, built a playable 3D, and even made a 2-minute animated film—all one-shot. - Taste and attention to detail. In coding and knowledge work tasks, it has much better taste and attention to detail than we've ever seen. It gets subtle things right, adds little features you might not have thought of, and generally understands the assignment in ways that surprised us. - Great use of context. We set it loose analyzing customer feedback surveys and our website data and it came back with a crisp, clean report that identified a. our biggest problem and b. a concrete testable solution—and then we sent it off to build that. - It's best for power users. If you're already used to orchestrating multiple agents in your work, this model can do things that you've never seen before. If you're a knowledge worker or vibe coder with a more basic setup, you're not going to notice a huge difference—in fact, it probably isn't the right model for you. - It's very slow, token-hungry. Using this thing for regular knowledge work is like squashing an ant with a rocket launcher. It also routinely uses 500k to 1M tokens on tasks. That's why it's best for your heaviest jobs—but not as good for tasks like collaborative writing. - It's expensive. It's about twice as expensive as Opus, and it's also incredibly token hungry—so expect it to be something you'll use sparingly unless your company pays for it. Overall, I think of it like a warp drive for coding: It can get you across the galaxy in a few hours, when it used to take months or years. But it's not appropriate for getting around town—you need something faster, cheaper, and more maneuverable. The ceiling is extraordinarily high on this model though. Even our most advanced testers like @kieranklaassen felt like they were only scratching the surface of it. Want our full vibe check with all of our testing and benchmarks? Read it on @every: every.to/vibe-check/anthropi…
166
300
74
3,480
623,166
yipping and yapping will replace typing and tapping. According to @tfadell keyboards were just a detour. Gemini/GPT realtime capabilities are already there…. but where are the agent-native voice apps?
My biggest takeaways from @tfadell: 1. When building a v1 of anything, decisions should generally be opinion-based, not data-driven. You have very few analogues when creating something the world hasn’t seen. You need one or two tastemakers charged with making those decisions. If you try to make everything data-driven, you either end up with an undifferentiated product or you’re using bullshit data. The key is informing your gut by gathering input, prototyping, then making the call. 2. The customer journey matters more than the product in isolation. You need to think about the entire journey—discovery, marketing, sales, distribution, installation, usage, and support—not just the product. The Nest thermostat reinvented how you bought it (Best Buy instead of installers), installed it (DIY instead of professional), and how it worked (learning instead of programming). You’re not building a product; you’re building a system. 3. Marketing is as important as the product itself, and most builders don’t realize this. When building, you’re living in the context—you understand the pain points and features. But customers don’t have that context. When the iPod launched in Europe using the same marketing they used in the U.S., it flopped because European consumers were at a different adoption stage. Even an amazing product like the iPod can fail without the right marketing. 4. Storytelling is an essential skill for builders, because humans are wired for narrative, not feature lists. Tony learned from watching his dad sell Levi’s—sometimes convincing customers not to buy, building trust. He watched Steve Jobs refine the iPhone story every day for two and a half years, pitching to friends, refining constantly. By launch, Steve had done it 10,000 times. The key is telling the why, not just the what. 5. Every new product needs three generations to succeed: make the product, fix the product, fix the business. The first iPod only sold to Mac enthusiasts (less than 1% of the market). It wasn’t until the third generation, with Windows connectivity and the iTunes Music Store, that the iPod took off. Same with the iPhone—it first worked only on AT&T with 2.5G; the third generation had margins and reliability dialed in. Stick with your idea through these three iterations. 6. Don’t cognitively surrender to AI. AI can help with prototyping and subtasks, but architecture, opinion-based decisions, taste, and ethics require human judgment. Just like Steve Jobs shut down porn in iTunes immediately, you need human leaders with clear principles. The companies that win will use AI to amplify human creativity and judgment, not replace it. 7. Tony predicts that the next breakthrough consumer device will be voice-first, screen last. Right now we tap first, use the keyboard second, and voice third. As AI improves, voice will become the primary way we interact with devices. But we’ll still need a screen of some kind. 8. Steve Jobs was wrong about several major product decisions. Steve refused Windows connectivity for iPod—“over my dead body.” Tony’s team kept working on it anyway. Eventually it shipped and became essential to iPod’s success. Same with the iPad stylus—Steve hated it—another skunkworks project, now a major feature. Sometimes you should keep working on things the leader doesn’t like when you can see it on the horizon. 9. The iPhone keyboard decision was the longest, most heated debate for the original iPhone. The team was split. After months of tests, where they compared typing speed and error rates, the data wasn’t definitively clear. Steve Jobs made the call: virtual keyboard, full screen. Those who couldn’t get on board were told to leave. 10. Start from pain, then ask “why now?” The biggest product breakthroughs pair an old, often habituated-away pain with a new technology that has made solving it possible. For Nest, it was AI that could finally learn your schedule and optimize your heating/cooling costs.
72
Dr. @slyubomirsky, I absolutely loved your interview on @jonfavs OFFLINE podcast. Also just started reading your book! The 5 mindsets really distill down to a beautiful essence what I had to learn the hard way! You used the metaphor of "relationship as a growing garden that needs tending" and interestingly this is the theme my partner and I arrived at as well! I am somewhat on the neurodivergence spectrum, so I always needed to put in a lot of work to open up, grow my emotional vocabulary and mental models about relationships. Your nuanced view on AI in relationships also really hit home for us. We started building a couples coaching app for ourselves over the past year. Recently, we started sharing it with other couples and recently published it. (We work in tech, but for us this is non-commercial, non-therapy ... more like a true passion project.) We'd really love your feedback as a scientist and educator: growingus.coach/download?v=t…
37