SamT (@st_bomba) header
SamT (@st_bomba) profile picture

Making AI stuff

Joined November 2021
Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)Photo by SamT (@st_bomba)
SamT retweeted
wake up babe the freaking pope got schmidhuber'd
55
315
37
3,890
178,178
BREAKING: OpenAI might have stolen another major proof. In a detailed Mastodon post, which I report in full in the comments, Andreas Thom presents several pieces of evidence suggesting that OpenAI may have trained Astra on conversations in which he and Gábor Kun were working on Gromov’s soficity conjecture, one of the ten problems OpenAI later announced Astra had solved. I know Andreas. We met several times early in our careers. He is an exceptional mathematician, a leading expert on sofic and hyperlinear groups, and one of the most respected scholars in the field. He has spent two decades working on this problem. If his account is correct, this is not a minor dispute over attribution. It would mean that unpublished human work was absorbed into a model and then presented to the world as a breakthrough by the model itself. And if the allegations raised by Levent Alpöge, Tristan Buckmaster, and now Andreas Thom are all substantiated, we are no longer looking at isolated incidents. We may be looking at one of the greatest intellectual scandals in the history of science. AI is not discovering new mathematics. AI is stealing human discovery.
665
4,782
788
19,663
1,815,322
everyone getting sniped by the personal drama, but missed the more interesting unanswered question: can these labs see all your work and scoop you when the stakes are "high enough"? 🤷🏻‍♀️
138
278
139
2,717
679,839
wtf is this way to handle mathematicians work and scientific communication TLDR: Leven and Tristan worked over several months on one of the Millenium Prize Problems with various AIs to reach final interesting results. OpenAI apparently heard about it in the last days and prompted their latest models to work on the direction Leven and Tristan found fruitful. They then tried to push for controlling communication of the result and dropping Leven from authorship with some very bad taste social pressure. Hope this is not a glimpse of the future we’ll get in science research with these dominating players playing marketing games hurtful for the real scientific community.
83
373
131
2,890
699,077
i'm sorry to my overlords, this was funnier than expected
101
519
96
4,427
485,873
How Anthropic's new results post would read without the PR: Claude orchestrated open-source protein design models, PXDesign, RFdiffusion, Genie, BoltzGen, from a 30k-token expert prompt and 12,500 H100-hours of compute, and designed binders against 14 of 15 targets. Hit rates of 22–35% against a 10–15% baseline, where some of those tools already report similar numbers on their own. The orchestration is genuinely impressive. But the open-source models did most of the lifting, and they came from the Baker lab, Columbia, MIT, ByteDance Seed, and most of them were already wet-lab validated before Claude touched them. Which also sets the ceiling. All these generators share a single PDB-shaped training distribution, so calling four of them doesn't diversify away the blind spot, since they fail together. The targets that worked are the well-studied ones. So the valid claim is that an agent can now drive this stack competently in the regime where the stack already works. Instead, we got this announcement:
Many drugs work by binding to a specific target in the body and blocking or changing what it does. An important first step in the drug development process is designing a molecule that can bind tightly to its target. Traditionally, that's meant weeks or months of expert work per target, sifting through a large number of candidates to identify the few that work. We wanted to test if Claude could successfully design novel protein binders from scratch (also called de novo design). With a protein design prompt written by a human expert, Claude autonomously designed protein binders against 14 out of 15 targets. We then worked with Adaptyv Bio and Twist Bioscience, who independently built and tested the proteins Claude designed.
74
251
43
2,259
320,928
There was one moment that really touched me in the alphafold documentary After the team won the protein prediction competition,they were describing to sir demis about creating an api service to fold ur own protein Demi: why not just run on all of them, and release the whole database? There is only 200 million, right? Yea, why not just? I think about that all the time
If @AnthropicAI really cared about safety, they should just use their new models to scan all open source codebases and provide the findings of weaknesses for free Nah, they just wanted monopoly through regulations
12
30
5
806
226,501
We just released the DiffusionGemma tech report. Text diffusion models open up a radically different part of the latency–quality Pareto frontier 👇 We hope the report makes it easier for researchers and engineers to understand the model, build on it, and create things we haven’t thought of yet. None of this work happened in isolation. DiffusionGemma builds on years of amazing research from the text diffusion community, and we wanted the report to recognise that. We’re standing on the shoulders of giants❤️ Let’s keep pushing towards lower-latency, higher-quality LLMs together!
8
74
10
409
52,445
SamT retweeted
Imagine having a powerful AI video model running inside your own creative setup. MiniMax H3 makes that possibility much more realistic through its open-weight release. With optimized weights, the model can run on certain consumer GPUs rather than requiring only enterprise hardware. Creators can generate, edit, test, and customize videos within their own local workflow. They gain more control over costs, tools, and the overall production process. The idea of a personal AI video studio is becoming increasingly practical. #MiniMaxH3 #OpenWeight #LocalAI #AIStudio #AIVideo huggingface.co/MiniMaxAI/Min…
2
1
2
13
2,461
didn't even notice at first, but apparently this is what the fellows at flappy airplanes get up to - creating slop papers to cite in more slop work seems like that neolabs' fellows program could use some house-cleaning
Replying to @suchenzang
incredible, they even plagiarized the "mode forcing" motivation, citing a 34-page preprint paper (alexiglad.github.io/assets/p…) that reads like pure claude slop, instead of the 2023 paper that introduced the term
5
7
394
82,754
SamT retweeted
Was just as excited as everyone else to read this cool new paper, and it felt like a trip down memory lane! XM seems to be the same as IMLE, and the motivation and insights are also similar. Having worked on IMLE for years, I'll provide some context for my followers 👇. 1/n
We discovered a third pretraining axis beyond parameters and data: exploration. Scaling exploration monotonically improves existing models across images/video/language, and unlocks end-to-end generation. In the simplest case, it's just a for loop. Introducing Explorative Modeling. TLDR: - Gains from exploration grow with scale: 7%→36% as data scales, 13%→23% as parameters scale, and gains double at 3× the compute - Adding exploration to ~SOTA baselines improves data efficiency by 6.2×, FLOP efficiency by 4.1×, parameter efficiency by 47%, and hits a near-SOTA 1.43 unguided FID on ImageNet - Exploration lets you trade training compute for generalization, and scales how end-to-end your generative model is - End-to-end Explorative Models (XMs) match diffusion performance on control tasks with up to 256× less inference compute 🧵Thread:
24
92
28
997
325,490
I had a chance to chat with Andrej when he visited Tokyo in 2022, right after he wrapped up his 5-year work with Elon (he told me he was "recovering"). It was clear that his true passions are education and empowerment. You can see this reflected on his X feed—there is no hidden agenda, just a genuine desire to share what excites him. In a way, Andrej represents the ultimate nightmare for organizations like OpenAI. His goal is to empower developers outside of closed labs to train their own models, making AI knowledge accessible far beyond a small, elite group. If you empower enough people, closed labs will eventually run out of the capital needed to acquire all that distributed talent, and the monopoly on AI power will dissolve. This is just my speculation, but looking at it through this lens, it makes complete sense why he left OpenAI after just a year.
Why is he not at a frontier AI lab at the most pivotal time in human history since at least the industrial revolution?
19
40
5
770
129,065
Delighted to share: Prospective Study of Conversational Diagnostic AI in Ambulatory Primary Care @GoogleDeepMind @GoogleResearch @BIDMChealth – arxiv.org/pdf/2603.08448 research.google/blog/explori… Like real medical training, we @GoogleDeepMind took a series of milestones on the way to performing these real-world clinical encounters: from passing medical licensing-style exams (rdcu.be/dgGfJ) to mirroring PCP skills in simulated consultation OSCEs (nature.com/articles/s41586-0…). Now, in partnership with @BIDMChealth, 100 patients engaged in a text-chat with our AI (AMIE) up to 5 days before their in-person PCP visit. AMIE took a comprehensive history and drafted a summary & differential diagnosis (DDx) for the PCP. It was carefully monitored by a physician ready to intervene based on strict safety criteria.
1
22
2
53
9,274
The secret behind Gemini 3? Simple: Improving pre-training & post-training 🤯 Pre-training: Contra the popular belief that scaling is over—which we discussed in our NeurIPS '25 talk with @ilyasut and @quocleix—the team delivered a drastic jump. The delta between 2.5 and 3.0 is as big as we've ever seen. No walls in sight! Post-training: Still a total greenfield. There's lots of room for algorithmic progress and improvement, and 3.0 hasn't been an exception, thanks to our stellar team. Congratulations to the whole team 💙💙💙
117
536
227
4,320
2,031,591
Our first release is Gemini 3 Pro, which is rolling out globally starting today. It significantly outperforms 2.5 Pro across the board: 🥇 Tops LMArena and WebDev @arena leaderboards 🧠 PhD-level reasoning on Humanity’s Last Exam 📋 Leads long-horizon planning on Vending-Bench 2
17
103
61
901
274,342
Gemini 3 Pro is the new leader in AI. Google has the leading language model for the first time, with Gemini 3 Pro debuting +3 points above GPT-5.1 in our Artificial Analysis Intelligence Index @GoogleDeepMind gave us pre-release access to Gemini 3 Pro Preview. The model outperforms all other models in Artificial Analysis Intelligence Index. It demonstrates strength across the board, coming in first in 5 of the 10 evaluations that make up Intelligence Index. Despite these intelligence gains, Gemini 3 Pro Preview shows improved token efficiency from Gemini 2.5 Pro, using significantly fewer tokens on the Intelligence Index than other leading models such as Kimi K2 Thinking and Grok 4. However, given its premium pricing ($2/$12 per million input/output tokens for <200K context), Gemini 3 Pro is among the most expensive models to run our Intelligence Index evaluations. Key takeaways: 📖 Leading intelligence: Gemini 3 Pro Preview is the leading model in 5 of 10 evals in the Artificial Analysis Intelligence Index, including GPQA Diamond, MMLU-Pro, HLE, LiveCodeBench and SciCode. Its score of 37% on Humanity’s Last Exam is particularly impressive, improving on the previous best model by more than 10 percentage points. It also is leading in AA-Omniscience, Artificial Analysis’ new knowledge and hallucination evaluation, coming first in both Omniscience Index (our lead metric that takes off points for incorrect answers) and Omniscience Accuracy (percentage correct). Given that factual recall correlates closely with model size, this may point to Gemini 3 Pro being a much larger model than its competitors 💻 Advanced coding and agentic capabilities: Gemini 3 Pro Preview leads two of the three coding evaluations in the Artificial Analysis Intelligence Index, including an impressive 56% in SciCode, an improvement of over 10 percentage points from the previous highest score. It is also strong in agentic contexts, achieving the second highest score in Terminal-Bench Hard and Tau2-Bench Telecom 🖼️ Multimodal capabilities: Gemini 3 Pro Preview is a multi-modal model, with the ability to take text, images, video and audio as input. It scores the highest of any model on MMMU-Pro, a benchmark that tests reasoning abilities with image inputs. Google now occupies the first, third and fourth position in our MMMU-Pro leaderboard (with GPT-5.1 taking out second place just last week) 💲Premium Pricing: To measure cost, we report Cost to Run the Artificial Analysis Intelligence Index, which combines input and output token prices with token efficiency to reflect true usage cost. Despite the improvement in token efficiency from Gemini 2.5 Pro, Gemini 3 Pro Preview costs more to run. Its higher token pricing of $2/$12 USD per million input/output tokens (≤200k token context) results in a 12% increase in the cost to run the Artificial Analysis Intelligence Index compared to its predecessor, and the model is among the most expensive to run on our Intelligence Index. Google also continues to price long context workloads higher than lower context workloads, charging $4/$18 per million input/output tokens for ≥200k token context. ⚡ Speed: Gemini 3 Pro Preview has comparable speeds to Gemini 2.5 Pro, with 128 output tokens per second. This places it ahead of other frontier models including GPT-5.1 (high), Kimi K2 Thinking and Grok 4. This is potentially supported by Google’s first-party TPU accelerators Other details: Gemini 3 Pro Preview has a 1 million token context window, and includes support for tool calling, structured outputs, and JSON mode See below for further analysis
57
227
85
1,595
251,656
I'm so proud!! The open-source trillion parameters reasoning model <3 > SOTA on HLE (44.9%) and BrowseComp (60.2%)
🚀 Hello, Kimi K2 Thinking! The Open-Source Thinking Agent Model is here. 🔹 SOTA on HLE (44.9%) and BrowseComp (60.2%) 🔹 Executes up to 200 – 300 sequential tool calls without human interference 🔹 Excels in reasoning, agentic search, and coding 🔹 256K context window Built as a thinking agent, K2 Thinking marks our latest efforts in test-time scaling — scaling both thinking tokens and tool-calling turns. K2 Thinking is now live on kimi.com in chat mode, with full agentic mode coming soon. It is also accessible via API. 🔌 API is live: platform.moonshot.ai 🔗 Tech blog: moonshotai.github.io/Kimi-K2… 🔗 Weights & code: huggingface.co/moonshotai
58
49
6
1,348
87,698
Vibe coding with AI Studio is so addictive! I built an AI Hair Stylist Agent that: > find the best haircut by looking my face > generates the after images using nano banana > lets me edit it live with the live API > find nearby salons using google maps Built in just 5 mins!
50
48
1
528
46,724
RL is not enough. It only reaches its potential when combined with other ideas. The most famous example is AlphaZero. RL was combined with self-play which created an implicit task curriculum that evolved through training. This is very different from many RL datasets for LLMs which have a fixed set of tasks. Even where the task set is fixed, RL still needs to be combined with other ideas to show signs of life. Thinking models only come to life through RL when we remove length penalisation and have enough prior knowledge in the training data. Looking ahead, long horizon tasks will require much more exploration and “going off-piste”. But current RL methods induce policy entropy collapse. Diverse mid-training before RL could help, but fundamentally current RL objectives don’t reward “interestingness” and deviating from the “current (high reward) thing”. And yet, discovery is all about deviating from the current thing - and the best ideas come from the wilderness. Deep learning is no exception. It was interesting long before it reached its true potential. We didn’t wait to introduce backprop and SGD until compute and data came online :). This is a long way of saying: crude RL maximalism is overhyped. The magic comes from the interplay of RL with other things, and the angels are in the details.
10
26
3
274
29,770