llm psychosis 1.0 survivor circa sonnet 3.5

Joined February 2010
Tensor-Slayer retweeted
0th-order pretraining keeps getting faster. I just opened a new Noise track-2 PR: a 37.7M-parameter transformer trained to val loss 4.2 in 1.66 s on one 8×H100 node, with no backprop anywhere. The current record is 2.46s. Two days ago the track-2 record was 47 s. Then came identity-path credit, moment kernels on tensor cores, structured starts, tail averaging, and a PyTorch port of our JAX trainer, built by a lot of people in the open. This PR doesn't change the algorithm at all. It uses #39's estimator and #38's constants with a faster update: 6.27 → 4.44 ms per update. Val matches #39 within 0.0004 on every seed, so the gain is pure systems. Most changes were worth 1–4%. Together, they cut 40% off #37's update. Where the time went: - The credit kernels and matmuls cost exactly the same as before. - 0.8 ms of eager PyTorch copies and casts were compiled away. - The credit kernels build their features in-kernel, merge their products (14 → 6 per tile), and run every block in one launch: 553 → 349 kernels per update. - Gradients and weight gathers move in bf16, and both all-to-alls run under compute: exposed NCCL is 0.25 → 0.10 ms. - GPU idle time is 0.42 → 0.16 ms. A critical note on the benchmark itself: At 1.66 s, track 2 has become a systems benchmark. The last 30% came from kernel launches, copies and collectives, not from better credit assignment. Each update now does the same math in fewer launches. That's fun engineering, but it says little about whether forward-only learning scales. And 4.2 is a low bar. It is only 0.33 nats past n-gram statistics. Track 1 (lowest val loss within 1 epoch) now edges past the backprop + Adam reference on loss (3.722 vs 3.769), but it needs 82 minutes on 8×H100 to get there. Matching backprop's loss is possible today; matching its efficiency isn't really close (yet?).
Replacing backprop with zeroth-order optimization is inevitable. Introducing Noise: a speedrun for pretraining without backprop. Last week we presented Dust, the first method to approach backprop with SGD for pretraining transformers. We think another 1,000x improvement on top of it is possible, and it will require *co-designing* credit assignment, optimizers, architectures, and eventually, hardware. We built Noise to iterate on this faster.
7
7
83
3,795
Tensor-Slayer retweeted
Inference Gross Margins - 87.76% to 96.94% Assumptions: 97% cached input, 2% uncached input and 1% output tokens Prefill: 80k uncached input tokens/s/GPU. Decode: 16k output tokens/s/GPU (250 tokens/s/user) Token mix: 970M cached input + 20M uncached input + 10M output per billion total tokens. It takes around 875 GPU seconds (250 for prefill & 625 for decode) to process 20M uncached input + 10M output tokens. Assuming GPU rental cost is around $3-$6/hr, the GPU system cost per billion tokens is around $0.73-$1.46 1B tokens generate $11.91 in revenue at off-peak prices and $23.82 at peak prices At off-peak prices, inference margins are between 87.76%-93.88% depending on the GPU rental cost ($3-$6/hr) At peak prices, inference margins are between 93.88%-96.94% depending on the GPU rental cost ($3-$6/hr)
32
63
24
717
147,283
Tensor-Slayer retweeted
LLM Writing is limited by semantic understanding. I wrote about it in my blog. This is the first essay in a series on LLMs and writing quality. The link is in the next tweet.
3
1
2
24
1,479
Tensor-Slayer retweeted
DeepSeek V4.1 Flash 1017 everyone's talking about it for a reason. It does great with 3d built this honeybee on a sunflower like it was nothing. Used Deepseek Harness, 1 turn, looks so good!
56
54
11
1,203
43,787
Tensor-Slayer retweeted
i was blown away by the naturalness of bulbul v4 when i first saw the demo at epoch a couple months ago we're launching v4 flash today and bulbul v4 pro to follow soon!
Today, we're introducing Bulbul V4 Flash, our latest text to speech model built for natural, expressive speech across Indian languages. Flash brings frontier-quality speech into a smaller, more efficient model, preserving the subtle details that make voices sound natural while making speech generation significantly faster. See details in our blog: links.sarvam.io/siuhmS
2
1
54
1,167
Tensor-Slayer retweeted
Can AI agents do interpretability research? At @PrimeIntellect Residency program, we built BioCircuit, an RL environment where agents trace attribution graphs on Qwen3-4B, find the features behind a concept and get graded by intervening on prompts they've never seen. Link : amitprakash.in/biocircuit/
10
26
2
196
12,689
Tensor-Slayer retweeted
My agent kept breaking in prod, and every fix I wrote broke something else. So I stopped writing the fixes. Now production failures become Harbor tasks, an RLM makes eval-driven reflections and GEPA optimizes the agent. Here's the whole flywheel:
7
3
1
7
1,662
LoRAs Trainer 😎 on consumer GPUs -for Min 8Gbs VRAMs -one install, one launcher, NF4 models. -for the latest image and video models on consumer NVIDIA GPUs -supported Qwen-Image 2.1, Krea 2, Z-Image, Anima, Klein9B, LTX-2.3 and MiniMax-H3 github.com/AcademiaSD/Academ…
3
33
361
15,072
Tensor-Slayer retweeted
I did promise you local model inside of ChatGPT! Point your LLM at this to have it configure itself One half of the repo is a proxy needed (could just be one host somewhere), the other half is the per-machine changes needed to your ChatGPT config github.com/muellerzr/local-c…
11
8
2
51
5,369
Tensor-Slayer retweeted
The same model, with the same weights, scores 62% in one agent harness and 33% in another. @adithya_s_k and the @huggingface team just released the ultimate guide to multi-harness RL, and it's one of the most practical RL write-ups this year, and everything open! The trick is simple. Don't touch the harness. Point it at a proxy instead of the model. The proxy speaks all four API formats coding agents use (OpenAI Chat Completions, OpenAI Responses, Anthropic Messages, Gemini). It records the exact token ids and logprobs vLLM sampled, and you train on that. You don't change a single line of Claude Code, Codex or OpenCode. Results: 🔹 Trained across 4 harnesses at once, LFM2.5-2.6B by @liquidai went from 42% to 54% 🔹 31% fewer tool calls, thanks to a small bonus for solving tasks in fewer steps 🔹 Training in OpenCode alone took OpenCode from 34% to 58%, but the multi-harness model improved everywhere They also tried the shortcut everyone reaches for: fine-tune on 3,189 successful rollouts from Qwen3.8-27B. Imitation plateaued at 47.5%, below both RL runs. Copying a bigger model doesn't get you there. Practice does. The best part is that everything is open: the capture proxy in OpenEnv, the trainer in TRL, the tasks, the SFT data, the training code and all seven trained models. Agents will run in dozens of harnesses. Now open models can be trained for each of them, by anyone. Read it here 👇 huggingface.co/spaces/FineEn…
196
161
77
1,244
139,333
Tensor-Slayer retweeted
Decision models now run on device in llama.cpp. Free, fast, private! llama serve -hf ggml-org/Kev-4B-GGUF
82
120
9
1,369
63,257
Tensor-Slayer retweeted
smells of "640kb of RAM ought to be enough for anybody"
I have been using Opus 5.5 since it came out. It is the best coding model I have ever used. If someone burns those weights into a chip, I’ll buy and use it for the rest of my life. I don’t need an upgrade after this.
26
26
1
1,895
101,771
Tensor-Slayer retweeted
happy to share that one of my papers from my time at @MSFTResearch got accepted at two NeurIPS workshops!! We study the effects of privileged information and how it breaks self distillation(TL;DR OPSD doesn't work well) work done in collaboration with Sarthak and @yashpandya96 🫡
19
6
1
203
5,130
Chinarxiv.org update! I fixed a bug in my pipeline and 1400+ new papers are live, with about ~1500 more coming in the next day! Check it out.
1
7
48
1,387
Tensor-Slayer retweeted
Replying to @Keleesssss
DSPy is one such language specifically tailored to functions with natural language based operations. DSPy is built around a “signature” which has inputs and outputs and a natural language specification of the task. Then we provide structure to define what “good” looks like, and optimize the implementation underneath this function signature. Here, rather than strictly unit tests as is usually done in swe, we use a dataset/eval. At first, we would only optimize the few shot examples of any of these functions, but as language models have gotten better we have moved to optimizing the prompts and now the code which completes your signature. You might like a blog from @michaelnisaac on the Module which lets you learn code, DSPy.flex cmpnd.ai/blog/let-the-model-…
1
6
33
1,394
Tensor-Slayer retweeted
GPT-6.1-Sol
18
20
9
587
99,359
Tensor-Slayer retweeted
Since I went into this release: *It's a smaller selection of 989 envs used to RL a 9B distilled model, not the big MiMo. *Rewards are not self-contained: general part need to set up a judge and webdev rely on their own grader service+vlm. *Most important part is inside general/envs directory (+ docker), not the dataset displayed on hf: genuinely solid mix of real/simulated documents we rarely see in OSS.
Wake up, ppl 👀 Xiaomi just open-sourced ~7K of the RL environments it used to train MiMo on HuggingFace, across domains like code, cyber, general, music and web dev I think this is one of the biggest things to happen in frontier open-source RL environment data. Indepth analysis and learnings coming soon 👀
13
17
1
242
17,729
Tensor-Slayer retweeted
Too many things are happening around Jev. A new ecosystem has already emerged and a big bunch of new papers published during last week. It's getting increasingly hard to keep up. So, I did what I did before 😼 Here I’ve made an attempt to do a holistic review. This is not a single-paper review, this is “deep research”-style analysis combined with multi-review. Maybe not perfect, but it helps me. Maybe it will help you as well. Let me know what do you think about this format. arxiviq.substack.com/p/jev-a…
5
39
1,899
DSPy 3.4.0 was just released! This release includes native support for Jev and System one models inside of DSPy! Use it with compatible signatures. This release also includes a brand new optimizer, ReAnchor, specifically for calibrating outputs with confidence.
35
77
28
504
143,782
Tensor-Slayer retweeted
Okay so I was hoping to push a blog or two out before this happens. Lobster too buttery, steak too juicy. Both overwhelmed by the support and a ~hair~ nervous but just know I’ll always talk about what I find interesting and have learned. Good and the bad.
Wait, why is Zach not monetized? This guy actually posts real alpha, gives free GPUs credits to people doing interesting work / doesn’t beg for money, and actually does his homework before he talks so it’s not nonsense or stolen Go follow this guy and give him some views
2
1
33
2,017