cyberhandcrafting boltwright /// byteslinger humbly serving atomwranglers /// prev cofounded @pulley and grew it to $15M ARR /// by all means build
Calgary
Joined December 2008
- Tweets5.9K
- Following2.2K
- Followers1.5K
- Likes60.3K
mark erdmann retweeted
Nice DeepSWE score! Does it survive a lowercase filename?
Introducing MaxxBench: 89 DeepSWE tasks with small changes to the instructions or starting code. Same engineering problem, slightly different requirement.
Models clustered around 74% on DeepSWE end up 23 pp apart.
Good at coding, or good at DeepSWE? 🧵
seriously nikita what are you on about, alberta is the obvious choice. if the servers get hot just crack a window bud
2
185
mark erdmann retweeted
It’s similar to the economics of gym memberships. They depend on the fact that most people don’t use all their usage each week.
mark erdmann retweeted
Oh my God! This looks like a very solid investigation, a one-tweet summary by me would be inappropriate, go read the thread!
My previously very high opinion of Kimi/Moonshot is in freefall right now. They need to answer and blame a rogue intern or something.
Kimi K3.1 recalls instructions it was never given on Terminal Bench. They match the hidden tests. K3.1 while solving: "Instructions likely distilled pitfalls from previous agents." 🤯
When we edit a task to contradict them, K3.1 refuses the new instructions and fails. Other models follow the edit.
Is it terminal(ly) benchmaxxed? 🧵
mark erdmann retweeted
So my friends I do not believe the MIT paper about LLMs understanding / writing weights was bad science. It is impressive and it is something you may want to explore. However the first set of tests, the game recognition of the tests, it looked like too straightforward... 1/N
mark erdmann retweeted
I did a little 'Overthinking Bench' - you ask a simple question such as 'How are you?' and see how many thinking tokens they spend.
Run at the lowest and highest thinking available, 5x runs each. You can rank in various ways - I did by total tokens.
is it ironic that everyone is suddenly saying "i told you so - private jets are insanely dangerous" as if they've been warning us for years
and meanwhile they will all jump into a car without thinking twice 😂
79
gtk
This is simultaneously very cool but also a bit exaggerated. Reading the prompt you gave, the prompt veeery much hints that looping is the issue and to find neurons that fix this. And as you say (screenshot below), it couldn't otherwise improve math.
So your project and website are great, but the tweet is a bit of a bait. But it worked, i read the full page including prompts 😄
88
easy explanation: this is the latest in a series of posts where elon attempts to pop the ai bubble just as his competitors file their S-1s 😉
teapaw.org/elonmusk/status/211443…
For a company worth $2 trillion, they’re not willing to eat the loss to keep the lead in the biggest TAM in human history?
Something’s not adding up.
1
169
mark erdmann retweeted
I've started asking ChatGPT to write the most unhinged replies to every AI-generated cold email I get, and honestly, it's low-key my favorite part of the day.
I don't edit them. I just send as is every time.
astonishing result in this paper. it's like if a neurosurgeon understood what each neuron was for while operating on you.
kinda makes you wonder what would happen if you gave astra access to a TMS machine pointed at your head and asked it to make you smarter. 😏
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-sp…
github.com/RikiyaT/lm_und…
huggingface.co/Qwen/Qwen3.5-0…
huggingface.co/RikiyaT/Qwen3.…
1
41
openai is holding fast so they can drop a megamodel the day of the anthropic ipo 😉
don't shoot until you see the whites of their eyes
1
1
110
mark erdmann retweeted
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains.
GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
mark erdmann retweeted
I just talked to a tool vendor that's been selling tools for 35 years he said he's never seen the field so dry the technical talent is drying completely up
Every single shop is hiring Machinists, programmers, maintenance technicians.
At this point you can pretty much we walk in and set your price
mark erdmann retweeted
Day 25/
We are doubling all usage limits for all Pro 100/200/500 tiers and Business Premium, effective today.
We heard your kind feedback and won’t be reducing usage limits for Pro 200, so your Work and Codex usage will stay the same. We’re also going to continue offering extended limits for dots for now, and usage of your dot will still continue to be separate from your default usage.
And we'll of course also keep shipping better models and other efficiency improvements that increase your effective usage over time.
The limits of my language are the limits of my world
AI is a lever
I think the same is true of creative fields, like I see artists really worrying about AI
but I wish so badly that I could sketch animation ideas and character concepts for my agent to flesh out instead of trying to find examples
I don't have the language!
3
100