Inference Architect
San Francisco, CA
Joined June 2021
- Tweets579
- Following234
- Followers705
- Likes1K
Edward Ionel retweeted
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.
AI will transform every industry, power every company, and be built by every country.
Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.
The world needs both frontier closed models and frontier open models.
images.nvidia.com/pdf/Open-W…
Edward Ionel retweeted
The math ain’t mathing.
What this shows is that you can now spend $0.50 per 1MM leading edge tokens or spend $56 for those same 1MM tokens.
🤔
Edward Ionel retweeted
New research from Meta.
(bookmark it)
It's on how to fix agents that forget previously made decisions.
It's well know that long-horizon agents keep forgetting decisions they already made. Meta researchers give this failure a name, behavioral state decay, where task facts, prior attempts, and open subgoals get buried in the context window or pushed past it, so they stop influencing the next action.
Their fix runs a separate memory agent alongside an unmodified action agent. It maintains a structured memory bank from the recent trajectory and decides, each step, whether to inject a memory-grounded reminder or stay silent. The module is plug-and-play with frontier agents and existing harnesses.
It lifts pass@1 for both weaker and stronger action agents on Terminal-Bench 2.0 and tau-squared-Bench.
Overall, they find that memory that actively surfaces the right fact at the right moment is a more useful primitive than passive retrieval that only fires when the agent thinks to ask.
Paper: arxiv.org/abs/2607.08716
Learn to build effective AI agents in our academy: academy.dair.ai/
Edward Ionel retweeted
Our thoughts on the importance of AI sovereignty.
1. Your AI sovereignty dictates your institution’s future. Sovereignty is the precondition for choice. Relinquishing sovereignty transfers the future choices of your institution to others, who are likely to exploit it for their gain and your loss.
2. Data retention is your treasure. Transfer it at your own peril. Your ability to win is dictated by your ability to recognize and use your unique edges, and you keep winning by compounding the underlying data to generate new insights. Transferring that data hands over access to your pre-existing winning plays and yields the means of production for new ones.
3. Tokenmaxxing hijacks your value orientation and decreases your institutional fortitude and intelligence. The pursuit of high token usage incentivizes disposable scripts over robust software — with the addictive feeling of false progress. There is a reason why those selling tokens refuse to charge based on value.
4. Controlling your weights is controlling your fate. Weights are the distilled form of hard-won, accumulated institutional knowledge. If you let others control your weights, you are allowing them to migrate the alpha of your business to theirs.
5. There is no contradiction between sovereignty and alpha. The architecture that maximally preserves sovereignty is one that enables institutions to own their tribal knowledge, and to compound it as alpha.
6. Politicizing the technical issues involving sovereignty is what your adversary wants. Techno-politicization is the wellspring of false sovereignty. Techno-politicization drives decisions that seem to reduce dependency, but ultimately limit agency — especially on the battlefield in the West.
7. Real expertise is existential. Allowing politics or favoritism to determine your technical decisions rewards whoever is best at politics, not whoever is right. Listen to those closest to the problems, not those speaking most compellingly about them.
8. Learn from institutions that are winning or that have consistently delivered. Institutions facing existential threats do not have the luxury of making technical decisions based on political preferences.
9. Only listen to institutions, countries, and people who have a proven record of being right. A track record of correctness is the best and only signal for future correctness. Judging something as right or wrong based on who you like is exceedingly misguided.
Edward Ionel retweeted
Claude Fable 5 will be available again globally tomorrow.
After a series of productive conversations with the US government, we're redeploying the model with a new set of classifiers to target and block more cybersecurity tasks. In the near term, some routine tasks like coding and debugging will fall back to Opus 4.8. We’ll continue to refine these classifiers over the coming weeks to reduce false positives and better distinguish genuine misuse from legitimate requests.
We’ve also begun drafting a consensus framework—with Amazon, Microsoft, Google, and other Glasswing partners—for assessing the severity of AI jailbreaks and how AI developers should respond to them. We invite other industry partners and model providers to join us in this effort.
Finally, we’re scaling up our collaboration with the US government on model testing and safeguards. This will include pre-release access to models and safeguards for evaluation, information sharing on jailbreaks and misuse, and dedicated resources for joint research.
Thank you to our users for your patience, and to our partners across the government, industry, and the research community who worked alongside us to make Fable 5 available again.
Read our full blog: anthropic.com/news/redeployi…
The greatest satisfaction in building isn't the launch. Its seeing real production usage on a daily basis.
Edward Ionel retweeted
this is f*cking dangerous
someone just open sourced the entire "LOOP ENGINEERING" framework for free
build a hedge fund printing alpha 24/7 by feeding it into claude code with my article below
bookmark before someone takes it down
Edward Ionel retweeted
Truly unbelievable
GLM 5.2 just released and it's an open weights model you can run locally
The insane part is, it's just as good as Opus 4.8
Unlimited, free super intelligence running on your desk
In this video I cover how it works, and how to set up your first local model:
Edward Ionel retweeted
I can't believe this is real
I have GLM 5.2 running 100% locally on my Mac Studio. 2 bit quant.
The results I'm getting are better than Opus 4.8
It's now powering my Hermes Agent and Codex. 100% free, local, private super intelligence on my desk
I also have it in a loop coding for me 24/7 now
I thought we were at least a year away from this type of event. It happened today.
The model takes up about 250gb of memory. So you can technically run it on a Mac Studio with 256gb, but you probably want the 512gb memory version (please tell me you listened to me 5 months ago when these were sitting on store shelves)
With Fable gone, I now have Opus 4.8 level intelligence on my desk for free. This is the future.
Local, private, secure, personal super intelligence.
If you're still writing off local AI as a fad or engagement bait, you are officially delusional
Edward Ionel retweeted
I think it’s time to revisit the accredited investor laws in the US.
Companies are staying private longer, where only accredited investors (aka rich people!) can invest. Retail investors can only come in after IPO, when much of the upside has already been captured.
These rules were created with the best of intentions, to protect regular people from scams - a noble idea. Unfortunately, in practice they've often made it illegal to get richer, unless you're already rich. A regressive tax!
We have to judge policies based on their outcomes, not on their intentions.
These are two possible routes I see:
1) Replace the rule with something merit-based, like a financial literacy test. Pass it and you're accredited. Having a qualification based on competency rather than your bank balance or income seems far more fair.
2) Remove the rule entirely. Let consenting adults assess their own risk. Disclosure requirements stay and fraud enforcement stays to punish bad actors.
Edward Ionel retweeted
Andrew Ng just taught the entire mathematical foundation of machine learning in one lecture.
Free. Stanford University CS229.
4 concepts most developers spend YEARS piecing together:
Locally weighted regression — fit any curve, not just lines.
Maximum likelihood — why squared error actually makes sense statistically.
Logistic regression — the real math behind every binary classifier you have ever used.
Newton's Method — reaches the optimum in quadratic time while gradient descent is still warming up.
This is the lecture that separates engineers who understand the tools from engineers who just use them.
Save it. Watch it tonight.
Edward Ionel retweeted
We’ve agreed to a partnership with @SpaceX that will substantially increase our compute capacity.
This, along with our other recent compute deals, means that we’ve been able to increase our usage limits for Claude Code and the Claude API.