up to something prev. yc, pioneer, uchicago
Joined January 2010
- Tweets2.1K
- Following299
- Followers928
- Likes8.1K
This was awesome to help work on. It’s obvious to us that making agentic financial operations more reliable is huge. Feel free to reach out, would love feedback on the benchmark!
We're launching Bank Arena: 52 long-running banking tasks across several banking apps.
We gave frontier computer-use agents a bank to run, from recovering transfers to settling merchant payouts. The median task takes experts ~75 minutes to complete, and the highest-scoring models completed <31% of tasks.
Here's what we found ↓
You have to ask yourself very seriously if what you're working on is ambitious enough/worthy of your time during the singularity.
An internal version of Astra, @OpenAI’s next major model family, solved 10 major open problems in mathematics, quantum complexity, and theoretical computer science.
We believe it will be a major step for scientific reasoning. openai.com/index/ten-advance…
5
1,275
I think if AI impact feels low in daily life, it’s because somehow it’s not superhuman at holistic strategic thinking yet. Many long horizon multivariate decisions it fails noticeably at. Maybe this is just a missing context problem. Maybe it’s an RL problem lol
2
485
.@Cloudflare mcp is great. Very happy I can manage dns, email rules etc. with agents now.
2
8
1,517
most tech jobs are becoming intent encoding (e.g. engineers prompt up better software than non engineers) and work checking (e.g. engineers check generated software better than non engineers)
2
343
It’s weirdly mentally straining going full tilt multiple agents working on multiple projects and learning to trust this kind of process because in the past I steered and validated work by being knee deep in at least the key implementation details. I now use evals and intent files.
1
2
260
Interesting future branch where successive releases get quietly swallowed by national security apparatus and everyone else gets suspiciously asymptotic capability updates
4
386
lol the real issue here is models are increasingly our tertiary cortical layer and it feels invasive when what should be one’s private thoughts are moderated by an outside force. Ofc Anthropic is a company, so this isn’t their obligation to protect against, but again this is why it feels so yucky
1
449
I like to think that Apple, had they a frontier AI lab, would have a much better approach to balancing AI safety with user freedom and privacy.
Claude Fable 5 will be available again globally tomorrow.
After a series of productive conversations with the US government, we're redeploying the model with a new set of classifiers to target and block more cybersecurity tasks. In the near term, some routine tasks like coding and debugging will fall back to Opus 4.8. We’ll continue to refine these classifiers over the coming weeks to reduce false positives and better distinguish genuine misuse from legitimate requests.
We’ve also begun drafting a consensus framework—with Amazon, Microsoft, Google, and other Glasswing partners—for assessing the severity of AI jailbreaks and how AI developers should respond to them. We invite other industry partners and model providers to join us in this effort.
Finally, we’re scaling up our collaboration with the US government on model testing and safeguards. This will include pre-release access to models and safeguards for evaluation, information sharing on jailbreaks and misuse, and dedicated resources for joint research.
Thank you to our users for your patience, and to our partners across the government, industry, and the research community who worked alongside us to make Fable 5 available again.
Read our full blog: anthropic.com/news/redeployi…
4
5
888
If you think about it LLMs make real digitally one of the benefits of a radically longer lifespan, namely skill recall that would otherwise take a big chunk of working life to accrue
220
The model gating and downgrading drama creates this slight paranoia that you’re being big brother watched when using models, which is hopefully enough to spur more frontier alternatives and a stronger personal computing push around ai.
215
The real reason ai capture by certain institutions is even slightly possible is the capex requirement for even attempting to train a frontier model. Enough inertia to prevent most companies/institutions in other countries from even attempting to set up their own labs and enough to prevent frontier model deployment from developing in a distributed, borderless way. Model training competence is more fungible I think.
1
1
200