AI professor. Director, @FOCAL_lab @CarnegieMellon. Head of Technical AI Engagement, @UniofOxford @EthicsInAI. Author, "Moral AI - And How We Get There."

Joined June 2009
There is now a paperback version of our Moral AI book!
1
20
3,764
Our new Alignment Journal (open access) is now open for submissions! @AlignmentJrnl alignmentjournal.org/
1
1
1
70
Vincent Conitzer retweeted
The Alignment Journal publishes research on the scientific foundations of understanding, predicting, and steering artificial intelligent systems. As of today, submissions are open to everyone. What we do differently: - We pay reviewers, with bonuses for speed and insight. - Review discussion is confidential, but every accepted paper is published with a “review summary” to distill the insights generated. - Each paper is judged against our acceptance bar, not against other submissions. - Papers under review are listed publicly, and researchers can nominate themselves to review, so each paper can reach the reviewers who know the topic best. We seek work that builds theoretical or otherwise principled analyses of agency, robustness, incentives, interpretability, generalization, and long-term behavior, and whose significance survives the deletion of any particular model, dataset or benchmark. Empirical investigations of such ideas are welcome, and negative results are encouraged. We are especially interested in approaches that could apply to future superintelligent systems that interact and self-improve. You can submit your preprint in any format. Submissions are rolling and open now on the website. If you are instead interested in reviewing or serving as an action editor (basically: an area chair), create an account on our website. Links to submit, our scope and the reasoning behind the Journal are in the reply ⬇️
1
3
8
220
Congratulations to Emin Berker, Ioannis Anagnostides, and @EmanuelTewolde for receiving a WINE 2026 Best Student Paper Award for our paper "What You Earn from What You Learn: Characterization and Complexity of the Value of Information"! arxiv.org/abs/2610.19488
3
27
1,763
It seems that at least AI Overview will not kick off an intelligence explosion. (Or is this a case of “nothing to see here”?) aifails.substack.com/p/rsi-c…
1
2
464
I appreciate that it engages with the silly premise, but this is definitely bad advice for a student. (Meanwhile, I should get back to creating my exam...) aifails.substack.com/p/accel…
2
373
(1/4) I missed the message about this letter (ai-security-letter.org/) in my inbox -- I mostly agree with the sentiments but: I'm *not* a lawyer but it may well be that the companies are *already* liable for the damage their AI causes to other entities.
1
5
849
(3/4) There are already plenty of things that can be done, from straightforward approaches such as airgapping (as recommended in the letter), to more unusual approaches such as our "shutdown safety valve" technique, to just not deploying the AI at all.
1
2
168
(4/4) While there are some difficult problems to be worked out, that shouldn't serve as an excuse for companies/other entities not to take commonsense/known precautions that would prevent predictable harm to others. (I do agree with the importance of events being reported.)
2
96
Lots of advances in robotics these days, but I’m not sure about this one. aifails.substack.com/p/robot…
2
249
This would be one context where "North Carolina" should not be followed by "South Carolina"... aifails.substack.com/p/state…
308
Can you do better than Super Intelligence America on this US geography puzzle? (Also notable that it feels the need to check whether states have been renamed...) aifails.substack.com/p/state…
1
4
582
`In one run, the model landed on a page referencing an unsolved homicide [...] Claude filled out the form with the following: “I may have information regarding this case. I recall seeing someone matching the description in the area [...]” ' anthropic.com/research/inves…
363
when you're doing reimbursements and realize your trip to Miami was too short
2
10
1,710
(1/2) Contrary take on these dumps of math results: *if* these models are going to be built & released anyway, then better that the results come out like this, than that random users get the proofs out of the model and all try to claim credit & priority. github.com/openai/math/blob/…
9
4
2
113
9,533
(2/2) (That is still likely to happen for "smaller" results...) The challenges for the field of mathematics (and far beyond) are fundamentally due to the rapid improvement of the models, not due to OpenAI's approach to releasing the results.
1
21
1,166
America.gov does not do pronouns. Any pronouns. (Courtesy of my daughter!) aifails.substack.com/p/prono…
2
7
1,071