
DPhil student at @UniofOxford.
Oxford, U.K.
Joined January 2023
- Tweets321
- Following518
- Followers163
- Likes12.6K
Pinned Tweet
1/n 🧵
Model evaluation is often bottlenecked by labelling cost. Active testing estimates a model's risk from far fewer labels, yet existing methods overlook a now-common resource: cheap predictions from powerful black-box models.
We address this with PPAT.
Kia retweeted
No one changes the world alone
Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models
Available to everyone through our API
arXiv has updated our policy on rate limiting for all submitters.
This update was made to fairly distribute moderator time & support the arXiv community of staff, volunteers, readers & authors.
Please read our announcement to learn more: blog.arxiv.org/2026/10/01/up…
Kia retweeted
🔥Welcome 🔺Simplex Diffusion Models🔻!
Standard discrete diffusion models suffer from "information collapse" because they discard uncertainty at intermediate steps by sampling categorical tokens. (1/5)
Kia retweeted
Students sometimes ask me if it still makes sense, in this accelerating age, to pursue a PhD in AI.
Perhaps counterintuitively, I think it's a great time to do so.
I wrote up some thoughts on this here: web.mit.edu/phillipi/www/wri…
Happy to share that PPAT has now been accepted to #NeurIPS2026! See you guys in Sydney/Paris.
yemen is in an ongoing famine right now and Facebook censored it, contributing to one of the worst humanitarian crises ever
but interesting Alexandr chooses to joke about this in particular. human suffering probably not top of mind for Meta
Kia retweeted
Looks like we have over 500 submissions to ICLR this year.
openreview.net/group?id=ICLR…
Kia retweeted
ICLR limited first-time authors to just one submission this cycle. I've gotten multiple emails now to be added as an author on papers purely to bypass this limit. Senior authors were already added to papers purely for prestige; the rate of paper laundering is going to go up.
TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity
Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission?
medium.com/@TmlrOrg/asking-a…
Kia retweeted
Thanks! 😀 Indeed, I solved neural self-reference (NS) in 1993 [1][2].
[1] JS. A self-referential weight matrix. ICANN 1993, Amsterdam, p 446-451
[2] K. Irie, I. Schlag, R. Csordas, JS. A Modern Self-Referential Weight Matrix That Learns to Modify Itself. ICML 2022
Kia retweeted
#AISTATS 2027 Call for Paper is out!
This year's edition is taking place in Montreal on May 3-6th, 2027 🇨🇦
Aymeric Dieuleveut and I are chairing
virtual.aistats.org/Conferen…
New this year: AI review, and more!
Abstract deadline: September 29, 2026
Paper deadline: October 6, 2026
GPT-6 Astra has the best result yet on the Bach Benchmark. Its chorale contains no voice-leading errors, and its harmonic palette is sophisticated enough to include a Neapolitan sixth chord. More importantly, it is the first model to ever write passing tones on this benchmark, a significant leap in musical understanding.
Extra High effort. Prompt below:
“In LilyPond (version 2.24), write a 4-part chorale in the style of Bach, 3/4 time, G minor. Use two staves -- soprano and alto on the top staff, tenor and bass on the bottom staff. Respond with only the code block.”
Kia retweeted
Diffusion LLMs have two limitations relative to AR models:
(1) Lower quality, and
(2) Slower inference at large batch sizes.
We address this "Uno"
> Retains the AR architecture of LLMs
> Each layer has two sets of weights: AR weights and Diffusion weights
> Diffusion weights enable parallel sampling from the AR distribution losslessly
Results:
💥Faster than all speculative decoding methods: DFlash and EAGLE-3
🔥 Beats ALL diffusion LLMs: Mercury 2, Diffusion Gemma, Llada
Links to the paper, models, code below
Kia retweeted
“Why did ANOVA fall out of fashion?”
statmodeling.stat.columbia.e…
Kia retweeted
Generative models can’t discover what they can’t reach.
We’re excited to introduce ActFlow: a continued pre-training scheme that actively expands the valid design space reachable by flow and diffusion models. We call this generable set expansion — a new learning principle for out-of-distribution generative modeling, and a step toward evolvable search spaces for scientific discovery. (1/5)
Kia retweeted
New blog post: continuous diffusion for language is back!
This research direction receded into the background for a while, but as of this year, it is once again a hot topic. I wrote down a historical perspective and some thoughts on the recent revival.
sander.ai/2026/08/24/continu…






























