Kianté Brantley (@xkianteb) profile picture

Assistant Professor at Harvard University @KempnerInst and SEAS | Fitness enthusiast | (He/Him/His)

Joined May 2009
Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)Photo by Kianté Brantley (@xkianteb)
Does LLM RL post-training need to be on-policy?
10
44
11
326
114,597
Haha! All day, every day, you always gotta keep the energy high, no matter what!
Many reasons why something may not work. But there's always at least one reason why it will. The only trick that actually matters is to always be high energy. F it we ball
1
4
565
Likewise, there’s nothing better than hanging out with friends and having fun!
At least half of my motivation to go in to work everyday is to hang out with people I think are fun and smart
7
385
Kianté Brantley retweeted
I am looking forward to talking about online reinforcement learning for digital health interventions in the dyadic setting in tomorrow’s Decision, Risk and Operations Seminar at the Columbia Business School!
1
16
585
Yeah, I can relate to this!
After reading AI-written slop, my brain feels so exhausted (or grossed out) that I have to cleanse the palate by reading something written before the invention of the internet.
9
485
Kianté Brantley retweeted
Five Harvard SEAS computer science graduate students—Prashanth Amireddy, Tian (Sunny) Qin, Paula Rodriguez-Diaz, Itai Shapira and Kevin Zhang—have been named 2027 Siebel Scholars. Congratulations! bit.ly/4znRkYj
3
15
2,103
Kianté Brantley retweeted
Long overdue announcement: thrilled to see Sunny Qin @sunnytqin and Paula Rodriguez-Diaz @paularodrid named 2027 Siebel Scholars! 🎉 So proud of these two rising stars. seas.harvard.edu/news/five-p…
3
4
37
2,105
📢✨Excited to announce this year's lineup for the 2026-27 Kempner Seminar Series, which kicks off Oct. 16! Check out the full speaker lineup for what promises to be a great series on the latest research related to natural and artificial intelligence! bit.ly/4j7PeHf
1
9
1,695
Kianté Brantley retweeted
My flight last night was delayed (thanks @Delta!) so I used the 'bonus' time to (finally, after lots of procrastination) put together (i.e. vibe-code) a website for my OT course at @Harvard (CS 2840, Fall '25) dmelis.github.io/otml-course….
3
8
1
104
8,031
Kianté Brantley retweeted
Building Comparative Motivation Profiles with Symmetric Belief Editing will appear at NeurIPS. We refined the methodology and messaging of our performative misalignment work. We are excited to extend this to white-box auditing. by @David00845018 @1700x0 @MinTaywon @JinghuaO via @MATSprogram 1/7
New post: Sycophancy Towards Researchers Drives Performative Misalignment We found no clear evidence that scheming is more valid than sycophancy to explain alignment faking. 🧵
1
5
27
1,714
Kianté Brantley retweeted
Go talk to Nathan. He might even tell you how he crushed the nanogpt speedrun record for a few hours with a new LM head
Attending @COLM_conf this week! I'll be presenting this paper on the softmax - or gradient - bottleneck (Thursday, 4:40pm) My DMs are open if you want to reach out :)
1
17
1,477
Kianté Brantley retweeted
Attending @COLM_conf this week! I'll be presenting this paper on the softmax - or gradient - bottleneck (Thursday, 4:40pm) My DMs are open if you want to reach out :)
🧵New paper: "Lost in Backpropagation: The LM Head is a Gradient Bottleneck" The output layer of LLMs destroys 95-99% of your training signal during backpropagation, and this significantly slows down pretraining 👇
2
8
2
101
7,603
If you're at COLM, be sure to chat with Nathan—he's fantastic!
Attending @COLM_conf this week! I'll be presenting this paper on the softmax - or gradient - bottleneck (Thursday, 4:40pm) My DMs are open if you want to reach out :)
17
1,158
Kianté Brantley retweeted
We'd love your opinion! The quick poll below decides what our @MOSS_workshop panel will debate. Please vote and share! 🌱
Help us shape the panel at MOSS @COLM_conf ! We've put together a quick poll. Questions with the most split opinions will become panel discussion topics. Vote: form.typeform.com/to/UOyzADc… See more info on our website: sites.google.com/view/moss-c…
5
1
22
1,937
Kianté Brantley retweeted
Sampling to Reinforce (srush.github.io/sampling-to-…) An elementary tutorial on sampling w/o randomness with a focus on gaining intuition for variance reduction as the key challenge.
20
47
664
36,867
Kianté Brantley retweeted
Pumped for this!
alright guys I'll have the pleasure this week to interview @mrdrozdov from databricks on all thing retrievals like: - RL for knowledge agents - learning representation program for retrieval - place of harness in all that if you have any questions on retrieval shoot it my way
1
2
32
1,917
I like this goal a lot!
If all computer scientists do is create superhuman AI, we will have failed. Our goal must be to make *humans* smarter. One of my 2026 teaching goals is to teach students to master the difficult art of using AI agents in ways the students get smarter, not dumber. Lesson ideas?
10
1,143
Kianté Brantley retweeted
The Murphy lab welcomes new postdoc Jixin Li, who just finished his PhD at Northeastern!
2
18
780
I think leaning into it was the only way to go!
I'll know we have AGI when food delivery services start offering wine pairings for Chipotle.
3
513
Kianté Brantley retweeted
New work from the lab by Nathan taking on the overall suite training process and usage. Very nice benefits in training compute, and the alignment buys significant gains in speculative decoding
🧵New paper: Matryoshka LM Suites Instead of training all models of a suite independently, we nest them within a single architecture and train the suite in a single run => much less compute, same performance Also allows free distillation, better speculative decoding & more 👇
1
7
42
6,777