Been Kim retweeted
When an LLM is underperforming, we tweak the prompt. Why not do the same for video models solving visual reasoning tasks?
Visual prompt engineering changes the start frame appearance but not the task, improving performance.
📄 arxiv.org/pdf/2607.25537
🌐 visual-prompt-engineering.gi…
Been Kim retweeted
The program for the #ICLR2026 Workshop "From Human Cognition to AI Reasoning" is now available. We have a fantastic lineup of talks.
🔗 hc-air.github.io/hcair26
Invited Speakers: @DocRachidAlami, @_beenkim, @ced_zhang
Co-Organizers: @julie_a_shah, @sarath_ssreedh, @si_tulli
Been Kim retweeted
Safety-oriented interpretability researchers should be focused on AI systems, not individual model artifacts. A snippet from the NeurIPS CogInterp workshop panel on Sunday:
Been Kim retweeted
This post seems to describe substantially the same view that I offer here:
web.stanford.edu/~cgpotts/bl…
Why are people describing the GDM post as concluding that mech-interp is a failed project? Is it the renaming of the field and constant talk of "pivoting"?
Been Kim retweeted
🔥 Proactive Co-Creator is officially LIVE in @GoogleAIStudio!
Stop guessing prompts. Start collaborating. Use it now to remix ideas and generate images, stories, and video with an AI that proactively helps you create.
🔗 Try it here: aistudio.google.com/apps/bun…
📍 At #NeurIPS2025? Come see the live demo TODAY (Dec 3) 9AM - 1:30PM | Google Booth #1533 (Kiosk 3)
🧠 Our research @GoogleDeepMind : We’re turning theory into practice. Read the papers behind the tech:
Concept Edits (Tech Report): storage.googleapis.com/conce…
Proactive Agents (ICML 25'): arxiv.org/abs/2412.06771
QuestBench (NeurIPS 25'): arxiv.org/abs/2503.22674
Been Kim retweeted
Awesome @NeurIPSConf keynote this morning by @YejinChoinka on The Art of (Artificial) Reasoning – and her broader thoughts and wishes on the future of Artificial Intelligence
neurips.cc/virtual/2025/invi…
Been Kim retweeted
Students in the US (and many other countries) can get their hands on all the Gemini 3 Pro goodness for free!
Been Kim retweeted
great overview of the approaches to and promise of interpretability by @_beenkim and @NeelNanda5
aipolicyperspectives.com/p/e…
Been Kim retweeted
Simply outstanding. One of the most remarkable things I've seen this year. Please visit the project page and prepare to be amazed.
I always suspected video models (which can also be easily controlled as shown by Genie) were the basis for significant robotics advances. Now I'm even more convinced. The intuition is simple: If you can image it, you can control it. Some refer to this as MPC.
Replying to @PaulVicol
🚀 All this and more in our paper!
arXiv: arxiv.org/abs/2509.20328
Project page: video-zero-shot.github.io/
By @thwiedemer, Yuxuan Li, @PaulVicol, @shaneguML, @nmatares, @kswersk, @_beenkim, @priyankjaini, and Robert Geirhos.
Been Kim retweeted
Title: Advice for a young investigator in the first and last days of the Anthropocene
Abstract: Within just a few years, it is likely that we will create AI systems that outperform the best humans on all intellectual tasks. This will have implications for your research and career! I will give practical advice, and concrete criteria to consider, when choosing research projects, and making professional decisions, in these last few years before AGI.
This is my current go-to academic talk. It's mostly targeted at early career scientists. It gets diverse and strong reactions. Let's try it here. Posting slides with speaker notes...
--
The title is a play on a very opinionated and pragmatic book by the nobel prize winner ramon y cajal, who is one of the founders of modern neuroscience.
To get you in the right mindset, on the right we have a plot of GDP vs time.
That is you, standing precariously on the top of that curve.
You are thinking to yourself -- I live in a pretty normal world.
Some things are going to change, but the future is going to look mostly like a linear extrapolation of the present.
And the plot should suggest that this may not be the right perspective on the future.
This plot by the way looks surprisingly similar even if you plot it on a log scale. We didn't stabilize on our current rate of growth until around 1950.
Been Kim retweeted
🚨 DeepMind finally dropped the Veo3 paper which shows what we all realize from playing with video-gen models.
Just like LLMs, visual reasoning on is an emergent property of training on tons of video. It can solve tasks not explicitly in training data.
"Veo 3 is the GPT-3 moment for visual reasoning"
Been Kim retweeted
🚀 All this and more in our paper!
arXiv: arxiv.org/abs/2509.20328
Project page: video-zero-shot.github.io/
By @thwiedemer, Yuxuan Li, @PaulVicol, @shaneguML, @nmatares, @kswersk, @_beenkim, @priyankjaini, and Robert Geirhos.
Been Kim retweeted
Are we experiencing a 'GPT moment' in vision?
Super excited to demonstrate the generality with which current video models can solve tasks from simple perception to visual reasoning!
🌐 video-zero-shot.github.io
Could video models be the path to general visual intelligence?
In our new paper, we show that Veo3 has emergent zero-shot capabilities, solving complex tasks across the vision stack.
Project page: video-zero-shot.github.io/
Paper: arxiv.org/abs/2509.20328
🧵👇🏻
Been Kim retweeted
Join us September 25 for a discussion with @_beenkim, Senior Staff Research Scientist at @GoogleDeepMind DeepMind, to explore new approaches to interpretability - from recent advancements to the challenges ahead as AI becomes more powerful. luma.com/jjbk6ndd
Been Kim retweeted
The one and only @_beenkim on Agentic Interpretability and Neologism: What LLMs Can Offer Us!
Been Kim retweeted
Come chat with me at our ICML poster about interpretability as a communication problem, and the need to derive new words for referencing language model concepts!
4:30PM-7, East Exhibition Hall A-B #E-500
We Can’t Understand AI Using our Existing Vocabulary
Understanding and control are two sides of the problem of communicating differing concepts between humans and machines.
New position paper: Robert Geirhos, @_beenkim, and I argue we must develop neologisms - new words - for human and machine concepts to understand and control AI
Been Kim retweeted
Join us at 09:10 for Been’s talk on Agentic Interpretability and Neologism: what LLMs can offer us.
Going to #ICML2025 tomorrow - Sat morning! If you are graduating this year with a PhD, and you are interested in Google DeepMind, send me a message.
Where I will be:
0. Wed 1pm @WiMLworkshop Mentoring Table and 2pm panel discussion
1. Wed 4:30pm East Exhibition Hall A-B #E-500 "Position: We Can’t Understand AI Using our Existing Vocabulary"
2. Thurs 11am East Exhibition Hall A-B #E-1107 "Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertainty"
3. Sat 9:10am East Ballroom A: Keynote at Actionable Interpretability
Been Kim retweeted
Say hi 👋to @ziwphd ,@MeeraHahn, @_beenkim, Wenjun Zeng and Rich Galt at #ICML2025 if you're interested in learning more about what we've been cooking on proactive T2I agents @GoogleDeepMind. Schedule 👇
Paper: arxiv.org/abs/2412.06771
Google DeepMind Booth Demo:
🕐 9:30am PDT, Thursday
Poster:
📍East Exhibition Hall A-B #E-1107
🕐 11 AM PDT, Thursday
Excited to see y'all there and show you our findings and our cool prototype! 🚀🚀
Check out our tech report on proactive T2I agents that ask clarification questions to reduce uncertainty!
With this agent, we obtain 2 times higher VQAScore in just 5 turns!🤯 We've open-sourced our agent code powered by #Gemini @GoogleDeepMind! 🚀
Code:github.com/google-deepmind/p…






































