Director of the Center for the Advancement of Progress

Ho-Chunk land
Joined April 2009
Introducing H-JEPA: the first end-to-end learned hierarchical world model for long-horizon visual planning! Built atop SIGReg/LeWM, H-JEPA provides a stable training recipe where semantic abstractions naturally emerge across levels... Paper+Code: arxiv.org/abs/2610.06805 🧵👇
19
78
12
584
41,453
Agree with this!
It sounds insane, because we're used to a particular way of doing research: of giving and receiving credit, of counting beans, of hiring, recruiting, and promoting. And the machine god came to crush that game. The old game is dead. That reasonably causes incredible amounts of dread for many folks, who understand this as the death of research. But it's not about Research, but the way we played the game. The old game was built around scarcity, scarce compute, scarce students, scarce hours, scarce people who knew the right technique and method etc. Most of a research career went into managing and playing along these constraints. Those walls just came crushing down. One person with a good question can now do what used to take a lab and five years. You do not need permission, you do not need a big grant, you do not need a professor or researcher title, or a team of twenty experts , or one thousand gpus to stare straight into the first light of the universe. How absolutely incredible
8
663
Excited to share that our Raon-SpeechChat is now on Artificial Analysis! 🔥 It is the first open-source full-duplex model landed in the "Most Attractive Quadrant"!! 🥇 #1 in Speech Reasoning (57.5%) 🥈 #2 in Conversational Dynamics (86.2%) Huge thanks to everyone on the team who made this possible! 📊 Benchmark: artificialanalysis.ai/speech… 🤗 Model: huggingface.co/KRAFTON/Raon-… 💻 Code: github.com/krafton-ai/Raon-S… For those interested in the broader Raon series, here are two more of our open-source SpeechLMs: 🔷 A.X K2 Raon-Speech: developed as part of Korea's national Sovereign AI Foundation Model initiative with SK Telecom, building on the A.X K2 Light backbone with KRAFTON AI's independently trained speech encoder and codec. It ranked #1 in Korean and #3 in English in our evaluation, and reached #1 on Hugging Face Any-to-Any Trending after release. huggingface.co/KRAFTON/A.X-K… 🔷 Raon-Speech-9B: our first open-source 9B Korean/English SpeechLM, integrating speech understanding and generation in a single model. huggingface.co/KRAFTON/Raon-… 🤗 Explore the full Raon series: huggingface.co/collections/K… #SpeechAI #FullDuplex #SpeechLanguageModel #OpenSource
1
6
2
48
2,089
This looks like a fantastic workshop!
Our 4th world modeling workshop will be looking at *Physics*! Happening at the Aspen Center for Physics end of February (wmw-aspen.github.io) If you are interested in presenting, submit your abstract here: docs.google.com/forms/d/e/1F… Deadline on October 9th, 1 page Abstract!
1
541
Me: Please implement todos. Astra: Working on it. Me: why is latex taking infinite time? Astra: The apparent infinite compilation was caused by an accidental recursive \newcommand{\E}{\E}. [Context: Astra introduced this] -- This is where AI is today. Report from the trenches.
3
1
54
4,924
Great advice! You should also have a version you can use to explain to everyday people
I’m a professor in the US, where I lead an AI research group. This is my series on PhD. Tip: Learn to explain your research without slides. If you can get another scientist/researcher interested in your problem during a 2-minute coffee conversation, conferences become much more useful.
1
11
1,645
This is my favorite demo how useful a robot can be just with a good harness design + models co-trained with our harness. Tools given to the robot are 1) manipulation (via an action model) 2) locomotion 3) speeking to a person
Excited to share Ludi₀.₁! Ludi₀.₁ is an agentic humanoid system that integrates real-time dialogue, social reasoning, memory, perception, navigation, and manipulation, while allowing a person to interrupt and redirect the robot during ongoing behavior.
3
7
3
91
22,363
Attended a talk today about the possibilitiy of AI systems having qualia, such as pain or pleasure. Reminded me of the great novel “Blindsight” by Peter Watts, that considered whether consciousness is necessary for intelligence. Maybe we already have our answer?
3
14
2,210
Please share widely. The UW–Madison ECE Department is recruiting at the assistant, associate, or full professor in foundational AI and machine learning tinyurl.com/4kwh8mvm
2
42
2
100
21,285
This is incredible: In a blistering dismantling of HHS Secretary RFK Jr., Sen. Warnock noted that we're seeing child deaths from measles for the 1st time in decades. "You are a hazard to the health of the American people." Make sure everyone sees this.
349
2,213
48
6,634
96,054
Congratulations, Jifan. Working with you has been super rewarding! I can't wait to see what you accomplish next.
Defended my PhD yesterday! I wrote a blogpost that distilled my research into a single takeaway (in 🧵) Thank you @rdnowak for the amazing four years. Now that I see it, he truly has the magic potion that helped so many of his students turn into great researchers.
22
2,707
Mine is sold out, but you can have this hot guy instead.
1
7
700
Congratulations, Sharon!
It’s official: I got my tenure! Immensely grateful to my colleagues, students, friends, and family who have supported me on this journey. On, Wisconsin!
1
11
1,273
Looking forward to seeing folks tomorrow afternoon!
Working in active learning, I often hear a common complaint — active learning doesn’t work sometimes. Our ICML 2025 paper JUST WORKS* when you have class imbalance. @rdnowak will present it Tuesday afternoon. Short 🧵below Paper: arxiv.org/abs/2312.09196
4
18
1,917
... although we don't know if Grok 4 is consulting with the boss to dominate HumorBench, techcrunch.com/2025/07/10/gr… :)
Releasing HumorBench today. Grok 4 is🥇 on this uncontaminated, non-STEM humor reasoning benchmark. 🫡🫡@xai Here are couple things I find surprising👇 1. this benchmark yields an almost perfect rank correlation with ARC-AGI. Yet the task of reasoning about New Yorker style cartoons/captions can’t be more different from tasks in ARC. 2. LLMs trained purely on STEM data does improve capability in non-STEM humor reasoning. Project page: reubennarad.github.io/Humor-… Paper: reubennarad.github.io/Humor-…
1
4
1,222
Surprising to also see how STEM fine-tuning transfers to reasoning about humor and jokes!
Whoa... Grok 4 beats o3 on our never-released benchmark: HumorBench, a non-STEM reasoning benchmark that measures humor comprehension. The task is simple: given a New Yorker Caption Contest cartoon and caption, explain the joke.
5
716