Marco lin retweeted
World models are central to intelligence - but how do we actually use them to behave flexibly? We review emerging findings on how the PFC’s inner dynamics translate structured knowledge into action. osf.io/preprints/psyarxiv/j7… 🧵 1/15
Marco lin retweeted
In our recent PNAS work, we showed that a local, biologically plausible learning rule can be designed so that both the neural network and the learning rule itself are "learned." More importantly, this rule always emerges to behave like a generalized gradient descent.
arxiv.org/abs/2412.20018v2
Marco lin retweeted
Can diversity stabilize network dynamics?
Our Science paper, “Disorder-promoted stability,” is now available on arXiv:
arxiv.org/abs/2609.25226
Interactive animation:
montanariarthur.com/animatio…
Many thanks to Arthur Montanari and Pietro Zanin for invaluable contributions.
Nature Neuroscience
Reciprocal connections dynamically build consensus between neocortical areas
nature.com/articles/s41593-0…
Marco lin retweeted
MIT published a brutally honest report on what AI is doing to students.
A committee of professors and students spent five months studying how AI changed learning on campus, and the findings read like a warning to every university on the planet.
Study groups are disappearing. Office hours are emptying out. Problem sets and take-home exams no longer prove anything, because AI can produce credible solutions to almost any written assignment in the undergraduate curriculum. Students who lean on chatbots lose mastery and confidence, and some slip into what the report calls cognitive surrender, reaching for AI at the first hint of struggle.
The numbers are rough. 46 percent of surveyed MIT undergrads use LLMs daily. 90 percent worry about their own overreliance. Undergrads who feel AI makes them replaceable now outnumber those who feel it makes them capable.
The committee's answer surprised me. They refused to fight AI with surveillance. The report calls AI detectors unreliable, says lockdown browsers feel like spying, and warns that policing students builds a classroom atmosphere of mutual distrust.
Instead, MIT wants to rebuild education around the things AI can't replace. That means oral exams, semester portfolios, in-person project work, and a required social component in every subject. The report even floats the idea of rethinking grades entirely, since without a GPA to optimize, much of the incentive to cheat with AI evaporates.
The committee warns professors against replacing undergrad research assistants with AI agents just because they're cheaper, because a university exists to grow people, not output.
The most famous tech school on earth admitted the machines broke its way of teaching. Its answer is more humans, not more software.
Marco lin retweeted
New preprint! Classic Hopfield networks store fixed points, static memories. Real neural circuits combine many oscillatory rhythms at once. Can one network memorize many distinct dynamical attractors? We show: yes, extensively 🌀
🧵👇 arxiv.org/abs/2609.07341
Marco lin retweeted
Check out our latest paper: "The Umwelt Representation Hypothesis: rethinking Universality".
Tl;dr: we argue that representational alignment emerges from overlap in ecological constraints, not convergence to one privileged world model.
cell.com/trends/cognitive-sc…
Marco lin retweeted
Published version:
nature.com/articles/s42254-0…
Full-text access:
rdcu.be/fCDGv
Marco lin retweeted
Intelligence is the ability to find paths through a space of computable functions.
Marco lin retweeted
Finally published:
“Loops all the way up: Recurrency as an implementation-first primitive for consciousness”
There are 200+ theories of consciousness, mostly talking past each other. Despite their differences, most give central stage to one key notion: recurrence 🧠🔁
Marco lin retweeted
High-Dimensional Dynamics in Low-Dimensional Networks link.aps.org/doi/10.1103/79h…
Marco lin retweeted
Final version is out: @LPiolopez @BeneHartl and Chris Fields:
sciencedirect.com/science/ar…
"Remapping and navigation of an embedding space via error minimization: A fundamental organizational principle of cognition in natural and artificial systems"
•Cognition is error-minimizing navigation of actively remapped embedding spaces.
•This mechanism bridges scales and substrates, from subcellular biology to modern AI.
•Agents rewrite embeddings to encode and update constraints, setpoints, and goals.
•Physical 3D space constrains embodied remapping, enforcing coherence and viability.
•Near-critical dynamics enable adaptive remapping without loss of system integrity.
Marco lin retweeted
insane. they distilled american frontier models that haven't even been invented yet. damn chinese
Big news: Kimi-K3 by @Kimi_Moonshot is now #1 in the Frontend Code Arena with 1679 pts, surpassing Claude Fable 5.
This is a 17-place jump from Kimi-k2.6 (#18 -> #1).
In Frontend, Kimi-K3 ranked #1 in 6 of 7 domains: Brand & Marketing, Reference-Based Design, Data & Analytics, Consumer Product, Simulations, and Content Creation Tools, landing #2 only in Gaming behind Fable 5.
The full model weights will be released by July 27.
Congrats to the @Kimi_Moonshot team on this major milestone!
Marco lin retweeted
(1/9) Our book is out this month. Generative AI and Stochastic Thermodynamics: A Tale of Free Energies, with @wellingmax (@cusp_ai + UvA) and @HoldijkLars (@UniofOxford), from Cambridge University Press (@CambridgeUP).
Marco lin retweeted
Seeing a lot recently about whether info theory explains modern AI. This is *exactly* what our epiplexity paper is about. It shows how to resolve paradoxes around DPI, synthetic data, and emergence, by considering computation and structural info: arxiv.org/abs/2601.03220
Marco lin retweeted
No smoking gun, but the preponderance of evidence points to smartphones, not economics, as the culprit for the global drop in fertility:
• In the US and UK, births fell first and fastest in areas that got 4G earliest
• Birth rates were stable in the US, UK and Australia until 2007; in France and Poland until 2009; in Mexico and Indonesia until 2012; in Ghana, Nigeria and Senegal until 2013-15
Each of these inflection points matches local smartphone adoption (see picture).
• The younger the age group, the sharper the drop.
• in-person socialising among young adults is dropping. In SK, by 50% in 20 years
• Sexual dysfunction is higher among heavy social media user
• Effect is largest in culturally traditional societies — Middle East, Latin America, sub-Saharan Africa
• Decline holds across countries hit hard by GFC 2008 and those not hit, fast-growing and not growing.
Excellent again @jburnmurdoch.
ft.com/content/fba35eca-df3a…
Marco lin retweeted
It is the deepest honor to have been joined by Michael Levin (@drmichaellevin), Victoria Klimaj, Zahra Sheikhbahaee (@zah_bah), Dalton Sakthivadivel (@DaltonSakthi), Adeel Razi (@adeelrazi), David Ha (@hardmaru), Nick Hay, Kevin Schmidt, Irina Rish (@irinarish), David Krakauer (@sfiscience), Melanie Mitchell (@MelMitchell1), Samuel Gershman (@gershbrain), and Joshua Tenenbaum in organizing this special issue of the Royal Society’s (@RSocPublishing) Philosophical Transactions A:
“World models, A(G)I, and the Hard problems of life-mind continuity: Toward a unified understanding of natural and artificial intelligence”
royalsocietypublishing.org/r…
This collection was motivated by a question with far reaching implications, ranging from the fundamental nature(s) of mind to choices that may determine the future of our civilization/species: what kinds of world modeling capabilities are likely to be realized by which kinds of minds and what world might we be in with respect to increasingly advanced artificial intelligences?
Will the scaling and refinement of present approaches result in AI with human-like (and beyond) cognitive abilities, or do we need radically different paradigms that more closely follow the principles of natural intelligence? Learning “world models” to predict/compress information may be how biological learners so efficiently learn (to learn) to achieve goals and generalize that knowledge across a broad range of task environments. World models may also be useful for reverse-engineering forms of “System 2” cognition, or the self-reflexive, deliberate, multi-step reasoning associated with cognitive capabilities that may be unique to humans. Predictive models that reflect how the world may be causally modified by actions allow agents to adaptively control their behavior with flexibility and context-sensitivity. Spatiotemporally and causally coherent models of the physical world may not only be the key for creating AIs that we can rely on for real-world deployment, but may even be the (dynamic) core of conscious cognition.
The contributions to this special issue consider the varieties of world models worth modeling from diverse points of view:
Douglas Hofstadter explores whether sufficiently coherent self-referential world modeling could ground meaning, consciousness, and a genuine “I” in future AI systems.
David Krakauer (@sfiscience), Melanie Mitchell (@MelMitchell1), and John Krakauer (@blamlab) examine the principles of emergent intelligence from a complex systems perspective.
Alexander Ku (@alex_y_ku), Declan Campbell, Xuechunzi Bai (@baixuechunzi), Jiayi Geng (@JiayiiGeng), Ryan Liu (@theryanliu), Raja Marjieh (@RajaMarjieh), R. Thomas McCoy (@RTomMcCoy), Andrew Nam, Ilia Sucholutsky (@sucholutsky), Liyi Zhang (@LiyiZhang_Leo), Jian-Qiao Zhu (@JQ_Zhu), and Thomas Griffiths (@cocosci_lab) argue for using the tools of cognitive science to understand and evaluate LLMs across multiple levels of analysis.
Evelina Leivada (@EvelinaLeivada), Gary Marcus (@GaryMarcus), Fritz Günther, and Elliot Murphy (@ElliotMurphy91) test whether LLMs deeply understand language and the “world behind words,” or primarily learn surface statistical regularities.
Pedro Tsividis (@ptsividis), João Loula, Jake Burga, Juan Pablo Rodriguez, Sergio Arnaud, Nate Foss (@_npfoss), Andres Campero, Ajay Subramanian (@ajaysub110), Thomas Pouncy, Samuel Gershman (@gershbrain), and Joshua Tenenbaum introduce a theory-based meta-learning architecture inspired by the remarkable flexibility and efficiency of human cognition.
Eunice Yiu (@eunice_yiu_), Kelsey Allen, Shiry Ginosar (@shiryginosar), and Alison Gopnik (@AlisonGopnik) explore empowerment, controllability, and causal reasoning as means of understanding the remarkable learning abilities of both child and adult minds.
Nadav Amir, Stas Tiomkin, and Angela Langdon investigate how goals shape the structure of experience and how the world modeling abilities of natural intelligences may be inseparable from values.
Vickram Premakumar, Michael Vaiana, Florin Pop (@FlorinPop17), Judd Rosenblatt (@juddrosenblatt), Diogo Schwerz de Lucena, Kirsten Ziman, and Michael Graziano show unexpected benefits of self-modeling as an inductive bias and regularizer for training artificial agents.
Hanlin Zhu, Baihe Huang, and Stuart Russell analyze why model-based reinforcement learning may fundamentally outperform model-free approaches in representational efficiency.
Bradly Alicea (@balicea1), Morgan Hough (@mhough), Amanda Nelson, and Jesse Parent (@JesParent) revisit fundamental cybernetic principles of regulation, adaptation, and world modeling across a wide assortment of complex adaptive systems.
Francesco Sacco (@FrancescoSacco1), Dalton Sakthivadivel (@DaltonSakthi), and Michael Levin explore topological constraints on self-organization and suggest that biological systems maintain long-range coherence in ways that are fundamentally different from current transformer architectures.
Georg Northoff (@NorthoffL), Yasir Catal, and Samira Abbasi examine how biological intelligence may depend on capabilities for flexible “inner time” to ensure adaptive alignment between the dynamics of system and world.
Nicolas Rouleau (@DrNRouleau) and Michael Levin explore whether theories of consciousness generalize beyond brains to unconventional embodiments and living systems more broadly.
Benjamin Lyons and Michael Levin investigate economies and collective intelligence as systems coordinated by “cognitive glues” in the form of shared models of scarcity and value.
Katherine Collins (@katie_m_collins), Umang Bhatt (@umangsbhatt), and Ilia Sucholutsky (@sucholutsky) consider “Rogers’ paradox” to demonstrate ways in which collective learning is impacted by different kinds of human-AI interactions.
Ruairidh Battleday (@RMBattleday) and Samuel Gershman (@gershbrain) distinguish between the “easy” and “hard” problems of science, and describe how while current AI systems demonstrate powerful narrow forms of optimization with respect to well-defined inference-spaces, further developments are needed for achieving capabilities for novel scientific discovery.
Fritz Breithaupt (@FritzBreithaupt) explores narrative world models and the roles of uncertainty and transformative experiences in natural intelligences, suggesting that coherent agency may depend on better understanding human-like meaning-making.
Taken together, these diverse perspectives suggest that while LLMs can clearly learn powerful generative models of language, they likely do so without having world models of sufficient spatiotemporal and causal coherence to achieve human-like reasoning abilities, capacities for generating subjective conscious experiences, or pathways to realizing artificial general superintelligence. However, by further developing world modeling architectures, we may eventually be able to create forms of intelligence that recapitulate the remarkable flexibility and generality of human intelligence. Finally, enhanced (e.g. more coherent/integrated) world models may not only afford expanded capabilities, but could potentially help ensure that increasingly powerful AI systems achieve both inner and outer alignment with human(e) values.
Baudrillardian Pope
Replying to @Pontifex
When simulation becomes the norm, it weakens the human capacity for discernment. As a result, our social bonds close in upon themselves, forming self-referential circuits that no longer expose us to reality. We thus come to live within bubbles, impermeable to one another. Feeling threatened by anyone who is different, we grow unaccustomed to encounter and dialogue. In this way, polarization, conflict, fear and violence spread. What is at stake is not merely the risk of error, but a transformation in our very relationship with truth.
Very Online AI discourse in 2015-2020: highly theoretical, uncertain, conjectures, thought experiments, EA and LW, monoculture apotheosis, concrete problems in AI safety, post-extropians echoes, I Notice I'm Confused, big owl book, AlphaGo, specification gaming, SSC, basilisks, Christiano's IDA, value loading problems, malicious use of AI arxiv, the alignment problem, "solving the technical problem", mesa-optimization, CFAR, acausal trade, quokkas, foom debates, GPT2 too dangerous to release
Very Online AI discourse in 2020-2023: governance becomes a thing, Brussels Effect hypothesis, open source mccarthysm, hallucinations and strawberries, scaling laws, Act I, shoggoths, international governance, SBF, subsequent e/acc ascendency, "TESCREAL", compute thresholds, DAN, waluigis, Kimi, cyborgism, Land, hyperstition, Sydney, simulators and looms, RSPs, websim, RLHF, pause letter, stochastic parrots, deception, BabyGPT, egregores, the Bankless interview
Very Online AI discourse in 2023-2026: pendulum shifts the other way, discourse broadens, situational awareness, national frameworks, 2027, Pliny, Golden Gate, deepseek, memes reach upper normie media, Truth Terminal, "little tech", reasoning models, Dwarkesh, scheming, MechaHitler, 4o, state level bills, sb1047, METR graph, advocacy and activism, IABIED, two more years bro I swear bro, jobs paranoia, Replika, psychosis, code of practice, eVaL aWaReNeSs, Ghibli, model welfare, agents, standards, Moltbook, cyber, slop, Mythos too dangerous to release
Marco lin retweeted
New preprint with @ksk_S.
Another preprint with @MiTiBennett
flame-challenge.authorea.com… The Autopoietic Theorem































