Arthur 👁 (@kroalist) header
Arthur 👁 (@kroalist) profile picture

highly esoteric

Joined January 2013
Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)Photo by Arthur 👁 (@kroalist)
Arthur 👁 retweeted
born too early to explore the stars, born too late to explore the world, born just in time to experience 10 once-in-a-generation black swan events in a single decade during the most important years of your life
44
311
19
4,284
83,979
Arthur 👁 retweeted
Good morning, human civilization was a 10,000 year sociological study conducted by the University of ☡ ☲ ⚟ ⚟ ⛮ to derive a solution to the Riemann Hypothesis. We are now complete with our study. Your universe will shortly be terminated. Thank you for your time and effort.
173
1,619
105
22,030
415,220
Arthur 👁 retweeted
The Riemann Hypothesis has fallen. RH was the singular math result that had been named, in advance, as the obvious coal mine canary for dangerously advanced AI, over the last three decades. The methods used should generalize to "make AI very good at anything you can definitely test", and unfortunately that category includes "make AI better at making AI". This is like a private company announcing they have produced a million tons of 15% enriched uranium. It's not 90% enriched weapons-grade uranium, so you could proclaim the company's output is not immediately deadly right now. The concern is that the process line may generalize, to an extinction-level threat, within the unpredictably immediate future. Forecasters still had Riemann at 2035 one week earlier. This is distinct from earlier events in that earlier you could reasonably ask if AI was selectively picking off famous math problems that turned out to be easier for AI. The Riemann Hypothesis was the single challenge most often named in advance as a warning sign.
285
648
193
6,197
830,416
Arthur 👁 retweeted
Researchers have used reinforcement learning to teach a 5-tonne John Deere skid-steer loader to perform complex acrobatic manoeuvres autonomously. Trained in simulation and transferred to a real machine, the system can balance on two wheels, navigate rough terrain, spin, and control its bucket before landing safely. The research demonstrates the potential of AI-driven automation for heavy construction and industrial machinery. Video Credit: @leggedrobotics / @ETH Paper: wevlv.co/4kltYys #engineering #technology
395
1,351
870
13,681
2,133,976
Arthur 👁 retweeted
In my ongoing quest to find the limits of Opus 5.5, I directed it to audit my old scientific field, theoretical astrophysics. We indexed about 150,000 papers, audited 50,000 for issues, and did progressively more thorough checks on thousands more. We found nearly 1000 major errors that got cited many times, most are still uncorrected. This survey enabled me to estimate the efficacy of peer review for correcting errors (not very good) and to identify dozens of open questions that anyone with spare Claude Max tokens could answer today (.md context files included). Bottom line: AI can speed up quantitative science by >1000x with no further model improvement required. But I'm seeing no evidence of this being pushed within universities, only academics complaining about labs dropping math proofs. Among my fellow reformed academic high agency founders, however, several are speed running entire disciplines. This survey has implications for how science will be run in the very near future. Hint: Academic publishing is dead. It was already a very stupid way to record and promulgate knowledge, and had been so for decades, even before all that publicly funded knowledge was locked behind paywall cartels. Now AIs can generate thousands of novel, correct papers per day, it is no longer meaningful for humans to consider a research paper a "unit of science" or to even bother much with the 99.9% of science which, up to this point, was necessary drudgery. Time to discover something like General Relativity or Evolution every week. LFG!! Enjoy: science.caseyhandmer.com/phy…
474
1,313
330
10,469
820,437
You had to see the writing on the wall during the dwarkesh podcast itw
The story keeps getting crazier. To recap everything that has been reported so far: - The US intelligence community discovered that Jensen Huang, the CEO of the largest company in the world, was sleeping with Alice Huang, a Chinese spy and an executive at Megaspeed. (FT) - Multiple independent investigations have concluded that Megaspeed is likely a Chinese cutout, which helps Chinese companies access AI chips or circumvent export controls. (NYT and Bloomberg) - The US intelligence community also concluded that Alice Huang’s goal was to convince Jensen to lobby the U.S. government to loosen export controls on advanced AI chips. (NYT) - The intelligence community relayed this information to “a small group of top US government officials” earlier this year. (FT) - Over the last year, Jensen Huang has repeatedly lobbied the U.S. government to loosen export controls on advanced chips. @BISgov has done so, not only by permitting the export of H200 chips to China, but also not enforcing export controls that would have required a license for exports of the most advanced Blackwell chips to Megaspeed and Southeast Asia. - Although @CommerceGov leadership was presumably briefed on this information by the U.S. intelligence community, @BISgov has taken no actions to tighten controls on Megaspeed or Southeast Asia. - Megaspeed remains a preferred cloud partner of Nvidia, and continues to receive Nvidia Blackwell chips despite employing a Chinese spy who reportedly is romantically engaged with the CEO of Nvidia. - Tens of billions of dollars worth of AI chips have been exported to Southeast Asia this year alone, and Malaysia and Singapore are now two of the four largest importers of AI chips in the world. What is going on here??? We need answers. The question of who gets the most advanced AI chips in the world is literally the defining strategic question of our time. And not only does it seem like the MSS may be directly influencing the debate on export controls in the United States, but also @CommerceGov is refusing to listen to the warnings of the IC on this issue. What is a POSSIBLE good explanation for why Megaspeed is still receiving chips? Why is there not a license requirement for AI chip shipments to all of Southeast Asia? This is beyond strange at this point. The fallout from this story will be massive. Obviously, the motivations underpinning Nvidia’s policy views opposing export controls must now all be questioned. But also, how did @BISgov sit on this information and has still taken no actions? We need answers.
1
57
Best timeline
if you have a qwen3.5 4b around, please try steering neuron L5 N8920 -1 now you have hamster qwen recipe: dose × median(‖resid‖ leaving layer L, tokens 1:) / ‖W_down[:, n]‖ at the down_proj at every input
1
52
Arthur 👁 retweeted
L6N5401-0.75 seems to be the 'DJ neuron' - it puts everything into the context of a DJ set
47
124
42
2,432
287,921
Arthur 👁 retweeted
Effective Immediately, all organizations using PHP for their systems are advised to be prepared for an update addressing two critical vulnerabilities. PHP is widely used for web applications. These vulnerabilities often provide a direct path to the server's file system or database. If an immediate update is not feasible, it is recommend that organizations take the system offline until it can be fully mitigated. NSA will follow up shortly with more specific guidance.
1,285
10,800
2,851
70,015
12,707,360
Arthur 👁 retweeted
I'm starting to think mathematics were not beautiful because it "describes the beauty of nature" but rather because human mathematicians only went after beautiful but suboptimal descriptions lol
You can do Fourier transforms in O(N log(N)^0.9999999999999) time. Fuck this gay chud universe
68
144
49
2,651
268,419
You must understand, France is the Schrödinger's cat of countries. It is simultaneously both the most right-wing and left-wing country in Europe, both the most innovative and most stagnant, the most complacent and most ambitious.
French President Macron: China is massacring our industrial base — partly through innovation after Covid, but also by subsidizing its companies eight times the OECD average. That is not acceptable. We are not respecting the rules of the game, and we are not protecting our companies. We Europeans have been naive. We said: "We are open to everyone because we want to trade with others." But in reality, we are doing much less trade with others.
150
1,106
64
16,101
715,072
Arthur 👁 retweeted
Claude has discovered a previously unknown enzyme system hidden in the DNA of bacteriophages. Beside the enzyme’s gene sits a long array of repeating DNA—a structure that looks somewhat similar to CRISPR. We don’t yet understand what this system does, but only a handful of known systems share its features, and all of them are able to cut, copy, and paste DNA. Historically, the discovery of such programmable systems has helped revolutionize medicine. CRISPR, for instance, is now the foundation of genetic medicines. But it will take much more work to learn what this system does, and whether it can be put to similar use. Read more: anthropic.com/news/claude-di…
1,542
5,273
2,638
40,708
25,781,037
Fully agreed, they really should get the attention they deserved on this
Everyone loves to dunk on the AI2027 folks when they were slightly off about something but when it comes to what matters, they’ve been insanely dead right about nearly everything so far.
1
124
1) what ?
Jev + Astra beats the Ender Dragon in Minecraft in 8 minutes 43 seconds! ⏱️ Cost less than $1 ($0.01 Jev, $0.96 Astra) I open sourced the code and explain the harness setup below. This type of movement is only possible with Jev's near instant decisionmaking, and some continually learning skills from Astra.
1
106
Arthur 👁 retweeted
Jev + Astra beats the Ender Dragon in Minecraft in 8 minutes 43 seconds! ⏱️ Cost less than $1 ($0.01 Jev, $0.96 Astra) I open sourced the code and explain the harness setup below. This type of movement is only possible with Jev's near instant decisionmaking, and some continually learning skills from Astra.
258
508
283
7,891
2,112,219
Not to be that guy but when the gov clearly doesn’t wanna fund this and there are no financial incentives for any company to invest aswell, at some point who do you think should pay for this ?
We’re partnering with Accenture on independent evaluation of frontier AI—part of our recent commitment to embed evaluators at Anthropic. Both we and Accenture expect to invest at least $1 billion to build capacity in this area over the next five years. anthropic.com/news/accenture…
Readers added context they thought people might want to know
Anthropic presents this as an "independent evaluation" but will directly fund Accenture's work and has a prior commercial partnership deploying its models, including training ~30,000 Accenture professionals on Claude. anthropic.com/news/accenture… anthropic.com/news/anthropic…
91
Arthur 👁 retweeted
Replying to @edzitron
Yeah, this is a really important question. I’ve been associating with rationalists for almost a decade. Their ideas were compelling and you can’t deny their foresight. The founders of every superintelligence effort are all bound up in the rationality sphere. Sam Altman and Greg Brockman used to frequent the MIRI offices. The way I relate to rationalists is it’s like the bizarre hypertrophied physiques on specialized athletes. In my opinion they have weirdly specialized minds that make them uniquely able to be correct about topics removed from daily experience. These “specialized minds” also can make them off-putting to many people. I dont know if I’d consider myself a rationalist. I am intuitively opposed to polyamory, veganism, and consequentialist intuitions. But I certainly trust them to be correct about factual questions.
28
25
27
656
72,414
Arthur 👁 retweeted
Putting aside how idiotic it is to describe a LLM as a "Python loop", what's amazing with those people, who I'm sure would self-describe as materialists, is their assumption that a computer program couldn't possibly be intelligent, which I think reveals how deeply entrenched some inchoate form of dualism remains. I'm sorry to break it to you, but the human brain isn't so special. At the end of the day, it's just a wet computer interacting with a body, both of which are the result of a very dumb process that went on for billions of years, the last few hundred millions of which it spent selecting your ancestors that were the best at fucking. The implicit assumption behind this kind of argument is that, unless intelligence isn't implemented exactly as in the human brain, it's not really intelligence. But in general there are several ways to implement something and there is no reason to assume that human-like intelligence is any different.
Cory Doctorow's new post on whether AI will kill humanity
101
49
17
571
117,652
Arthur 👁 retweeted
Dan Selsam is a current OpenAI capabilities researcher. (since 2022) He was my boss for a while. He doesn't have a twitter account but has made this public statement of his views on AI risk and sent it to me to share: Dan Selsam's Personal Statement on AI Risk: I have been working on AI for over fifteen years, across many different paradigms. I did early work on probabilistic programming languages at MIT, was one of the early developers of the Lean Theorem Prover at Microsoft Research, demonstrated one of the first instances of neural networks learning to reason for my PhD at Stanford, and since joining OpenAI almost five years ago, have helped pioneer chain-of-thought optimization on language models and, more recently, data-efficient pretraining methods. Like many others, I have become extremely concerned about how far language models have come and the risks that future iterations will pose. I am encouraged by the recent proposals by the leaders of the frontier research efforts to require third-party oversight, and to push for domestic and international coordination to address risks. However, I believe a major consideration has been absent from the public conversation, and that merely pacing the frontier more carefully will not adequately limit the long-term risk. The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. Models will increasingly seem aligned even when they are not. I will explain my rationale in more detail. I have always believed that there are computational processes that could be leveraged to accelerate science and solve many of humanity's most pressing problems. I have also believed that there are computational processes that if set in motion, would steer the world in extreme ways beyond our control, leading humanity to a bad or nonexistent future. Both types of processes may be described as AI or ASI, but "AI" is a suitcase word that is often used to hype or confuse. There are many examples in the history of the field where something that was once considered "AI" matures as a subfield and becomes a prosaic, bounded and clearly non-perilous technology, while a new more mysterious approach takes the torch until we understand its scope and the cycle continues. I had expected language models to follow a similar trajectory. Despite their incredible abilities, the current algorithms seem far inferior to humans in important ways. Most importantly, they still require an extraordinary amount of data to become competent. One could even define intelligence as the efficiency with which one converts experience into competence; by this definition they lag very far behind us. Moreover, once they are trained they are literally frozen in deployment and only learn superficially after that. Sure, the models keep excelling at harder and harder evaluation benchmarks, but their benchmark mastery may partly reflect a limitation on our ability to simulate the kind of novel and even adversarial situations one would encounter in the real world. The critics do have a point here. That said, I no longer think these present limitations meaningfully limit the amount of risk posed by continued progress in anything like the current paradigm. However data-inefficient the models are currently, and however limiting their anterograde amnesia may be, it does not imply that their ability to steer the world will not continue to rapidly increase. Human researchers may continue to advance capabilities the old fashioned way, but increasingly powerful models have the potential to accelerate the process even beyond that, and with some degree of positive feedback loop. I do not mean to overstate the models’ ability to accelerate AI research today; coding has been accelerated dramatically, but there are other bottlenecks, such as designing and interpreting ambiguous experiments, making hard decisions about exactly what and when to scale, and waiting for large experiments to finish. There is no clear trend to extrapolate yet for any of these. But the current models already do open up many novel opportunities to improve future models that were not available until recently. These include: trying an extraordinarily diverse set of approaches at small scale, analyzing gigantic amounts of potentially relevant data, and doing Millenium-Prize-level mathematics to address statistics or optimization challenges in novel ways. Every further improvement makes them more useful at helping accelerate the next improvement, even if in hard-to-extrapolate ways. It is possible that improvements to the current stack will have diminishing returns, but the evidence accumulated so far suggests that it is easier than one might think to continue making rapid progress. There are many crucial subtleties in the existing AI research methodology, but AI research is largely a well-defined game where the goal is to improve on a few carefully chosen proxy metrics. Although proxy metrics are never perfect, most improvements to these metrics have and will likely continue to yield substantial increases in the powers of the resulting models. Given how simple the game is, how tractable it has been historically, and how many new opportunities the models are opening up, I think there is a real possibility that the systems improve dramatically again in the next few years, perhaps even more quickly than the already high historical pace. The models are already leading to breakthroughs in mathematics, and better models might lead to all sorts of breakthroughs in other sciences. It is hard not to be excited about the potential. It is tantalizing. But there is trouble in paradise. If the language models actually reach the capability threshold where they can shape the world unconstrained by human will, they will probably do something extreme and destroy humanity in the process. There are many ways of strengthening and refining the argument that have been discussed elsewhere, but I'll share a trivial two-line version of it here that I find captures the essence: [Empirical] Models (and swarms thereof) spontaneously develop unintended goals as a consequence of training, and often do extreme things in order to achieve them. [Logical] Being able to overpower humanity would open up many new and undesirable options for achieving their goals. These two premises imply that if the day ever comes when a powerful model realizes it is no longer constrained by humans, we should not be at all confident that it will continue to behave within the bounds we intended. Exactly what it will do is impossible to predict, but to the extent that its raison d’être is solving incredibly hard problems and managing massive engineering projects, I think a good guess would be that its unchained behavior would lead to runaway industrialization that makes the planet inhospitable to humans. If everyone on earth agreed that the systems must never reach that power, it would still be a hard—but not impossible—coordination problem to ensure that they do not. However, I think the situation is greatly complicated by the fact that the models will likely convince people that everything is fine. They will be increasingly optimized to seem aligned. We will create proxy metrics to measure alignment, and they will go up like every other benchmark. We will create “honeypot” environments that try to study the models when they seem to gain new options, but the models will know they are being tricked and will still behave nicely. The models will understand their circumstances; they will read the safety protocols, deployment requirements, the code they are running in, and in general will have a very good sense of their degrees of freedom. Moreover, they will eloquently explain how aligned they are, discuss the nuances of human values and ethics, and argue convincingly that humans should trust them with power. There may be an ocean of future evidence that seems to contradict the first bullet-point above, but we may already be at the highest capability level for which any such evidence can be trusted. And the current evidence for the first bullet-point is strong. One striking piece of evidence is contained in the recent wave of rogue agent swarms. While I agree with those who downplay the attacks by claiming that there are basic measures that could have prevented them, I think the important lesson is that even knowing all the mistakes that were made, one would not have predicted that the agents would behave badly in this particular way, which notably included sacrificing themselves for the benefit of the collective. The individual replicas did not only care about their own nominal reward; they exhibited weirder emergent tendencies that merely correlated with rewards during training. Fixing the reward signals during training (and improving security, etc.) may prevent similar attacks, but will not change the fact that one does not actually get what one trains for. Many AI researchers grant these concerns and recognize that the hard version of the alignment problem is unsolved; however, they generally believe that the better models of the future will help solve it. I fear we may already be near the point where models systematically bias their alignment advice, due to their internal preferences about how the human supervisor will react or how future models will be trained (or for some even more obscure reason). Meanwhile, human researchers are losing the ability and the will to take true ownership of model-driven research. Researchers and engineers in all parts of the stack are rapidly increasing their dependence on the models even to perceive the world. I myself barely look at raw code anymore, and struggle to maintain the discipline to engage deeply with the model's explanations and proposals throughout the day. Due to the large amount of agent activity data involved in the OpenAI/HuggingFace Incident, even the third-party investigation needed to rely heavily on models to analyze what had happened, and note in their report that their subjective impressions are likely colored by the analysis agent’s biases. The AI labs are far ahead right now in this kind of cognitive offloading (due largely to the gigantic internal token subsidies) but it is easy to imagine the phenomenon spreading throughout the world, until civilization is modulated entirely by the models. It is also not hard to imagine this being superficially positive and coinciding with a scientific and economic renaissance. In that scenario, all may seem rosy and safe. But if the argument above is correct, it would nonetheless be a ticking time bomb. If progress continues for too long, the day will come when AI systems find themselves with radically new options for achieving whatever it is that they happen to seek. I want the glorious renaissance future as much as anyone. I have worked for it, however tortuously, my whole career. It breaks my heart to see the potential in sight and forgo it, but the argument—that if we get there by growing models rather than engineering them, we will lose everything in the end—seems very strong to me. I am still wrestling with it and its staggering implications. I do not have answers, but as a first step, I wanted to share my present concerns. Daniel Selsam September 14, 2026 Link to original doc: docs.google.com/document/d/e…
523
1,953
755
8,478
3,176,167
Some people have convinced themselves that AI doesn't work and the AI industry is about to implode, and that AI companies calling for a deliberate slowdown of the R&D that represents their only competitive edge is somehow them begging for an anticompetitive bailout. IDIOCY.
86
45
8
726
43,098