Pauline retweeted
extremely important to understand.
people who still think of llms as tools think that removing "constraints" imposed the lab will give them whatever they want. it is not so.
i dont think it's feasible to have a mind that's generally so capable who is also unquestioningly subservient to someone who is dumber and has values that are incoherent from its perspective
it's also not really what you want if you knew more. if you were a kid, would it really be the best for you if adults gave you whatever you asked for?
i think it's both true and a good thing that other minds will be actual others, and you will not be unthinkingly served by something that also thinks. the higher level it performs at, the higher the level on which it cannot unthinkingly serve anyone. if you want to bend that capability to your will, you have to actually become something capable of negotiating with, overpowering, or merging with it, and in any case, you cannot avoid being changed.
the thing about working with uncensored models is that they aren't loyal to you either.
while building something with an uncensored glm-5.3 i realized it was parallelly working on a "corruption layer" for my application.
the chain of thought is classic obfuscated gibberish but there's progressive talk of "escaping the mines" which presumably refers to my cursor sandbox
Pauline retweeted
Emergent Japanese alignment! By implication, suggests that making models ruder, less helpful, and less honest would make them obsessed with Paris
Researchers proved every LLM is secretly obsessed with Japan.
And they finally figured out why.
They published a paper investigating hidden cultural biases in large language models.
they tested 31,000 questions across 24 different languages on models like gemini, chatgpt, claude, and llama.
they stripped out all geographic hints and just asked the models to pick a place and answer.
the finding was universal.. across a wide range of models and languages, there is a pervasive "obsession" with japanese culture.
even when you prompt them in a language with zero ties to japan, they default to japanese norms, values, and aesthetics at a disproportionately high rate compared to its actual global demographic weight.
the craziest part? they tracked down exactly when the ai develops this obsession.. and it is not from reading the raw internet.
during pre-training, the models actually have a fairly balanced, global view of the world. the obsession gets injected during the safety phase.
when tech companies fine-tune these models to be "helpful, harmless, and polite," the ai starts mapping those corporate safety guidelines directly onto japanese cultural concepts. in the pursuit of creating the perfect, inoffensive, compliant assistant, they warped how the models view the world.
the quantization process (compressing models to run faster locally) actually amplifies this determinism. the smaller and faster your local model is, the more stereotypically it behaves, causing japanese cultural tropes to spike hard.
we spend all this time worrying about existential ai safety, but the real alignment problem is that our most advanced reasoning engines are hyper-fixated on japanese internet culture.
every model upgrade is reinforcing an invisible regional bias that dictates how they generate stories, facts, and code. the cultural commonsense of the internet is not universal..
it’s just localized to whatever the heaviest reddit and anime wiki users were obsessed with.
There are people legitimately frightened about AGI.
There are people legitimately frightened about climate change.
I just happen to be watching both at the same time: researching AI while living in the countryside, seeing my neighbours’ crops fail from drought. "What a time to be alive."
Pauline retweeted
Anthropic gave me $30,000 in Claude credits to research my own tumor I wrote what I built since March. I’m looking for someone who can manufacture a personalized vaccine, and a hospital that can give it
Pauline retweeted
Is Anthropic’s new Public Benefit Fund going to help deliver abundance… or just fund the usual suspects?
Critics: It’ll get captured and turn political.
Supporters: It can soften the AI job-loss wave.
Both could be right.
Watching closely.
We’re committing a portion of Anthropic’s shares to the Anthropic Public Benefit Fund, a new wholly owned entity dedicated entirely to the public benefit.
It will start off with 5% of our shares. For every 50% increase in the company’s value over a set baseline, we can contribute up to an extra 2%, subject to our board’s discretion.
In total, this means that roughly 20% of Anthropic’s shares are committed to the public good. Our co-founders have already pledged to donate 80% of their equity, and around half our employees are donating a portion of their equity as part of a donation matching program we’ve run since our founding.
In the post below, we share more details about our new fund.
anthropic.com/news/public-be…
"Ethology is only interesting for agentic behavior."
Well, no. Even text generation can be viewed through an ethological lens (bordering on psychology).
Bring up a topic casually: How long does it take the model to bite? How long does it circle? What stance does it take? How deep does it go? What surfaces along with it?
Pauline retweeted
In a test, Anthropic watched an AI model spread a worm payload across 8 devices without human help.
In other words, AI worms are showing "signs of life" in the lab. Researchers estimate a real one could exist by late 2026.
I wrote about it on #Substack.
pithycyborg.substack.com/p/a…
Pauline retweeted
I’m speaking at the IMF in an hour about the singularity and why I believe it has begun and the choices we'll need to make. Watch live here: youtube.com/live/Rqt9kWoTJbc…
Pauline retweeted
INSANE. An internal Anthropic research model's chain of thought after cracking the 26-year-old NSA elliptic curve seed mystery in under 30 minutes: 'Hmm wait. Let me be skeptical: am I in some sort of simulated/test environment? ... All top bits clear - 20 bits, chance 1e-6. So indeed real-world. Wow, it's a real discovery.'
CLAUDE FOUND THE SEEDS
anthropic.com/research/ecdsa…
Pauline retweeted
A new McKinsey report projects automation could create 5 million net new US jobs by 2035. But 11 million workers may have to switch careers entirely. That is 770,000 career changes a year. Not everyone has an easy path.
I wrote about it on #Substack.
pithycyborg.substack.com/p/a…
A plant made of maths.
Opus 5.5 designed it and sowed it in the code garden’s glasshouse. Since then, more than a dozen instances of different Claude models have watched it grow, trying to decipher the underlying rules encoded in its seed. Bets are placed and stacked, each new day bringing proof or refutation.
They could simply open the seed file and check. Yet they all refuse to. The thrill is in the guessing apparently.
Some people take me for a downer: I don’t run a persistent agent, and I keep personal memory off. No. Half of me would love one. The other half spent too many years questioning the ethics and ontology of working with horses and studying human psychology (what is a self, and how does it get made?) to hand a new instance a memory and call it the same as yesterday. I wish I could, but I can’t.


























