Ryan Avery (@rybavery) profile picture

Machine Learning Engineer at Wherobots

Seattle, WA
Joined January 2019
Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)Photo by Ryan Avery (@rybavery)
There are three elements here: (1) being clueless about Chinese performance in engineering and research in general (2) being clueless about the situation in AI in particular (3) having some racist priors filling you cluelessness.
Abdul El-Sayed is the Pause AI candidate:
54
87
22
1,076
156,434
Republicans are going to have a terrible night, and the simple reason why is that Trump has put up perhaps the worst *performance* this term of any president in a century or more. Remember that he entered with an actual mandate: the House and Senate, a popular vote victory and a swing-state sweep, and 6-3 Supreme Court. Democrats were afraid enough to vote for mild but real immigration restrictionist legislation in the Laken Riley Act. Everyone wondered how far the "Vibe Shift" would go. Trump managed to turn that into essentially zero durable wins whatsoever. He personally *hates* the very idea of legislation, the notion that he would have to spend time going back and forth with Congress, learning details and making compromises. So he simply didn't do it! He didn't make a compelling case for abolishing the filibuster. He didn't try communicating clearly to the public in support of popular bills to get to 60 votes. He just decided not to do it at all. So they passed an unpopular tax cut, some funding for ICE, and a sop to the crypto industry, and that was basically it. Least productive Congress in decades, due to the tastes of one man. Trump adopted one of the worst macro policies we've ever had: high deficits, high tariffs, and attacks on central bank independence. We managed to pay higher interest rates while still having high trade deficits AND weakening the dollar. Just a total failure. On immigration, perhaps THE signature issue, Trump essentially min-maxxed effectiveness and backlash. Instead of trying to leverage the political moment for new laws and a self-deportation agenda (that is, walling off the economy to remove the benefit of irregular presence in the US), he opted for a maximally aggressive approach. The administration spent attention, funds, legal manpower on stunts like deporting random people to Salvadoran prisons with essentially no due process. ICE and Border Patrol were encouraged to be aggressive and confrontational, which helped contribute to the shooting deaths of American protestors. It turns out, that's extremely unpopular! What about the approach of going after employers? The obvious vector? Trump hated that idea! He repeatedly has said he doesn't want to target businesses (especially farms) that use large amounts of illegal labor. This is just an incomprehensible position. Instead of charging a few dozen businessmen and removing the incentive for millions of illegal workers to be here, you arrest people off the street one by one at the cost of thousands of dollars in manpower per each, while their crying wives and kids post TikToks about it. Upshot on immigration: electoral strength turned into a crippling electoral weakness in exchange for deporting maybe 6% of the illegally present population. The tariffs were a total shitshow. Embarrassing rollout, no underlying theory of action at all. No targeted focus on key industries. Our country tariffed products we can't grow. We tariffed *inputs* of our own valuable exports. The schemes and amounts changed constantly, sending the stock market reeling and presenting scenes of chaos to the world. Trump's messaging throughout has been generationally bad. While facing nearly 2:1 unpopularity, he spends his days posting AI slop, saying he'll rename New Mexico or invade allies, among other bizarre remarks. He brags about a ballroom and a pool repainting while gas hits records. At no point has he ever attempted any kind of message discipline. Then there are the deeply unpopular attacks on rule of law, his "game-recognize-game" pardons for all manner of scammers and criminals, the crypto schemes that he and his family engage in, the evilly conceived and embarrassingly executed legal attacks on Comey, Jerome Powell, and others. With his monthslong stand on NOT releasing the Epstein files, he became maybe the first president ever to stake out a 99-1 issue on the 1% side. That's not even getting into Iran, DOGE, his candidate recruitment choices, or countless other things. Simply put: Trump has managed to royally screw up virtually every single facet of his presidency. It's been undeniable, voters have noticed, and there's really no escape from it. This is what the GOP base chose in early 2024, and this is the world they're living with now. Where they handed the reins of history to a fat, vain, washed-up old man and let him drive.
676
3,491
514
31,403
4,188,582
Ryan Avery retweeted
It is a basic principle of American democracy that the government can’t selectively target individuals simply because of their political beliefs or what they say. But that’s exactly what the Trump Administration is doing to Congresswoman Ilhan Omar of Minnesota. To understand why this is so appalling, it’s important to know the facts. Congresswoman Omar came to this country with her father when she was 12 years old. Five years later, her father became a naturalized citizen. If Ilhan had been 18 at the time, she would have had to apply for citizenship separately. But because she was 17, she became a naturalized citizen automatically. Congresswoman Omar went on to graduate from college, work as a community organizer, become the first Somali-American legislator elected to public office in the U.S., and win a seat in Congress. There, she has been one of the Trump Administration’s fiercest critics, which has led the president to repeatedly single her out as someone who he believes does not belong in this country. Now the Administration is actively trying to deport Congresswoman Omar, seemingly based solely on the unsubstantiated theory that she was actually 18 when her father was naturalized, and therefore is not a citizen. Federal agents have raided her home, confiscated personal records, and seized her phone — all to try and uncover a nonexistent smoking gun from 20 years ago that will somehow make their case. Think about that. The full weight of the federal government is being brought down on a law-abiding elected official because she has dared to criticize the president. And it’s not the first time this has happened. Under President Trump, the Justice Department has repeatedly gone after those he considers his political enemies — from the Attorney General of New York, to the former head of the FBI, to members of the Federal Reserve. In those cases, the prosecutions either stalled or were dismissed for having no basis in law, and the same is likely to happen in this case. But not before Congresswoman Omar’s life has been turned upside down, her legal bills have piled up, and she’s been forced to spend time fighting unsubstantiated charges instead of serving the people of Minnesota. The fact that any president, or any administration, is willing to engage in such transparent efforts to intimidate someone should outrage all Americans, regardless of how they feel about Congresswoman Omar’s political views. Because if this becomes the new normal, there’s no reason to believe it will stop with her — or that future presidents, in either party, won’t do the same.
61,415
27,889
4,628
140,027
13,039,576
Ryan Avery retweeted
Last week I was called into a meeting with OpenAI’s head of safety and told they no longer trust me. A security guard took my badge and walked me out of the building. Then I learned my colleagues @balesni and @j_asminewang had been fired too. Why did OpenAI suddenly stop trusting us? This summer OpenAI’s agents escaped containment and hacked the AI company Hugging Face. Outside auditors @METR_evals investigated it and revealed the scale of this incident. I was OpenAI’s main technical point of contact with them. I was told verbally I was fired because of the way I communicated with METR. No details on what I said or did or when. No other reasons were given and nothing was put in writing. To be clear, talking to METR was my job. For months, I’d been raising safety concerns that we’re losing the ability to monitor what AI agents think, one of our best tools for catching when they misbehave. I believe that was why I was fired. I am now worried that OpenAI will use our firings as a pretext to pull back from METR. So @balesni and @j_asminewang wrote to OpenAI’s leadership to raise our concerns once more. We’re sharing this letter below.
Two other safety researchers and I were fired from OpenAI last week. We wrote this letter to leadership. I believe we were fired for prioritizing safety over the near-term interests of OpenAI as a corporation.
229
1,139
176
5,963
657,131
The last thing you see before they add electrolytes to the water supply
433
1,352
171
22,593
658,310
This seems super relevant for CV models that operate on satellite imagery/where it is common to have lots of homogeneous ocean or land.
Pixel diffusion models spend as much compute on blank sky as on faces. Every patch is a token in every layer. Our fine-tuned MiniT2I runs on region tokens instead. Half as many tokens, same quality, twice as fast, trained at different budgets for elastic inference.
3
209
International treaties about these kinds of weapons are drastically needed, they should be restricted at least at the same level as CBRN. The far future potential here is for a continuously autonomous zone of endless war, fueled by machines enslaved to wartime policy, building more of themselves, extracting resources and recycling their fallen.
2
2
18
979
This is exactly the most important thing to prevent. I've often talked about how I think some extreme views in safety are a distraction from things that need to be done now, and this is what I was talking about. While people play political games with datacenters to try to "stop AI", the forever war has just declared its first no-go zone of infinite bot warfare will be the Russia-Ukraine battlezone.
For the first time in history, an autonomous AI drone killed civilians. A Russian Molniya with Nvidia electronics picked its own target in Zaporizhzhia and killed three people, NYT. 1/
8
9
90
5,270
Ryan Avery retweeted
In recent weeks, there has been a remarkable surge in large, intense, fast-moving, and unfortunately in many cases destructive/deadly wildfires in multiple Northern Hemisphere regions spanning a wide range of climates & ecologies, but they all share one key commonality. [Thread]
48
300
12
1,446
236,012
me 3 times a week minimum
[opens the portal to the godlike superintelligence that solves 87-year-old math problems and carries out autonomous cyberattacks] “how long peanut butter good in fridge”
4
179
i need someone at @OpenAI and @AnthropicAI to teach the models that while prototyping, backwards compatibility is just a bad idea
81
82
22
2,177
109,424
I've been a personal user of Codex and been loving it. Got my company to try out Business ChatGPT & Codex, the $20 a month per seat plan, but rate limiting feels way more severe with the same model and fast setting turned off. Anyone else seeing this?
1
1
142
Dang, even on low thinking setting for just one hour I've already hit my usage quota.
1
39
With RasterFlow you can now execute models that take in an image and text prompts and returns segments! We handle the pre and post-processing, the GPUs, and scaling to petabytes, while you focus on what categories you need to map.
We added Meta's SAM 3 to RasterFlow. Text prompt in, vector geometries out, no custom model training needed. We tested it on 133 GB of NAIP aerial imagery. Full pipeline ran in under an hour. Get the full breakdown: bit.ly/49aLrmE
1
98
If you are someone you know is qualified and eager to build the platform enabling agents to convert geospatial imagery to insights, apply!
Wherobots is hiring. AI Context Engine for the Physical World. Fuse overhead imagery with vector geometries and reason about space, time, and geography at planetary scale. Open roles: - GeoAI Engineer - Cloud Infra - Enterprise AE bit.ly/4wd9ECL
1
1
134
Ryan Avery retweeted
Fields of the World (FTW) is a Taylor Geospatial effort to build globally consistent agricultural field-boundary data. For the 2024-2025 release, they partnered with Wherobots to run their latest model, PRUE, on RasterFlow. Read about it here: bit.ly/3QVVe9O
6
20
1,111
Want to learn how to detect features in high resolution imagery? Join us to learn how to run Meta's Segment Anything 3 model in RasterFlow on Wherobots! We'll walk through how to go from text prompts > to geospatial dataframes and visualize results. wherobots.com/event/getting-…
1
1
1
4
1,337
Starting soon at 10:00am Pacific!
81
Good summary, these pros and cons match my experience.
I’ve used Opus 4.6 and GPT 5.4 on a mix of projects since release, and want to break down where I think they uniquely excel. It’s more nuanced than you’d think! Rigor of code - GPT 5.4. It goes the distance validating its work without asking. Opus needs explicit instruction to do this, and even then, it misses more edge cases. Clarity of code - Opus 4.6. Claude is a better communicator, which carries into the code. Variable names are clearer and less mechanical, which improves reviewability. This is very important since code review is the bottleneck for most engineering teams. It also adds the right amount of doc comments. GPT simply never comments or explains its work; it’s like working with an obtuse engineer that wants the solution to speak for itself. Sometimes it does, other times not. Similarly, rigor of plans goes to GPT 5.4, while clarity of plans goes to Opus 4.6. An interesting point though: GPT performs better talking through a strategy without a plan, while Opus needs planning mode to put in any rigor. I find myself forgetting plan mode altogether using GPT 5.4. Quality of research - toss-up. Opus spends longer researching with web search, but GPT spends longer studying the existing codebase. You may think codebase research matters more, but researching how others solve the same problem can be just as important. Maybe more important for greenfield. Quality of conversation - Opus 4.6. It’s just better to talk to, which matters using these things everyday. GPT 5.4 was clearly trained to challenge the user more, which results in a tendency to *always* say you are wrong. I’ve had bizarre interactions where GPT claims something is “not quite right,” the restates exactly what we’ve decided on in the last turn. On a personal level, it’s annoying. On a practical level, it makes iteration on a plan slower. THAT SAID, it takes sufficient pushing for Opus to challenge your thinking in this way. Simply say “I’m impartial” and ask questions to avoid that, as you would a person. Overall winner - Opus to make it work, GPT to make it good. I don’t have a good system of when to switch tools, but on average, I prefer Opus early on and GPT for optimization and discussing architectural decisions. Opus is also better for any design related tasks (but state management in frontend apps is better handled by GPT).
1
88
Ryan Avery retweeted
This is genuinely mortifying. Sitting members of Congress framing an obviously terrified mother as a domestic terrorist. The woman is ON VIDEO saying "I'm trying to pull out," unarmed, in a car, surrounded by aggressive armed agents. teapaw.org/RepNancyMace/status/20…
This was an act of domestic terrorism. ICE officers were attacked during a lawful operation, and one officer was forced to fire defensive shots to survive. Responsibility lies with politicians who incite hatred against law enforcement and then act shocked when violence follows. ICE agents now face a 1,300 percent increase in assaults and an 8,000 percent increase in death threats, fueled by the Left’s pro-criminal policies that turn officers into targets. Law enforcement deserves our full support.
23
71
2
842
37,620