rex retweeted
Nothing breaks the illusion of progress faster than trying something that's not in the training data / RL pipeline.
What you're feeling as AGI is *simply* coming from additional datasets and mercor/micro1 consultants.
Now, to be clear, it's still tremendous feat of engineering and product. It's a phenomenal magic trick.
But it's still a magic trick.
rex retweeted
🚨🇦🇷 𝗔𝗛𝗢𝗥𝗔: Manchester United confirma su interés en arruinar la carrera del mediocampista ofensivo Argentino, jugador del Como, Nico Paz (22). [Sun]
rex retweeted
In all seriousness I think this represents both a disturbing society-level inability to process basic facts that involve numbers, a lurch toward degrowth on the left and right, and a failure of mainstream journalism to go beyond just nodding along to the "concerns" of everyday people without checking to see if they're the result of a game of telephone that leads back to nothing
rex retweeted
Congressis think they are still living in the 60's or even 90's where they write the propaganda.
In this case, after this "aura" filled meeting the "Pandit" in the airport, the trip just fell apart and was an absolute disaster.
JFK had ideas of an Indian focussed Marshall plan, to use American money to build up Indian infra. Just imagine the possibilities if we started building up expressways (limited ofc), sewage systems, possibly mass transit in Mumbai and Delhi in the 60's?
But Legru was more interested in ogling the youngest Kennedy sister, refused to go beyond monosyllabic responses and JFK later confessed to RFK that this was the worst meeting of his life.
rex retweeted
Che, quien iba a decir que la forma de terminar con el dominio de las pandillas en Haití era cagarlos a tiros en vez de darles “ayuda humanitaria y consensos”.
Asombroso.
rex retweeted
Do my non robotics friends know what’s happening rn? Before October 20 it took 1 week to train a whole body controller (ie robot walking model) on 128 GPUs. Now it takes 3 minutes on 1 GPU
rex retweeted
Everytime I see a Dwarkesh video, I'm wondering what they are smoking in SF. It seems very distant from reality
"Superintelligence" is one of the cringiest terms I've seen, it's a rebrand of AI to get more money out of VCs.
An no, recursive self-improvement hasn't started. It's just human researchers prompting to say "speed it up". It does some cute kernel optimizations and hyperparameter sweeps, very similar to the NanoGPT speed run records done by humans. Nothing fundamental or groundbreaking gets invented by so-called superintelligence.
To give an example: when @Recursive_SI released their (impressive) Flint model on @huggingface, I cringed a little for their use of the terms "superintelligence" + "recursive self-improvement". As said in their blog post, through "recursive SI", LLMs were able to figure out - I kid you not - to determine how many total parameters and active parameters the model should have. So yeah, it's just changing a config. It's doing hyperparameter sweeps on things humans have built (like MoE's, validation loss, perplexity etc). Of course, you shouldn't tell that to VCs. You should scare them by saying AI is improving itself at an alarming rate - this increases the $$$ raised by another factor.
Can we please stop all this misinformation: no, superintelligence is not here. No, recursive self-improvement hasn't started. And yes, there's lots of work to do to build more reliable AI that is actually smart.
This is why there's such a huge gap between super impressive benchmark numbers of LLMs, and the (lacking) economical impact of them. It's not able to do research like a human, doing experiments, coming up with actual new stuff, and generalize beyond their large amounts of training data.
rex retweeted
Has better surface & lane markings than most underpasses of Bangalore
Thanks to the brilliant @GBA_office & their excellent contractors
rex retweeted
American pilots should be banned worldwide, whether they're operating ships or aircraft.
rex retweeted
Phillipines is if India's colonization was taken to its logical extreme. No manufacturing, completely converted, only English, Everyone working for gora sahebs
WATCH: Students from the University of Santo Tomas hold a university-wide walkout to oppose the Pax Silica initiative ahead of the 49thASEAN Summit on Friday, Nov. 13. (Video by Divina Eloisa Meguines/ THE FLAME) | via @YmanRoxas
rex retweeted
Issue is adhoc nature of it, it's great work so as building mri scanners but what's our comprehensive indigenization plan alongwith ensuring these nascent startups become scalable for prodn at competitive costs
For those calling our manufacturing as screwdriver technology: Designed in India, Made in India 5-axes precision CNC machines with the accuracy of 2 microns! For reference, the thickness of human hair is about 80 microns.
(5-axes = x, y, z, rotate, turn)
This is the way electronics and semiconductor manufacturing ecosystem is taking shape.
India now manufacturing things that go into things that go into things…
rex retweeted
I know a line that can not only do this and boost ridership by 77%, making 10+ connections with the network (per IISc study). But what is government proposing? A flyover through 80ft.
