Pinned Tweet
Introducing GEN-1.5, a one-shot learner.
It can learn new tasks in a few seconds. Show it what to do, and it generalizes.
This capability emerged from pretraining on physical data at scale, as a step towards our mission of building general intelligence for the physical world.
How many pucks could a puck bot pack if a puck bot could pack pucks? 🏒
12 hockey pucks is a tight fit in this container – watch the model fix the arrangement when pucks get stuck or misplaced.
GEN-1.5 doesn't just puck around. Read more about it in our blog post and sign up for the waitlist in the comments below.
Other tasks our models can do:
youtube.com/playlist?list=PL…
Read more about GEN-1.5, our latest foundation model for the physical world:
generalistai.com/blog/gen-1.…
GEN-1.5 puts together a kit of cosmetics, then puts together another kit, then another kit, then another...
We're expanding access to GEN-1.5
Sign up to get in line
generalistai.com/waitlist
Other tasks our models can do:
youtube.com/playlist?list=PL…
Read more about GEN-1.5, our latest foundation model for the physical world:
generalistai.com/blog/gen-1.…
We're expanding access to GEN-1.5
Sign up to get in line
generalistai.com/waitlist
GEN-1.5 packs a bottle into a box, then packs another bottle into a box, then another bottle, then another one, then another...
Read more about GEN-1.5 in our blog post in the comments below.
Read more about GEN-1.5, our latest foundation model for the physical world: generalistai.com/blog/gen-1.…
Other tasks our models can do:
youtube.com/playlist?list=PL…
Read more about GEN-1.5, our latest foundation model for the physical world:
generalistai.com/blog/gen-1.…
Robot puts a ring on it
GEN-1.5 puts an O-ring on a hydraulic rod gland, then takes the ring off, then puts the ring back on, then takes the ring off, then ring on, ring off, ring on...
Read more about GEN-1.5 in our blog post in the comments below.
Other tasks our models can do:
youtube.com/playlist?list=PL…
Read more about GEN-1.5, our latest foundation model for the physical world:
generalistai.com/blog/gen-1.…
A simple example of physical prompt steerability: same environment, different prompts, different behaviors.
Thanks @JagdeepBhatia8 for the suggestion.
Read more about GEN-1.5 in our blog post in the comments below.
Physical prompting is an elegant idea!
One request for the @GeneralistAI team: can we see an example of *physical prompt steerability*, where different prompts induce distinct behavior in the *same* environment?
I'm curious whether GEN-1.5 is listening to the physical prompt or simply executing the most likely action sequence for the scene under its pretraining prior.
Other tasks our models can do:
youtube.com/playlist?list=PL…
Read more about GEN-1.5, our latest foundation model for the physical world:
generalistai.com/blog/gen-1.…
We've reduced the time it takes to go from physical prompt → robot behavior.
The faster anyone can teach a robot to do something new, the easier it becomes to scale physical work.
Read more about GEN-1.5 in our blog post in the comments below.
Read more about GEN-1.5, our latest foundation model for the physical world: generalistai.com/blog/gen-1.…
Generalist retweeted
Last week @willknight came by and got a preview of one-shot prompting and we had some fun improvisational moments with the robot. Thanks Will for helping capture the moment.
I'm usually wary about talk of "the ChatGPT moment for robots" because language is less complex than the physical world. After visiting @GeneralistAI, though, where I saw their robots perform impressive manipulation with just a prompt, I think you can see it happening in a limited way. (Thanks to @peteflorence and co for having me!) wired.com/story/generalist-a…
Generalist retweeted
Good question thanks Ani. Here's a video that gives a sense of the answer here about the effect of prompting:
- in the first part, the model is just babbling with no prompt in context
- at the end, we add a prompt for taking money out of a pouch (generalizing to the wallet)
Replying to @peteflorence @andyzengineer
Very cool work, Pete! I'm curious if you've tried an extreme version of this: no in-context example at all; just place objects in front of the robot and see if it can infer the task.
I suspect this will have non-trivial success rates, which would also allow you to figure out how much of the benefit is actually coming from the prompt (rather than pure zero-shot task inference + capability).
I remember Russ showed something like this in his Stanford talk on LBMs last year:
youtu.be/TN1M6vg4CsQ?si=-8J-…
We started planning yesterday’s @generalistai GEN-1.5 announcement about 3 weeks ago. Two weeks ago, already feeling whiplash from new results, I asked ChatGPT to create this image to share in our internal meme channel.
🤖 Made with AI
During a recent visit to Generalist AI, I watched a robotic arm improvise and use a banana as a tool. wired.com/story/generalist-a…
RT @felixwyw: At 10:06pm on Aug 3, I watched a robot do something I thought was years away.
We were working on few-gradient learning with…
This quoted post is unavailable.
GEN-1.5 has been training continuously for over 8 months. We left it running because every metric we tracked kept improving with the engine: absorbing more data, scaling more efficiently, boosting post-training, and compounding step-change improvements through algorithmic advances.
To us, GEN-1.5 represents a new frontier of generality — one that challenges our own understanding of how these models behave when pretrained at a scale of physical interaction data few thought possible without shortcuts. We do not yet see where this asymptotes.
Read more in the full blog: generalistai.com/blog/gen-1.…









