Cofounder/CEO @theworldlabs, Prof (CS @Stanford), Co-Director @StanfordHAI, #AI #SpatialIntelligence #GenAI #computervision #robotics #AI-healthcare
Stanford, CA, U.S.A.
Joined April 2010
- Tweets3.1K
- Following1.2K
- Followers1.1M
- Likes7.9K
Fei-Fei Li retweeted
Excited to share Halcyon, our latest research on multimodal pretraining!
Building strong text-to-image generative models is simpler than we think!
Blog: radicalnumerics.ai/blog/halc…
Models: huggingface.co/collections/r…
Paper: radicalnumerics.ai/assets/ha…
1/8 Does text-to-image generation need language pretraining?
Today, we share Halcyon, a family of early-fusion, base models trained from scratch. Halcyon outperforms strong late-fusion baselines with up to 275× less pretraining compute. Models and recipes are open.
Halcyon is part of a research program at Radical Numerics on the science of multimodal pretraining and scaling.
Fei-Fei Li retweeted
Atlas beta access has started rolling out!
Here’s a look at how you can control camera paths with pixel-perfect precision.
Every one of my mathematician friend sees beauty in the numbers, shapes and the natural phenomena they work with. Who defines beauty in the age of machines?🤔
Fei-Fei Li retweeted
Experimenting with Chisel in Atlas beta. We’ve been rolling out beta access to a bunch of users and it’s been really cool seeing what people are building.
Fei-Fei Li retweeted
So excited to welcome @theworldlabs and @drfeifei to the @AMD family! I’ve always been a huge fan of Fei-Fei and her pioneering research in AI. Together, we’ll combine World Labs’ deep expertise in AI and world models with AMD’s compute leadership to power the future of AI and strengthen the open AI ecosystem. Can’t wait for all we’ll accomplish!
The goal of building any technology, AI included, should be bettering human lives and society.
“Any threat to human society, including existential, is within ourselves,” says World Labs Technologies CEO Fei-Fei Li as she discusses the risks surrounding AI, and the responsibility humans have in shaping how the technology is developed and used.
Listen to our full interview here: bloom.bg/3V74HgP
Agents can be AI, but agency is human. It is every individual’s responsibility to empower our own agency, with the help of tools. But the North Star should always remain human centered.
Fei-Fei Li retweeted
What happens when you give a world model 32 images of a place we know very well?
World Labs put Atlas to the test on Voyager.
Atlas brings text, images, video, and 3D into a shared spatial context, enabling one model to generate new views, reconstruct scenes, and simulate worlds. With Voyager, you can now see that in action in real time.
Pretrained from scratch on NVIDIA Blackwell GPUs. Take a look around 👇
From 32 input images to real-time flight through @nvidia's Voyager headquarters.
Trained on NVIDIA Blackwell GPUs, Atlas uses these images as 3D spatial context to generate new views, letting you explore with pixel-perfect camera control.
Take a look around.
Fei-Fei Li retweeted
From 32 input images to real-time flight through @nvidia's Voyager headquarters.
Trained on NVIDIA Blackwell GPUs, Atlas uses these images as 3D spatial context to generate new views, letting you explore with pixel-perfect camera control.
Take a look around.
Fei-Fei Li retweeted
Atlas beta access is rolling out to users, some ideas for API developers
- give Astra "eyes" in Blender, let it place and render new camera views with Atlas
- 3D reconstruction (this video uses 9 image inputs of my studio to make a scene, any Zillow apartment works)
- graybox-to-world, use depth inputs and generate multi-view renders of a scene
Incredible opportunity for robotic learning researchers/engineers to join @theworldlabs! ❤️🔥
We're hiring in robot learning at @theworldlabs! Join me, @drfeifei, and the team to define and scale the next generation of world models for robot learning!
Atlas for Robotics: worldlabs.ai/blog/atlas#robo…
Real-to-Sim-to-Real: worldlabs.ai/blog/real-to-si…
Apply: jobs.ashbyhq.com/worldlabs/8…
Fei-Fei Li retweeted
SparkJS 2.2.0 is out packing tons of bug fixes an improvements. Enjoy!
🎉 🥳
20% faster splat sorting, 14% FPS gains in some systems, 50% smaller bundle size and more.
Dive into the full detailed change log github.com/sparkjsdev/spark/…
Fei-Fei Li retweeted
University leaders should make sure they reason about the broader trend.
Around 2020, Fei-Fei and others at Stanford identified the growing compute divide between industry and academia, and the need for policy response in pushing for the National Research Cloud.
In 2021, the same point was made when applied to model training in the foundation models paper.
In 2022, the same point was made when applied to model evaluation in HELM among other works.
In 2026, the same point was made when applied to model use. OpenAI spent more than $6.5 million to resolve Navier Stokes (Astra prices for 130B output tokens only).
The stakes are not just the academic computer scientists doing frontier research on how to build AI models. The stakes are about the whole university system doing frontier research.
Coping with "scarcity is the mother of invention" won't cut it, and we should trust the "godmother of AI" on that.
The world of R&D is forking into two paths: the token-abundant research, and the token-starved research. The future is in the former - evidentially, the progress by today's top AI industry teams and neolabs is breathtaking, where researchers’ human brilliance is super charged by AI’s assistance. Every research university president should be reading this report and reflecting on what the future of higher education research should be.
openai.com/index/research-ac…
The world of R&D is forking into two paths: the token-abundant research, and the token-starved research. The future is in the former - evidentially, the progress by today's top AI industry teams and neolabs is breathtaking, where researchers’ human brilliance is super charged by AI’s assistance. Every research university president should be reading this report and reflecting on what the future of higher education research should be.
openai.com/index/research-ac…
Fei-Fei Li retweeted
Real time streaming of next view prediction model that has accurate camera positioning and is 3D consistent. Unbelievable.
Fei-Fei Li retweeted
For those who remember @theworldlabs original RTFM demo: Atlas allows us to break out of these small spaces.
Here I took the kids playroom and using Atlas-turbo prompted a new outside area into existence.
RTFM, a new generative interactive world model by World Labs, generates real-time video from a single image for exploring 3D worlds.
Trained on large-scale video data to predict the next frame. Achieves unbounded persistence via spatial memory.
try it: rtfm.worldlabs.ai
Fei-Fei Li retweeted
Our new Atlas model now runs real-time after some intense inference optimization! Generating and navigating worlds is so much more visceral when it's interactive.
Inference runs on both B200 and MI355X with similar performance. Both devices are incredible workhorses!