Lawson (@lawsonfulton) header
Lawson (@lawsonfulton) profile picture

Reality View @ Tesla SI

Palo Alto
Joined November 2007
Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)Photo by Lawson (@lawsonfulton)
Lawson retweeted
In FSD V15, the Tesla AI computer re-renders reality with chevrons in the sky for turns like a video game. You can tap any point on the reality revisualizer to make your car go there.
1,255
1,711
395
17,996
1,361,816
Lawson retweeted
This is real-time AI video generation (no gaming engine!) using just half of one AI4 TRIP accelerator. Let that sink in …
The crazier thing is that the right side uses less compute than what the left used to take. Extreme compute efficiency optimization.
718
632
133
6,535
674,959
Lawson retweeted
It’s like GTA
Here are the new FSD visualizations in FSD V15. It continuously streams a view from an arbitrary virtual camera situated above your vehicle. Upcoming navigation turns display directly in the driving visualization. Turn signals are quieter and fade out after a few clicks.
1,180
1,140
149
15,693
1,217,673
Lawson retweeted
FSD 15 VISUALIZATIONS ARE INSANE HOW IS THIS EVEN POSSIBLE
FSD v15 now starting to roll out – upgrading every part of the end-to-end driving network Safety 25x better handling of safety critical cases Tesla Reality View  Adds a live visualization of the drive that lets you see & control what FSD is planning to do Navigation for start & end of the trip now learns end-to-end from fleet route preferences. Later v15 releases will expand this to the entire route. You also should notice better detection of signs, animals, debris, potholes and standing water, plus more natural speed handling in school zones and inclement weather. Lastly, FSD can now slow for speed cameras & Bike Rack Mode lets you enable FSD w/ bike racks or similar hitch accessories
89
121
15
2,976
131,624
Lawson retweeted
Look at how good the visualizations are in Tesla FSD v15! 🤯😍 Absolutely stunning
19
14
3
347
7,883
Lawson retweeted
v15 is 25x safer than v14 across the fleet. That’s hard to notice on any individual drive because most drives are already very safe. The difference only becomes clear when you aggregate millions of miles. All credit goes to the incredibly talented and dedicated @TeslaSI engineers who made this possible. It’s an honor to work alongside them.
FSD v15 now starting to roll out – upgrading every part of the end-to-end driving network Safety 25x better handling of safety critical cases Tesla Reality View  Adds a live visualization of the drive that lets you see & control what FSD is planning to do Navigation for start & end of the trip now learns end-to-end from fleet route preferences. Later v15 releases will expand this to the entire route. You also should notice better detection of signs, animals, debris, potholes and standing water, plus more natural speed handling in school zones and inclement weather. Lastly, FSD can now slow for speed cameras & Bike Rack Mode lets you enable FSD w/ bike racks or similar hitch accessories
136
247
33
2,354
174,040
Lawson retweeted
FSD v15 is magical
FSD v15 now starting to roll out – upgrading every part of the end-to-end driving network Safety 25x better handling of safety critical cases Tesla Reality View  Adds a live visualization of the drive that lets you see & control what FSD is planning to do Navigation for start & end of the trip now learns end-to-end from fleet route preferences. Later v15 releases will expand this to the entire route. You also should notice better detection of signs, animals, debris, potholes and standing water, plus more natural speed handling in school zones and inclement weather. Lastly, FSD can now slow for speed cameras & Bike Rack Mode lets you enable FSD w/ bike racks or similar hitch accessories
12
6
212
6,428
V15 debuts the Tesla Reality View. The same end-to-end driving model also renders a realistic view of the world around the vehicle. It’s not there just because it looks cool, but it also communicates the intent of the car. The arrows show the turns FSD intents to take, the pins show its intent to park in a spot and so on.
Omg the big holographic arrows telling you where to go
200
264
58
2,728
90,068
Look how far we’ve come
108
208
51
2,934
213,155
XV is the culmination of countless late nights from our incredible team. Reality View is probably the most fun I have ever had working on a project. Can’t wait for everyone to try it.
FSD v15 now starting to roll out – upgrading every part of the end-to-end driving network Safety 25x better handling of safety critical cases Tesla Reality View  Adds a live visualization of the drive that lets you see & control what FSD is planning to do Navigation for start & end of the trip now learns end-to-end from fleet route preferences. Later v15 releases will expand this to the entire route. You also should notice better detection of signs, animals, debris, potholes and standing water, plus more natural speed handling in school zones and inclement weather. Lastly, FSD can now slow for speed cameras & Bike Rack Mode lets you enable FSD w/ bike racks or similar hitch accessories
345
206
22
3,960
123,429
👀
What if we are just driving in a video game
3
5
224
4,639
Using FSD is far safer than driving manually, as measured over 12 billion miles of its use. Safer by a margin of 2x the miles between collisions! It can do so, because, FSD is trained on corner cases extracted from more than a 1000 lifetimes of driving. It has learnt to accurately predict the probability of collision even for crazy cases such others running red lights, swerving into us, kids running into roads and such. Do watch the full video for some highlights. A no-brainer way to significantly improve your and your family's safety is to get a Tesla with FSD. It also completely takes the stress out of driving. Not saying this just because I work at Tesla, rather that it's genuinely a great product already and is continuing to get even better.
FSD Supervised helps save lives
612
1,247
123
9,168
1,214,767
Really big
De toekomst van mobiliteit is aangebroken FSD Supervised has been approved in the Netherlands 🇳🇱 & will begin rolling out in the country shortly!  Trained on billions of kilometers of real-world driving data, it can drive you almost anywhere under your supervision – from residential roads to city streets & highways No other vehicle can do this.  We're excited to bring FSD Supervised to more European countries soon
1
1
36
2,516
Just the beginning
Just started Tesla Robotaxi drives in Austin with no safety monitor in the car. Congrats to the @teslasi team! If you’re interested in solving real-world AI, which is likely to lead to AGI imo, join Tesla AI. Solving real-world AI for Optimus will be 100X harder than cars.
1
1
27
2,086
Come join and help us develop this super cool tech! See @aelluswamy's write up for more details.
Wrote about some of the recent work from the excellent @teslasi team. The same material was presented at the International Conference of Computer Vision this week. The main purpose of sharing this content is to show the cutting-edge work that the team has been developing and attract more talented engineers to join the team. Tesla is THE place to solve real-world robotics. The team is extremely talented, determined and motivated. The technology that is already developed is cutting-edge and the roadmap is exhilarating. The work done here will tremendously benefit all of humanity. Hence, we believe that this is the best place to work on AI on the entire planet currently. Join us and let's bring millions of intelligent, friendly and useful robots to life. tesla.com/AI
7
3
5
144
24,087
A peek into what we've been working on
A new 30-minute presentation from @aelluswamy, Tesla’s VP of AI, has been released, where he talks about FSD, AI and the team’s latest progress. Highlight from the presentation: • Tesla's vehicle fleet can provide 500 years of driving data every single day. Curse of Dimensionality: • 8 cameras at high frame rate = billions of tokens per 30 seconds of driving context. • Tesla must compress and extract the right correlations between sensory input and control actions. Data Advantage: • Tesla has access to a “Niagara Falls of data” — hundreds of years’ worth of collective fleet driving. • Uses smart data triggers to capture rare corner cases (e.g., complex intersections, unpredictable behavior). Quality and Efficiency: • Extracts only the essential data needed to train models efficiently. Debugging and Interpretability: • Even though the system is end-to-end, Tesla can still prompt the model to output interpretable data: 3D occupancy, road boundaries, objects, signs, traffic lights, etc. • Natural language querying: ask the model why it made a certain decision. • These auxiliary predictions don’t drive the car but help engineers debug and ensure safety. Tesla’s Advanced Gaussian Splatting (3D Scene Modeling): • Tesla developed a custom, ultra-fast Gaussian splatting system to reconstruct 3D scenes from limited camera views. • Produces crisp, accurate 3D renderings even from few camera angles — far better than standard NeRF/splatting approaches. • Enables rapid visual debugging of the driving environment in 3D. Evaluation & World Models: • Evaluation is the hardest challenge: models may perform well offline but fail in real-world conditions. • Tesla builds balanced, diverse evaluation datasets focusing on edge cases — not just easy highway driving. Introduced a learned world simulator (neural network-generated video engine): • Can simulate 8 Tesla camera feeds simultaneously — fully synthetic. • Used for testing, training, and reinforcement learning. • Allows adversarial event injection (e.g., adding a pedestrian or vehicle cutting in). • Enables replaying past failures to verify new model improvements. • Can run in near real-time, letting testers “drive” inside a simulated world. What’s Next: • Scale robotaxi service globally. • Unlock full autonomy across the entire Tesla fleet. • Cybercab: next-gen 2-seat vehicle designed specifically for robotaxi use, targeting lowest transportation cost (cheaper than public transit). • Same neural networks will power Optimus humanoid robot. • The same video generation system is now being applied to Optimus. • The system can simulate and plan movement for robots, adapting easily to new forms. via the International Conference on Computer Vision (ICCV). Full presentation: youtube.com/watch?v=wHK8GMc9…
14
1,091
Sadly I missed the photo 😭
1
11
802
👀
Cybertruck vision Park update continues to rollout! Woo! Anyone else?
1
9
1,502
Lawson retweeted
Tesla Vision Autopark now rolling out to vehicles with ultrasonic sensors in the US & Canada
This is a pretty tight parking space that probably 90% of drivers can’t parallel park in. Tesla Vision performs it effortlessly. Now available in FSD (Supervised) v12.3.6 for vehicles with ultra sonic sensors.
384
718
85
5,306
1,178,367