(Multi-agent) simulation and RL • Ph.D. student NYU • Prev @Waymo @NVIDIAAI.

NYC
Joined September 2017
Replying to @elliotarledge
@elliotarledge The network encoder is the bottleneck. This project was done with PufferDrive 2.0. It runs at ~300-400k SPS on a 4090 or 5090. IIRC, using one of the standard PufferLib MLPs gets you 1-1.5 M SPS, but the entity encoder is more performant. Starting from PufferLib 5.0 + spending a little time optimizing the regularizer implementation should get you to ~800k or higher SPS, but the network is still a bottleneck (overview below).
1
1
33
Sweden, here we come! 🇸🇪 I’m heading to ECCV, where we’ll host our workshop this Tuesday: emerging-ad.github.io/ We have a fantastic lineup of speakers; see you there!
1
3
32
2,258
Refactoring efforts pay off 🙂 (same functionality; less and more readable code)
1
1
43
1,812
Looking forward to presenting our work on spiced self-play online on the 31st of July! Sign-up link below
2
4
37
4,873
We provide a couple of comparisons on the webpage! spiced-self-play.com/ e.g., see yellow car here
2
480
New Paper: Human-like Autonomy Emerges from Self-Play and a Pinch of Human Data. We trained self-play RL on 60 years of simulation on 1 GPU in ~15 hours. Regularizing with 30 minutes of demonstration data produces much more human-like driving policies!
8
40
8
350
78,510
Two of my cartoons made it into Nature Communications! Glad to have collaborated on this work, and congratulations to the authors on the publication.
1
1
25
1,464
New preprint led by @saeedrmd! “Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic." Drawing on 200+ papers, it offers a snapshot of where the field stands and outlines promising directions ahead.
2
2
17
1,616
I'm feeling this one today
2
11
2
171
106,477
Benchmarks are a key driver of progress. But how should we evaluate human-like driving? Does the Waymo Open Sim Agent Challenge (WOSAC) really capture what matters? Looking forward to any feedback!
3
5
2
40
7,050