Robin KIPS (@robin_kips) profile picture

Applied Research Scientist at Reality Labs - Meta Phd at Telecom Paris - Institut Polytechnique de Paris

Joined April 2017
Photo by Robin KIPS (@robin_kips)Photo by Robin KIPS (@robin_kips)Photo by Robin KIPS (@robin_kips)Photo by Robin KIPS (@robin_kips)Photo by Robin KIPS (@robin_kips)Photo by Robin KIPS (@robin_kips)Photo by Robin KIPS (@robin_kips)
Come check our new #CVPR2025 paper, and released dataset for AR/VR motion synthesis! Project Website: barquerogerman.github.io/RPM… Come visit our poster in Nashville 🗓️ Friday, June 13 🕥 10:30 - 12:30 📍 Poster ID 156 (Session 1 – Exhibit Hall D)
1
1
88
🤖 ML Architecture: We introduce Rolling Prediction Models, that generates smooth and realistic full-body human motion from Hand Tracking, with realistic transition between tracking and synthesis
1
43
📚 New Dataset of real VR inputs: We release the GORP dataset, the first dataset of real VR inputs with paired ground truth. It can be used to explore motion generation from a realistic sensor setup. With 14 hours this dataset is large enough for both training and evaluation.
29
Glad to announce that our latest paper will be presented at WACV2025. Title: XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration Arxiv: arxiv.org/abs/2411.18377
1
1
4
205
In this paper we proposed to leverage the available depth sensing signal, combined with self-supervision to learn a multi-modal pose estimation model capable of tracking lower body motion on XR devices, relaxing the need for large scale ground truth data in XR body tracking.
77
Introducing Cryptic Cabinet, a new open source mixed reality showcase built with Presence Platform helps turn any room into a unique gameplay experience. ocul.us/3UM9imb
2
47
5
163
14,649
Hand tracking side-by-side comparison 🙌 Top: Apple Vision Pro Bottom: Meta Quest 3
195
649
221
6,541
2,130,271
Our Generative Legs technology is now available for all Quest devices !
We're excited to announce the release of Inside-Out Body Tracking, the first vision-based tracking system for mapping out upper body movements with Quest 3, as well as an AI update that generates plausible leg motions for all Quest devices, Generative Legs ocul.us/3tOBpq0
1
4
137
We're excited to announce the release of Inside-Out Body Tracking, the first vision-based tracking system for mapping out upper body movements with Quest 3, as well as an AI update that generates plausible leg motions for all Quest devices, Generative Legs ocul.us/3tOBpq0
17
55
14
268
44,395
We’re excited for you to start experimenting with all of the new tools and capabilities in our v60 release. Check out what’s new across Haptics, MR Utility Kit, Movement SDK, and more, and learn how these updates can help you accelerate your development: ocul.us/3TPa01J
7
19
65
8,290
The CoreAI team at Meta Reality Labs is hiring 2024 interns to work on 3D Generative AI. Joins us to explore (& publish) new methods for texture and shape synthesis and stylization. Feel free to message me if you have any questions or apply directly! metacareers.com/jobs/7117114…
3
21
115
19,860
Excited to share 🔥OmniControl🔥 for incorporating 💭flexible spatial control signals💭 into a text-conditioned human motion generation. The generated motions are realistic, coherent, and consistent with the spatial constraints. -Project page: neu-vi.github.io/omnicontrol…
4
17
3
136
31,038
Excited to share that the launch of our "Generative Legs" was announced last week at Meta Connect. This ML based technology allows to generate a realistic full body motion given the available tracking signal of the VR headset without additional sensors, in real time.
1
13
1,568
"HMD-NeMo: Online 3D Avatar Motion Generation from Sparse Observations" will be presented at #ICCV2023. Please come and meet us (Room "Foyer Sud" - 013, on Thursday 10:30AM) Link to paper: openaccess.thecvf.com/conten… Together with @fatemeh_saleh, David, Pashmina, and @dopomoc
3
8
2
35
13,632
Happy to share our new paper on hair reconstruction that will appear at #ICCV2023, congrats to @ness_pirs and colleagues! We produce a detailed and personalized strand-based hairstyle from the monocular video. Project page: samsunglabs.github.io/Neural… More details in the thread 🧵
18
442
43
2,640
228,006
We have released the code and weights for our #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"! code: github.com/facebookresearch/… abs: arxiv.org/abs/2304.08577 project: dulucas.github.io/agrol/ The demo is below:
4
50
3
300
35,717
Robin KIPS retweeted
Our CVPR2023 paper is finally out on arxiv🤩 this is a joint work with @artsiom_s @AlbertPumarola @alitabet @robin_kips @blacksquirrel__ during my internship at Meta. Amazing team and fantastic experience!!! Stay tuned for the code.
Our paper "Avatars Grow Legs" (CVPR 2023) is out! TL; DR: Fast Diffusion models to generate full body motions based on head and hands tracking inputs, Will release the code in a few days.
2
2
14
1,478
Robin KIPS retweeted
Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model abs: arxiv.org/abs/2304.08577 project page: dulucas.github.io/agrol/
6
59
7
303
90,091
This paper shows some of our research at Meta Reality Labs in reconstructing a user's pose from only the sensors of the Quest headset using Reinforcement Learning. authors: with Jungdam Won and Yuting Ye paper: arxiv.org/abs/2209.09391 video: youtu.be/CkTHsz6Ldas 1/4👇
52
586
161
3,079
Robin KIPS retweeted
This morning, Mark Zuckerberg announced that @PyTorch is moving to a new, independent #PyTorchFoundation as part of the #LinuxFoundation umbrella. Learn what’s next for one of the leading platforms for #AI research and production applications. https://teapaw.org/t.co/CRSQ3aB3Gm
16
186
31
937