Come check our new #CVPR2025 paper, and released dataset for AR/VR motion synthesis!
Project Website: barquerogerman.github.io/RPM…
Come visit our poster in Nashville
🗓️ Friday, June 13
🕥 10:30 - 12:30
📍 Poster ID 156 (Session 1 – Exhibit Hall D)
1
1
88
🤖 ML Architecture:
We introduce Rolling Prediction Models, that generates smooth and realistic full-body human motion from Hand Tracking, with realistic transition between tracking and synthesis
1
43
Glad to announce that our latest paper will be presented at WACV2025.
Title: XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration
Arxiv: arxiv.org/abs/2411.18377
Robin KIPS retweeted
Introducing Cryptic Cabinet, a new open source mixed reality showcase built with Presence Platform helps turn any room into a unique gameplay experience. ocul.us/3UM9imb
Robin KIPS retweeted
Hand tracking side-by-side comparison 🙌
Top: Apple Vision Pro
Bottom: Meta Quest 3
Our Generative Legs technology is now available for all Quest devices !
We're excited to announce the release of Inside-Out Body Tracking, the first vision-based tracking system for mapping out upper body movements with Quest 3, as well as an AI update that generates plausible leg motions for all Quest devices, Generative Legs ocul.us/3tOBpq0
Robin KIPS retweeted
We're excited to announce the release of Inside-Out Body Tracking, the first vision-based tracking system for mapping out upper body movements with Quest 3, as well as an AI update that generates plausible leg motions for all Quest devices, Generative Legs ocul.us/3tOBpq0
Robin KIPS retweeted
We’re excited for you to start experimenting with all of the new tools and capabilities in our v60 release. Check out what’s new across Haptics, MR Utility Kit, Movement SDK, and more, and learn how these updates can help you accelerate your development: ocul.us/3TPa01J
Robin KIPS retweeted
The CoreAI team at Meta Reality Labs is hiring 2024 interns to work on 3D Generative AI. Joins us to explore (& publish) new methods for texture and shape synthesis and stylization. Feel free to message me if you have any questions or apply directly!
metacareers.com/jobs/7117114…
Robin KIPS retweeted
Excited to share 🔥OmniControl🔥 for incorporating 💭flexible spatial control signals💭 into a text-conditioned human motion generation.
The generated motions are realistic, coherent, and consistent with the spatial constraints.
-Project page: neu-vi.github.io/omnicontrol…
Excited to share that the launch of our "Generative Legs" was announced last week at Meta Connect.
This ML based technology allows to generate a realistic full body motion given the available tracking signal of the VR headset without additional sensors, in real time.
Robin KIPS retweeted
"HMD-NeMo: Online 3D Avatar Motion Generation from Sparse Observations" will be presented at #ICCV2023. Please come and meet us (Room "Foyer Sud" - 013, on Thursday 10:30AM)
Link to paper: openaccess.thecvf.com/conten…
Together with @fatemeh_saleh, David, Pashmina, and @dopomoc
Robin KIPS retweeted
Happy to share our new paper on hair reconstruction that will appear at #ICCV2023, congrats to @ness_pirs and colleagues!
We produce a detailed and personalized strand-based hairstyle from the monocular video.
Project page: samsunglabs.github.io/Neural…
More details in the thread 🧵
Robin KIPS retweeted
We have released the code and weights for our #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"!
code: github.com/facebookresearch/…
abs: arxiv.org/abs/2304.08577
project: dulucas.github.io/agrol/
The demo is below:
Robin KIPS retweeted
Our CVPR2023 paper is finally out on arxiv🤩 this is a joint work with @artsiom_s @AlbertPumarola @alitabet @robin_kips @blacksquirrel__ during my internship at Meta. Amazing team and fantastic experience!!! Stay tuned for the code.
Robin KIPS retweeted
Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model
abs: arxiv.org/abs/2304.08577
project page: dulucas.github.io/agrol/
Robin KIPS retweeted
This paper shows some of our research at Meta Reality Labs in reconstructing a user's pose from only the sensors of the Quest headset using Reinforcement Learning.
authors: with Jungdam Won and Yuting Ye
paper: arxiv.org/abs/2209.09391
video: youtu.be/CkTHsz6Ldas
1/4👇
Robin KIPS retweeted
This morning, Mark Zuckerberg announced that @PyTorch is moving to a new, independent #PyTorchFoundation as part of the #LinuxFoundation umbrella. Learn what’s next for one of the leading platforms for #AI research and production applications. https://teapaw.org/t.co/CRSQ3aB3Gm

















