Director of Science at @Microsoft @HoloLens, Professor of Computer Science at @ETH Zurich, working on #ComputerVision
Zurich, Switzerland
Joined April 2009
- Tweets189
- Following349
- Followers7.9K
- Likes472
Marc Pollefeys retweeted
ZipSplat: Fewer Gaussians, Better Splats
@veichta, Sunghwan Hong, @majti89, @mapo1
tl;dr: predict Gaussians directly in 3D from a compact set of scene tokens->decouple primitive placement from the 2D pixel grid
arxiv.org/abs/2606.05102
Marc Pollefeys retweeted
Today afternoon @CVPR: 𝐅𝐮𝐧𝐑𝐞𝐜 [Poster 654] 🌴
➡️Input: Egocentric interaction Video 👷♀️
⬅️Output: Functional 4D Reconstruction 🏡
-- come say hi at the poster! 🚀
/w @AlexDelitzas @mapo1 @majti89 @Stanford @ETH
1/ Excited to present FunREC: "Reconstructing Functional 3D Scenes from Egocentric Interaction Videos" at #CVPR2026!
FunREC builds functional, interactable 3D digital replicas of real-world environments from a single egocentric interaction video.
👇 Here's me turning my own kitchen into a functional 3D digital twin, just by interacting with it.
🔗 Project page: functionalscenes.github.io
📄 Paper: arxiv.org/abs/2604.05621
🗓️ Poster: Session 4 (#654), Sat Jun 6, 16:45–18:45, ExHall A
Marc Pollefeys retweeted
Introducing EgoVerse: an ecosystem for robot learning from egocentric human data.
Built and tested by 4 research labs + 3 industry partners, EgoVerse enables both science and scaling
1300+ hrs, 240 scenes, 2000+ tasks, and growing
Dataset design, findings, and ecosystem 🧵
Marc Pollefeys retweeted
#ICCV2025 is starting today 🌺 you can find us at:
🥽 LaMAria Tutorial: 325B, 1:00PM
➡️lamaria.ethz.ch/tutorial
☀️ OpenSUN3D Workshop: 306 B, 1:30PM
➡️opensun3d.github.io
@pesarlin @efedele16 @FrancisEngelman @AlexDelitzas @mapo1 @ICCVConference
Marc Pollefeys retweeted
What a fantastic week at #CoRL2025 in Seoul! It was a pleasure for us on the 🇨🇭Zurich @Microsoft team to finally meet in person the colleagues we collaborate with from our global 🌍 AI teams in Tokyo, Cambridge, Redmond, Beijing and Seoul!
Welcome, @oier_mees ! It's been great to have you join our team.
If you too are excited about this topic, consider joining us! We have open positions for full-time and interns.
After two fantastic years at @UCBerkeley I'm thrilled to share that I've joined @Microsoft in Zurich🇨🇭to pioneer the next generation of multimodal foundation models to drive agents 🤖 that can seamlessly interact across the digital and physical worlds 🌍
We are hiring! 🧵
Welcome, @oier_mees ! It's been great to have you join our team.
If you too are excited about this topic, consider joining us!
After two fantastic years at @UCBerkeley I'm thrilled to share that I've joined @Microsoft in Zurich🇨🇭to pioneer the next generation of multimodal foundation models to drive agents 🤖 that can seamlessly interact across the digital and physical worlds 🌍
We are hiring! 🧵
Marc Pollefeys retweeted
Multi-View 3D Point Tracking
Frano Rajič, @haofeixu, @marko_mih, @derek_siyuanli, Irem Demir, Emircan Gündoğdu, @leike_lk, @serge_prokudin, @mapo1, @SiyuTang3
tl;dr: per-view features+depth maps->fused 3D feature point cloud->kNN-based correlation->spatiotemporal transformer->overlapping windows->3D point trajectories
arxiv.org/abs/2508.21060
Marc Pollefeys retweeted
You're in Zurich or its zone of influence (Lausanne, Paris, BXL, Munich, London, ...) and like AI + Robots?
We (@openai) together with @mimicrobotics, @lokirobotics, and Zurich Builds are organizing a hackathon from Fri 9 May afternoon to Sun 11.
Limited spots, more below:
Marc Pollefeys retweeted
Yuedong @donydchen just gave a fantastic Oral presentation of MVSplat at #ECCV2024! Come to our poster 157 to discuss more! – at Milan, Lombardy
Marc Pollefeys retweeted
📢 Today, we release LabelMaker, a fully automatic tool to create semantic annotations for indoor scenes. LabelMaker will be presented as spotlight at #3DV2024 in March.
🔗 labelmaker.org
🛠️ github.com/cvg/LabelMaker
with @hermannsblum , @FrancisEngelman , and @mapo1
Marc Pollefeys retweeted
I am overjoyed to announce I am hosting the "Workshop on Urban Scene Modeling" along with an amazing team at @CVPR 2024!
Submission deadline March 24
usm3d.github.io
more two challenges, brand new dataset, and amazing keynote speakers soon...!
#CVPR2024 #usm3d #usm3d2024
Marc Pollefeys retweeted
For #NeurIPS2023 we're presenting our latest work SNAP - Self-Supervised Neural Maps for Visual Positioning and Semantic Understanding
Geo data at scale + self-supervision = 💥
Video: youtu.be/xogrwdgNQdo
Paper: arxiv.org/pdf/2306.05407
Code: github.com/google-research/s…
summary🧵⬇️
ALT Teaser image
Marc Pollefeys retweeted
Today @aycatakmaz and I will present our paper OpenMask3D at @NeurIPSConf 🎷🚀
Come by to learn more about the project or to chat about related topics!
📍 Great Hall & Hall B1+B2 (level 1) #906
🕰️ 10:45-12:45
🌎 openmask3d.github.io
@FrancisEngelman @fedassa @mapo1 – at New Orleans, LA
Marc Pollefeys retweeted
Today @efedele16 and I will present our work OpenMask3D at @NeurIPSConf 🎷
Visit our poster to learn more about OpenMask3D or to chat with us!
📍 Great Hall & Hall B1+B2 (level 1) #906
🕰️ 10:45-12:45
🌎 openmask3d.github.io
@FrancisEngelman @fedassa @mapo1
Marc Pollefeys retweeted
Join us today @ICCVConference at the @GoogleAI booth for a live demo of OpenMask3D 🛋️ (un petit amuse-bouche of our @NeurIPSConf '23 work on open-set 3D instance segmentation)
⏲️15:30
🏠Google Booth
openmask3d.github.io
Amazing work w/ @aycatakmaz @efedele16 @mapo1 @fedassa
Marc Pollefeys retweeted
I am excited to announce our HoloAssist work at #ICCV! Get your hands on the dataset at holoassist.github.io/, released under a permissive license. Meet my collaborator @big_stamp at the poster session this Friday from 02:30-04:30 PM. Huge thanks to the coauthors and colleagues at @MSFTResearch for their support. Tagging co-authors on X - @neelsj @mapo1 @danbohus @seanandrist.
HoloAssist is a new multimodal dataset consisting of 166 hours of interactive task executions with 222 participants. Discover how it offers invaluable data to advance the capabilities of next-gen AI copilots for real-world tasks: msft.it/60139Uv4d
Marc Pollefeys retweeted
Joint work by: @DRozumnyi @matas_jiri @mapo1 @VittoFerrariCV @Martin_R_Oswald
Code: github.com/rozumden/tracking…
