Henry Ruhs

THIS IS CRAZY 🤯Bifrost just shipped a proper real2sim pipeline that actually works at production speed! You send a single video of a real industrial site or lab. Their system reconstructs a fully navigable, photorealistic 3D environment in ~30 minutes instead of the usual 12+ hours of manual modeling. Technical stack under the hood: - 3D Gaussian Splatting (and derivatives like World Labs Marble) turns the video frames into a dense, view-dependent radiance field. This gives real-time rendering of the exact geometry, materials, and lighting of the captured space without traditional mesh reconstruction bottlenecks. - Articulated asset generation (building on models like TRELLIS for static objects and Articraft-style systems for movable parts) automatically extracts and converts objects into simulation-ready rigid-body or articulated assets with correct collision geometry, joints, and physical properties. - GPU orchestration + domain randomization layers on top so the environment can be relit (GaRe-style), cluttered, and sensor-simulated across RGB, depth, segmentation, and 6-DoF poses. The result is a high-fidelity digital twin that robots can interact with immediately. You drop your policy into the reconstructed scene, run thousands of parallel rollouts on Manifold, and surface failure modes at compute speed rather than waiting for real-world iterations. This closes a big part of the classic sim-to-real gap: visual fidelity no longer looks like a 2001 PS1 game, and the physics/assets are grounded in the actual site instead of generic asset libraries. The DeLorean garage demo is just the public teaser: the same pipeline is already being used for factory cells, warehouses, and manipulation benchmarks.