Will Harvey retweeted
π₯πͺ What should happen when you remove an object from a video?
Example 1:
A domino chain is falling β remove the middle blocks β the last block should remain standing
Example 2:
Two cars are about to crash β remove one car β the other should drive away π
Current video object removal models fail at these dynamic scenarios.
We introduce VOID: a model that removes objects and updates the scene as if they were never there.
π Preferred 64.8% of the time vs Runway Aleph, Gen-Omnimatte, ProPainter, and more.
π Project page: void-model.github.io
π» GitHub: github.com/Netflix/void-modeβ¦
π€ Demo: huggingface.co/spaces/sam-moβ¦
π arXiv: arxiv.org/abs/2604.02296
w/ @willarvey @ZhuoningYuan @ChengTim0708 and collaborators at @NetflixResearch and @INSAITinstitute
Will Harvey retweeted
It is @NeurIPS time again! I am excited to present our trans-dimensional jump diffusion work with @AndrewC_ML @willarvey @ValentinDeBort1 @tom_rainforth and @ArnaudDoucet1 ! Come over on Thursday 2nd poster session, neurips.cc/virtual/2023/postβ¦. arxiv.org/abs/2305.16261 #NeurIPS2023
Will Harvey retweeted
This paper is a goldmine for anyone training diffusion models, carefully picking apart theory and practice and showing which choices really matter.
I was quite excited to see the authors of the StyleGAN series of papers tackle this topic, and boy do they deliver!
Elucidating the Design Space of Diffusion-Based Generative Models
abs: arxiv.org/abs/2206.00364
improve efficiency and quality obtainable with pre-trained score networks from previous work, including improving the FID of an existing ImageNet-64 model from 2.07 to near-SOTA 1.55
Will Harvey retweeted
Flexible Diffusion Modeling of Long Videos
abs: arxiv.org/abs/2205.11495
demonstrate improved video modeling over prior work on a number of datasets and sample temporally coherent videos over 25 minutes in length








