Video Diffusion Model
A class of generative models trained on large-scale video-text pairs that learn to progressively denoise from noise to generate coherent frame sequences. They can be used for novel view synthesis and video re-shooting.
Timeline (last 90 days)
Deepfakes, NeRF (neural radiance fields), and video diffusion models are key technologies in the AI cloning technology chain.
StateCraft's core architecture consists of two components: an abstract state responsible for tracking entity attributes and changes, and a visual state generated by a video diffusion model that represents the current viewpoint's frame.
In StateCraft, a language model is responsible for maintaining and updating the abstract state, and the video diffusion model transforms the abstract state into visual output, with the generation of the visual state conditioned on the abstract state.
Video diffusion models are far more computationally intensive than image generation.
All Facts (4)
Deepfakes, NeRF (neural radiance fields), and video diffusion models are key technologies in the AI cloning technology chain.
50%UnverifiedStateCraft's core architecture consists of two components: an abstract state responsible for tracking entity attributes and changes, and a visual state generated by a video diffusion model that represents the current viewpoint's frame.
50%UnverifiedIn StateCraft, a language model is responsible for maintaining and updating the abstract state, and the video diffusion model transforms the abstract state into visual output, with the generation of the visual state conditioned on the abstract state.
50%UnverifiedVideo diffusion models are far more computationally intensive than image generation.
50%