Tag Archives: Lumiere

Google’s new video generation AI model Lumiere uses a new diffusion model called Space-Time-U-Net, or STUNet, that figures out where things are in a video (space) and how they simultaneously move and change (time). Ars Technica reports this method lets Lumiere create the video in one process instead of putting smaller still frames together.  Lumiere starts with creating a base frame from the prompt. Then, it uses the STUNet framework to begin approximating where objects within that frame… Source link

We’ve come a long way from Will Smith eating spaghetti in the last 10 months. AI-generated video is advancing at a jaw-dropping rate – and Google’s extraordinary new space-time diffusion model Lumiere shifts the goalposts yet again. Lumiere can create remarkably realistic – or high quality surrealistic – video clips up to five seconds in length. It can animate still images, or just portions of them, in response to natural language text prompts about what you’d like to see. It can take… Source link