Since last year, Artificial Intelligence (AI) models for generating text, images and videos are developing by leaps and bounds. So fast in fact, that it’s become harder to keep up. Compared to high-speed startups, tech giants like Google have decided to go down this path slowly and with caution. Though, the results of their research are also stunning. One of them promises to create high-resolution movies from text with Google’s AI. The new deep-learning model from Google should allow users to generate videos of high quality, based on text inputs alone. This approach combines two of the company’s recent text-to-video projects – Imagen Video and Phenaki. Both of them are still in the research & development phase but the first renderings show that the mentioned AI could be a game-changer for our industry. Let’s dive into this brave new world together! How to create movies from text with Google’s AI? The first technology we have to take a look at is called Phenaki. As described in its research paper, this model is capable of taking several sequences of text prompts, creating connections between them, and then synthesizing a coherent visual story. From the outside, it seems as if AI reads inputs like a normal film script and then decides how to translate the storyline into pictures (sounds like a director’s job, right?). For example, look how Phenaki processed the following description: “Side view of an astronaut who is walking through a puddle on Mars. The astronaut is dancing on Mars; the...
Published By: CineD - Tuesday, 14 February, 2023