Gen-2 — the latest version of the runway AI video generator
runway AI‘s Gen-2 is the latest version of the company’s video generator. It is a text-to-video tool that creates motion pictures based on brief descriptions, unlike its predecessor. Truly, it could revolutionize video and movie production.
In addition to this, Runway Gen-2 adds several new features to the video generator, such as adding a background and other objects that blend with your original image.
Moreover, it enables you to train custom AI video generation models that can be used for specific projects. Thus, runway AI could be easily integrated into work and other activities. It is not publicly available at the time of writing.
Check any Runway AI sample; you will see the video constantly shifting. So, the problem with AI video generators like Runway is that they don’t produce realistic images.
Their skin seems to vibrate as the video plays. The janky aesthetic may be the result of AI video generators rendering each second of the video.
When you combine these AI renders together, you end up with unnatural textures in AI videos. This is also true when Meta generates video from the text.
A Make-A-Video tool was announced in September 2022, but it hasn’t been released publicly. Meta’s samples indicate that the tool can produce images of “superhero dogs flying” and “horses galloping.”
Despite this, Meta and Runway AI outputs seem too rudimentary for real-world use. Some are too basic, while most are awkward and clunky.
With further research, these text-to-video tools may produce better results. Once that happens, they will change video production.
As a temporary solution, you can try the new AI features of popular video editing software. Adobe Premiere Pro, for example, now offers text-based editing.
With this tool, you can easily search for specific segments of your video by searching specific keywords. It automatically transcribes video dialogue into editable text and adds it to your Timeline.
Using the sequenced transcript, you can copy and paste phrases, and Adobe AI will change your Timeline accordingly.
Adobe also adds automatic tone mapping, which allows users to work with different media and color spaces without having to tweak settings. It transforms color gamuts from log formats to display standard sequences correctly.
