AI text-to-video generation within reach with Runway’s 2nd gen model

How AI tools are creating new possibilities for movies and visual design, according to this AWS-powered startup

And now, AI startup Runway Research has announced a new AI video generation model that’s set to make text-to-video mainstream, with its Gen-2 offering. It is a full-stack applied research company that builds generative AI models and develops infrastructure to deploy those models to production. Runway AI is designed for anyone who wants to create and edit videos, regardless of their level of technical expertise. From amateur TikTokers and YouTubers to professional movie and TV studios, Runway AI’s tools can be used by anyone with anything to say.

These systems have the capacity to comprehend and generate content across diverse modalities, including text, images, audio and video. This research is pivotal in enabling AI to be more versatile and adaptable, opening up new avenues for creative applications. Gen-1 allows users to transform existing video footage, input a rough 3D animation or shaky smartphone clip and apply an AI-generated overlay.

RELATED NEWS

Gen-2 costs 5 credits per second of video generation, with 1 credit being equal to $.01​. At this stage, Gen-2 is more of a novelty or toy than a genuinely useful tool in a video workflow. While its output can potentially be edited into something more coherent, this would likely require significant work, possibly even more than shooting the footage in the first place​. However, the model does show promise in understanding a range of styles, like anime and claymation, that can be adapted to the lower framerate​.

The entrance of the publicly available AI program Gen-2 by Runway then poses to be a rational follow-up on the progress of artificial intelligence. It analyzes the written words and in minutes – even seconds – the program produces a video based on the prompt the user feeds into its system. Within the Runway program, there are multiple options for creating videos.

Titanium 3D printing video might be a peek behind the iPhone 16 curtain

Anyone who wants to try the tool out will need to sign up through the company’s Discord. While text-to-image AI tools such as Midjourney and Dall-E advance and become more and more perfected, Runway‘s recently launched text-to-video AI tool, Gen-2, appears to be the logical progression in Gen-AI technology. The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Runway uses a combination of AI and human moderation to prevent users from generating videos that include pornographic or violent content or violate copyrights.

Yakov Livshits
Founder of the DevEducation project
A prolific businessman and investor, and the founder of several large companies in Israel, the USA and the UAE, Yakov’s corporation comprises over 2,000 employees all over the world. He graduated from the University of Oxford in the UK and Technion in Israel, before moving on to study complex systems science at NECSI in the USA. Yakov has a Masters in Software Development.

The emergence of text-to-video AI programs like Gen-2 allows general users to create video content without relying heavily on the complex settings of movie making. Gen-2 doubles as a video-ready production tool that realistically and consistently synthesizes new videos. ‘It’s like Yakov Livshits filming something new, without filming anything at all,’ says Runway. In one of its video models, Runway types ‘the late afternoon sun peeking through the window of a New York City loft’ and puts together a scenic view of the city from the window inside a plant-covered apartment.

We’re on the precipice of a massive shift when it comes to content creation that is empowering for creatives around the world. New technologies like generative AI are allowing more diverse stories to be told and opening the door to possibilities that artists could Yakov Livshits only dream of in the past. These tools are ushering in the next generation of artistic expression, which will be highly democratized and accessible. “Deep neural networks for image and video synthesis are becoming increasingly precise, realistic, and controllable.

At the start of the year, Microsoft bought a stake in the latter startup for a sum reported to be $10 billion. As part of the deal, OpenAI received access to a significant amount of Azure cloud infrastructure. Google is said to have made the investment as part of a $100 million funding round that Runway recently raised. The round was first reported last month by Insider, which cited sources as saying that the capital came from a “top cloud provider.” The report didn’t name the cloud provider in question.

Browse News Releases

The Pro plan costs $28 per user per month (billed annually as $336) and includes 2250 credits per month, which equates to 450 seconds of Gen-2. For larger teams and organizations that need a custom, secure, and robust flexibility at scale, there is the Enterprise plan, for which you would need to contact Runway for pricing. Investors recently told Insider that they were big fans of buzzy photo and video generative AI startup Runway. The world of Generative AI reaches another milestone with RunwayML‘s release of Gen-2, a multi-modal AI system capable of creating novel videos from text, images, or video clips. This funding round brings the company’s total funding to $95.5 million, according to Crunchbase. Runway plans to use the fresh funds to develop new tools, particularly around audiovisual applications.

• The company’s core product is a browser-based video editing platform that utilizes AI and ML algorithms to automate or enhance the editing process.
• The startup is offering a web-based video editor that specialises in AI tools such as pose detection and background removal.
• In conclusion, Runway AI is an innovative startup that aims to bring the power of AI to everyone, everywhere with anything to say.
• For the time being, filmmakers, animators, CGI artists, and ethicists can rest easy.
• With Gen-1, Runway is launching Video to Video, a form of generative AI that uses words and images to generate new videos out of existing ones.