Generate AI video-to-video content directly from your phone using Runway’s iOS app

TL;DR:

  • Runway has launched its first mobile app for iOS users, allowing direct access to its video-to-video generative AI model, Gen-1.
  • Gen-1 functions like a style transfer tool, generating entirely new videos as output.
  • The results can be unusual, with warping and melting features, but still fun to experiment with.
  • The app allows for recording directly from the device, but has limitations such as a five-second footage limit and banned prompts.
  • Processing time is around two to three minutes and is done in the cloud, expected to speed up in the future with the addition of Gen-2.
  • The potential of generative AI is staggering and comparable to the “optical toys” phase of the 19th century.
  • Runway’s mobile app is an exciting opportunity for those interested in cutting-edge technology.

Main AI News:

Leading AI startup, Runway, has launched its first mobile app on the iOS platform, providing users with direct access to its innovative video-to-video generative AI model, Gen-1. With a limited number of credits available for free users, the app can be easily downloaded and utilized to transform existing videos with just a text, image, or video input. Gen-1 operates much like a style transfer tool, with a key difference being that it generates entirely new videos, rather than simply applying filters. This enables users to give their videos a unique touch, whether it be a watercolor painting aesthetic or a charcoal sketch.

 However, as with any generative AI, the results can be…unusual. For example, when adding a claymation effect, the resulting models may not resemble actual claymation, with limbs warping and features melting or smearing between frames. Despite this, the app is still a fun and exciting tool to experiment with. As the app allows for recording directly from the device, it is an ideal platform for on-the-go video editing.

However, there are some limitations to keep in mind, such as a maximum footage length of five seconds, banned prompts, and a processing time of two to three minutes. Although the processing is done in the cloud, it is expected to speed up in the future, with the addition of Runway’s purely generative Gen-2 model coming soon. Despite these limitations, the potential of tools like Gen-1 is truly staggering. The current era of generative AI can be compared to the “optical toys” phase of the 19th century, where the ancestors of modern cameras were being developed. Runway’s mobile app is a prime example of this exciting new technology and an opportunity not to be missed.

Conlcusion:

The launch of Runway’s Gen-1 mobile app on iOS represents a significant step forward in the field of generative AI and its potential applications. With its ability to generate entirely new videos as output and its intuitive interface, the app is poised to be a popular tool among creative individuals and businesses alike. However, its limitations and processing time should be taken into consideration.

From a market perspective, the success of Runway’s app could pave the way for further advancements and innovations in the field of generative AI. It could also lead to increased demand for video-to-video content creation tools, further solidifying the role of AI in the creative industries. Overall, the launch of the Gen-1 mobile app is a promising development and one to watch closely in the coming months and years.

Source