Company type | Private |
---|---|
Industry | Artificial intelligence, machine learning, software development |
Founded | 2018 |
Headquarters | |
Area served | Worldwide |
Key people |
|
Products | Gen-1, Gen-2, Gen-3 Alpha |
Number of employees | 86 |
Website | runwayml |
Runway AI, Inc. (also known as Runway and RunwayML) is an American company headquartered in New York City that specializes in generative artificial intelligence research and technologies. [1] The company is primarily focused on creating products and models for generating videos, images, and various multimedia content. It is most notable for developing the commercial text-to-video and video generative AI models Gen-1, Gen-2 [2] [3] and Gen-3 Alpha. [1]
Runway's tools and AI models have been utilized in films such as Everything Everywhere All At Once, [4] in music videos for artists including A$AP Rocky, [5] Kanye West, [6] Brockhampton, and The Dandy Warhols, [7] and in editing television shows like The Late Show [8] and Top Gear. [9]
The company was founded in 2018 by the Chileans Cristóbal Valenzuela, [10] Alejandro Matamala, and the Greek Anastasis Germanidis after they met at New York University Tisch School of the Arts ITP. [11] The company raised US$2 million in 2018 to build a platform to deploy machine learning models at scale inside multimedia applications.
In December 2020, Runway raised US$8.5 million [12] in a Series A funding round.
On December, 2021, the company raised US$35 million in a Series B funding round. [13]
In August 2022, the company co-released an improved version of their Latent Diffusion model with the CompVis Group at Ludwig Maximilian University of Munich and a compute donation by Stability AI. [14] [15]
On December 21, 2022 Runway raised U$50 million [16] in a Series C round. Followed by a $141 million Series C extension round in June 2023 at a $1.5 billion valuation [17] [18] from Google, Nvidia, and Salesforce [19] to build foundational multimodal AI models for content generation to be used in films and video production. [20] [21]
In February 2023 Runway released Gen-1 and Gen-2 the first commercial and publicly available foundational video-to-video and text-to-video generation model [22] [23] [24] accessible via a simple web interface.
In June 2023 Runway was selected as one of the 100 Most Influential Companies in the world by TIME magazine. [25]
Runway is focused on generative AI for video, media, and art. The company focuses on developing proprietary foundational model technology that professionals in filmmaking, post-production, advertising, editing, and visual effects can utilize. Additionally, Runway offers an iOS app aimed at consumers [26]
The Runway product is accessible via a web platform and through an API as a managed service.
Gen-1 is a video-to-video generative AI system that synthesize new videos by applying the composition and style of an image or text prompt to the structure of a source video. The model was released in February 2023. The Gen-1 model was trained and developed by Runway based on the original paper Structure and Content-Guided Video Synthesis with Diffusion Models from Runway Research. [27] Gen-1 is an example of Generative artificial intelligence for video creation.
Gen-2 is a multimodal AI system that can generate novel videos with text, images or video clips. The model is a continuation of Gen-1 and includes a modality to generate video conditioned to text. Gen-2 is one of the first commercially available text-to-video models. [28] [29] [30] [31]
Gen-3 Alpha is the first of an upcoming series of models trained by Runway on a new infrastructure built for large-scale multimodal training. It is a major improvement in fidelity, consistency, and motion over Gen-2, and a step towards building General World Models. [2]
Training data for Gen-3 has been sourced from thousands of YouTube videos and potentially pirated films. A former Runway employee alleged to 404 Media that a company-wide effort was to compile videos into spreadsheets, which was then downloaded using youtube-dl through proxy servers to avoid being blocked by YouTube. In tests, 404 Media discovered that names of YouTubers would generate videos in their respective styles. [32]
Runway hosts an annual AI Film Festival [33] in Los Angeles and New York City. [34] [35]
Music and artificial intelligence (AI) is the development of music software programs which use AI to generate music. As with applications in other fields, AI in music also simulates mental tasks. A prominent feature is the capability of an AI algorithm to learn based on past data, such as in computer accompaniment technology, wherein the AI is capable of listening to a human performer and performing accompaniment. Artificial intelligence also drives interactive composition technology, wherein a computer composes music in response to a live performance. There are other AI applications in music that cover not only music composition, production, and performance but also how music is marketed and consumed. Several music player programs have also been developed to use voice recognition and natural language processing technology for music voice control. Current research includes the application of AI in music composition, performance, theory and digital sound processing.
Brainly is an education company based in Kraków, Poland, with headquarters in New York City. It is an AI-powered homework help platform targeting students and parents. As of November 2020, Brainly reported having 15 million daily active users, making it the world's most popular education app. In 2024, FlexOS reported Brainly as the #1 Generative AI Tool in the education category and the #6 Generative AI Tool overall. Also in 2024, Andreessen Horowitz reported Brainly as #6 in the Top 50 Gen AI Mobile Apps by monthly active users.
Multimodal learning, in the context of machine learning, is a type of deep learning using multiple modalities of data, such as text, audio, or images.
OpenAI is an American artificial intelligence (AI) research organization founded in December 2015 and headquartered in San Francisco, California. Its mission is to develop "safe and beneficial" artificial general intelligence, which it defines as "highly autonomous systems that outperform humans at most economically valuable work". As a leading organization in the ongoing AI boom, OpenAI is known for the GPT family of large language models, the DALL-E series of text-to-image models, and a text-to-video model named Sora. Its release of ChatGPT in November 2022 has been credited with catalyzing widespread interest in generative AI.
Artificial intelligence art is visual artwork created through the use of an artificial intelligence (AI) program.
Cristóbal Valenzuela is a Chilean-born technologist, software developer, and CEO of Runway. In 2018, Valenzuela co-founded the AI research company Runway in New York City with Anastasis Germanidis and Alejandro Matamala.
You.com is an AI assistant that began as a personalization-focused search engine. While still offering web search capabilities, You.com has evolved to prioritize a chat-first AI assistant.
Stable Diffusion is a deep learning, text-to-image model released in 2022 based on diffusion techniques. The generative artificial intelligence technology is the premier product of Stability AI and is considered to be a part of the ongoing artificial intelligence boom.
A text-to-image model is a machine learning model which takes an input natural language description and produces an image matching that description.
Mohammad Emad Mostaque is a British-Bangladeshi business executive, mathematician, and former hedge fund manager. He is the founder and was CEO of Stability AI until 23 March 2024, one of the companies behind Stable Diffusion.
A text-to-video model is a machine learning model that takes a natural language description as input and produces a video relevant to the input text. Recent advancements in generating high-quality, text-conditioned videos have largely been driven by the development of video diffusion models.
ElevenLabs is a software company that specializes in developing natural-sounding speech synthesis software using deep learning.
Generative artificial intelligence is artificial intelligence capable of generating text, images, videos, or other data using generative models, often in response to prompts. Generative AI models learn the patterns and structure of their input training data and then generate new data that has similar characteristics.
The AI boom, or AI spring, is an ongoing period of rapid progress in the field of artificial intelligence (AI) that started in the late 2010s before gaining global prominence by 2022. Known examples include protein folding prediction led by Google DeepMind and generative AI led by OpenAI.
In the 2020s, the rapid advancement of deep learning-based generative artificial intelligence models are raising questions about whether copyright infringement occurs when the generative AI is trained or used. This includes text-to-image models such as Stable Diffusion and large language models such as ChatGPT. As of 2023, there are several pending U.S. lawsuits challenging the use of copyrighted data to train AI models, with defendants arguing that this falls under fair use.
Adobe Firefly is a generative machine learning model included as part of Adobe Creative Cloud. It is currently being tested in an open beta phase.
Aleph Alpha is a German artificial intelligence (AI) startup company founded by professionals with experience as employees of Apple, SAP and Deloitte, based in Heidelberg. Aleph Alpha attempts to provide a full-stack sovereign technology stack for generative AI, independent from US companies and comply with European data protection regulations and the AI Act. It built one of the most powerful AI clusters inside its own data centre and develops large language models (LLM), which try to provide transparency of its sources used for the results generated and are intended for enterprises and governmental agencies only. Training of its model has been done in five European languages.
Suno AI, or simply Suno, is a generative artificial intelligence music creation program designed to generate realistic songs that combine vocals and instrumentation, or are purely instrumental. Suno has been widely available since December 20, 2023, after the launch of a web application and a partnership with Microsoft, which included Suno as a plugin in Microsoft Copilot.
Sora is an upcoming generative artificial intelligence model developed by OpenAI, that specializes in text-to-video generation. The model generates short video clips corresponding to prompts from users. Sora can also extend existing short videos. As of July 2024 it is unreleased and not yet available to the public.
Stability AI is an artificial intelligence company, best known for it's text-to-image model Stable Diffusion.