Meta, the parent company of Facebook, has recently unveiled a new AI model called Movie Gen, which is capable of generating highly realistic video and audio content based on written commands. This AI, which competes directly with OpenAI’s Sora model, can create videos up to 16 seconds long and audio clips up to 45 seconds. In a demonstration, Meta showcased Movie Gen’s capabilities, including creating lifelike videos of swimming and surfing animals, as well as generating actions based on specific commands, such as drawing, singing, and conducting experiments.
One unique feature of Movie Gen is its ability to create background music and sound effects that synchronize with the content of the video. Additionally, users have access to video editing tools within the Movie Gen platform. Test videos have shown Movie Gen’s capability to attach virtual objects to real-life scenes, such as adding feather balls to a person’s hands while running in the desert or transforming a parking lot into a skateboarding area.
While Meta emphasized that Movie Gen presents exciting opportunities for creative expression, they also stated that AI technology will not replace the work of artists and creators. Meta plans to make Movie Gen available to the content creation community and integrate the model into their flagship products shortly.
The entertainment industry has shown great interest in leveraging AI tools to streamline the filmmaking process, but concerns about copyright issues, professional ethics, and the potential misuse of AI-generated content have also been raised. Meta has indicated that Movie Gen will be made available to the content creation community and those working in the entertainment industry, but there are no plans to release it to all users due to the unique risks associated with the model.
In developing Movie Gen, Meta combined licensed information repositories and public user data as part of the model’s training data. Meanwhile, rival company OpenAI has been working with Hollywood agents to seek a cooperation agreement in training their Sora model. Notably, the entertainment industry has seen instances of legal action related to AI-generated content, such as actress Scarlett Johansson suing a producer for imitating her voice without permission.
Overall, Movie Gen represents a significant advancement in AI technology for content creation, and its integration into Meta’s flagship products is anticipated to have a substantial impact on the entertainment industry.