Meta, the parent company of Facebook and Instagram, has introduced two artificial intelligence (AI) models for content editing and generation. The first model, Emu Video, generates video clips based on text and image inputs, using a "factorized" approach to training. The second model, Emu Edit, focuses on image manipulation, allowing users to perform precise edits, such as background removal or addition. Both models are in the research stage, with potential use cases for creators, artists, and animators.
Meta, the parent company of Facebook and Instagram, has unveiled two new artificial intelligence (AI) models designed for content editing and generation. The first model, Emu Video, utilizes a "factorized" approach to generate video clips based on text and image inputs. The second model, Emu Edit, focuses on image manipulation, providing users with precise editing capabilities, including background removal or addition. Although still in the research stage, Meta sees potential use cases for creators, artists, and animators. The models aim to offer advanced content creation tools with applications across various media formats.
The Emu Video model is trained using a two-step process, generating images conditioned on a text prompt and then creating videos based on both the text and the generated image. This approach allows the model to efficiently generate video clips, responding to different inputs. The Emu Edit model, specializing in image manipulation, enables users to perform tasks such as altering backgrounds, applying color and geometry transformations, and conducting local and global edits on images.
Meta emphasizes the precision of its AI models, particularly in following specific instructions for image editing. For instance, the company mentions that when adding text to a baseball cap, the cap itself should remain unchanged.
It's worth noting that Meta has faced increased scrutiny from regulators regarding its AI tools, leading the company to adopt a cautious approach to their deployment. Recently, Meta announced restrictions on the use of its AI tools for creating ads on Facebook and Instagram, specifically disallowing political campaigns and advertisers from utilizing these tools. While the company is actively developing advanced AI models, it remains mindful of ethical considerations and regulatory concerns surrounding AI-based technologies.
(ANA PAULA PEREIRA, COINTELEGRAPH, 2023)
