- D-ID launches an AI tool that translates videos into 30 languages, replicates the speaker’s voice, and syncs lip movements.
- The tool builds on D-ID’s previous viral technology and is available to subscribers at no extra cost.
- Subscription plans start at $56 annually, with enterprise options available.
- The tool targets marketing, entertainment, and social media businesses for global content localization.
- AI Video Translate competes in a growing market of AI-driven dubbing and translation tools.
- Powered by D-ID’s proprietary Rosetta-1 model, it supports videos up to 5 minutes in length with specific usage guidelines.
Main AI News:
D-ID, a pioneer in AI video creation, has introduced a sophisticated translation tool that converts videos into multiple languages, replicates the speaker’s voice, and synchronizes lip movements with the translated dialogue. This innovation builds on D-ID’s earlier successes, such as the viral animation of old family photos that captured global attention. The new tool promises to empower creators by significantly expanding their content’s accessibility across different languages and regions.
Following a successful Series B funding round in 2022, which brought in $25 million, D-ID has been focused on meeting the needs of its growing enterprise clientele in the U.S. The AI Video Translate tool, now available at no additional cost to D-ID subscribers, allows users to translate their videos into one of 30 available languages, including Arabic, Mandarin, Japanese, Hindi, Spanish, and French. Subscription plans start at $56 annually for basic features, escalating to $1,293 per year for more comprehensive options, with custom pricing available for enterprise users.
The launch of this tool offers a compelling, cost-efficient solution for businesses looking to localize their content for global markets, particularly in industries like marketing, entertainment, and social media. D-ID’s new offering enters a competitive landscape of dubbing and AI video tools, which have traditionally catered to large-scale productions but are now becoming more accessible to smaller creators. YouTube’s recent multi-language audio feature, adopted by top creators like MrBeast, exemplifies this trend of making multilingual content more accessible.
The use of AI in voice translation and cloning is rapidly evolving, with major players like Microsoft and Vimeo developing similar technologies for video dubbing and voice replication. Companies like Descript, ElevenLabs, and Speechify are also at the forefront of this innovation. At the same time, platforms such as HeyGen and Deepbrain AI offer AI avatars that can communicate in multiple languages.
Powered by D-ID’s proprietary Rosetta-1 model, the AI Video Translate tool is available through D-ID Studio and its API. It supports video content between 10 seconds and 5 minutes, with a maximum file size of 2GB. To achieve the best results, the tool works optimally with videos that feature a single person facing the camera with their face fully visible.
D-ID offers a one-month trial of this groundbreaking technology, with additional demonstrations on its website. This launch underscores the company’s dedication to providing innovative and accessible AI solutions that help content creators reach a global audience.
Conclusion:Â
The introduction of D-ID’s advanced AI translation tool marks a significant shift in the market for multilingual content creation. By providing an accessible and cost-effective solution for video translation and voice replication, D-ID is lowering the barriers for businesses and creators to reach global audiences. This factor could increase competition and innovation within AI video technology, pushing other companies to enhance their offerings. The market will likely see a surge in adopting AI-driven localization tools as businesses seek more efficient ways to expand their reach internationally, thereby driving further growth and development in this sector.
