Indian AI startup NeuralGarage uses AI to achieve perfect synchronization of film and television dubbing

When watching dubbed movies, audiences often encounter a problem: the character's mouth shape does not match the dubbing language, which not only affects the viewing experience, but also makes it difficult to immerse yourself in the story. In order to change this situation, NeuralGarage, an Indian startup founded in 2021, is actively working hard to revolutionize the dubbing industry.

NeuralGarage is headquartered in Bangalore, India, and was co-founded by four old friends Anjan Panjaj, Subhashish Saha, Subabraat Dbanta and Mandal Natkar. The platform aims to solve the problem of facial motion mismatch in dubbed content. With its technology "VisualDub", NeuralGarage not only ensures that the character's mouth shape and dubbing are consistent, but also maintains the naturalness and high quality of the picture.

NeuralGarage stood out in the AWS Global Generative AI Accelerator Program and received $1 million in AWS promotional credits and other support. The company emphasizes that video quality must be ensured when adjusting facial expressions, especially when camera angles and lighting change, which is a particularly difficult challenge.

For example, if a professor speaks in Spanish while watching "Paper," NeuralGarage's technology can make it appear as if he is speaking English. "Once you experience synchronicity like this, it's hard to go back to the way it was before," said Subbharat Depantal, the company's co-founder and chief technology officer.

Currently, NeuralGarage has partnered with big names such as Amazon India and Coca-Cola to help the advertising industry quickly update video content for different festivals or promotions. Depantal mentioned that Amazon India has recently started leveraging the technology by applying the same video footage to different seasonal marketing campaigns.

In the film industry, NeuralGarage works with film distributors such as Europa Movies, which has a market share of 95%, to help them deal with challenges such as global distribution, piracy prevention, and dubbing synchronization.

Despite NeuralGarage's technological potential, it still faces many challenges. One of the main issues is ensuring that facial adjustments are seamlessly integrated with high-quality video, while adapting to different camera angles and lighting conditions. In addition, technology needs to remain natural and avoid an "artificial intelligence feel" when processing the facial expressions of high-profile actors.

In order to cope with competition, NeuralGarage plans to further expand its market influence in 2025. The company successfully received US$1.45 million in financing from Xfinity Ventures in 2022 and is currently preparing for Series A financing to expand business scale and improve products.