Automating Multilingual Video Dubbing Using Deep Learning and Audio Synthesis

Author(s)	Himanshu Sehrawat, Varun Goel, Meenu Garg, Neha Agarwal
Country	India
Abstract	The paper offers a holistic approach to video translation into several languages that combines deep learning, and audio synthesis techniques, in order to automate the process. Exploiting recent advance in automated speech translation and multimodal translation, we shall develop an approach reproducing high-quality dubbed video materials efficiently and at a large scale. The methodology includes: 1. extraction of audio from the original videos, 2. transcription and translation of audios, 3. synthesis of translated audio tracks, and 4. fusion them with the audio of original videos in order to get final multilingual dubbed videos. Trial findings provide evidence that the suggested approach is able to generate high-quality and indistinguishable from original counterpart dubbed videos among different languages and video formats.
Keywords	Video Dubbing, Automatic Speech Translation, Multilingual Translation, Deep Learning, Audio Synthesis.
Field	Engineering
Published In	Volume 6, Issue 3, May-June 2024
Published On	2024-05-13
Cite This	Automating Multilingual Video Dubbing Using Deep Learning and Audio Synthesis - Himanshu Sehrawat, Varun Goel, Meenu Garg, Neha Agarwal - IJFMR Volume 6, Issue 3, May-June 2024. DOI 10.36948/ijfmr.2024.v06i03.20067
DOI	https://doi.org/10.36948/ijfmr.2024.v06i03.20067
Short DOI	https://doi.org/gtt8vf

About IJFMR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9898-5948-55	editor@ijfmr.com

International Journal For Multidisciplinary Research