Indian Flag
Government Of India
A-
A
A+

NPTEL Python Lectures Punjabi (Dubbed and lip synced)

NPTEL Python Lectures in Punjabi (Dubbed and lip synced)

About Use Case

Cross-lingual dubbing of lecture videos requires the transcription of the original audio, correction and removal of disfluencies, domain term discovery, text-to-text translation into the target language, chunking of text using target language rhythm, text-to-speech synthesis followed by isochronous lip-syncing to the original video. This task becomes challenging when the source and target languages belong to different language families, resulting in differences in generated audio duration. This is further compounded by the original speaker's rhythm, especially for extempore speech. The work involves generating dubbed and lipsynced NPTEL lectures in vernacular languages.  Reference: 1. Lipsyncing Efforts for Transcreating Lecture Videos in Indian Languages ) (2. Technology Pipeline for Large Scale Cross-Lingual Dubbing of Lecture Videos into Multiple Indian Languages)

Source Organization Source Organization

Digital India BHASHINI Division

Tags Tags

  • NPTEL
  • lectures
  • lipsync
  • dubbing

Tags Sector

Science, Technology and Research

Related Datasets Related Datasets

Updated 2 month(s) ago
Nepali male Mono (indicTTS Phase 3)
Nepali male Mono (indicTTS Phase 3)
Information
Nepali Male Monolingual dataset containing about 10 hours of standard Studio quality audios along with text.
multilingual-TTS
TTS corpus
studio-recorded TTS data
TTS training
indictts
  • See Upvoters0
  • Downloads4
  • File Size1.95 GB
  • Views38

DIGITAL INDIA BHASHINI DIVISION