Indian Flag
Government Of India
A-
A
A+
ORGANISATION

AI4Bharat - IndicBERTv2-MLM-Sam-TLM: Multilingual MLM with Sampled Translation

A transformer-based model pre-trained on multiple Indian languages using Masked Language Modeling and Sampling-based Translation Language Modeling techniques.

About Model

IndicBERTv2-MLM-Sam-TLM is a multilingual language model pre-trained on multiple Indian languages using Masked Language Modeling (MLM) and Sampling-based Translation Language Modeling (Sam-TLM) techniques. This training regimen enables the model to effectively handle translation tasks and understand semantic relationships across diverse Indian languages.

AI4Bharat - IndicBERTv2-MLM-Sam-TLM: Multilingual MLM with Sampled Translation

Metadata Metadata

MIT

Doddapaneni, Sumanth and Aralikatte, Rahul and Ramesh, Gowtham and Goyal, Shreya and Khapra, Mitesh M. and Kunchukuttan, Anoop and Kumar, Pratyush.

Multilingual Language Model

N.A.

Open

AI4Bharat

Sector Agnostic

21/02/25 13:21:07

0

Activity Overview Activity Overview

  • Downloads0
  • Redirect 6
  • File Size 0
  • Views 259

Tags Tags

  • Multilingual
  • Indian Languages
  • NLP
  • Language Model
  • Masked Language Modeling
  • Sampling-based Translation

License Control License Control

MIT

More Models from AI4Bharat More Models from AI4Bharat

AI4Bharat- 500 M - RomanSetu Multilingual Native-to-Roman Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
Multilingual
Instruction-Tuning
Llama
LLaMA2
  • See Upvoters1
  • Downloads53
  • File Size0
  • Views1,102
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat- 400 M - RomanSetu Multilingual Native-to-Roman Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
Multilingual
LLaMA2
Llama
Instruction-Tuning
  • See Upvoters1
  • Downloads94
  • File Size0
  • Views1,218
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat- Maithili - IndicConformer Automatic Speech Recognition (ASR) Model
This model takes in mono-channel audio files at a 16,000 Hz sampling rate (WAV format) and outputs the transcribed text of the speech contained in the audio.
NLP
Automatic Speech Recognition
Speech-to-Text
  • See Upvoters0
  • Downloads29
  • File Size0
  • Views843
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat- Konkani - IndicConformer Automatic Speech Recognition (ASR) Model
Automatic Speech Recognition (ASR) model for Konkani speech recognition, processing 16,000 KHz mono WAV audio and transcribing spoken content into text
Speech-to-Text
Automatic Speech Recognition
NLP
  • See Upvoters0
  • Downloads35
  • File Size0
  • Views849
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat- Kashmiri - IndicConformer Automatic Speech Recognition (ASR) Model
This Automatic Speech Recognition (ASR) model transcribes Kashmiri speech from 16,000 KHz mono WAV audio files into text
NLP
Automatic Speech Recognition
Kashmiri
Speech-to-Text
  • See Upvoters0
  • Downloads28
  • File Size0
  • Views965
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat - Romansetu-200M -Multilingual LLM for Indian langauges using romanization
RomanSetu is Efficiently unlocking multilingual (Indian Languages) capabilities of Large Language Models via Romanization.
Instruction-Tuning
Multilingual
LLaMA2
Llama
  • See Upvoters0
  • Downloads6
  • File Size0
  • Views337
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat - Romansetu-100M - Multilingual LLM for Indian langauges using romanization
RomanSetu is Efficiently unlocking multilingual (Indian Languages) capabilities of Large Language Models via Romanization.
Multilingual
Llama
Instruction-Tuning
LLaMA2
  • See Upvoters0
  • Downloads11
  • File Size0
  • Views641
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat- Kannada - IndicConformer Automatic Speech Recognition (ASR) Model
This Kannada Automatic Speech Recognition (ASR) model transcribes 16kHz mono-channel audio into text. It utilizes a Conformer-Large architecture with 120M parameters and a hybrid CTC-RNNT decoder for high-accuracy speech recognition.
NLP
Automatic Speech Recognition
Audio Processing
  • See Upvoters0
  • Downloads25
  • File Size0
  • Views966
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat – Romanized Path – Base to Supervised Fine-Tuning (SFT)
Romansetu model is built on base pretrained model which is supervised fine tuned on instuction-following tasks using romanized Indian languages.
Llama
Instruction-Tuning
Multilingual
LLaMA2
  • See Upvoters0
  • Downloads3
  • File Size0
  • Views251
Updated 1 year(s) ago

AI4BHARAT

AI4Bharat-IndicTrans2 Large-1B -English-to-Hindi (Devanagari) – : Language Translation Model
A large-scale neural machine translation (NMT) model for translating English to Hindi (Devanagari) language, leveraging 1 billion parameters for high-quality translations.
NLP
Large Model
high-quality-translation
low-resource-NLP
cross-lingual
Multilingual
Machine Translation
Transformer
  • See Upvoters0
  • Downloads35
  • File Size0
  • Views1,120
Updated 1 year(s) ago

AI4BHARAT