Indian Flag
Government Of India
A-
A
A+

AI4Bharat - Romansetu-200M -Multilingual LLM for Indian langauges using romanization

RomanSetu is Efficiently unlocking multilingual (Indian Languages) capabilities of Large Language Models via Romanization.

About Model

RomanSetu presents an approach that involves the continual pretraining of an English LLM, such as Llama 2, on romanized text of non-English, non-Roman script languages, followed by instruction tuning on romanized data. For continual pretraining, approximately 200 million words per language were collected and transliterated using IndicXlit with romanized data used in training.

AI4Bharat - Romansetu-200M -Multilingual LLM for Indian langauges using romanization

Metadata Metadata

Llama 2 Community License Agreement

Jaavid Aktar Husain, Raj Dabre, Aswanth Kumar, Jay Gala, Thanmay Jayakumar, Ratish Puduppully, Anoop Kunchukuttan

Multilingual Model

N.A.

Open

AI4Bharat

Sector Agnostic

02/05/25 11:00:58

0

Activity Overview Activity Overview

  • Downloads0
  • Redirect 4
  • Views 193
  • File Size 0

Tags Tags

  • Llama
  • Multilingual
  • Instruction-Tuning
  • LLaMA2

License Control License Control

Llama 2 Community License Agreement

More Models from AI4Bharat More Models from AI4Bharat

AI4Bharat- 500 M - RomanSetu Multilingual Native-to-Roman Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
Instruction-Tuning
LLaMA2
Multilingual
Llama
  • See Upvoters1
  • Downloads38
  • File Size0
  • Views627
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat- 400 M - RomanSetu Multilingual Native-to-Roman Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
Multilingual
Llama
Instruction-Tuning
LLaMA2
  • See Upvoters1
  • Downloads67
  • File Size0
  • Views772
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat- Maithili - IndicConformer Automatic Speech Recognition (ASR) Model
This model takes in mono-channel audio files at a 16,000 Hz sampling rate (WAV format) and outputs the transcribed text of the speech contained in the audio.
Automatic Speech Recognition
Speech-to-Text
NLP
  • See Upvoters0
  • Downloads21
  • File Size0
  • Views474
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat- Konkani - IndicConformer Automatic Speech Recognition (ASR) Model
Automatic Speech Recognition (ASR) model for Konkani speech recognition, processing 16,000 KHz mono WAV audio and transcribing spoken content into text
Speech-to-Text
NLP
Automatic Speech Recognition
  • See Upvoters0
  • Downloads24
  • File Size0
  • Views507
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat- Kashmiri - IndicConformer Automatic Speech Recognition (ASR) Model
This Automatic Speech Recognition (ASR) model transcribes Kashmiri speech from 16,000 KHz mono WAV audio files into text
Kashmiri
Speech-to-Text
NLP
Automatic Speech Recognition
  • See Upvoters0
  • Downloads17
  • File Size0
  • Views501
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat - Romansetu-200M -Multilingual LLM for Indian langauges using romanization
RomanSetu is Efficiently unlocking multilingual (Indian Languages) capabilities of Large Language Models via Romanization.
Instruction-Tuning
LLaMA2
Llama
Multilingual
  • See Upvoters0
  • Downloads4
  • File Size0
  • Views194
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat - Romansetu-100M - Multilingual LLM for Indian langauges using romanization
RomanSetu is Efficiently unlocking multilingual (Indian Languages) capabilities of Large Language Models via Romanization.
Llama
Multilingual
Instruction-Tuning
LLaMA2
  • See Upvoters0
  • Downloads8
  • File Size0
  • Views311
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat- Kannada - IndicConformer Automatic Speech Recognition (ASR) Model
This Kannada Automatic Speech Recognition (ASR) model transcribes 16kHz mono-channel audio into text. It utilizes a Conformer-Large architecture with 120M parameters and a hybrid CTC-RNNT decoder for high-accuracy speech recognition.
Automatic Speech Recognition
Audio Processing
NLP
  • See Upvoters0
  • Downloads18
  • File Size0
  • Views466
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat – Romanized Path – Base to Supervised Fine-Tuning (SFT)
Romansetu model is built on base pretrained model which is supervised fine tuned on instuction-following tasks using romanized Indian languages.
LLaMA2
Instruction-Tuning
Multilingual
Llama
  • See Upvoters0
  • Downloads3
  • File Size0
  • Views137
Updated 8 month(s) ago

AI4BHARAT

AI4Bharat-IndicTrans2 Large-1B -English-to-Hindi (Devanagari) – : Language Translation Model
A large-scale neural machine translation (NMT) model for translating English to Hindi (Devanagari) language, leveraging 1 billion parameters for high-quality translations.
Machine Translation
Transformer
low-resource-NLP
high-quality-translation
Large Model
cross-lingual
NLP
Multilingual
  • See Upvoters0
  • Downloads25
  • File Size0
  • Views568
Updated 8 month(s) ago

AI4BHARAT