Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

AI4Bharat- Hercules Bengali LORA: Evaluation Model

Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs, particularly for Bengali
  • Upvotes0upvotes
  • Downloads9downloads
  • Views334views
  • File size0
  • Shares0Shares
  • Last updatedupdated 06 Nov 2026
UpvoteUpvote
0
LICENSE MIT
SECTOR Sector Agnostic

About Model

Hercule is a cross-lingual evaluation model from the CIA Suite, designed to assess multilingual LLMs, with a focus on Bengali. It evaluates multilingual outputs using English reference responses and is fine-tuned on the INTEL dataset for enhanced alignment with human judgments. Hercule outperforms zero-shot models like GPT-4 on the RECON test set, excelling in low-resource scenarios and supporting zero-shot evaluation for unseen languages. Built on Llama-3.1-8B-Instruct, it uses LoRA for efficient multilingual assessment.

Metadata Metadata

MIT

Sector Agnostic

Sumanth Doddapaneni and Mohammed Safi Ur Rahman Khan and Dilip Venkatesh and Raj Dabre and Anoop Kunchukuttan and Mitesh M. Khapra

N.A.

AI4Bharat

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

21/02/25 13:21:54

N.A.

0

Tags

  • Transformers
  • Bengali
  • Text Generation
  • text-generation-inference
  • conversational

Related Models Related Models

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views126
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views500
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views550
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views508
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,080
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views490
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views319
  • File Size3.17 GB


Related Models by Organization Related Models by Organization

AI4Bharat - MultiIndic WikiBio Structured Summarization Model
MultiIndicWikiBioSS is a multilingual sequence-to-sequence model fine-tuned on the IndicWikiBio dataset for nine Indian languages
AI4BHARAT
  • See Upvoters0
  • Downloads5
  • Views148
  • File Size0

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views535
  • File Size0

AI4Bharat - IndicBART Model for Structured Summarization
IndicBARTSS is a multilingual, sequence-to-sequence pre-trained model designed for natural language generation tasks in 11 Indic languages
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views733
  • File Size0

AI4Bharat- LLaMA Prometheus Model
Llama-Prometheus is an English evaluation model from the CIA Suite, fine-tuned on the Feedback-Collection dataset using Llama-3.1-8B-Instruct
AI4BHARAT
  • See Upvoters0
  • Downloads10
  • Views436
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views349
  • File Size0

AI4Bharat- Hercules Urdu LORA Model: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English references
AI4BHARAT
  • See Upvoters0
  • Downloads1
  • Views197
  • File Size0

AI4Bharat-IndicConformer-STT-PA-Hybrid-CTC-RNNT-Large (Punjabi): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition Model (ASR) model for Punjabi, utilizing a hybrid CTC-RNNT decoder.
AI4BHARAT
  • See Upvoters0
  • Downloads16
  • Views670
  • File Size0

AI4Bharat-IndicConformer-STT-ML-Hybrid-CTC-RNNT-Large (Malayalam): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Malayalam, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads39
  • Views851
  • File Size0

AI4Bharat-IndicConformer-STT-MNI-Hybrid-CTC-RNNT-Large (Manipuri): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Manipuri, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads19
  • Views714
  • File Size0

AI4Bharat- IndicConformerAutomatic Speech Recognition (ASR) Model for Dogri
The Dogri ASR (Automatic Speech Recognition) model transcribes 16kHz mono-channel audio into text. It is based on a Conformer-Large architecture with 120M parameters and a hybrid CTC-RNNT decoder, ensuring accurate and efficient speech-to-text conversion
AI4BHARAT
  • See Upvoters0
  • Downloads14
  • Views631
  • File Size0


Related Models by Sector Related Models by Sector

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views126
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views500
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views550
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views508
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,080
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views490
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views319
  • File Size3.17 GB


Related Models by Task Type Related Models by Task Type

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views535
  • File Size0

AI4Bharat- LLaMA Prometheus Model
Llama-Prometheus is an English evaluation model from the CIA Suite, fine-tuned on the Feedback-Collection dataset using Llama-3.1-8B-Instruct
AI4BHARAT
  • See Upvoters0
  • Downloads10
  • Views436
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views349
  • File Size0

AI4Bharat- Hercules Urdu LORA Model: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English references
AI4BHARAT
  • See Upvoters0
  • Downloads1
  • Views197
  • File Size0

AI4Bharat - Hercule-UR: Urdu language translation Evaluation Model
An Urdu-language evaluation model aimed at assessing multilingual Large Language Models by comparing outputs to English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads4
  • Views335
  • File Size0

AI4Bharat - Hercule-TE: Telugu language translation Evaluation Model
A Telugu-language evaluation model designed to evaluate multilingual Large Language Models by scoring outputs against English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views769
  • File Size0

AI4Bharat - Hercule-HI: Hindi language translation Evaluation Model
A Hindi-language evaluation model for assessing multilingual Large Language Models by comparing outputs to English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads70
  • Views1,203
  • File Size0

AI4Bharat - Hercule-BN: Bengali Language Translation Evaluation Model
A Bengali-language evaluation model aimed at assessing multilingual Large Language Models by scoring outputs against English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views702
  • File Size0