Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

AI4Bharat- Hercules Urdu LORA Model: Evaluation Model

Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English references
  • Upvotes0upvotes
  • Downloads1downloads
  • Views196views
  • File size0
  • Shares0Shares
  • Last updatedupdated 06 Nov 2026
UpvoteUpvote
0
LICENSE MIT
SECTOR Sector Agnostic

About Model

Hercule is an advanced cross-lingual evaluation model introduced as part of the CIA Suite to assess multilingual Large Language Models (LLMs). It is fine-tuned on the INTEL dataset and demonstrates strong alignment with human evaluations, outperforming zero-shot proprietary models like GPT-4 on the RECON test set. Designed for low-resource languages, Hercule enables reference-based evaluation by scoring multilingual outputs using English reference responses. It provides structured feedback with a 1-5 scale scoring rubric and highlights the effectiveness of lightweight fine-tuning techniques like LoRA.

Metadata Metadata

MIT

Sector Agnostic

Sumanth Doddapaneni and Mohammed Safi Ur Rahman Khan and Dilip Venkatesh and Raj Dabre and Anoop Kunchukuttan and Mitesh M. Khapra

N.A.

AI4Bharat

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

21/02/25 13:21:52

N.A.

0

Tags

  • Transformers
  • Urdu
  • Text Generation
  • text-generation-inference
  • conversational

Related Models Related Models

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views126
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views500
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views550
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views508
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,080
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views490
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views319
  • File Size3.17 GB


Related Models by Organization Related Models by Organization

AI4Bharat - MultiIndic WikiBio Structured Summarization Model
MultiIndicWikiBioSS is a multilingual sequence-to-sequence model fine-tuned on the IndicWikiBio dataset for nine Indian languages
AI4BHARAT
  • See Upvoters0
  • Downloads5
  • Views148
  • File Size0

AI4Bharat- Hercules Bengali LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs, particularly for Bengali
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views334
  • File Size0

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views534
  • File Size0

AI4Bharat - IndicBART Model for Structured Summarization
IndicBARTSS is a multilingual, sequence-to-sequence pre-trained model designed for natural language generation tasks in 11 Indic languages
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views733
  • File Size0

AI4Bharat- LLaMA Prometheus Model
Llama-Prometheus is an English evaluation model from the CIA Suite, fine-tuned on the Feedback-Collection dataset using Llama-3.1-8B-Instruct
AI4BHARAT
  • See Upvoters0
  • Downloads10
  • Views435
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views349
  • File Size0

AI4Bharat-IndicConformer-STT-PA-Hybrid-CTC-RNNT-Large (Punjabi): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition Model (ASR) model for Punjabi, utilizing a hybrid CTC-RNNT decoder.
AI4BHARAT
  • See Upvoters0
  • Downloads16
  • Views670
  • File Size0

AI4Bharat-IndicConformer-STT-ML-Hybrid-CTC-RNNT-Large (Malayalam): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Malayalam, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads39
  • Views851
  • File Size0

AI4Bharat-IndicConformer-STT-MNI-Hybrid-CTC-RNNT-Large (Manipuri): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Manipuri, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads19
  • Views714
  • File Size0

AI4Bharat- IndicConformerAutomatic Speech Recognition (ASR) Model for Dogri
The Dogri ASR (Automatic Speech Recognition) model transcribes 16kHz mono-channel audio into text. It is based on a Conformer-Large architecture with 120M parameters and a hybrid CTC-RNNT decoder, ensuring accurate and efficient speech-to-text conversion
AI4BHARAT
  • See Upvoters0
  • Downloads14
  • Views631
  • File Size0


Related Models by Sector Related Models by Sector

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views126
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views500
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views550
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views508
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,080
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views490
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views319
  • File Size3.17 GB


Related Models by Task Type Related Models by Task Type

AI4Bharat- Hercules Bengali LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs, particularly for Bengali
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views334
  • File Size0

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views534
  • File Size0

AI4Bharat- LLaMA Prometheus Model
Llama-Prometheus is an English evaluation model from the CIA Suite, fine-tuned on the Feedback-Collection dataset using Llama-3.1-8B-Instruct
AI4BHARAT
  • See Upvoters0
  • Downloads10
  • Views435
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views349
  • File Size0

AI4Bharat - Hercule-UR: Urdu language translation Evaluation Model
An Urdu-language evaluation model aimed at assessing multilingual Large Language Models by comparing outputs to English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads4
  • Views335
  • File Size0

AI4Bharat - Hercule-TE: Telugu language translation Evaluation Model
A Telugu-language evaluation model designed to evaluate multilingual Large Language Models by scoring outputs against English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views769
  • File Size0

AI4Bharat - Hercule-HI: Hindi language translation Evaluation Model
A Hindi-language evaluation model for assessing multilingual Large Language Models by comparing outputs to English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads70
  • Views1,203
  • File Size0

AI4Bharat - Hercule-BN: Bengali Language Translation Evaluation Model
A Bengali-language evaluation model aimed at assessing multilingual Large Language Models by scoring outputs against English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views702
  • File Size0