Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

AI4Bharat- LLaMA Prometheus Model

Llama-Prometheus is an English evaluation model from the CIA Suite, fine-tuned on the Feedback-Collection dataset using Llama-3.1-8B-Instruct
  • Upvotes0upvotes
  • Downloads10downloads
  • Views435views
  • File size0
  • Shares0Shares
  • Last updatedupdated 06 Nov 2026
UpvoteUpvote
0
LICENSE MIT
SECTOR Sector Agnostic

About Model

Llama-Prometheus is an advanced English evaluation model introduced as part of the CIA Suite to assess the performance of multilingual Large Language Models (LLMs). It is fine-tuned on the Feedback-Collection dataset using the same setup as Prometheus 2, but with Llama-3.1-8B-Instruct as its base model. Llama-Prometheus provides structured evaluation using a reference-guided direct assessment method, requiring evaluation instructions, a response, a scoring rubric, and a reference answer. It ensures accurate benchmarking of LLMs with detailed scoring criteria.

Metadata Metadata

MIT

Sector Agnostic

Sumanth Doddapaneni and Mohammed Safi Ur Rahman Khan and Dilip Venkatesh and Raj Dabre and Anoop Kunchukuttan and Mitesh M. Khapra

N.A.

AI4Bharat

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

21/02/25 13:21:51

N.A.

0

Tags

  • Transformers
  • English
  • Text Generation
  • text-generation-inference
  • conversational

Related Models Related Models

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views126
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views500
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views550
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views508
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,080
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views490
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views319
  • File Size3.17 GB


Related Models by Organization Related Models by Organization

AI4Bharat - MultiIndic WikiBio Structured Summarization Model
MultiIndicWikiBioSS is a multilingual sequence-to-sequence model fine-tuned on the IndicWikiBio dataset for nine Indian languages
AI4BHARAT
  • See Upvoters0
  • Downloads5
  • Views148
  • File Size0

AI4Bharat- Hercules Bengali LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs, particularly for Bengali
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views334
  • File Size0

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views534
  • File Size0

AI4Bharat - IndicBART Model for Structured Summarization
IndicBARTSS is a multilingual, sequence-to-sequence pre-trained model designed for natural language generation tasks in 11 Indic languages
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views733
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views349
  • File Size0

AI4Bharat- Hercules Urdu LORA Model: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English references
AI4BHARAT
  • See Upvoters0
  • Downloads1
  • Views197
  • File Size0

AI4Bharat-IndicConformer-STT-PA-Hybrid-CTC-RNNT-Large (Punjabi): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition Model (ASR) model for Punjabi, utilizing a hybrid CTC-RNNT decoder.
AI4BHARAT
  • See Upvoters0
  • Downloads16
  • Views670
  • File Size0

AI4Bharat-IndicConformer-STT-ML-Hybrid-CTC-RNNT-Large (Malayalam): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Malayalam, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads39
  • Views851
  • File Size0

AI4Bharat-IndicConformer-STT-MNI-Hybrid-CTC-RNNT-Large (Manipuri): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Manipuri, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads19
  • Views714
  • File Size0

AI4Bharat- IndicConformerAutomatic Speech Recognition (ASR) Model for Dogri
The Dogri ASR (Automatic Speech Recognition) model transcribes 16kHz mono-channel audio into text. It is based on a Conformer-Large architecture with 120M parameters and a hybrid CTC-RNNT decoder, ensuring accurate and efficient speech-to-text conversion
AI4BHARAT
  • See Upvoters0
  • Downloads14
  • Views631
  • File Size0


Related Models by Sector Related Models by Sector

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views126
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views500
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views550
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views508
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,080
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views490
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views319
  • File Size3.17 GB


Related Models by Task Type Related Models by Task Type

AI4Bharat- Hercules Bengali LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs, particularly for Bengali
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views334
  • File Size0

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views534
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views349
  • File Size0

AI4Bharat- Hercules Urdu LORA Model: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English references
AI4BHARAT
  • See Upvoters0
  • Downloads1
  • Views197
  • File Size0

AI4Bharat - Hercule-UR: Urdu language translation Evaluation Model
An Urdu-language evaluation model aimed at assessing multilingual Large Language Models by comparing outputs to English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads4
  • Views335
  • File Size0

AI4Bharat - Hercule-TE: Telugu language translation Evaluation Model
A Telugu-language evaluation model designed to evaluate multilingual Large Language Models by scoring outputs against English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views769
  • File Size0

AI4Bharat - Hercule-HI: Hindi language translation Evaluation Model
A Hindi-language evaluation model for assessing multilingual Large Language Models by comparing outputs to English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads70
  • Views1,203
  • File Size0

AI4Bharat - Hercule-BN: Bengali Language Translation Evaluation Model
A Bengali-language evaluation model aimed at assessing multilingual Large Language Models by scoring outputs against English reference responses.
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views702
  • File Size0