Llama-Prometheus is an advanced English evaluation model introduced as part of the CIA Suite to assess the performance of multilingual Large Language Models (LLMs). It is fine-tuned on the Feedback-Collection dataset using the same setup as Prometheus 2, but with Llama-3.1-8B-Instruct as its base model. Llama-Prometheus provides structured evaluation using a reference-guided direct assessment method, requiring evaluation instructions, a response, a scoring rubric, and a reference answer. It ensures accurate benchmarking of LLMs with detailed scoring criteria.
MIT
Sector Agnostic
Sumanth Doddapaneni and Mohammed Safi Ur Rahman Khan and Dilip Venkatesh and Raj Dabre and Anoop Kunchukuttan and Mitesh M. Khapra
N.A.
N.A.
N.A.
N.A.
N.A.
N.A.
N.A.
N.A.
Open
21/02/25 13:21:51
N.A.
0
© 2026 - Copyright AIKosh. All rights reserved.