Hercule-hi is a Hindi-language evaluation model from the CIA Suite, aimed at assessing multilingual Large Language Models (LLMs). It evaluates Hindi outputs by comparing them to English reference responses, ensuring accurate scoring and better alignment with human judgments. Fine-tuned on the INTEL dataset, the model supports zero-shot evaluations on unseen languages and provides feedback with scores from 1 to 5. Users can access wrapper functions and classes for seamless integration from the associated GitHub repository.
MIT
Sector Agnostic
Sumanth Doddapaneni and Mohammed Safi Ur Rahman Khan and Dilip Venkatesh and Raj Dabre and Anoop Kunchukuttan and Mitesh M. Khapra
N.A.
N.A.
N.A.
N.A.
N.A.
N.A.
N.A.
N.A.
Open
21/02/25 13:21:03
N.A.
0
© 2026 - Copyright AIKosh. All rights reserved.