BhashaBench-Multi is a large-scale multilingual multiple-choice question answering (MCQ) benchmark covering four specialised Indian knowledge domains across 22 Indian languages plus English.
No existing open-source benchmark provides purpose-built Indian domain knowledge coverage across such a broad set of languages and specialised domains. BhashaBench-Multi is designed to evaluate language understanding, domain knowledge, and cross-lingual robustness of NLP systems in low-resource and mid-resource Indian language settings. These four domains were selected as high-stakes, underserved verticals in Indian-language NLP: * BhashaBench-Ayur * BhashaBench-Finance * BhashaBench-Legal * BhashaBench-Krishi
* Benchmarking multilingual LLMs on Indian-language domain knowledge across agriculture, finance, law, and Ayurveda * Evaluating cross-lingual knowledge transfer and robustness across 22 Indian languages and English * Research on multilingual reasoning, domain adaptation, and low-resource language understanding * Assessing knowledge preservation and performance disparities across diverse Indian languages and scripts
Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)
22 files
22 files
22 files
22 files
17.79 KB
© 2026 - Copyright AIKosh. All rights reserved.