BhashaBench-Multi is a large-scale multilingual multiple-choice question answering (MCQ) benchmark covering four specialised Indian knowledge domains across 22 Indian languages plus English.
No existing open-source benchmark provides purpose-built Indian domain knowledge coverage across such a broad set of languages and specialised domains. BhashaBench-Multi is designed to evaluate language understanding, domain knowledge, and cross-lingual robustness of NLP systems in low-resource and mid-resource Indian language settings. These four domains were selected as high-stakes, underserved verticals in Indian-language NLP: * BhashaBench-Ayur * BhashaBench-Finance * BhashaBench-Legal * BhashaBench-Krishi
* Benchmarking Multilingual Llms On Indian-language Domain Knowledge Across Agriculture, Finance, Law, And Ayurveda * Evaluating Cross-lingual Knowledge Transfer And Robustness Across 22 Indian Languages And English * Research On Multilingual Reasoning, Domain Adaptation, And Low-resource Language Understanding * Assessing Knowledge Preservation And Performance Disparities Across Diverse Indian Languages And Scripts
Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)
22 files
22 files
22 files
22 files
17.79 KB
© 2026 - Copyright AIKosh. All rights reserved.