Indian Flag
Government Of India
A-
A
A+
ORGANISATION
BhashaBench-Multi

BhashaBench-Multi

BhashaBench-Multi is a large-scale multilingual multiple-choice question answering (MCQ) benchmark covering four specialised Indian knowledge domains across 22 Indian languages plus English.

About Dataset

No existing open-source benchmark provides purpose-built Indian domain knowledge coverage across such a broad set of languages and specialised domains. BhashaBench-Multi is designed to evaluate language understanding, domain knowledge, and cross-lingual robustness of NLP systems in low-resource and mid-resource Indian language settings. These four domains were selected as high-stakes, underserved verticals in Indian-language NLP: * BhashaBench-Ayur * BhashaBench-Finance * BhashaBench-Legal * BhashaBench-Krishi

Purpose of Dataset

* Benchmarking multilingual LLMs on Indian-language domain knowledge across agriculture, finance, law, and Ayurveda * Evaluating cross-lingual knowledge transfer and robustness across 22 Indian languages and English * Research on multilingual reasoning, domain adaptation, and low-resource language understanding * Assessing knowledge preservation and performance disparities across diverse Indian languages and scripts

Activity Overview Activity Overview

  • Downloads0
  • Downloads 5
  • File Size 823.42 MB
  • Views 75

Tags Tags

  • Punjabi
  • Sindhi
  • Sanskrit
  • Kashmiri
  • Manipuri
  • Assamese
  • Maithili
  • Oriya
  • Konkani
  • urdu
  • telugu
  • tamil
  • malayalam
  • bengali
  • gujarati
  • english
  • marathi
  • translation
  • task_categories:multiple-choice
  • kannada
  • Dogri
  • Bodo
  • Question Answering
  • hindi
  • nepali

License Control License Control

Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)

bhashabench-multi ( 1 files, 4 directories )


Directory
bhashabench_ayur

22 files

Directory
bhashabench_finance

22 files

Directory
bhashabench_krishi

22 files

Directory
bhashabench_legal

22 files

text/markdown
README.md

17.79 KB

Data Quality Score BetaData Quality Score Beta

Version Control Version Control

FolderVersion 1(823.42 MB)
  • Kundeshwar Vijay Pundalik·3 month(s) ago
    • chevron_rightFolder
      bhashabench-multi
      • chevron_rightFolder
        bhashabench_ayur
      • chevron_rightFolder
        bhashabench_finance
      • chevron_rightFolder
        bhashabench_krishi
      • chevron_rightFolder
        bhashabench_legal
      • text/markdown
        README.md