Indian Flag
Government Of India
A-
A
A+
ORGANISATION
BhashaBench-Multi

BhashaBench-Multi

BhashaBench-Multi is a large-scale multilingual multiple-choice question answering (MCQ) benchmark covering four specialised Indian knowledge domains across 22 Indian languages plus English.

About Dataset

No existing open-source benchmark provides purpose-built Indian domain knowledge coverage across such a broad set of languages and specialised domains. BhashaBench-Multi is designed to evaluate language understanding, domain knowledge, and cross-lingual robustness of NLP systems in low-resource and mid-resource Indian language settings. These four domains were selected as high-stakes, underserved verticals in Indian-language NLP: * BhashaBench-Ayur * BhashaBench-Finance * BhashaBench-Legal * BhashaBench-Krishi

Purpose of Dataset

* Benchmarking Multilingual Llms On Indian-language Domain Knowledge Across Agriculture, Finance, Law, And Ayurveda * Evaluating Cross-lingual Knowledge Transfer And Robustness Across 22 Indian Languages And English * Research On Multilingual Reasoning, Domain Adaptation, And Low-resource Language Understanding * Assessing Knowledge Preservation And Performance Disparities Across Diverse Indian Languages And Scripts

Activity Overview Activity Overview

  • Downloads0
  • Downloads 0
  • File Size 823.42 MB
  • Views 5

Tags Tags

  • Punjabi
  • Sindhi
  • Sanskrit
  • Kashmiri
  • Manipuri
  • Assamese
  • Maithili
  • Oriya
  • Konkani
  • urdu
  • telugu
  • tamil
  • malayalam
  • bengali
  • gujarati
  • english
  • marathi
  • translation
  • task_categories:multiple-choice
  • kannada
  • Dogri
  • Bodo
  • Question Answering
  • hindi
  • nepali

License Control License Control

Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)

bhashabench-multi ( 1 files, 4 directories )


Directory
bhashabench_ayur

22 files

Directory
bhashabench_finance

22 files

Directory
bhashabench_krishi

22 files

Directory
bhashabench_legal

22 files

text/markdown
README.md

17.79 KB

Data Quality Score BetaData Quality Score Beta

Version Control Version Control

FolderVersion 1(823.42 MB)
  • Kundeshwar Vijay Pundalik·2 day(s) ago
    • chevron_rightFolder
      bhashabench-multi
      • chevron_rightFolder
        bhashabench_ayur
      • chevron_rightFolder
        bhashabench_finance
      • chevron_rightFolder
        bhashabench_krishi
      • chevron_rightFolder
        bhashabench_legal
      • text/markdown
        README.md