Indian Flag
Government Of India
A-
A
A+
/IIT Bombay ORGANISATION
UpvoteUpvote
0

IndicQA_Benchmark

A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages
2.75
AI Score infoDownload score report
  • Upvotes0upvotes
  • Downloads39downloads
  • Views666views
  • File size370.70 MB
  • Shares0Shares
  • Last updatedupdated 15 Dec 2025
UpvoteUpvote
0
COVERAGE India Specific
LICENSE CC0 1.0 Public Domain
TYPE Structured
SECTOR Education and Skill Development
UPDATES NA

About Dataset

Large Language Models (LLMs) perform well on unseen tasks in English, but their abilities in non English languages are less explored due to limited benchmarks and training data. To bridge this gap, we introduce the Indic QA Benchmark, a large dataset for context grounded question answering in 11 major Indian languages, covering both extractive and abstractive tasks. Evaluations of multilingual LLMs, including instruction finetuned versions, revealed weak performance in low resource languages due to a strong English language bias in their training data. We also investigated the Translate Test paradigm,where inputs are translated to English for processing and the results are translated back into the source language for output. This approach outperformed multilingual LLMs, particularly in low resource settings. By releasing Indic QA, we aim to promote further research into LLMs question answering capabilities in low resource languages. This benchmark offers a critical resource to address existing limitations and foster multilingual understanding.

Tags

  • Transalation
  • Indian Language
  • Indic language
  • Machine transaltion

Related Datasets Related Datasets

Vikaspedia Telugu Education Dataset
Vikaspedia Telugu Education Dataset
4.7Information•Updated 1 month(s) ago
CENTRE FOR DEVELOPMENT OF ADVANCED COMPUTING (C-DAC), HYDERABAD
  • See Upvoters0
  • Downloads21
  • Views99
  • File Size23.28 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads12
  • Views42
  • File Size859.60 KB

Verified Active Learning at Scale
Verified Active Learning at Scale
2.8Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads10
  • Views97
  • File Size1.27 GB

Online Live-Polling Dataset
Online Live-Polling Dataset
3.0Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads15
  • Views72
  • File Size8.52 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads9
  • Views63
  • File Size35.62 MB

Chimple Maths Student Results
Chimple Maths Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views60
  • File Size18.20 MB

Chimple English Student Results
Chimple English Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views78
  • File Size19.80 MB

Chimple Hindi Student Results
Chimple Hindi Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads15
  • Views57
  • File Size19.72 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads2
  • Views84
  • File Size53.01 KB

Chimple NIPUN English Learning Dataset
Chimple NIPUN English Learning Dataset
2.8Information•Updated 2 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads4
  • Views77
  • File Size10.75 KB


Related Datasets by Organization Related Datasets by Organization

Vikaspedia Telugu Education Dataset
Vikaspedia Telugu Education Dataset
4.7Information•Updated 1 month(s) ago
CENTRE FOR DEVELOPMENT OF ADVANCED COMPUTING (C-DAC), HYDERABAD
  • See Upvoters0
  • Downloads21
  • Views99
  • File Size23.28 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads12
  • Views42
  • File Size859.60 KB

Verified Active Learning at Scale
Verified Active Learning at Scale
2.8Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads10
  • Views97
  • File Size1.27 GB

Online Live-Polling Dataset
Online Live-Polling Dataset
3.0Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads15
  • Views72
  • File Size8.52 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads9
  • Views63
  • File Size35.62 MB

Chimple Maths Student Results
Chimple Maths Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views60
  • File Size18.20 MB

Chimple English Student Results
Chimple English Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views78
  • File Size19.80 MB

Chimple Hindi Student Results
Chimple Hindi Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads15
  • Views57
  • File Size19.72 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads2
  • Views84
  • File Size53.01 KB

Chimple NIPUN English Learning Dataset
Chimple NIPUN English Learning Dataset
2.8Information•Updated 2 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads4
  • Views77
  • File Size10.75 KB


Related Datasets by Sector Related Datasets by Sector

Vikaspedia Telugu Education Dataset
Vikaspedia Telugu Education Dataset
4.7Information•Updated 1 month(s) ago
CENTRE FOR DEVELOPMENT OF ADVANCED COMPUTING (C-DAC), HYDERABAD
  • See Upvoters0
  • Downloads21
  • Views99
  • File Size23.28 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads12
  • Views42
  • File Size859.60 KB

Verified Active Learning at Scale
Verified Active Learning at Scale
2.8Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads10
  • Views97
  • File Size1.27 GB

Online Live-Polling Dataset
Online Live-Polling Dataset
3.0Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads15
  • Views72
  • File Size8.52 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads9
  • Views63
  • File Size35.62 MB

Chimple Maths Student Results
Chimple Maths Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views60
  • File Size18.20 MB

Chimple English Student Results
Chimple English Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views78
  • File Size19.80 MB

Chimple Hindi Student Results
Chimple Hindi Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads15
  • Views57
  • File Size19.72 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads2
  • Views84
  • File Size53.01 KB

Chimple NIPUN English Learning Dataset
Chimple NIPUN English Learning Dataset
2.8Information•Updated 2 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads4
  • Views77
  • File Size10.75 KB


Related Datasets by Task Type Related Datasets by Task Type

Vikaspedia Telugu Education Dataset
Vikaspedia Telugu Education Dataset
4.7Information•Updated 1 month(s) ago
CENTRE FOR DEVELOPMENT OF ADVANCED COMPUTING (C-DAC), HYDERABAD
  • See Upvoters0
  • Downloads21
  • Views99
  • File Size23.28 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads12
  • Views42
  • File Size859.60 KB

Verified Active Learning at Scale
Verified Active Learning at Scale
2.8Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads10
  • Views97
  • File Size1.27 GB

Online Live-Polling Dataset
Online Live-Polling Dataset
3.0Information•Updated 1 month(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads15
  • Views72
  • File Size8.52 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads9
  • Views63
  • File Size35.62 MB

Chimple Maths Student Results
Chimple Maths Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views60
  • File Size18.20 MB

Chimple English Student Results
Chimple English Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads14
  • Views78
  • File Size19.80 MB

Chimple Hindi Student Results
Chimple Hindi Student Results
2.8Information•Updated 1 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads15
  • Views57
  • File Size19.72 MB

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads2
  • Views84
  • File Size53.01 KB

Chimple NIPUN English Learning Dataset
Chimple NIPUN English Learning Dataset
2.8Information•Updated 2 month(s) ago
CHIMPLE LEARNING FOUNDATION
  • See Upvoters0
  • Downloads4
  • Views77
  • File Size10.75 KB