Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0
MILU - Multi-task Indic LLM performance evaluation dataset

MILU - Multi-task Indic LLM performance evaluation dataset

MILU is a comprehensive benchmark dataset designed to evaluate the performance of Large Language Models (LLMs) across 11 Indic languages. It spans 8 domains and 41 subjects, covering ~80,000 multiple - choice questions with culturally relevant knowledge from India.
0
AI Score infoDownload score report
  • Upvotes0upvotes
  • Downloads44downloads
  • Views1,269views
  • File size0
  • Shares1Shares
  • Last updatedupdated 06 Nov 2026
UpvoteUpvote
0
COVERAGE India
LICENSE Attribution 4.0 International (CC BY- 4.0)
TYPE Unstructured
SECTOR Sector Agnostic
UPDATES Static

About Dataset

The MILU (Multi-task Indic Language Understanding Benchmark) dataset is a large-scale evaluation dataset intended to assess the performance of multilingual Large Language Models (LLMs) in the context of Indic languages. It covers 11 Indian languages, including Hindi, Bengali, Gujarati, Kannada, Malayalam, Marathi, Odia, Punjabi, Tamil, Telugu, and English. The dataset spans 8 diverse domains such as Arts & Humanities, Social Sciences, STEM, and Business, containing questions from 41 different subjects. With approximately 80,000 multiple-choice questions and a validation set of 8,933 samples, MILU provides a rigorous benchmark for evaluating language understanding across diverse linguistic and knowledge domains. It incorporates culturally specific knowledge from Indian regional and state-level examinations, making it an essential dataset for LLM evaluation in the Indian linguistic context. The dataset is open-source and available under a CC-BY-4.0 license.

Tags

  • Multilingual Dataset
  • NLP
  • Indic Languages
  • benchmark dataset
  • LLM evaluation
  • question-answering
  • knowledge assessment
  • language understanding
  • Indian language processing

Related Datasets Related Datasets

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size1.90 MB

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 12 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads224
  • Views2,922
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,613
  • File Size0

Lahaja
Lahaja
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views356
  • File Size0

Svarah
Svarah
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views240
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views554
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views258
  • File Size0


Related Datasets by Organization Related Datasets by Organization

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size1.90 MB

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 12 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads224
  • Views2,922
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,613
  • File Size0

Lahaja
Lahaja
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views356
  • File Size0

Svarah
Svarah
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views240
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views554
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views258
  • File Size0


Related Datasets by Sector Related Datasets by Sector

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size1.90 MB

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 12 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads224
  • Views2,922
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,613
  • File Size0

Lahaja
Lahaja
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views356
  • File Size0

Svarah
Svarah
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views240
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views554
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views258
  • File Size0


Related Datasets by Task Type Related Datasets by Task Type

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size1.90 MB

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 12 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads224
  • Views2,922
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,613
  • File Size0

Lahaja
Lahaja
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views356
  • File Size0

Svarah
Svarah
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views240
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views554
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 15 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views258
  • File Size0