Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

Updesh

Updesh is a large-scale synthetic dataset designed to advance post-training of LLMs for 13 Indian languages
2.75
AI Score infoDownload score report
  • Upvotes0upvotes
  • Downloads54downloads
  • Views1,061views
  • File size16.21 GB
  • Shares0Shares
  • Last updatedupdated 15 Dec 2025
UpvoteUpvote
0
COVERAGE India
LICENSE Microsoft-research-license
TYPE Unstructured
SECTOR Sector Agnostic
UPDATES NA

About Dataset

  • Updesh is a large-scale synthetic dataset designed to advance post-training of LLMs for Indic languages. It integrates translated reasoning data and synthesized open-domain generative content to support culturally-grounded multilingual adaptation of LLMs.

  • Despite the rapid progress in instruction-tuned LLMs, most existing datasets focus on English, creating a gap in high-quality, culturally grounded resources for Indic languages—resources that are essential for enabling Small Language Models (SLMs) to serve India’s diverse linguistic landscape. Updesh aims to fill this gap by providing rich, multilingual instruction-tuning data grounded in Indian languages and contexts.

  • Unlike previous English centric translated datasets, Updesh employs a dual approach of culturally-grounded data generation and careful, selective translation, ensuring linguistic nuance and relevance for each language.

  • By releasing Updesh as open data, researchers and communities working on Indian languages as well as other low-resource languages gain unprecedented access to high-quality, culturally-nuanced data.

  • Languages: Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali, Odia, Punjabi, Tamil, Telugu, Urdu

  • Data Composition: Reasoning Data: ~6.8M translated tuples, Generative Data: ~2.1M synthesized tuples

Tags

  • NLP Dataset
  • Reasoning
  • Instruction-Tuning
  • Indian Language
  • llm
  • fine-tuning

Related Datasets Related Datasets

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 10 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views21
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads218
  • Views2,896
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,606
  • File Size0

Lahaja
Lahaja
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views353
  • File Size0

Svarah
Svarah
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views235
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views550
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views257
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads200
  • Views3,168
  • File Size0


Related Datasets by Organization Related Datasets by Organization

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 10 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views21
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads218
  • Views2,896
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,606
  • File Size0

Lahaja
Lahaja
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views353
  • File Size0

Svarah
Svarah
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views235
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views550
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views257
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads200
  • Views3,168
  • File Size0


Related Datasets by Sector Related Datasets by Sector

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 10 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views21
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads218
  • Views2,896
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,606
  • File Size0

Lahaja
Lahaja
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views353
  • File Size0

Svarah
Svarah
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views235
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views550
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views257
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads200
  • Views3,168
  • File Size0


Related Datasets by Task Type Related Datasets by Task Type

Panchayati Raj and Drinkin
Panchayati Raj and Drinkin
4.2Information•Updated 10 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views2
  • File Size282.56 KB

Agent Communication
Agent Communication
4.5Information•Updated 11 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views21
  • File Size4.08 MB

INDIAN INSTITUTE OF SCIENCE (IISC), BANGALORE
  • See Upvoters2
  • Downloads218
  • Views2,896
  • File Size0

IndicDLP
IndicDLP
5.0Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads388
  • Views2,606
  • File Size0

Lahaja
Lahaja
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads17
  • Views157
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads57
  • Views353
  • File Size0

Svarah
Svarah
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads33
  • Views235
  • File Size0

IndicVoices-R
IndicVoices-R
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads60
  • Views550
  • File Size0

Shrutilipi
Shrutilipi
-Information•Updated 14 day(s) ago
AI4BHARAT
  • See Upvoters0
  • Downloads26
  • Views257
  • File Size0

AI4BHARAT
  • See Upvoters0
  • Downloads200
  • Views3,168
  • File Size0