Home/Datasets/Nagamese-English Machine Translation Corpus

ORGANISATION

Nagamese-English Machine Translation Corpus

The Nagamese-English Machine Translation Corpus, as part of the NagaNLP Toolkit is a parallel text dataset containing English-Nagamese sentence pairs, intended for training and evaluating machine translation systems between the two languages.

About Dataset

The Nagamese-English Machine Translation Corpus, as part of the NagaNLP Toolkit is a bilingual parallel corpus developed as part of the NagaNLP research effort to address the severe shortage of digital resources for Nagamese Creole. The dataset contains 4,178 English-Nagamese parallel sentence pairs. The dataset supports both English to Nagamese and Nagamese to English machine translation. The corpus contains sentences spanning different registers and topics, including everyday narration, sports commentary, descriptive prose, dialogue style content, general informational sentences, and everyday conversational expressions. The dataset is represented using two fields: 'english_sentence' and 'nagamese_sentence'. The dataset has also been used to fine-tune an NLLB-200-based translation model. This dataset is a part of NagaNLP Toolkit. The dataset is described i: Agniva Maiti, Manya Pandey, and Murari Mandal. (2025). NagaNLP: Bootstrapping NLP for Low-Resource Nagamese Creole with Human-in-the-Loop Synthetic Data. arXiv preprint arXiv:2512.12537. The dataset is currently distributed on Hugging Face under a CC BY-NC 4.0 license, which requires attribution and restricts use to non-commercial purposes. This dataset was identified and facilitated for onboarding as part of the Dataset Onboarding Support Team (DOST) initiative led by CivicDataLab (CDL), partnering with the Gates Foundation in collaboration with BHASHINI. CivicDataLab provided support for dataset discovery, validation, metadata preparation, and onboarding facilitation. All dataset ownership and intellectual property rights remain with the original author(s).

Purpose of Dataset

The purpose of the dataset is to support the development and evaluation of machine translation systems for English and Nagamese. It can be used for neural machine translation, bilingual language modelling, cross-lingual representation learning, low-resource translation research, multilingual NLP, language technology development, language preservation, and development of translation tools and applications for Nagamese. The corpus can also support fine-tuning and evaluation of pretrained multilingual translation models.

Dataset Metadata

License

Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)

Geographical coverage

Northeast India

Sector

Science, Technology and Research

Author

Agniva Maiti

Source Organisation

Digital India BHASHINI Division

Uploaded by

Nikil Augustine

Data Quality Score (Beta)

Dataset type

Structured

Frequency

Static

Time Granularity

Static

Year range

N.A.

Date & Time

26/08/26 07:51:02

Visibility

Open

Hosted / Redirected

Hosted

Data Type

Hybrid

Data Collection Method

This Dataset Is A Part Of Naganlp Toolkit. The Corpus Was Created Using A Multi Stage Llm-to-human Bootstrapping Pipeline. Google Gemini 2.5 Pro Was First Guided Through Persona And Task Definition, Interactive Grammatical Elicitation, And Knowledge Consolidation Using Authentic Nagamese Materials Such As Articles And Social Media Posts. Once A Structured Understanding Of Nagamese Grammar And Vocabulary Had Been Established, Structured Few-shot Prompting With In-context Reinforcement Was Used To Generate A Large Set Of Conversational Instruction Pairs. The Model's Core Grammatical Rules And Authentic Nagamese Texts Were Periodically Reintroduced Between Generation Batches To Reduce Context Drift And Maintain Linguistic Consistency. After That It Underwent A Single, Crucial Human Validation Step. The Raw Generated Conversational Pairs Were Reviewed And Corrected By Native Speakers To Fix Any Grammatical Errors, Unnatural Phrasing, Or Logical Inconsistencies.

Activity Overview

License Control

Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)

Related Datasets

Updated 1 month(s) ago

NagaNLP NER Annotated Corpus

The NagaNLP NER Annotated Corpus is a human-validated Named Entity Recognition dataset for Nagamese Creole containing 214 annotated sentences. It provides token-level NER annotations for identifying entities such as persons, locations, organizations, and miscellaneous entities in low-resource Nagamese text. This dataset is part of the NagaNLP Toolkit.

Computational Linguistics

NER

low-resource

Nagamese

northeast-india

Nagaland

Low Resource NLP

Low Resource Languages

Named entity recognition

naga

pos

Part-of-Speech Tagging

POS Tagging

Annotated Corpus

Low-resource Language

Low-resource NLP

Language Resource

NagaNLP

DIGITAL INDIA BHASHINI DIVISION

View Details

Updated 1 month(s) ago

NagaNLP POS Annotated Corpus

The NagaNLP POS Annotated Corpus is a human-validated Part-of-Speech annotated dataset for Nagamese, containing 214 sentences and approximately 4,800 tokens. Each token is assigned a Universal POS tag to support POS tagging and low-resource NLP research. This dataset is a part of NagaNLP Toolkit.