Indian Flag
Government Of India
A-
A
A+
Home/Models/NE-BERT

NE-BERT

NE-BERT is Northeast India's first domain-specific multilingual foundation model. Built on the ModernBERT architecture and trained on 8.3 million sentences, it supports 9 regional languages: Assamese, Khasi, Garo, Manipuri (Meitei), Mizo, Nyishi, Nagamese, Kokborok, and Pnar. It achieves State-of-the-Art performance on regional benchmarks and offers 1.6x faster inference, bridging the digital divide for low-resource languages.

About Model

NE-BERT is a state-of-the-art transformer model designed specifically for the complex, low-resource linguistic landscape of Northeast India. While generic multilingual models (like mBERT or IndicBERT) often underperform on Austroasiatic and Tibeto-Burman languages due to data scarcity, NE-BERT treats these languages as first-class citizens. Supported Languages: The model is trained on a curated corpus of ~8.3 million sentences covering: 1. Assamese [asm] (Indo-Aryan) 2. Manipuri/Meitei [mni] (Tibeto-Burman) 3. Khasi [kha] (Austroasiatic) 4. Mizo [lus] (Tibeto-Burman) 5. Garo [grt] (Tibeto-Burman) 6. Nyishi [njz] (Tibeto-Burman) 7. Nagamese Creole [nag] (Indo-Aryan) 8. Kokborok [trp] (Tibeto-Burman) 9. Pnar [pbv] (Austroasiatic) Technical Key Features: * Architecture: ModernBERT-Base (Pre-Norm, Rotary Embeddings, Flash Attention 2) * Context Window: Supports up to 8,192 tokens * Efficiency: 1.6x more efficient tokenization than mBERT * Performance: Low perplexity on Austroasiatic and Tibeto-Burman languages

NE-BERT

Metadata Metadata

Attribution 4.0 International (CC BY- 4.0)

MWirelabs

Transformers

PyTorch

Open

MWire Labs

Arts, Culture and Tourism

22/11/25 13:08:10

Badal Nyalang

0

Activity Overview Activity Overview

  • Downloads0
  • Redirect 10
  • Views 306
  • File Size 0

Tags Tags

  • modernbert
  • Masked Language Modeling
  • northeast-india
  • low-resource-NLP
  • northeast bert
  • mwirelabs
  • token-efficiency
  • Assamese
  • Garo
  • Nyishi
  • Meitei
  • Nagamese
  • khasi
  • A'chik
  • Mizo
  • kokborok
  • Pnar

License Control License Control

Attribution 4.0 International (CC BY- 4.0)

Related Models Related Models

Northeast Language Identification
NE-LID is a fast and accurate language identification model for Northeast Indian languages using character level features. It is designed for low resource and script diverse text and achieves high accuracy on short sentences.
language identification
fasttext
northeast-india
low-resource
Multilingual
MWire Labs
fastText
  • See Upvoters0
  • Downloads6
  • File Size0
  • Views229
Updated 1 month(s) ago
MWIRE LABS
View Details
share

More Models from MWire Labs More Models from MWire Labs

Northeast Language Identification
NE-LID is a fast and accurate language identification model for Northeast Indian languages using character level features. It is designed for low resource and script diverse text and achieves high accuracy on short sentences.
fastText
MWire Labs
Multilingual
low-resource
northeast-india
fasttext
language identification
  • See Upvoters0
  • Downloads6
  • File Size0
  • Views229
Updated 1 month(s) ago
MWIRE LABS
View Details
share
NortheastNER
NortheastNER is a token classification model built on XLM-RoBERTa and fine-tuned on ~25k sentences from gazetteers, news, and cultural texts across Northeast India. It detects region-specific entities, places, tribes, festivals, tourist sites, flora, fauna, and experimental local names; ideal for low-resource NER, regional search, cultural analytics, and knowledge graph applications.
northeast-india
NER
Northeast India
Conservation
Meghalaya
XLM-RoBERTa
low-resource
Token Classification
  • See Upvoters0
  • Downloads9
  • File Size0
  • Views116
Updated 3 month(s) ago
MWIRE LABS
View Details
share
Kren-M
Northeast India's first AI language model. Kren-M is a 2.6B parameter bilingual model for Khasi-English, built on Gemma-2-2B. Features Kren-NE custom tokenizer covering 7 NE languages (Khasi, Garo, Mizo, Assamese, Manipuri, Nagamese, Nyishi) with 35.7% efficiency gain. Trained on 5.43M Khasi sentences. Capabilities: bidirectional translation, natural conversation, cultural context. Designed for language preservation across Northeast India
Garo
khasi
northeast-india
low-resource
continued-pretraining
Instruction-Tuning
bilingual
Indian Languages
Northeast India
Kren-M
Northeast India Languages
Foundational model
Tokenizer
  • See Upvoters0
  • Downloads11
  • File Size0
  • Views369
Updated 3 month(s) ago
MWIRE LABS
View Details
share
NE-BERT
NE-BERT is Northeast India's first domain-specific multilingual foundation model. Built on the ModernBERT architecture and trained on 8.3 million sentences, it supports 9 regional languages: Assamese, Khasi, Garo, Manipuri (Meitei), Mizo, Nyishi, Nagamese, Kokborok, and Pnar. It achieves State-of-the-Art performance on regional benchmarks and offers 1.6x faster inference, bridging the digital divide for low-resource languages.
kokborok
Pnar
modernbert
Masked Language Modeling
northeast-india
mwirelabs
token-efficiency
Assamese
Garo
Nyishi
low-resource-NLP
Meitei
Nagamese
khasi
A'chik
Mizo
northeast bert
  • See Upvoters0
  • Downloads10
  • File Size0
  • Views306
Updated 3 month(s) ago
MWIRE LABS
View Details
share
KhasiBERT
Khasi language model trained on 3.6M sentences using RoBERTa architecture. 110M parameters. Supports NLP tasks for Khasi text processing.
region:us
safetensors
roberta
Fill-Mask
khasi
Bert
masked-lm
foundational-model
low-resource
Indian Language
austroasiatic
kha
autotrain_compatible
endpoints_compatible
Meghalaya
digital-india
  • See Upvoters1
  • Downloads16
  • File Size0
  • Views468
Updated 5 month(s) ago
MWIRE LABS
View Details
share
Khasi English Semantic Search Model
Khasi-English semantic search model, trained on 66,794 pairs with 0.69-0.74 similarity. ~90MB, supports Meghalaya tourism/culture. By MWirelabs
Meghalaya
khasi-culture
text-embeddings-inference
autotrain_compatible
license:cc0-1.0
kha
en
Sentence Similarity
cross-lingual
semantic search
khasi
safetensors
sentence-transformers
  • See Upvoters0
  • Downloads15
  • File Size0
  • Views436
Updated 5 month(s) ago
MWIRE LABS
View Details
share

© 2026 - Copyright AIKosh. All rights reserved. This portal is developed by National e-Governance Division for AIKosh mission.