Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
1

KhasiBERT

Khasi language model trained on 3.6M sentences using RoBERTa architecture. 110M parameters. Supports NLP tasks for Khasi text processing.
  • Upvotes1upvotes
  • Downloads33downloads
  • Views1,314views
  • File size0
  • Shares0Shares
  • Last updatedupdated 15 Sept 2025
UpvoteUpvote
1
LICENSE Creative Commons Attribution Non Commercial 4.0
SECTOR Education and Skill Development

About Model

KhasiBERT is the first transformer-based language model developed specifically for the Khasi language of Meghalaya. This foundational model addresses the computational linguistics needs for Meghalaya's 1.4+ million Khasi speakers and enables digital language processing infrastructure for the state.

The model implements the RoBERTa architecture with 12 transformer layers, 768 hidden dimensions, and 12 attention heads, totaling 110,652,416 parameters. KhasiBERT was trained using masked language modeling on a corpus of 3,621,116 Khasi sentences collected and preprocessed to represent diverse linguistic patterns of the language.

A custom Byte-Level BPE tokenizer with 32,000 vocabulary tokens was developed specifically for the Khasi language to handle its Austroasiatic linguistic characteristics effectively. Training utilized mixed-precision (FP16) optimization with a batch size of 24, learning rate of 5e-5, and AdamW optimizer over 150,880 training steps.

The model supports standard transformer operations including masked token prediction, contextualized embeddings generation, and can be fine-tuned for downstream tasks such as text classification, sentiment analysis, named entity recognition, and question answering in Khasi. Input sequences are limited to 512 tokens with standard special tokens for beginning-of-sequence, end-of-sequence, padding, unknown tokens, and masking.

Technical specifications include GELU activation functions, 0.1 dropout probability, layer normalization with epsilon 1e-12, and positional embeddings up to 514 positions. The model weights are distributed in Safetensors format and are compatible with the Transformers library ecosystem for integration with existing NLP workflows.

Metadata Metadata

Creative Commons Attribution Non Commercial 4.0

Education and Skill Development

MWirelabs

N.A.

MWire Labs

Badal Nyalang

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

04/09/25 02:55:59

N.A.

0

Tags

  • Bert
  • safetensors
  • endpoints_compatible
  • autotrain_compatible
  • Fill-Mask
  • Indian Language
  • low-resource
  • region:us
  • kha
  • khasi
  • Meghalaya
  • austroasiatic
  • masked-lm
  • roberta
  • foundational-model
  • digital-india

Linked Model Linked Model

Kren v1: Khasi Generative Language Model
Kren v1 is the first Khasi generative language model, trained on 1M lines, pioneering encoder-to-decoder adaptation for low-resource AI.
MWIRE LABS
  • See Upvoters0
  • Downloads0
  • Views8
  • File Size390.67 MB

Kren-M
Northeast India's first AI language model. Kren-M is a 2.6B parameter bilingual model for Khasi-English, built on Gemma-2-2B. Features Kren-NE custom tokenizer covering 7 NE languages (Khasi, Garo, Mizo, Assamese, Manipuri, Nagamese, Nyishi) with 35.7% efficiency gain. Trained on 5.43M Khasi sentences. Capabilities: bidirectional translation, natural conversation, cultural context. Designed for language preservation across Northeast India
MWIRE LABS
  • See Upvoters0
  • Downloads40
  • Views1,231
  • File Size0


Related Models by Organization Related Models by Organization

Northeast STT Multilingual Speech to Text Model
A multilingual Speech-to-Text (STT) model for eight Northeast Indian languages, fine-tuned from Whisper Medium using over 150,000 speech-text pairs from public and institutional datasets. The model expands speech recognition support for low-resource indigenous languages, including Khasi, Garo, Mizo, Kokborok, Nagamese, Assamese, Chakma, and Wancho.
MWIRE LABS
  • See Upvoters0
  • Downloads4
  • Views163
  • File Size0

NE-SpeechEmbed
NE-SpeechEmbed is a multilingual speech-text embedding model by MWire Labs for Northeast Indian languages. The model supports semantic speech search, cross-modal retrieval, and audio-text embeddings across Khasi, Garo, Mizo, Nagamese, Kokborok, Assamese, Wancho, and Chakma.
MWIRE LABS
  • See Upvoters0
  • Downloads0
  • Views94
  • File Size0

NE-Embed
NE-Embed is a multilingual text embedding model for Northeast Indian languages, enabling semantic search, retrieval, and RAG across 10 languages including Khasi, Garo, Meitei, Bodo, Mizo, Assamese, Nyishi, Kokborok, Pnar, and Nagamese. Fine-tuned on LaBSE with 201,738 parallel pairs.
MWIRE LABS
  • See Upvoters0
  • Downloads0
  • Views90
  • File Size0

Mizo OCR - Text Recognition for Mizo Language
OCR model for the Mizo language achieving 90.68% character accuracy on synthetic and curated printed text
MWIRE LABS
  • See Upvoters0
  • Downloads4
  • Views473
  • File Size0

NE-OCR
NE-OCR is a multilingual Optical Character Recognition model developed by MWire Labs to accurately recognize printed text from documents in Northeast Indian languages. The model supports Assamese, Bodo, English, Garo, Hindi, Khasi, Kokborok, Meitei (Bengali script), Meitei (Meitei Mayek script), Mizo, Nagamese, and Nyishi. It is designed to enable reliable digitization of books, newspapers, government records, educational materials, and cultural archives from Northeast India where mainstream OCR
MWIRE LABS
  • See Upvoters0
  • Downloads9
  • Views320
  • File Size0

Nagamese Speech-to-Text
Automatic Speech Recognition (ASR) model for Nagamese speech, designed to transcribe spoken Nagamese into text for real-world usage.
MWIRE LABS
  • See Upvoters0
  • Downloads5
  • Views301
  • File Size0

Garo OCR - Text Recognition for Garo
OCR model for the Garo language achieving 93.13% character accuracy.
MWIRE LABS
  • See Upvoters0
  • Downloads0
  • Views476
  • File Size0

Northeast Language Identification
NE-LID is a fast and accurate language identification model for Northeast Indian languages using character level features. It is designed for low resource and script diverse text and achieves high accuracy on short sentences.
MWIRE LABS
  • See Upvoters1
  • Downloads13
  • Views1,218
  • File Size0

NortheastNER
NortheastNER is a token classification model built on XLM-RoBERTa and fine-tuned on ~25k sentences from gazetteers, news, and cultural texts across Northeast India. It detects region-specific entities, places, tribes, festivals, tourist sites, flora, fauna, and experimental local names; ideal for low-resource NER, regional search, cultural analytics, and knowledge graph applications.
MWIRE LABS
  • See Upvoters0
  • Downloads15
  • Views497
  • File Size0

Kren-M
Northeast India's first AI language model. Kren-M is a 2.6B parameter bilingual model for Khasi-English, built on Gemma-2-2B. Features Kren-NE custom tokenizer covering 7 NE languages (Khasi, Garo, Mizo, Assamese, Manipuri, Nagamese, Nyishi) with 35.7% efficiency gain. Trained on 5.43M Khasi sentences. Capabilities: bidirectional translation, natural conversation, cultural context. Designed for language preservation across Northeast India
MWIRE LABS
  • See Upvoters0
  • Downloads40
  • Views1,231
  • File Size0


Related Models by Sector Related Models by Sector

NCERT-TUTOR-v3
NCERT-aligned tutor LoRA for on-device K-12 tutoring. Runs on 4 GB VRAM (RTX 3050). Stage-3 chained adapter: 15.7k curated questions (Grades 6-12, 13 subjects) + 3 DPO stages (math reasoning, mined factuality, multi-subject). 58% on held-out NCERT math with worked steps.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads5
  • Views202
  • File Size65.36 MB

IndNumNLI-Classifier-v1
IndNumNLI Classifier is a soft-voting ensemble of Random Forest and Gradient Boosting trained on 16 numerical reasoning features extracted from Indian government statistical premise-hypothesis pairs. It classifies NLI labels as entailment, neutral, or contradiction with a test accuracy of 60 percent and macro F1 of 0.64.
SYMBIOSIS SKILLS AND PROFESSIONAL UNIVERSITY
  • See Upvoters0
  • Downloads1
  • Views65
  • File Size584.97 KB

NEET-BioBERT
NEET-BioBERT is a fine-tuned version of DistilBERT (base uncased) specifically trained to classify the correct option for NEET-style multiple-choice biology questions. It selects the best answer among four choices (A, B, C, D).
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads8
  • Views162
  • File Size256.10 MB

LecaDis
Dictionary Constrained Disambiguation for Improved NMT
IIT BOMBAY
  • See Upvoters0
  • Downloads38
  • Views1,043
  • File Size4.70 GB


Related Models by Task Type Related Models by Task Type

MAIRA-2 - Multimodal AI for Radiology Report Generation
A multimodal Transformer model designed for generating grounded and non-grounded radiology reports from chest X-rays, integrating vision and language understanding for medical AI research.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads33
  • Views1,325
  • File Size0

RAG Engine
Python script that implements a Retrieval‑Augmented Generation (RAG) pipeline for document question answering.
Text Generation
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size0

CoRover-BharatGPT-Instruct
BharatGPT-Instruct E2B is a multilingual language model by CoRover.ai, designed to deliver high-quality, culturally relevant AI responses across Indian languages.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views61
  • File Size9.57 GB

CoRover-BharatGPT-mini
BharatGPT Mini - A compact, Transformer-based language model developed by CoRover, pretrained on large-scale text data to understand and generate natural language, advancing India’s indigenous AI capabilities.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views134
  • File Size967.26 MB

CoRover-BharatGPT-3B-Indic
A multilingual model fine-tuned on authentic conversational data across Indic languages, supporting translation, summarisation, and text generation. Ideal for Secure RAG (S-RAG) and domain-specific fine-tuning, it enables the development of sovereign, multilingual AI agents, chatbots, voicebots, and virtual assistants.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views23
  • File Size6 GB

Kaveri-4B
Kaveri-4B is a multilingual text-generation model for conversational AI, instruction following, reasoning, coding assistance, summarization, translation, and general-purpose NLP tasks.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views47
  • File Size7.51 GB

Kaveri-1-5B
Kaveri-1.5B is a lightweight multilingual text-generation assistant by RiyaVibe for general chat, instruction following, basic question answering, simple coding help, basic math, translation, and local or cloud inference.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views31
  • File Size2.89 GB

Kaveri-05b
Kaveri 0.5B is a lightweight multilingual conversational AI assistant designed for local inference, instruction following, chat, and agent workflows.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views56
  • File Size739.29 MB

gnani-evon-v3-30B-A3B
Hybrid Mamba2–Transformer MoE, 30B total / ~3.5B active, trained end-to-end for Indic capability across 11 languages. 128K context, tool calling, native-script output. Apache-2.0.
GNANI INNOVATIONS PRIVATE LIMITED
  • See Upvoters0
  • Downloads4
  • Views201
  • File Size0

Phi-1.5 - Lightweight Transformer Model for Text Generation and Coding
A 1.3B parameter Transformer model trained on structured QA, NLP tasks, and Python code, optimized for text generation, summarization, and creative writing, with no fine-tuning from human feedback.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads43
  • Views1,702
  • File Size0