Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
1

AI4Bharat - IndicBERT: Multilingual Language Representation Model

A transformer-based model pre-trained on large-scale corpora, covering 12 major Indian languages.
  • Upvotes1upvotes
  • Downloads45downloads
  • Views1,445views
  • File size0
  • Shares0Shares
  • Last updatedupdated 05 Nov 2026
UpvoteUpvote
1
LICENSE MIT
SECTOR Sector Agnostic

About Model

Indic-BERT is a multilingual language representation model pre-trained on large-scale corpora covering 12 major Indian languages. It is based on the BERT architecture and is designed to provide contextual embeddings for various natural language processing tasks such as text classification, named entity recognition, and question answering. Indic-BERT aims to enhance the performance of NLP applications in Indian languages by offering rich semantic representations.

Metadata Metadata

MIT

Sector Agnostic

Divyanshu Kakwani and Anoop Kunchukuttan and Satish Golla and Gokul N.C. and Avik Bhattacharyya and Mitesh M. Khapra and Pratyush Kumar

N.A.

AI4Bharat

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

21/02/25 13:21:14

N.A.

0

Tags

  • Multilingual
  • Indian Languages
  • NLP
  • Bert
  • Language Model

Related Models Related Models

Dhir-5B-4bit
Dhīr 5B MoE Q4_K_M GGUF (3.4 GB) for offline llama.cpp in English + 10 Indian languages. 5.09B total/1.79B active parameters; 91% token agreement (1.5M tokens), ≤1.8% perplexity vs BF16.
Large Language Models
ZENTEIQ
  • See Upvoters2
  • Downloads9
  • Views145
  • File Size3.13 GB

microsoft/Phi-3-vision-128k-instruct
Phi-3-vision-128k-instruct is a state-of-the-art multimodal model by Microsoft, designed to process both text and visual inputs with a context length of up to 128,000 tokens.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads12
  • Views279
  • File Size0

Phi-3-Medium-4K-Instruct - Scalable AI Model for Reasoning and Code Generation
A 14B parameter AI model optimized for 4K and 128K token context lengths, designed for advanced reasoning, math, and coding applications, supporting both research and commercial use.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views261
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for high-speed, efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for enhanced performance.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views162
  • File Size0

Phi-3-Small-8K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Small-8K-Instruct, designed for efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for fast, scalable AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views172
  • File Size0

Phi-3-Mini-4K-Instruct GGUF - Optimized AI Model for GGUF Inference
A GGUF-optimized version of Phi-3-Mini-4K-Instruct, designed for efficient low-memory AI inference, supporting quantized and full-precision formats for balanced performance and quality.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters1
  • Downloads29
  • Views1,552
  • File Size0

Phi-3-Medium-128K-Instruct - Advanced Long-Context AI for Code and Logical Reasoning
A 14B parameter AI model optimized for 128K token context length, designed for complex reasoning, mathematical problem-solving, and efficient AI applications in commercial and research environments.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views131
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CPU - Optimized AI Model for CPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient long-context inference on CPUs, supporting structured reasoning, text generation, and code processing.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views206
  • File Size0

Phi-3-Mini-128K-Instruct ONNX - Optimized AI Model for Long-Context ONNX Inference
An ONNX-optimized version of Phi-3-Mini-128K-Instruct, quantized for fast, scalable inference on CPUs, GPUs, and mobile devices, supporting long-context AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views120
  • File Size0

Phi-3-Medium-4K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-4K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views209
  • File Size0


Related Models by Organization Related Models by Organization

AI4Bharat - MultiIndic WikiBio Structured Summarization Model
MultiIndicWikiBioSS is a multilingual sequence-to-sequence model fine-tuned on the IndicWikiBio dataset for nine Indian languages
AI4BHARAT
  • See Upvoters0
  • Downloads5
  • Views146
  • File Size0

AI4Bharat- Hercules Bengali LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs, particularly for Bengali
AI4BHARAT
  • See Upvoters0
  • Downloads9
  • Views329
  • File Size0

AI4Bharat- Hercules Hindi LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite designed to assess multilingual Large Language Models (LLMs) in Hindi
AI4BHARAT
  • See Upvoters0
  • Downloads24
  • Views530
  • File Size0

AI4Bharat - IndicBART Model for Structured Summarization
IndicBARTSS is a multilingual, sequence-to-sequence pre-trained model designed for natural language generation tasks in 11 Indic languages
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views723
  • File Size0

AI4Bharat- LLaMA Prometheus Model
Llama-Prometheus is an English evaluation model from the CIA Suite, fine-tuned on the Feedback-Collection dataset using Llama-3.1-8B-Instruct
AI4BHARAT
  • See Upvoters0
  • Downloads10
  • Views422
  • File Size0

AI4Bharat- Hercules Telugu LORA: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English reference responses
AI4BHARAT
  • See Upvoters0
  • Downloads25
  • Views346
  • File Size0

AI4Bharat- Hercules Urdu LORA Model: Evaluation Model
Hercule is a cross-lingual evaluation model from the CIA Suite, fine-tuned on the INTEL dataset to assess multilingual LLMs using English references
AI4BHARAT
  • See Upvoters0
  • Downloads1
  • Views194
  • File Size0

AI4Bharat-IndicConformer-STT-PA-Hybrid-CTC-RNNT-Large (Punjabi): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition Model (ASR) model for Punjabi, utilizing a hybrid CTC-RNNT decoder.
AI4BHARAT
  • See Upvoters0
  • Downloads16
  • Views664
  • File Size0

AI4Bharat-IndicConformer-STT-ML-Hybrid-CTC-RNNT-Large (Malayalam): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Malayalam, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads39
  • Views846
  • File Size0

AI4Bharat-IndicConformer-STT-MNI-Hybrid-CTC-RNNT-Large (Manipuri): Automatic Speech Recognition Model
A large-scale Automatic Speech Recognition (ASR) model for Manipuri, utilizing a hybrid CTC-RNNT decoder
AI4BHARAT
  • See Upvoters0
  • Downloads19
  • Views707
  • File Size0


Related Models by Sector Related Models by Sector

Dhir-5B-4bit
Dhīr 5B MoE Q4_K_M GGUF (3.4 GB) for offline llama.cpp in English + 10 Indian languages. 5.09B total/1.79B active parameters; 91% token agreement (1.5M tokens), ≤1.8% perplexity vs BF16.
Large Language Models
ZENTEIQ
  • See Upvoters2
  • Downloads9
  • Views145
  • File Size3.13 GB

microsoft/Phi-3-vision-128k-instruct
Phi-3-vision-128k-instruct is a state-of-the-art multimodal model by Microsoft, designed to process both text and visual inputs with a context length of up to 128,000 tokens.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads12
  • Views279
  • File Size0

Phi-3-Medium-4K-Instruct - Scalable AI Model for Reasoning and Code Generation
A 14B parameter AI model optimized for 4K and 128K token context lengths, designed for advanced reasoning, math, and coding applications, supporting both research and commercial use.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views261
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for high-speed, efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for enhanced performance.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views162
  • File Size0

Phi-3-Small-8K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Small-8K-Instruct, designed for efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for fast, scalable AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views172
  • File Size0

Phi-3-Mini-4K-Instruct GGUF - Optimized AI Model for GGUF Inference
A GGUF-optimized version of Phi-3-Mini-4K-Instruct, designed for efficient low-memory AI inference, supporting quantized and full-precision formats for balanced performance and quality.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters1
  • Downloads29
  • Views1,552
  • File Size0

Phi-3-Medium-128K-Instruct - Advanced Long-Context AI for Code and Logical Reasoning
A 14B parameter AI model optimized for 128K token context length, designed for complex reasoning, mathematical problem-solving, and efficient AI applications in commercial and research environments.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views131
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CPU - Optimized AI Model for CPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient long-context inference on CPUs, supporting structured reasoning, text generation, and code processing.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views206
  • File Size0

Phi-3-Mini-128K-Instruct ONNX - Optimized AI Model for Long-Context ONNX Inference
An ONNX-optimized version of Phi-3-Mini-128K-Instruct, quantized for fast, scalable inference on CPUs, GPUs, and mobile devices, supporting long-context AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views120
  • File Size0

Phi-3-Medium-4K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-4K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views209
  • File Size0


Related Models by Task Type Related Models by Task Type

sarvam-1
India's first indic model, pretrained on 4 trillion tokens
SARVAM AI
  • See Upvoters4
  • Downloads300
  • Views6,751
  • File Size0

AI4Bharat - IndicBERTv2-MLM-Sam-TLM: Multilingual MLM with Sampled Translation
A transformer-based model pre-trained on multiple Indian languages using Masked Language Modeling and Sampling-based Translation Language Modeling techniques.
AI4BHARAT
  • See Upvoters0
  • Downloads6
  • Views268
  • File Size0

AI4Bharat - IndicBERTv2-MLM-only: Multilingual Masked Language Model
A transformer-based model pre-trained exclusively on Masked Language Modeling tasks across multiple Indian languages.
AI4BHARAT
  • See Upvoters0
  • Downloads11
  • Views434
  • File Size0

AI4Bharat - IndicBERTv2-SS: Multilingual Sentence Similarity Model
A transformer-based model pre-trained on multiple Indian languages, focusing on Sentence Similarity tasks.
AI4BHARAT
  • See Upvoters0
  • Downloads7
  • Views493
  • File Size0

AI4Bharat - IndicBERTv2-MLM-Back-TLM: Multilingual Language Translation Model with Back-Translation
A transformer-based model pre-trained on multiple Indian languages using Masked Language Modeling and Back-Translation Language Modeling techniques.
AI4BHARAT
  • See Upvoters0
  • Downloads18
  • Views293
  • File Size0

Khasi English Semantic Search Model
Khasi-English semantic search model, trained on 66,794 pairs with 0.69-0.74 similarity. ~90MB, supports Meghalaya tourism/culture. By MWirelabs
MWIRE LABS
  • See Upvoters0
  • Downloads27
  • Views1,187
  • File Size0

AI4Bharat- 500 M - RomanSetu Multilingual Native-to-Roman Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
AI4BHARAT
  • See Upvoters1
  • Downloads57
  • Views1,200
  • File Size0

AI4Bharat- 400 M - RomanSetu Multilingual Native-to-Roman Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
AI4BHARAT
  • See Upvoters1
  • Downloads98
  • Views1,301
  • File Size0

AI4Bharat- 500 M - RomanSetu Multilingual Roman-to-Native Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
AI4BHARAT
  • See Upvoters0
  • Downloads30
  • Views521
  • File Size0

AI4Bharat- 400 M - RomanSetu Multilingual Roman-to-Native Model
RomanSetu is a multilingual continual pretrained transformer model designed for transliteration across six Indic languages
AI4BHARAT
  • See Upvoters0
  • Downloads46
  • Views898
  • File Size0