Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
1

SKT-ST-X-0-3B

Model Overview :-- SKT 3B-MoE is a compact Small Language Model (SLM) built using ST-X-0 Taken Mixtral For Better MoE Stability , it delivers efficient and intelligent responses while maintaining a small footprint.
  • Upvotes1upvotes
  • Downloads3downloads
  • Views64views
  • File size0
  • Shares0Shares
  • Last updatedupdated 06 Jul 2026
UpvoteUpvote
1
LICENSE Apache 2.0
SECTOR Science, Technology and Research

About Model

# 🚀 SKT-ST-X-0-3B: Sovereign Indian Intelligence **A Compact, High-Efficiency Mixture of Experts (MoE) Language Model** ### 🌟 Overview **SKT-ST-X-0-3B** is a state-of-the-art Small Language Model (SLM) engineered by **SKT AI LABS, India**. Designed for maximum performance on a minimal footprint, it utilizes advanced **Mixtral-inspired MoE stability techniques** to deliver intelligent, lightning-fast responses. | Feature | Specification | |---|---| | **Architecture** | Mixture of Experts (MoE) | | **Total Params** | ~3 Billion | | **Active Params** | ~1.1 Billion (2 expert/token) | | **Context Window** | 8K Tokens | | **Training Data** | 40B Tokens (SKT-OMNI-CORPUS-2T) | ### 🧠 Why SKT-ST-X-0-3B? * **Bilingual Mastery:** Optimized for both English and Hindi. * **Efficiency:** Designed for edge deployment with low VRAM requirements via 4-bit quantization. * **Reasoning Power:** Robust performance in logic, coding, and complex problem-solving. * **Sovereign AI:** Built in India, for the world, by **SKT AI LABS** . ### 🛠️ Quick Setup ```python from transformers import AutoModelForCausalLM, AutoTokenizer import torch # Load with 4-bit quantization for extreme efficiency model = AutoModelForCausalLM.from_pretrained( "sKT-Ai-Labs/SKT-ST-X-0-3B", device_map="auto", load_in_4bit=True ) tokenizer = AutoTokenizer.from_pretrained("sKT-Ai-Labs/SKT-ST-X-0-3B") ``` ### 📊 Performance Metrics (MTEB) * **Amazon Polarity Classification:** 56.88% Accuracy * **Amazon Counterfactual Classification:** 39.35% F1-Score ### 📜 License Released under the **Apache-2.0 License**. ### 📧 Contact For partnerships or technical inquiries, reach out to **support@sktailabs.in**.

Metadata Metadata

Apache 2.0

Science, Technology and Research

sKT-Ai-Labs

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

24/06/26 03:50:50

N.A.

0

Tags

  • Mixture of Experts
  • moe
  • SKT AI LABS
  • slm
  • 3b-model

Related Models Related Models

MAIRA-2 - Multimodal AI for Radiology Report Generation
A multimodal Transformer model designed for generating grounded and non-grounded radiology reports from chest X-rays, integrating vision and language understanding for medical AI research.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads33
  • Views1,325
  • File Size0

shuka-v1
Multilingual audio to text model
SARVAM AI
  • See Upvoters3
  • Downloads117
  • Views2,673
  • File Size0

sarvam-1
India's first indic model, pretrained on 4 trillion tokens
SARVAM AI
  • See Upvoters4
  • Downloads301
  • Views6,808
  • File Size0

RAG Engine
Python script that implements a Retrieval‑Augmented Generation (RAG) pipeline for document question answering.
Text Generation
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size0

tokenmodel
How people read your model before they download it.
Transformers
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size0

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views3
  • File Size0

LUCAN 10B
LUCAN 10B Physics MoE is an 11B parameter multi-domain scientific foundation model built on a hybrid Mamba2 state-space and 12-layer Sparse Mixture-of-Experts (MoE) architecture with a PhysicsConstrainedOutputHead. It models continuous scientific latents across fluid transport, chemical reactors, phase-change thermal physics, and molecular systems.
SHODH AI PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views30
  • File Size4.02 GB

LUCAN 3B
LUCAN 3B is an approximately 3-billion-parameter scientific AI model from Shodh AI for processing numerical reactor data. This release includes the model weights, dedicated tokenizers and matching adapters for bioreactor and continuous-flow reactor applications, along with loading instructions and an introductory guide.
SHODH AI PRIVATE LIMITED
  • See Upvoters0
  • Downloads1
  • Views39
  • File Size4.44 GB

MIZO MT
This Machine Translation (MT) model translates text from one language to another using a trained neural network. It can support multilingual communication and language translation applications. Translation quality depends on language coverage, training data, and contextual accuracy. For Mizo, evaluate the model using representative test sentences before deployment.
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size496.68 MB

CoRover-BharatGPT-Instruct
BharatGPT-Instruct E2B is a multilingual language model by CoRover.ai, designed to deliver high-quality, culturally relevant AI responses across Indian languages.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views61
  • File Size9.57 GB


Related Models by Organization Related Models by Organization

RAG Engine
Python script that implements a Retrieval‑Augmented Generation (RAG) pipeline for document question answering.
Text Generation
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size0

tokenmodel
How people read your model before they download it.
Transformers
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size0

AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views3
  • File Size0

Samadhan-Bharat-Epoch1-Tri-Statutory-Neural-Model
Sovereign 5-Head Tri-Statutory Deep Neural Engine integrating 22 Indic constitutional languages, MSMED Act Section 16 monthly compounding (3x RBI rate), CGST Section 16(2)(b) statutory delivery estoppel, Section 43B(h) Income Tax profit disallowances, and RBI CRILC delinquency classification.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads2
  • Views36
  • File Size584.43 KB

Samadhan-Bharat-Sovereign-Indic-Voice-RVC-Acoustic-Engine
Deep neural acoustic adjudication and Retrieval-Based Voice Conversion (RVC) engine trained on IndiaAI cloud infrastructure. Features 1,976,327 trainable parameters with a 4-layer LayerNorm SiLU backbone and multi-head statutory predictors. Simultaneously predicts invoice default principal, statutory delay horizon, Section 16 monthly compound interest (at 3x RBI Bank Rate), and 4-quadrant legal classification from 256-D vernacular speech feature tensors across India's 22 scheduled languages.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads1
  • Views41
  • File Size2.41 MB

Samadhan-Bharat-Sovereign-4Quadrant-2B-Master-Engine
Sovereign 4-Quadrant Dual-Pincer neural engine for simultaneous MSME delayed trade liquidity unfreezing and GST circular trading fraud detection, trained and validated over 1.35 Trillion statutory transactions.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views34
  • File Size44.73 KB

Samadhan-Bharat-Sovereign-Dual-Head-Model
Dual-head sovereign legal AI model trained on IndiaAI AIRAWAT and 16-Core CPU supercluster across 15.7M+ tokens. Features a 95.04% accurate Judicial Adjudication Head for Section 18 MSMED disputes and a 100.00% accurate Treasury Anti-Fraud Head for circular GST invoice interception.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads1
  • Views55
  • File Size55.94 KB

Test model
Model Short Description
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views1
  • File Size65 Bytes

NCERT-TUTOR-v3
NCERT-aligned tutor LoRA for on-device K-12 tutoring. Runs on 4 GB VRAM (RTX 3050). Stage-3 chained adapter: 15.7k curated questions (Grades 6-12, 13 subjects) + 3 DPO stages (math reasoning, mined factuality, multi-subject). 58% on held-out NCERT math with worked steps.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads5
  • Views206
  • File Size65.36 MB

Kaveri-4B
Kaveri-4B is a multilingual text-generation model for conversational AI, instruction following, reasoning, coding assistance, summarization, translation, and general-purpose NLP tasks.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views47
  • File Size7.51 GB


Related Models by Sector Related Models by Sector

shuka-v1
Multilingual audio to text model
SARVAM AI
  • See Upvoters3
  • Downloads117
  • Views2,673
  • File Size0

sarvam-1
India's first indic model, pretrained on 4 trillion tokens
SARVAM AI
  • See Upvoters4
  • Downloads301
  • Views6,808
  • File Size0

LUCAN 10B
LUCAN 10B Physics MoE is an 11B parameter multi-domain scientific foundation model built on a hybrid Mamba2 state-space and 12-layer Sparse Mixture-of-Experts (MoE) architecture with a PhysicsConstrainedOutputHead. It models continuous scientific latents across fluid transport, chemical reactors, phase-change thermal physics, and molecular systems.
SHODH AI PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views30
  • File Size4.02 GB

LUCAN 3B
LUCAN 3B is an approximately 3-billion-parameter scientific AI model from Shodh AI for processing numerical reactor data. This release includes the model weights, dedicated tokenizers and matching adapters for bioreactor and continuous-flow reactor applications, along with loading instructions and an introductory guide.
SHODH AI PRIVATE LIMITED
  • See Upvoters0
  • Downloads1
  • Views39
  • File Size4.44 GB

MIZO MT
This Machine Translation (MT) model translates text from one language to another using a trained neural network. It can support multilingual communication and language translation applications. Translation quality depends on language coverage, training data, and contextual accuracy. For Mizo, evaluate the model using representative test sentences before deployment.
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size496.68 MB

COILD Multilingual Translation
COILD Multilingual Translation Model (COILD-Mul-MT)
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads0
  • Views36
  • File Size0

GNM Generative aNthropometric Model - v3
GNM (pronounced genome) is a state-of-the-art parametric 3D statistical model of the human head developed by Google. Learned from a large dataset of high-resolution 3D scans, GNM provides fine-grained, disentangled control over facial identity, expressions, and head pose, complete with controllable internal anatomy (eyeballs, teeth, and tongue). The model is released under the Apache 2.0 permissive license, suitable for both academic research and commercial applications.
GOOGLE LLC
  • See Upvoters0
  • Downloads0
  • Views29
  • File Size0

BHASHINI IISc Sourashtra VITS TTS Models
VITS text-to-speech models for Sourashtra, a low-resource Indo-Aryan language. There are male and female voices, and each voice accepts text in either Tamil script or Sourashtra script.
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters1
  • Downloads3
  • Views113
  • File Size0

DiffusionGemma
DiffusionGemma is a generative model built by Google DeepMind. Based on the 26B A4B Mixture-of-Experts (MoE) Gemma 4 architecture, DiffusionGemma generates tokens using discrete diffusion. This open-weights model is multimodal, handling text, image, and video inputs to generate text output.
GOOGLE LLC
  • See Upvoters1
  • Downloads3
  • Views68
  • File Size0

SPRING-INX-DATA2VEC-AQC-GUJARATI
Automatic Speech Recognition (ASR) model for speech recognition, processing audio and transcribing spoken content into text.The inference code, installation requirements, and usage instructions are available in the SPRING Lab, IIT Madras GitHub repository: https://github.com/Speech-Lab-IITM/Fairseq-Inference
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads4
  • Views64
  • File Size3.52 GB


Related Models by Task Type Related Models by Task Type

MAIRA-2 - Multimodal AI for Radiology Report Generation
A multimodal Transformer model designed for generating grounded and non-grounded radiology reports from chest X-rays, integrating vision and language understanding for medical AI research.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads33
  • Views1,325
  • File Size0

RAG Engine
Python script that implements a Retrieval‑Augmented Generation (RAG) pipeline for document question answering.
Text Generation
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views22
  • File Size0

CoRover-BharatGPT-Instruct
BharatGPT-Instruct E2B is a multilingual language model by CoRover.ai, designed to deliver high-quality, culturally relevant AI responses across Indian languages.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views61
  • File Size9.57 GB

CoRover-BharatGPT-mini
BharatGPT Mini - A compact, Transformer-based language model developed by CoRover, pretrained on large-scale text data to understand and generate natural language, advancing India’s indigenous AI capabilities.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views135
  • File Size967.26 MB

CoRover-BharatGPT-3B-Indic
A multilingual model fine-tuned on authentic conversational data across Indic languages, supporting translation, summarisation, and text generation. Ideal for Secure RAG (S-RAG) and domain-specific fine-tuning, it enables the development of sovereign, multilingual AI agents, chatbots, voicebots, and virtual assistants.
COROVER PRIVATE LIMITED
  • See Upvoters0
  • Downloads0
  • Views23
  • File Size6 GB

Kaveri-4B
Kaveri-4B is a multilingual text-generation model for conversational AI, instruction following, reasoning, coding assistance, summarization, translation, and general-purpose NLP tasks.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views47
  • File Size7.51 GB

Kaveri-1-5B
Kaveri-1.5B is a lightweight multilingual text-generation assistant by RiyaVibe for general chat, instruction following, basic question answering, simple coding help, basic math, translation, and local or cloud inference.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views31
  • File Size2.89 GB

Kaveri-05b
Kaveri 0.5B is a lightweight multilingual conversational AI assistant designed for local inference, instruction following, chat, and agent workflows.
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters0
  • Downloads0
  • Views56
  • File Size739.29 MB

gnani-evon-v3-30B-A3B
Hybrid Mamba2–Transformer MoE, 30B total / ~3.5B active, trained end-to-end for Indic capability across 11 languages. 128K context, tool calling, native-script output. Apache-2.0.
GNANI INNOVATIONS PRIVATE LIMITED
  • See Upvoters0
  • Downloads4
  • Views202
  • File Size0

Phi-1.5 - Lightweight Transformer Model for Text Generation and Coding
A 1.3B parameter Transformer model trained on structured QA, NLP tasks, and Python code, optimized for text generation, summarization, and creative writing, with no fine-tuning from human feedback.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads43
  • Views1,703
  • File Size0