Indian Flag
Government Of India
A-
A
A+

Param2-17B-Thinking

BharatGen presents Param-2-17B-MoE-A2.4B, a large-scale Mixture-of-Experts (MoE) language model designed to deliver high model capacity while retaining the inference efficiency of a much smaller dense model. It uses a Hybrid MoE architecture with 17B total parameters, while activating only 2.4B parameters per token.

About Model

* 17B parameter Mixture of Experts (MoE) language model * Multilingual: English, Hindi + 21 Indian languages * Trained on ~22 trillion tokens across two pretraining phases * Uses 64 specialized experts, dynamically activated per token * Supports long-context understanding (up to 4096 tokens) * Efficient inference: Only 2.4B active parameters per token * Advanced Capabilities: Thinking & Reasoning, Tool Calling, Mathematics, Code Generation * Designed for diverse downstream applications and further fine-tuning

Param2-17B-Thinking

Metadata Metadata

Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)

bharatgenai

Transformers

PyTorch

Open

BharatGen

Other

13/03/26 11:03:42

57.29 GB

Param2-17B-A2.4B-Thinking ( 2 directories )


Directory
__MACOSX

1 directories

Directory
Param2-17B-A2.4B-Thinking

20 files

Activity Overview Activity Overview

  • Downloads1
  • Downloads 41
  • File Size 25.33 GB
  • Views 1,060

Tags Tags

  • Mixture of Experts
  • Multilingual Text
  • pretrained

License Control License Control

Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0)

Version Control Version Control

FolderVersion 1(25.33 GB)
  • admin·2 month(s) ago
    • chevron_rightFolder
      Param2-17B-A2.4B-Thinking
      • chevron_rightFolder
        __MACOSX
      • chevron_rightFolder
        Param2-17B-A2.4B-Thinking

More Models from BharatGen More Models from BharatGen

Param-1-5B
Param-1-5B is a bilingual (English–Hindi) large language model developed under the Param-1 family. With 5 billion parameters, this model extends the capabilities of Param-1-2.9B by incorporating enhanced mathematical reasoning and code understanding/generation. The model is pretrained from scratch and designed to serve as a strong foundation for downstream tasks such as mathematical problem solving, and code-related understanding / generation.
pretrained
  • See Upvoters0
  • Downloads0
  • File Size10.42 GB
  • Views17
Updated 5 day(s) ago

BHARATGEN

Param-1-Instruct
BharatGen introduces the early checkpoint of SFT (Supervised Fine-Tuned) for Param 1, a bilingual language model trained from scratch in English and Hindi. With 2.9 billion parameters, this checkpoint builds upon the pretraining phase and serves as a foundation for more downstream tasks, safety testing, and customization.
QnA
Instruction-Tuning
Model Fine-Tuning
  • See Upvoters0
  • Downloads0
  • File Size5.36 GB
  • Views12
Updated 5 day(s) ago

BHARATGEN

BharatGen - Param 1 Indic-Scale Bilingual Foundation Model
Param1 is a 2.9 billion parameter language model pretrained on English and Hindi, designed for text completion.
Large Language Model
  • See Upvoters4
  • Downloads679
  • File Size13.79 GB
  • Views19,506
Updated 6 day(s) ago

BHARATGEN

Param2-17B-Thinking
BharatGen presents Param-2-17B-MoE-A2.4B, a large-scale Mixture-of-Experts (MoE) language model designed to deliver high model capacity while retaining the inference efficiency of a much smaller dense model. It uses a Hybrid MoE architecture with 17B total parameters, while activating only 2.4B parameters per token.
Mixture of Experts
Multilingual Text
pretrained
  • See Upvoters1
  • Downloads41
  • File Size57.29 GB
  • Views1,061
Updated 2 month(s) ago

BHARATGEN

BharatGen Multilingual TTS - Sooktam2
Sooktam-2 is a multilingual Indic Text-to-Speech model by BharatGen supporting 12 languages including Hindi, Marathi, Tamil, Telugu, Bengali, Urdu, Punjabi and Indian English. It enables high-quality speech synthesis with reference-guided voice conditioning, preserving speaker voice, accent and prosody for natural and expressive generation.
multilingual-TTS
Text-to-Speech
Multilingual Speech
Audio Synthesis
sooktam2
  • See Upvoters0
  • Downloads9
  • File Size1.25 GB
  • Views796
Updated 2 month(s) ago

BHARATGEN

BharatGen - Param-1-7B-MoE Advancing Multilingual GenAI for India
Param-1-7B-MoE is a multilingual large language model developed under the Param-1 family as part of BharatGen – A Suite of Generative AI Technologies for India. With 7 billion parameters and a Mixture of Experts (MoE) architecture, the model is designed to better understand and generate text across English, Hindi, and 14 additional Indian languages. The model is pretrained from scratch with a strong focus on linguistic diversity, cultural context, and large-scale multilingual representation.
safetensors
mixtral
region:us
  • See Upvoters1
  • Downloads79
  • File Size0
  • Views1,187
Updated 4 month(s) ago

BHARATGEN

BharatGen-AgriParam
Large language model fine-tuned from Param-1-2.9B-Instruct on a high-quality, India-centric agriculture dataset.
Multiturn
QnA
  • See Upvoters0
  • Downloads3
  • File Size0
  • Views68
Updated 5 month(s) ago

BHARATGEN

BharatGen-FinanceParam
large language model fine-tuned from Param-1-2.9B-Instruct on a high-quality finance dataset.
Multiturn
QnA
  • See Upvoters0
  • Downloads15
  • File Size0
  • Views108
Updated 5 month(s) ago

BHARATGEN

BharatGen-LegalParam
Large language model fine-tuned from Param-1-2.9B-Instruct on an exhaustive India-centric legal dataset.
Multiturn
QnA
Summarization
  • See Upvoters0
  • Downloads1
  • File Size0
  • Views38
Updated 5 month(s) ago

BHARATGEN

BharatGen-AyurParam
Large language model fine-tuned from Param-1-2.9B-Instruct on a high-quality Ayurveda dataset
Ayurvedic
  • See Upvoters0
  • Downloads2
  • File Size0
  • Views32
Updated 5 month(s) ago

BHARATGEN