Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

BiomedBERT - Domain-Specific Biomedical Language Model

A biomedical NLP model pre-trained from scratch on abstracts and full-text articles from PubMed and PubMed Central, achieving state-of-the-art performance on biomedical language understanding tasks.
  • Upvotes0upvotes
  • Downloads102downloads
  • Views1,998views
  • File size0
  • Shares0Shares
  • Last updatedupdated 12 Nov 2026
UpvoteUpvote
0
LICENSE MIT
SECTOR Healthcare, Wellness and Family Welfare

About Model

BiomedBERT (formerly PubMedBERT (abstracts + full text)) is a domain-specific biomedical language model developed by Microsoft. Unlike general NLP models that start with broad-domain corpora, BiomedBERT is pre-trained from scratch using PubMed abstracts and full-text articles from PubMed Central, enabling superior performance on biomedical NLP tasks. Key capabilities of BiomedBERT include: 1. Biomedical text classification 2. Named entity recognition (NER) for medical terminology 3. Question answering in the medical domain 4. Biomedical language inference and reasoning This model outperforms general-domain language models on various benchmarks and currently holds the top score on the Biomedical Language Understanding and Reasoning Benchmark. BiomedBERT is intended for research purposes only and should not be used for clinical decision-making. It serves as a valuable tool for biomedical AI researchers, medical text mining, and healthcare-related NLP applications.

Metadata Metadata

MIT

Healthcare, Wellness and Family Welfare

Microsoft

N.A.

Vikram Malhotra

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

11/04/25 06:17:29

N.A.

0

Tags

  • PyTorch
  • Transformers
  • JAX
  • English
  • Bert
  • inference endpoints
  • Fill-Mask
  • exbert

Related Models Related Models

microsoft/Phi-3-vision-128k-instruct
Phi-3-vision-128k-instruct is a state-of-the-art multimodal model by Microsoft, designed to process both text and visual inputs with a context length of up to 128,000 tokens.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads12
  • Views283
  • File Size0

Phi-3-Medium-4K-Instruct - Scalable AI Model for Reasoning and Code Generation
A 14B parameter AI model optimized for 4K and 128K token context lengths, designed for advanced reasoning, math, and coding applications, supporting both research and commercial use.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views270
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for high-speed, efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for enhanced performance.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views168
  • File Size0

Phi-3-Small-8K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Small-8K-Instruct, designed for efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for fast, scalable AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views174
  • File Size0

Phi-3-Mini-4K-Instruct GGUF - Optimized AI Model for GGUF Inference
A GGUF-optimized version of Phi-3-Mini-4K-Instruct, designed for efficient low-memory AI inference, supporting quantized and full-precision formats for balanced performance and quality.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters1
  • Downloads29
  • Views1,580
  • File Size0

Phi-3-Medium-128K-Instruct - Advanced Long-Context AI for Code and Logical Reasoning
A 14B parameter AI model optimized for 128K token context length, designed for complex reasoning, mathematical problem-solving, and efficient AI applications in commercial and research environments.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views133
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CPU - Optimized AI Model for CPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient long-context inference on CPUs, supporting structured reasoning, text generation, and code processing.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views212
  • File Size0

Phi-3-Mini-128K-Instruct ONNX - Optimized AI Model for Long-Context ONNX Inference
An ONNX-optimized version of Phi-3-Mini-128K-Instruct, quantized for fast, scalable inference on CPUs, GPUs, and mobile devices, supporting long-context AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views121
  • File Size0

Phi-3-Medium-4K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-4K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views211
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views110
  • File Size0


Related Models by Organization Related Models by Organization

microsoft/Phi-3-vision-128k-instruct
Phi-3-vision-128k-instruct is a state-of-the-art multimodal model by Microsoft, designed to process both text and visual inputs with a context length of up to 128,000 tokens.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads12
  • Views283
  • File Size0

Phi-3-Medium-4K-Instruct - Scalable AI Model for Reasoning and Code Generation
A 14B parameter AI model optimized for 4K and 128K token context lengths, designed for advanced reasoning, math, and coding applications, supporting both research and commercial use.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views270
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for high-speed, efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for enhanced performance.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views168
  • File Size0

Phi-3-Small-8K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Small-8K-Instruct, designed for efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for fast, scalable AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views174
  • File Size0

Phi-3-Mini-4K-Instruct GGUF - Optimized AI Model for GGUF Inference
A GGUF-optimized version of Phi-3-Mini-4K-Instruct, designed for efficient low-memory AI inference, supporting quantized and full-precision formats for balanced performance and quality.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters1
  • Downloads29
  • Views1,580
  • File Size0

Phi-3-Medium-128K-Instruct - Advanced Long-Context AI for Code and Logical Reasoning
A 14B parameter AI model optimized for 128K token context length, designed for complex reasoning, mathematical problem-solving, and efficient AI applications in commercial and research environments.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views133
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CPU - Optimized AI Model for CPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient long-context inference on CPUs, supporting structured reasoning, text generation, and code processing.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views212
  • File Size0

Phi-3-Mini-128K-Instruct ONNX - Optimized AI Model for Long-Context ONNX Inference
An ONNX-optimized version of Phi-3-Mini-128K-Instruct, quantized for fast, scalable inference on CPUs, GPUs, and mobile devices, supporting long-context AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views121
  • File Size0

Phi-3-Medium-4K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-4K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views211
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views110
  • File Size0


Related Models by Sector Related Models by Sector

BiomedVLP-CXR-BERT - Domain-Specific BERT for Chest X-ray Reports
A specialized biomedical language model pre-trained on radiology reports from MIMIC-CXR and PubMed, optimized for radiology NLP tasks such as masked language modeling, phrase grounding, and medical text classification.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads16
  • Views419
  • File Size0

RadEdit: A deep learning biomedical vision models to discover failure cases
A latent diffusion model for editing chest X-ray images by adding or removing abnormalities, designed for stress-testing biomedical vision models and evaluating their robustness in clinical AI research.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads15
  • Views341
  • File Size0

BioViL-T - Temporal Vision-Language Model for Radiology
A domain-specific vision-language model designed for analyzing chest X-rays and radiology reports, leveraging temporal multi-modal pre-training for improved biomedical inference, phrase grounding, and image-text alignment.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads22
  • Views1,461
  • File Size0

BiomedVLP-CXR-BERT-Specialized - Domain-Specific Vision-Language Model for Radiology
A specialized biomedical language model trained on chest X-ray reports from MIMIC-CXR and PubMed, optimized for radiology NLP, masked language modeling, and multi-modal contrastive learning with image-text alignment.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads9
  • Views478
  • File Size0

BiomedCLIP-PubMedBERT_256-vit_base_patch16_224: A biomedical vision-language foundation model
A biomedical vision-language foundation model trained on PMC-15M, using PubMedBERT as the text encoder and Vision Transformer as the image encoder, optimized for cross-modal retrieval, classification, and visual question answering in medical AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads27
  • Views1,724
  • File Size0

RAD-DINO - Vision Transformer for Medical Image Encoding
A vision transformer model trained with self-supervised learning for encoding chest X-rays, optimized for medical image analysis, classification, retrieval, and report generation.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads17
  • Views1,175
  • File Size0

MAIRA-2 - Multimodal AI for Radiology Report Generation
A multimodal Transformer model designed for generating grounded and non-grounded radiology reports from chest X-rays, integrating vision and language understanding for medical AI research.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads33
  • Views1,327
  • File Size0

RAD-DINO-MAIRA-2 - Vision Transformer for Medical Imaging
A vision transformer model trained for chest X-ray encoding using self-supervised learning, optimized for medical image analysis and report generation.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads14
  • Views1,019
  • File Size0

MANAS-1-small-40M
A state-of-the-art EEG Brain Foundation Model.
MANNAS AI (INTELLIHEALTH WORLD PVT. LTD.)
  • See Upvoters0
  • Downloads5
  • Views164
  • File Size1.65 GB

Parrotlet-A-2p5-Pro
Medical ASR model for Indian English, Hindi, Telugu, Kannada, Marathi.
EKA CARE
  • See Upvoters0
  • Downloads5
  • Views216
  • File Size0


Related Models by Task Type Related Models by Task Type

BiomedVLP-CXR-BERT - Domain-Specific BERT for Chest X-ray Reports
A specialized biomedical language model pre-trained on radiology reports from MIMIC-CXR and PubMed, optimized for radiology NLP tasks such as masked language modeling, phrase grounding, and medical text classification.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads16
  • Views419
  • File Size0

BiomedVLP-CXR-BERT-Specialized - Domain-Specific Vision-Language Model for Radiology
A specialized biomedical language model trained on chest X-ray reports from MIMIC-CXR and PubMed, optimized for radiology NLP, masked language modeling, and multi-modal contrastive learning with image-text alignment.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads9
  • Views478
  • File Size0