Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

Microsoft's - LLM2CLIP Llama3.2-1B-EVA02-L-14-336

A model that integrates the Llama3.2-1B language model with the EVA02-L-14-336 visual encoder to enhance cross-modal understanding and retrieval tasks.
  • Upvotes0upvotes
  • Downloads2downloads
  • Views202views
  • File size0
  • Shares0Shares
  • Last updatedupdated 06 Nov 2026
UpvoteUpvote
0
LICENSE Apache 2.0
SECTOR Sector Agnostic

About Model

The LLM2CLIP-Llama3.2-1B-EVA02-L-14-336 model is part of the LLM2CLIP series, aiming to extend the capabilities of CLIP models by combining Large Language Models (LLMs) with advanced visual encoders. This integration allows the model to process more detailed and extended textual descriptions, overcoming the context window limitations of traditional CLIP text encoders. By fine-tuning the LLM in the caption space using contrastive learning, the model enhances the textual discriminability of output embeddings. This approach leads to substantial improvements in cross-modal tasks, such as image-text retrieval and zero-shot image classification. Experiments have demonstrated that this method boosts performance significantly, transforming a CLIP model trained solely on English data into a state-of-the-art cross-lingual model. Moreover, when integrated into multimodal training with models like Llava 1.5, it consistently outperforms traditional CLIP models across nearly all benchmarks, showcasing comprehensive performance enhancements.

Metadata Metadata

Apache 2.0

Sector Agnostic

Weiquan Huang and Aoqi Wu and Yifan Yang and Xufang Luo and Yuqing Yang and Liang Hu and Qi Dai and Xiyang Dai and Dongdong Chen and Chong Luo and Lili Qiu

N.A.

Vikram Malhotra

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

N.A.

Open

20/08/25 05:43:55

N.A.

0

Tags

  • LLM2CLIP
  • EVA02
  • CrossModal
  • ZeroShotClassification
  • ImageTextRetrieval
  • Llama3.2-1B

Related Models Related Models

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views122
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views498
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views548
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views506
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,079
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views485
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views317
  • File Size3.17 GB


Related Models by Organization Related Models by Organization

microsoft/Phi-3-vision-128k-instruct
Phi-3-vision-128k-instruct is a state-of-the-art multimodal model by Microsoft, designed to process both text and visual inputs with a context length of up to 128,000 tokens.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads12
  • Views284
  • File Size0

Phi-3-Medium-4K-Instruct - Scalable AI Model for Reasoning and Code Generation
A 14B parameter AI model optimized for 4K and 128K token context lengths, designed for advanced reasoning, math, and coding applications, supporting both research and commercial use.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views270
  • File Size0

BiomedBERT - Domain-Specific Biomedical Language Model
A biomedical NLP model pre-trained from scratch on abstracts and full-text articles from PubMed and PubMed Central, achieving state-of-the-art performance on biomedical language understanding tasks.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads102
  • Views1,999
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for high-speed, efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for enhanced performance.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views168
  • File Size0

Phi-3-Small-8K-Instruct ONNX-CUDA - Optimized AI Model for NVIDIA GPU Inference
An ONNX-optimized version of Phi-3-Small-8K-Instruct, designed for efficient inference on NVIDIA GPUs, supporting FP16 and INT4 quantization for fast, scalable AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views174
  • File Size0

Phi-3-Mini-4K-Instruct GGUF - Optimized AI Model for GGUF Inference
A GGUF-optimized version of Phi-3-Mini-4K-Instruct, designed for efficient low-memory AI inference, supporting quantized and full-precision formats for balanced performance and quality.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters1
  • Downloads29
  • Views1,580
  • File Size0

Phi-3-Medium-128K-Instruct - Advanced Long-Context AI for Code and Logical Reasoning
A 14B parameter AI model optimized for 128K token context length, designed for complex reasoning, mathematical problem-solving, and efficient AI applications in commercial and research environments.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views133
  • File Size0

Phi-3-Medium-128K-Instruct ONNX-CPU - Optimized AI Model for CPU Inference
An ONNX-optimized version of Phi-3-Medium-128K-Instruct, designed for efficient long-context inference on CPUs, supporting structured reasoning, text generation, and code processing.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views212
  • File Size0

Phi-3-Mini-128K-Instruct ONNX - Optimized AI Model for Long-Context ONNX Inference
An ONNX-optimized version of Phi-3-Mini-128K-Instruct, quantized for fast, scalable inference on CPUs, GPUs, and mobile devices, supporting long-context AI applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views121
  • File Size0

Phi-3-Medium-4K-Instruct ONNX-DirectML - Optimized AI Model for Windows GPU Inference
An ONNX-optimized version of Phi-3-Medium-4K-Instruct, designed for efficient AI inference on Windows machines using DirectML, supporting INT4 quantization for high-performance execution on AMD, Intel, and NVIDIA GPUs.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views212
  • File Size0


Related Models by Sector Related Models by Sector

spk cond tts pflow Hindi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads3
  • Views122
  • File Size3.46 GB

spk cond tts pflow Marathi
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views498
  • File Size3.49 GB

spk cond tts pflow Telugu
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads0
  • Views85
  • File Size3.38 GB

spk cond tts pflow Bengali
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views83
  • File Size3.49 GB

spk cond tts pflow Tamil
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views139
  • File Size3.47 GB

Tamil vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Tamil.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views548
  • File Size3.17 GB

Marathi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Marathi.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views506
  • File Size3.18 GB

Hindi vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Hindi.
BHARATGEN
  • See Upvoters0
  • Downloads4
  • Views1,079
  • File Size3.18 GB

Telugu vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Telugu.
BHARATGEN
  • See Upvoters0
  • Downloads2
  • Views485
  • File Size3.17 GB

Bengali vb
This 150 M-parameter non-autoregressive speech generative model, developed by BharatGen, is designed for speaker-conditioned Text-to-speech in Bengali.
BHARATGEN
  • See Upvoters0
  • Downloads1
  • Views317
  • File Size3.17 GB


Related Models by Task Type Related Models by Task Type

Microsoft's - LLM2CLIP Llama-3.2-1B-Instruct-CC-Finetuned
A fine-tuned model combining Llama-3.2-1B with LLM2CLIP for enhanced cross-modal tasks and instruction-based applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views174
  • File Size0

Microsoft's - LLM2CLIP Llama-3-8B-Instruct-CC-Finetuned
A fine-tuned model combining Llama-3-8B with LLM2CLIP for improved cross-modal tasks and instruction-based applications.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads0
  • Views154
  • File Size0

Microsoft's - LLM2CLIP Openai-L-14-224
A model that combines OpenAI's L-14-224 visual encoder with LLMs to enhance cross-modal understanding and retrieval tasks.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads2
  • Views140
  • File Size0

Microsoft's - LLM2CLIP-Openai-L-14-336
A model combining OpenAI's L-14 visual encoder with LLMs to enhance cross-modal understanding and retrieval tasks.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views165
  • File Size0

Microsoft's - LLM2CLIP-EVA02-B-16
A model that merges LLMs with the EVA02-B-16 visual encoder to boost cross-modal task performance.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads4
  • Views253
  • File Size0

Microsoft's - LLM2CLIP Openai-B-16
A model that integrates OpenAI's B-16 visual encoder with LLMs to enhance cross-modal understanding and retrieval.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads3
  • Views162
  • File Size0

Microsoft's - LLM2CLIP-EVA02-L-14-336
A model integrating Large Language Models (LLMs) with the EVA02 visual encoder to enhance cross-modal understanding.
MICROSOFT CORPORATION (INDIA) PVT. LTD.
  • See Upvoters0
  • Downloads1
  • Views410
  • File Size0

GNM Generative aNthropometric Model - v3
GNM (pronounced genome) is a state-of-the-art parametric 3D statistical model of the human head developed by Google. Learned from a large dataset of high-resolution 3D scans, GNM provides fine-grained, disentangled control over facial identity, expressions, and head pose, complete with controllable internal anatomy (eyeballs, teeth, and tongue). The model is released under the Apache 2.0 permissive license, suitable for both academic research and commercial applications.
GOOGLE LLC
  • See Upvoters0
  • Downloads0
  • Views33
  • File Size0

High Resolution Canopy Heights Model
Meta and the World Resources Institute created Canopy Height Maps using AI models (DINOv2) on high-resolution Maxar satellite imagery.
FACEBOOK INDIA ONLINE SERVICES PRIVATE LIMITED
  • See Upvoters0
  • Downloads38
  • Views629
  • File Size0