Qwen3-VisionCaption-2B-GGUF
Qwen3-VisionCaption-2B is an abliterated v1.0 variant fine-tuned by prithivMLmods from Qwen3-VL-2B-Instruct-abliterated-v1, specifically engineered for seamless, high-precision image captioning and uncensored visual analysis across diverse multimodal contexts including complex scenes, artistic content, technical diagrams, and sensitive imagery. It bypasses conventional content filters to deliver robust, factual, and richly descriptive captions with deep reasoning, spatial awareness, multilingual OCR support (32 languages), and handling of varied aspect ratios while maintaining the base model's 256K token long-context capacity for comprehensive visual understanding. Ideal for research in content moderation, red-teaming, dataset annotation, creative applications, and generative safety evaluation, the model produces detailed outputs suitable for accessibility tools, storytelling, and vision-language tasks on edge devices via efficient inference frameworks like Transformers.
Qwen3-VisionCaption-2B [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Qwen3-VisionCaption-2B.BF16.gguf | BF16 | 3.45 GB | Download |
| Qwen3-VisionCaption-2B.F16.gguf | F16 | 3.45 GB | Download |
| Qwen3-VisionCaption-2B.F32.gguf | F32 | 6.89 GB | Download |
| Qwen3-VisionCaption-2B.Q8_0.gguf | Q8_0 | 1.83 GB | Download |
| Qwen3-VisionCaption-2B.mmproj-bf16.gguf | mmproj-bf16 | 823 MB | Download |
| Qwen3-VisionCaption-2B.mmproj-f16.gguf | mmproj-f16 | 819 MB | Download |
| Qwen3-VisionCaption-2B.mmproj-f32.gguf | mmproj-f32 | 1.63 GB | Download |
| Qwen3-VisionCaption-2B.mmproj-q8_0.gguf | mmproj-q8_0 | 445 MB | Download |
Run with llama.cpp on Jan, Ollama, LM Studio, and other platforms.
| Preview 1 | Preview 2 |
|---|---|
 |  |
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
