----------------------------------------------- - Model Details and Specifications: ------------------------------------------------

Devstral Small 2507 Vision GGUF (Ollama & Llama.cpp)

This release contains: Llama.cpp and Ollama compatible GGUF converted and Quantized model files (Compatible with both Ollama, and Llama.cpp) (More information and an updates to the ModelCard (this page) coming soon!)

Quantized GGUF version of:

• EnlistedGhost/Devstral-Small-2507-Vision (by EnlistedGhost)

Original Model Link:

• EnlistedGhost/Devstral-Small-2507-Vision

--------------------------------------------------- - Conversion and GGUF Quantization: ----------------------------------------------------

Software used to convert Safetensors to GGUF:

• llama.cpp

Software used to create Quantized GGUF Files:

• llama.cpp

Specific GitHub Commit Point:

• b7266

Converted to GGUF and Quantized by:

• EnlistedGhost

------------------------------- ---- Updates & News ---- -------------------------------

Model Updates (as of: December 28th, 2025)

• Uploaded: All remaining GGUF Converted and Quantized model files (Q5_K, Q6_K, Q8_0)
• Updated: ModelCard (this page)

-------------------------------------- ---- How to run this Model ---- --------------------------------------

Compatible Software (Required to use this Model) You can run this model by using either Ollama (or) Llama.cpp (Below are instruction on running these GGUF files with Ollama)

How to run this Model using Ollama You can run this model by using the "ollama run" command. Simply copy & paste one of the commands from the list below into your console, terminal or power-shell window.

Vision Projector (Files) mmproj (Vision Projector) Files

--------------------------- ---- Original Info ---- ---------------------------

(Crossposted from the link in the above section: "Model Details"):

Devstral Small 1.1

Devstral is an agentic LLM for software engineering tasks built under a collaboration between Mistral AI and All Hands AI 🙌. Devstral excels at using tools to explore codebases, editing multiple files and power software engineering agents. The model achieves remarkable performance on SWE-bench which positions it as the #1 open source model on this benchmark.

It is finetuned from Mistral-Small-3.1, therefore it has a long context window of up to 128k tokens. As a coding agent, Devstral is text-only and before fine-tuning from Mistral-Small-3.1 the vision encoder was removed.

For enterprises requiring specialized capabilities (increased context, domain-specific knowledge, etc.), we will release commercial models beyond what Mistral AI contributes to the community.

Learn more about Devstral in our blog post.

Updates compared to Devstral Small 1.0:

• Improved performance, please refer to the benchmark results.
• Devstral Small 1.1 is still great when paired with OpenHands. This new version also generalizes better to other prompts and coding environments.
• Supports Mistral's function calling format.

Key Features:

• Agentic coding: Devstral is designed to excel at agentic coding tasks, making it a great choice for software engineering agents.
• lightweight: with its compact size of just 24 billion parameters, Devstral is light enough to run on a single RTX 4090 or a Mac with 32GB RAM, making it an appropriate model for local deployment and on-device use.
• Apache 2.0 License: Open license allowing usage and modification for both commercial and non-commercial purposes.
• Context Window: A 128k context window.
• Tokenizer: Utilizes a Tekken tokenizer with a 131k vocabulary size.

Benchmark Results

SWE-Bench

Devstral Small 1.1 achieves a score of 53.6% on SWE-Bench Verified, outperforming Devstral Small 1.0 by +6,8% and the second best state of the art model by +11.4%.

When evaluated under the same test scaffold (OpenHands, provided by All Hands AI 🙌), Devstral exceeds far larger models such as Deepseek-V3-0324 and Qwen3 232B-A22B.

Usage

We recommend to use Devstral with the OpenHands scaffold. You can use it either through our API or by running locally.