Devstral Small 1.1 GGUF
Original model: Devstral Small 1.1
Model creator: Mistral AI
Devstral is an agentic LLM for software engineering tasks built under a collaboration between Mistral AI and All Hands AI 🙌. Devstral excels at using tools to explore codebases, editing multiple files and power software engineering agents. The model achieves remarkable performance on SWE-bench which positionates it as the #1 open source model on this benchmark.
It is finetuned from Mistral-Small-3.1, therefore it has a long context window of up to 128k tokens. As a coding agent, Devstral is text-only and before fine-tuning from
Mistral-Small-3.1the vision encoder was removed.
This repo contains GGUF format model files for Mistral AI's Devstral Small 1.1 (2507). Read more on Mistral’s announcement blog post.
What is GGUF?
GGUF is a file format for representing AI models. It is the third version of the format, introduced by the ggml-org team on August 21st 2023.
Converted with llama.cpp build b5864 (revision 11ee0fe), using autogguf-rs.
Chat template: Mistral 3 (v7-Tekken)
<s>[SYSTEM_PROMPT]{{system_message}}[/SYSTEM_PROMPT]
[INST]{{prompt}}[/INST]
{{assistant_response}}</s>
Download & run with cnvrs on iPhone, iPad, and Mac!
cnvrs is the best app for private, local AI on your device:
- create & save Characters with custom system prompts & temperature settings
- download and experiment with any GGUF model you can find on HuggingFace!
- or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
- make it your own with custom Theme colors
- powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
- try it out yourself today, on Testflight!
- if you already have the app, download Devstral Small 2507 now!
- cnvrsai:///models/search/hf?id=brittlewis12/devstral-small-2507-GGUF
- follow cnvrs on twitter to stay up to date
Original Model Evaluation
| Model | Agentic Scaffold | SWE-Bench Verified (%) |
|---|---|---|
| Devstral Small 1.1 | OpenHands Scaffold | 53.6 |
| Devstral Small 1.0 | OpenHands Scaffold | 46.8 |
| GPT-4.1-mini | OpenAI Scaffold | 23.6 |
| Claude 3.5 Haiku | Anthropic Scaffold | 40.6 |
| SWE-smith-LM 32B | SWE-agent Scaffold | 40.2 |
| Skywork SWE | OpenHands Scaffold | 38.0 |
| DeepSWE | R2E-Gym Scaffold | 42.2 |