Qwen2.5-Coder-7B-mobile
✅ WORKS — Verified June 2026.
Verification Results
| Prompt | Response | Correct? |
|---|
| What is the capital of France? | "The capital of France is Paris." | ✅ |
| What is 2+2? Just the number. | "4" | ✅ |
Model Details
| Attribute | Value |
|---|
| Base Model | Qwen/Qwen2.5-Coder-7B |
| File Size | 4466 MB |
| Format | GGUF |
| Chat Format | chatml |
| CPU Speed | 3.0 tokens/sec |
| License | apache-2.0 |
Usage
from llama_cpp import Llama
llm = Llama(model_path="model.gguf", chat_format="chatml", n_ctx=512, n_threads=4, verbose=False)
response = llm.create_chat_completion(
messages=[{"role": "user", "content": "What is the capital of France?"}],
max_tokens=50,
)
print(response["choices"][0]["message"]["content"])
dispatchAI SDK
from dispatchai import load_model
model = load_model("Qwen2.5-Coder-7B-mobile", backend="gguf")
print(model.chat("Hello!"))
🚀 dispatchAI