Nex-N2.5-mini GGUF
GGUF files for Nex-N2.5-mini, a long-context agentic model for coding, tool use, computer use, and multimodal workloads. The source checkpoint supports a native context length of 262,144 tokens (256K).
Benchmarks
Benchmark results reported by Nex-AGI for the original Nex-N2.5 family. These figures are not measurements of this GGUF conversion.
GGUF files
| Quantization | File | Size (GB) |
|---|---|---|
| Q8_0 | Nex-N2.5-mini-Q8_0.gguf | 36.90 GB |
| Q6_K | Nex-N2.5-mini-Q6_K.gguf | 28.51 GB |
| Q5_K_M | Nex-N2.5-mini-Q5_K_M.gguf | 24.73 GB |
| Q5_K_S | Nex-N2.5-mini-Q5_K_S.gguf | 23.98 GB |
| Q4_K_M | Nex-N2.5-mini-Q4_K_M.gguf | 21.17 GB |
| Q4_K_S | Nex-N2.5-mini-Q4_K_S.gguf | 19.89 GB |
| Q4_0 | Nex-N2.5-mini-Q4_0.gguf | 19.72 GB |
| Q3_K_M | Nex-N2.5-mini-Q3_K_M.gguf | 16.76 GB |
| Q3_K_S | Nex-N2.5-mini-Q3_K_S.gguf | 15.18 GB |
| IQ3_XXS | Nex-N2.5-mini-IQ3_XXS.gguf | 13.62 GB |
| Q2_K | Nex-N2.5-mini-Q2_K.gguf | 12.94 GB |
| IQ2_M | Nex-N2.5-mini-IQ2_M.gguf | 11.66 GB |
| IQ2_XS | Nex-N2.5-mini-IQ2_XS.gguf | 10.51 GB |
| IQ2_XXS | Nex-N2.5-mini-IQ2_XXS.gguf | 9.50 GB |
| IQ1_M | Nex-N2.5-mini-IQ1_M.gguf | 8.24 GB |
| TQ1_0 | Nex-N2.5-mini-TQ1_0.gguf | 7.90 GB |
| IQ1_S | Nex-N2.5-mini-IQ1_S.gguf | 7.48 GB |
TQ1_0 is an experimental ternary quantization. IQ1_S and IQ1_M use importance-matrix quantization.
Multimodal projector
| File | Size | Description |
|---|---|---|
| mmproj-Nex-N2.5-mini-F16.gguf | 899 MB | F16 vision projector for runtimes with multimodal support |
The projector is optional for text-only use. Use it with a current llama.cpp build that supports the model's multimodal path.
Chat template
The GGUF embeds the upstream chat template. An external copy is provided as chat_template.jinja for runtimes that require a separate template file.
Usage
For text generation with llama.cpp:
llama-cli \
-m Nex-N2.5-mini-Q4_K_M.gguf \
-c 8192 --jinja \
--temp 0.7 --top-p 0.95 \
-p "Explain why reproducible builds matter."
For an OpenAI-compatible server:
llama-server \
-m Nex-N2.5-mini-Q4_K_M.gguf \
-c 8192 --jinja --host 0.0.0.0 --port 8080
Increase -c up to 262144 when sufficient memory is available. Tool-call behavior depends on the serving runtime and its parser integration; use the embedded template and verify tool calls in the target application.
Source and build
- Source model: nex-agi/Nex-N2.5-mini
- Source revision: 87420286149d9cce9bd46cd335ef9bda33c37c1b
- Conversion: ggml-org/llama.cpp commit f3f1a8f2760f28325a5ec20c05b171e5b7c83a29
- License: Apache-2.0
- Checksums: SHA256SUMS.txt