Kimi K2.5 DFlash GGUF
GGUF made to use in ikawrakow/ik_llama.cpp, currently for PR #1970. The small quantizations delivered here are made for test purposes; feel free to create your own quantization.
Derived from the safetensors DFlash draft model z-lab/Kimi-K2.5-DFlash.
Compatible target model
Kimi-K2.5.gguf- Mainly tested with IQ1_KT.
Files
| File | Quant | Size |
|---|---|---|
kimi-k2-5-dflash-F16.gguf | F16 | 6.5 GB |
kimi-k2-5-dflash-Q8_0.gguf | Q8_0 | 3.5 GB |
kimi-k2-5-dflash-Q4_K_M.gguf | Q4_K_M | 1.9 GB |
Usage
./build/bin/llama-server \
--model <target.gguf> \
--model-draft <draft.gguf> \
--spec-type dflash:n_max=<N>,cross_ctx=<N> ...
Notes
- This repo contains DFlash draft models, not a standalone instruct model.
- Use it with the matching target family listed above.
Q4_K_MandQ8_0are small test-oriented quants; create your own quant if you need a different tradeoff.