Ornith-1.5-9B with MTP - ASHQ1-Remix
This is a GGUF quantized version of the original model.
📈 Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)
| Model | Size | PPL | KLD | RMS Δp | top-p | Speed |
|---|---|---|---|---|---|---|
| Q8_0 (stock) | 9333 MiB | 9.0824 | 0.0058 | 2.26% | 97.9% | 244 t/s |
| Fidelity-48pc | 8436 MiB | 9.0227† | 0.0087 | 2.58% | 97.2% | 260 t/s |
| Precision-42pc | 7554 MiB | 8.9957† | 0.0094 | 2.72% | 96.8% | 324 t/s |
| Q6_K-imx (stock) | 7209 MiB | 8.9836† | 0.0107 | 2.90% | 96.4% | 320 t/s |
| Quality-36pc | 6388 MiB | 8.9895† | 0.0241 | 4.22% | 94.5% | 1313 t/s |
| Q5_K_M-imx (stock) | 6335 MiB | 8.6345† | 0.0665 | 6.48% | 90.7% | 1219 t/s |
| Compact-33pc ⭐ | 5945 MiB | 9.1332 | 0.0319 | 4.88% | 93.1% | 1219 t/s |
| Mini-30pc 🥈 | 5566 MiB | 9.0189† | 0.0425 | 5.65% | 91.8% | 1384 t/s |
| IQ4_XS-imx (stock) | 5080 MiB | 9.2758 | 0.0538 | 6.29% | 90.7% | 1506 t/s |
| Nano-27pc | 4750 MiB | 9.5968 | 0.0802 | 7.57% | 87.9% | 1249 t/s |
| Pico-24pc | 4389 MiB | 9.5871 | 0.1202 | 9.25% | 85.1% | 1384 t/s |
| IQ3_M-imx (stock) | 4313 MiB | 9.5973 | 0.1421 | 10.46% | 84.3% | 1384 t/s |
ℹ️ About ASHQ1-Remix Suite
Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.
🔗 Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-Remix_Double-Quantization_Suite