OvisOCR2 - ASHQ1-Remix
This is a GGUF quantized version of the original model.
📈 Release Benchmarks (wiki.test.raw, symmetric FA-auto reference)
| Model | Size | PPL | KLD | RMS Δp | top-p | Speed |
|---|---|---|---|---|---|---|
| Q8_0 (stock) | 774 MiB | 28.7134 | 0.0009 | 0.61% | 98.3% | 3413 t/s |
| Fidelity-48pc | 704 MiB | 28.7754 | 0.0019 | 0.96% | 97.3% | 2560 t/s |
| Precision-42pc 🥈 | 670 MiB | 28.8111 | 0.0023 | 1.04% | 97.2% | 3200 t/s |
| Q6_K-imx (stock) | 601 MiB | 28.8894 | 0.0033 | 1.25% | 96.5% | 3413 t/s |
| Quality-36pc ⭐ | 556 MiB | 29.0026 | 0.0077 | 1.93% | 94.7% | 3200 t/s |
| Q5_K_M-imx (stock) | 551 MiB | 29.0602 | 0.0088 | 2.02% | 94.2% | 3200 t/s |
| IQ4_XS-imx (stock) | 481 MiB | 30.5363 | 0.0305 | 3.94% | 90.2% | 3413 t/s |
| Nano-27pc | 457 MiB | 30.5109 | 0.0598 | 5.82% | 87.2% | 3200 t/s |
| Pico-24pc | 442 MiB | 31.9258 | 0.0699 | 6.16% | 85.6% | 3200 t/s |
| IQ3_M-imx (stock) | 433 MiB | 32.0551 | 0.0895 | 7.35% | 84.2% | 3200 t/s |
ℹ️ About ASHQ1-Remix Suite
Activation-aware GGUF quantization whose every ratio, floor, and cap traces to a measured experiment. Plain-BF16-native first; AutoRound lineage supported with explicit saturation bounds. Full seven-tier ladder validated across six model families.
🔗 Link: https://huggingface.co/Soulfate24/AutoRound-ASHQ1-Remix_Double-Quantization_Suite