Mtrini-27B-Tellus-IQ2_XS
This repository contains the IQ2_XS GGUF quantization of Mtrini-27B-Tellus by CompiwerAI.
CompiwerAI — Building AI For Everyone.
File
Mtrini-27B-Tellus-IQ2_XS.gguf
Approximate size: 8.47 GiB
Quantization: IQ2_XS
Approximate bits per weight: 2.3125 bpw
Quantization
The IQ2_XS release was generated from the F16 GGUF using an importance matrix created from a dedicated calibration dataset.
| Property | Value |
|---|---|
| Calibration context | 512 |
| Threads | 20 |
| Chunks | 32 |
| Calibration PPL | ~2.4629 ± 0.04545 |
| Importance entries | 496 |
Architecture
- Architecture:
qwen35 - Tensor count: 851
- Transformer blocks: 64
- Embedding size: 5120
- FFN size: 17408
- Attention heads: 24
- KV heads: 4
llama.cpp
llama-cli \
-m Mtrini-27B-Tellus-IQ2_XS.gguf \
-p "What is 27 multiplied by 8?"
Validation example:
216
Related Releases
- Main:
CompiwerAI/Mtrini-27B-Tellus - Adapter:
CompiwerAI/Mtrini-27B-Tellus-Adapter - Merged:
CompiwerAI/Mtrini-27B-Tellus-Merged - F16 GGUF:
CompiwerAI/Mtrini-27B-Tellus-GGUF - Imatrix:
CompiwerAI/Mtrini-27B-Tellus-IQ2_XS-Imatrix