Qwen3.6-27B Architect Polaris2 Fable B F451 - MTP MoQ GGUF

Tensor-aware mixed-precision GGUF quantizations of nightmedia/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451, including the model's MTP tensors.

This repository provides several MoQ size/quality points, an experimental NVFP4 variant, the c128 importance matrix used during quantization, and the complete interactive evaluation report.

Quantization method

MoQ uses tensor-aware mixed quantization instead of assigning one quantization type to the entire model.

• Weight tensors are grouped by their structural role and sensitivity.
• Per-group KLD sensitivity studies are used to decide which groups require higher precision.
• Less sensitive groups use more compact formats, while sensitive groups are protected with higher-precision formats.
• A 128-chunk importance matrix is incorporated into the quantization process.
• The large MTP tensors are explicitly retained at high precision.
• Every output was audited against its tensor recipe: all 866 tensor names, shapes, and quantization types matched.

The MTP-MoQ-NVFP4 variant uses NVFP4 for selected tensor groups while retaining the rest of the mixed-precision policy. On an RTX 5090 it improves short-prompt prefill throughput substantially, although the regular MoQ-4.8 model provides better KLD quality at the same file size.

No single quant is best for every use case:

• MTP-MoQ-4.6 is a compact balanced option.
• MTP-MoQ-4.8 is the recommended quality/size point around 16.15 GB.
• MTP-MoQ-5.1 provides the best quality in the regular MoQ series.
• MTP-MoQ-NVFP4 is intended for testing NVFP4 acceleration, especially on Blackwell GPUs.

Files

Sizes are decimal GB. Payload BPW is calculated from the actual GGUF tensor payload and excludes the GGUF header.

Additional files:

• Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-BF16.gguf: BF16 GGUF reference model.
• Qwen3.6-27B-Architect-Polaris2-Fable-B-F451.c128.imatrix.gguf: the 128-chunk importance matrix used for these quantizations.
• Jianqiao1_MoQ_vs_DavidAU_GGUF_report.html: self-contained interactive report with zoomable and pannable charts.

Quality evaluation

All quality results were measured under the same conditions:

• WikiText-2 raw test set
• Context length 512
• 580 evaluation chunks
• KLD calculated against logits from the BF16 model
• BF16 reference PPL: 6.320035

Lower PPL, Mean KLD, and p999 KLD are better.

MoQ results

Comparison with DavidAU Fable Fusion 711 GGUF

The following DavidAU GGUF files were evaluated locally using the same BF16 reference logits and the same evaluation settings.

Near-size comparison

Positive percentages mean the MoQ model is smaller or has a lower metric.

Quality charts

Model size vs p999 KLD

Model size vs Mean KLD

Model size vs WikiText-2 PPL

For interactive zooming, panning, series selection, and detailed hover values, download and open Jianqiao1_MoQ_vs_DavidAU_GGUF_report.html.

RTX 5090 performance

Throughput was measured with f16 KV cache and three repetitions. MTP-MoQ-NVFP4 and MTP-MoQ-4.8 have exactly the same 16.150 GB file size.

License

This repository is released under the Apache License 2.0. Users should also review and comply with the terms of the original model.

Acknowledgements

• Thanks to nightmedia for the original Qwen3.6-27B Architect Polaris2 Fable B F451 model.
• Thanks to DavidAU for the Fable Fusion 711 GGUF series used in the comparison.
• Thanks to the Qwen team for Qwen3.6.