Qwen3.8-27B ARA Abliterated / Uncensored NVFP4 + MTP
This is a multimodal, refusal-ablated (commonly described as "uncensored") W4A4
NVFP4 derivative of the reproducible
trohrbaugh/Qwen3.8-27B-heretic-ara
BF16 checkpoint. It is intended for native Blackwell NVFP4 inference.
What is preserved
- The vision tower, recurrent convolutions, language head, and all 15 native MTP tensors remain BF16.
- The MTP tensors were grafted from the hash-verified source after Transformers serialization and verified bit-exact.
- All 333 vision tensors were verified bit-exact against the BF16 source.
- The language-model linear layers use compressed-tensors NVFP4 W4A4 group-16 quantization.
Validation
This artifact passed its text-capability, image-vision, benign refusal-surface,
native MTP-acceptance, integrity, and clean-load gates on vLLM 0.23. See
BUILD_MANIFEST.json, VALIDATION_REPORT.json, and SHA256SUMS for exact
provenance and results. Video tensors/processors are preserved, but video input
was not part of the live runtime gate.
The live gate used Qwen3_5ForConditionalGeneration, native three-token MTP,
the FlashInfer CUTLASS NVFP4 kernel, an 8,192-token context, and an RTX PRO 6000
Blackwell GPU. Loaded model memory was approximately 19.53 GiB.
vLLM example
vllm serve aday777/Qwen3.8-27B-ARA-abliterated-NVFP4-MTP \
--served-model-name Qwen3.8-27B-ARA-NVFP4-MTP \
--max-model-len 8192 \
--speculative-config '{"method":"mtp","num_speculative_tokens":3}'
Use a recent vLLM build with Qwen3.5 multimodal and compressed-tensors NVFP4 support. Native NVFP4 execution requires compatible Blackwell hardware and CUDA runtime support.
Notes
"Abliterated" or "uncensored" describes the source checkpoint's refusal-ablation process; it is not a guarantee that every prompt will receive a particular answer. Users remain responsible for evaluating outputs and applying safeguards appropriate to their deployment.
Support
If this model is useful to you, Bitcoin donations are welcome:
bc1q5ayht3fxhj0v95fk0z8l2f6900g3awdsw5842p