Ornith 1.5 35B A3B NVFP4 — GGUF

This repository contains a GGUF conversion of Ornith AI's Ornith-1.5-35B-A3B-NVFP4 checkpoint for use with compatible GGML/llama.cpp-based inference engines.

The purpose of this conversion is to preserve the model's native NVFP4 mixed-precision representation in GGUF rather than requantizing the model into another quantization format.

Model

• Base model: ornith-ai/Ornith-1.5-35B-A3B-NVFP4

• Architecture: Qwen3.5 MoE

• Parameters: 35B total / ~3B active

• Quantization: NVFP4

• Format: GGUF

• Intended runtime: llama.cpp and other runtimes supporting GGUF NVFP4 tensors

Conversion

The original Hugging Face Safetensors checkpoint was converted using the convert_hf_to_gguf.py tooling from llama.cpp.

The conversion preserves the source checkpoint's NVFP4 tensors rather than converting the model to FP16, BF16, or FP32 and subsequently requantizing it.

Ornith-1.5-35B-A3B-NVFP4
             │
             │ Hugging Face Safetensors
             ▼
convert_hf_to_gguf.py
             │
             │ Native GGUF NVFP4 representation
             ▼
Ornith-1.5-35B-A3B-NVFP4.gguf
             │
             ▼
          llama.cpp