Ornstein3.8-27B

BF16 safetensors for Ornstein3.8-27B, a vision-language fine-tune of Qwen/Qwen3.8-27B. Architecture is Qwen3_5ForConditionalGeneration: interleaved linear and full attention (Gated DeltaNet), native image/video, 262K context.

The LoRA was trained on Fireworks AI and merged into the Qwen3.8-27B language stack. Quantized GGUFs (Q8_0, Q6_K, Q4_K_M) and an mmproj are in GestaltLabs/Ornstein3.8-27B-GGUF.

Status

This checkpoint injects Ornstein thinking into Qwen3.8-27B. It is an early merge, not a finished quality release. Planned quality work uses RL environments and energy-based fine-tuning.

Evaluation

Qwen3.8-27B achieves an estimated 97.0% accuracy on the full GSM8K benchmark when running in standard unquantized precision (BF16/FP8).

Single greedy BF16 run on a Fireworks dedicated H100 (temperature=0, top_k=40, max_tokens=4000), answers from message.content first. Qwen does not report GSM8K on the Qwen3.8-27B card. This score does not apply to GGUF quants.

Support this work

I'm a PhD student in visual neuroscience at the University of Toronto. Training and release compute is self-funded (rented H100s and a local DGX Spark). If these artifacts are useful, Ko-fi helps keep the experiments running.

Model details

Usage

Requires a Transformers build with Qwen3.8 / qwen3_5 support.

from transformers import AutoProcessor, AutoModelForImageTextToText

model_id = "GestaltLabs/Ornstein3.8-27B"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(
    model_id, dtype="bfloat16", device_map="auto"
)

messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "image": "https://example.com/image.jpg"},
            {"type": "text", "text": "Describe this image."},
        ],
    }
]
inputs = processor.apply_chat_template(
    messages, add_generation_prompt=True, tokenize=True,
    return_dict=True, return_tensors="pt",
).to(model.device)
out = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(out[0], skip_special_tokens=True))

Text-only chat uses the same template with {"type": "text", ...} and no image.

vLLM and SGLang: load this repo as a Qwen3.8 27B VLM (qwen3_5). Use a build that already supports that architecture.

Files

Related

• GGUFs: GestaltLabs/Ornstein3.8-27B-GGUF
• Upstream: Qwen/Qwen3.8-27B
• Training: Fireworks AI

License

Apache 2.0, inherited from the Qwen 3.8 base release.