🍷 Winery Qwen3.5 9B · Assemblage
A skill-routed merge of 7 Qwen3.5-9B fine-tunes, built with the Winery fusion compiler. A normal soup mixes every tensor with the same weights. This one gives each region of the network to the donors that are best at what that region does. 9.5 GB at Q8_0.
How the regions are routed
| Region | Job | Donors (weight) |
|---|---|---|
| Embeddings, norms, layers 0-3 | proven core (same as 9B Grand Cru) | MiMo 1 · Opus-Distill 1 · DavidAU 1 · NeoHorse 0.5 |
| FFN layers 4-21 | knowledge / facts | Opus-Distill 1 · NeoHorse 1 · MiMo 0.8 · Qwythos 0.7 · DavidAU 0.6 · Qwen3.8-Distill 0.4 · Tess 0.3 |
| FFN layers 22-31 | multi-step math | MiMo 1 · DavidAU 0.9 · Opus-Distill 0.8 · Qwen3.8-Distill 0.8 · NeoHorse 0.4 · Qwythos 0.4 · Tess 0.3 |
| Attention / delta-net 4-25 | reasoning | MiMo 1 · DavidAU 0.9 · Opus-Distill 0.8 · Qwen3.8-Distill 0.7 · NeoHorse 0.5 · Qwythos 0.5 · Tess 0.4 |
| Attention / delta-net 26-31 | tool use, formatting | MiMo 0.9 · DavidAU 0.8 · Opus-Distill 0.8 · Qwen3.8-Distill 0.6 · Qwythos 0.6 · Tess 0.6 · NeoHorse 0.4 |
All 427 tensors were mixed with zero fallbacks. The full recipe is in recipe.txt.
Scores
Local quick bench (410 questions: 200 MMLU, 150 ARC-Challenge, 60 GSM8K; thinking off, greedy). Same harness for every row.
| Model | MMLU | ARC-C | GSM8K | Avg |
|---|---|---|---|---|
| 🍷 9B Assemblage (this) | 73.0 | 97.3 | 88.3 | 86.2 |
| 🍷 9B Grand Cru (soup) | 70.0 | 96.7 | 90.0 | 85.6 |
| 9B DELLA blend | 73.0 | 96.7 | 83.3 | 84.3 |
| 9B TIES blend | 71.5 | 96.0 | 81.7 | 83.1 |
| 9B Breadcrumbs blend | 72.5 | 95.3 | 80.0 | 82.6 |
The Assemblage is the new Winery 9B leader: +0.6 over the Grand Cru, driven by MMLU (73.0 vs 70.0); the Grand Cru keeps the GSM8K edge (90.0). These are small-sample local numbers, not leaderboard results.
Use
Works in llama.cpp (recent builds with Qwen3.5 support), Jan, LM Studio and the Winery app.
llama-cli -m Winery-Qwen3.5-9B-Assemblage-Q8_0.gguf -cnv
⚠️ One donor is an uncensored tune, so this model refuses less than stock Qwen. You're responsible for how you use it.