Qwen3.5-9B-GGUF (Q4_K_M) — Tin Nguyen Lab distribution mirror
This is a mirror. Tin Nguyen Lab did not train, fine-tune, or quantize this model.
This repository redistributes a single, unmodified GGUF file:
| File | Qwen3.5-9B-Q4_K_M.gguf |
| Size | 5,680,522,464 bytes (5.68 GB) |
| SHA256 | 03b74727a860a56338e042c4420bb3f04b2fec5734175f4cb9fa853daf52b7e8 |
Provenance
| Role | Who |
|---|---|
| Original model / weights | Qwen/Qwen3.5-9B — the Qwen team |
| GGUF conversion + quantization | unsloth, in unsloth/Qwen3.5-9B-GGUF |
| This mirror | Tin Nguyen Lab — redistribution only, bytes unchanged |
Mirrored from unsloth/Qwen3.5-9B-GGUF at commit
3885219b6810b007914f3a7950a8d1b469d598a5.
The SHA256 above is identical to the Git-LFS object id that unsloth/Qwen3.5-9B-GGUF
publishes for the same file at that commit, so the file here is byte-for-byte the one
distributed upstream. That equivalence is verifiable by anyone:
# what upstream publishes for this file
curl -s "https://huggingface.co/api/models/unsloth/Qwen3.5-9B-GGUF?blobs=true" \
| python3 -c "import json,sys;print([s['lfs']['sha256'] for s in json.load(sys.stdin)['siblings'] if s['rfilename']=='Qwen3.5-9B-Q4_K_M.gguf'][0])"
# what this mirror publishes
curl -s "https://huggingface.co/api/models/tinnlab/Qwen3.5-9B-GGUF?blobs=true" \
| python3 -c "import json,sys;print([s['lfs']['sha256'] for s in json.load(sys.stdin)['siblings'] if s['rfilename']=='Qwen3.5-9B-Q4_K_M.gguf'][0])"
Note on what this does and does not prove: the matching hash proves this copy is identical to unsloth's published file. It does not independently verify that unsloth's quantization is a faithful conversion of Qwen's original weights — that is a separate claim this mirror makes no attempt to establish.
Why this mirror exists
To keep a shipped "install a local model, no API key needed" flow working from a repository its maintainers control. It is a stability measure, not an improvement: there is nothing here that upstream does not have.
What is NOT mirrored
Upstream publishes 28 files (~148 GB): 25 quantizations plus multimodal projector
(mmproj-*.gguf) and imatrix files. This mirror carries only Q4_K_M, so it
serves text chat / tool use. It does not carry the vision projector and cannot be used
for image or video input. For anything else, use
unsloth/Qwen3.5-9B-GGUF directly.
README_upstream.md in this repository is unsloth's original model card, preserved
verbatim from the mirrored commit, and is the authoritative documentation for the
model itself (usage, chat template, quantization details).
Access
Public and anonymous — no token, no account, no gated agreement.
Licence
Apache-2.0, inherited from Qwen/Qwen3.5-9B. The full licence text as shipped by the
original licensor is included as LICENSE; attribution notices are in NOTICE.
Redistribution here relies on Apache-2.0 §4, and the licence and attribution are
retained accordingly.