GLM-5.2-JANGTQ4
JANGTQ (JANG TurboQuant) quantization of zai-org/GLM-5.2 for MLX on Apple silicon. TurboQuant applies a random-sign Hadamard rotation, a per-row FP16 norm, and a per-layer Lloyd-Max codebook to the routed experts, keeping the backbone at higher precision.
Profile: JANGTQ4
| Component | Precision |
|---|---|
| Attention | FP16 |
| Shared experts | FP16 |
| Routed experts | 4-bit |
| Embeddings | FP16 |
| LM head | FP16 |
Requirements
- Load with the
jang-toolsPython package or vMLX. Not supported by stock MLX, LM Studio, or Ollama. - Kimi's tokenizer uses tiktoken and custom code:
pip install tiktoken blobfileand setTRANSFORMERS_TRUST_REMOTE_CODE=1.
Usage
import os
os.environ["TRANSFORMERS_TRUST_REMOTE_CODE"] = "1"
from jang_tools.load_jangtq import load_jangtq_model as load
from mlx_lm import generate
model, tokenizer = load("bearzi/GLM-5.2-JANGTQ4")
msgs = [{"role": "user", "content": "Write a Python function that reverses a string."}]
prompt = tokenizer.apply_chat_template(msgs, add_generation_prompt=True, tokenize=False)
print(generate(model, tokenizer, prompt=prompt, max_tokens=512, verbose=True))
License
Inherited from the base model zai-org/GLM-5.2; quantization does not change the upstream terms. Attribution is required only for very large commercial deployments (see the license link above).