shirdel-coder-9b-claude-fable-5 : GGUF
Claude Fable 5–style instruction tuning combined with Evol-Instruct-Code-80k-v1. Fine-tuned and converted to GGUF format using Q6_K quantization.
Example usage:
- For text only LLMs:
llama-cli -hf Tesleum/shirdel-coder-9b-claude-fable-5 --jinja - For multimodal models:
llama-mtmd-cli -hf Tesleum/shirdel-coder-9b-claude-fable-5 --jinja
vLLM
Install:
pip install vllm
Serve:
vllm serve "Tesleum/shirdel-coder-9b-claude-fable-5"
Or specify tokenizer explicitly:
vllm serve "Tesleum/shirdel-coder-9b-claude-fable-5" \
--tokenizer Qwen/Qwen3.5-9B