MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
GGUF quantizations for local deployment: MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF
MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking is a compact 1B Thinking language model built on openbmb/MiniCPM5-1B. Compared with V1, this V2 release is further fine-tuned on Fable 5 data with a stronger focus on tool calling / function calling, while also improving coding and instruction-following. It keeps MiniCPM5's native Thinking chat template and XML tool-call format.
Previous version: MiniCPM5-1B-Claude-Opus-Fable5-Thinking (V1)
For llama.cpp / Ollama / LM Studio deployment, see the GGUF repository.
Overview
| Item | Detail |
|---|---|
| Base model | openbmb/MiniCPM5-1B (1B dense Llama architecture) |
| Post-training | Fable 5 traces (V2) |
| Key gains vs V1 / base | Stronger tool calling, plus improved coding and instruction following |
| Chat format | MiniCPM5 native Thinking template with optional chain-of-thought blocks |
| Context length | 128K (max_position_embeddings = 131072) |
| Deployment | Single-GPU friendly; suitable for edge / local use |
Capabilities
- Tool calling (enhanced in V2) — more reliable XML / function-calling style tool use on top of MiniCPM5's native format
- Coding — code generation, debugging, and software-engineering-style tasks
- Instruction following — more reliable adherence to user prompts and structured constraints
- Thinking mode — chain-of-thought reasoning via the MiniCPM5 chat template
- Long context — up to 128K tokens (131,072 tokens per
config.json)
Benchmark
BFCL + API-Bank
| Model | BFCL non_live | BFCL live | API-Bank |
|---|---|---|---|
| MiniCPM5-1B (Base) | 41.51% | 60.24% | 7.30% |
| MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking | 43.06% | 63.33% | 22.10% |
Tau-Bench
| Domain | MiniCPM5-1B (Base) | MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking |
|---|---|---|
| Airline | 0.34 (17/50) | 0.36 (18/50) |
| Retail | 0.052 (6/115) | 0.070 (8/115) |
Quick start
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
model_id,
trust_remote_code=True,
torch_dtype=torch.bfloat16,
device_map="auto",
)
messages = [{"role": "user", "content": "Write a Python function to merge two sorted lists."}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512, do_sample=False)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
Sampling recommendations
Generation defaults are inherited from MiniCPM5-1B:
| Mode | Params |
|---|---|
| Think (default) | temperature=0.9, top_p=0.95 |
| No Think | temperature=0.7, top_p=0.95, enable_thinking=False |
Limitations
- Thinking outputs — the model may emit reasoning blocks before the final answer; downstream apps can strip them before display
- 1B scale — optimized for lightweight local deployment, not frontier-scale general reasoning
Provenance & licensing
Released under Apache-2.0, inherited from MiniCPM5-1B.
Acknowledgements
- Base model: OpenBMB / MiniCPM5-1B
- GGUF conversion: llama.cpp