sriq-ai/SRIQ-MiniCPM5-2B-v1.6
Merged bf16 weights. Reasons in compressed Simplified Chinese and answers in the language it was asked in.
SRIQ · Benchmarks · Training data · Base model · Adapter
Results
No benchmarks were run for this release. Nothing here reports rows that reason in Chinese, verification rate, or looping against the base model. Evaluate it on your own workload before relying on it.
Known limitations
- Training saw 9,988 of the dataset's 9,988 rows at 313 steps on an effective batch of 32, about 1.00 of one epoch. The rest were never shown to the model: the run is step-capped, not epoch-capped.
- Inherits the base model's limitations. Do not pass
enable_thinking=False: the template prefills an empty<think></think>and the trace disappears.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("sriq-ai/SRIQ-MiniCPM5-2B-v1.6", torch_dtype="auto", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("sriq-ai/SRIQ-MiniCPM5-2B-v1.6")
Training
| run | cpm-v2 |
| method | LoRA over a 4-bit (QLoRA) base, merged to bf16 |
| dataset | sriq-ai/sriq-sft-v1.6 @ 599b60765cef835f03329eac03ebfa98f11e6480 |
| steps | 313 (max_steps; step-capped, not epoch-capped) |
| effective batch size | 32 (per-device 8 × gradient accumulation 4) |
| epoch fraction | 1.00 (9,988 of 9,988 rows) |
| final training loss | 0.9216 |
| LoRA | r 32, α 32, dropout 0.0 |
| target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| learning rate | 1.5e-4, linear schedule, 10 warmup steps |
| max sequence length | 8,192 (over-long rows dropped, not truncated) |
| hardware | 8 × NVIDIA A100-SXM4-80GB, secure cloud, 700 GB container disk |
| GPU price | $12.72/hr |
| wall clock | 54 m |
| GPU cost | ~$11.61 |
| adapter | sriq-ai/SRIQ-MiniCPM5-2B-v1.6-adapter, pushed before the merge |
Wall clock and cost are measured by the agent from its own start to publish, so they cover the base-model download and the merge upload as well as training.
How this was trained
SRIQ runs its finetunes on an internal platform at train.sriq.org. An admin submits a run; it verifies every secret, permission and quota before spending anything, rents the GPU, trains, pushes the adapter, merges, publishes, and terminates the pod itself. No pod outlives its job, and a deadline and a spend ceiling are both set before the first dollar.
Every figure in the table above is recorded by that pipeline, not written by hand. The platform is not public.
License
Apache-2.0. Developed by SRIQ. Base model by openbmb.
Card generated by the SRIQ training pipeline on 2026-09-26.