Tercet-R-1.1

Reasoning + tool-call chat model (~502M) — latest Tercet-R snapshot

A ~502M hybrid GDN-2 + GQA model, continued on multi-turn tools and instruction following

What this is

Tercet-R-1.1 is the latest public reasoning / tool-use checkpoint in the Tercet-R line.

• Previous public snapshot: kerzgrr/Tercet-R-1.0
• Base (pretrain): kerzgrr/Tercet-base
• Live demo: kerzgrr/tercet-r-1.1-demo
• Hub weights are the EMA snapshot in bfloat16

This upload is the latest complete stage-3 SFT checkpoint (optimizer step 5,300). The stage-3 run is still in progress toward a much longer schedule; 1.1 is the snapshot that existed when this repo was published.

Initialization was the instruct-run EMA at step 5,000 (tercet-r-instruct), not the public 1.0 file (that release packaged instruct step 4,500). The chat contract is unchanged.

Chat contract

Thinking

Each assistant turn is prefixed with a zero-loss control token:

inference.py streams the <think> region live (dim yellow) and hides the control tokens.

Tool calls (SmolTalk JSON)

<tool_call>
{"name": "web-search", "arguments": {"query": "…"}}
</tool_call>

Stage-3 also saw stateful_python_code_exec leftovers from earlier Cascade-2 SFT. inference.py auto-runs:

Tool results

Each observation is a tool (or user) turn prefixed with:

<|tool_response|>
{observation}

Install & run

pip install torch safetensors tokenizers huggingface_hub
hf download kerzgrr/Tercet-R-1.1 inference.py --local-dir .
python inference.py

python inference.py --prompt "What is the capital of France?"
python inference.py --tools web-search,python,calculator
python inference.py --no-think --prompt "Reply in one sentence."

inference.py auto-downloads weights / tokenizer / tiny_gdn/ and auto-installs pinned flash-linear-attention. Git is required on PATH.

Interactive commands: /think /no_think /system … /reset /exit.

Model architecture

Same TinyGDN hybrid as Tercet-base (501,635,264 parameters):

Training

Stage-3 does not re-include Cascade-2 math/math_tool.jsonl. The restricted Python tool in inference.py is there so leftover stateful_python_code_exec calls still compute instead of failing open.

Limitations

• In-progress run: this is a mid-stage-3 snapshot, not a finished 1.1 train
• Scale: ~502M is a research / edge model, not a frontier system
• Requires flash-linear-attention; not GGUF / llama.cpp compatible today
• The Python tool is a restricted interpreter (math-oriented imports only)

Model family

Citation

@misc{tercetr11,
  title={Tercet-R-1.1: A 502M Hybrid GDN-2 + GQA Reasoning Model},
  author={kerzgrr},
  year={2026},
  url={https://huggingface.co/kerzgrr/Tercet-R-1.1}
}

R is for reasoning.