DualMind TKD Agentic 1.7B
DualMind TKD Agentic 1.7B is a two-stage derivative of
Qwen/Qwen3-1.7B.
It combines topology-guided mathematical knowledge distillation with assistant-masked agentic and function-calling specialization.
Training lineage
Stage 1: topology-guided knowledge distillation
- Student:
Qwen/Qwen3-1.7B - Teacher:
Qwen/Qwen3-8B - Dataset:
0xZee/dataset-CoT-Advanced-Calculus-268 - Training scope: full-model fine-tuning
- Objective: supervised cross-entropy plus sparse top-k-and-tail teacher distillation
- Structural signals: teacher distribution discrepancy, transition topology, gap-energy diagnostics, and phase-weighted Explore/Examine/Response supervision
Stage 1 was designed to transfer mathematical reasoning behavior while placing additional learning pressure on derivation, verification, and high-discrepancy reasoning transitions.
Stage 2: agentic specialization
- Dataset:
NousResearch/hermes-function-calling-v1 - Training scope: LoRA specialization followed by weight merging
- Supervision: assistant and tool-call outputs only
- Tool schemas, user messages, and tool-result messages were visible as context but excluded from direct loss
- Mathematical replay was mixed into Stage 2 to reduce catastrophic forgetting
The files in this repository contain the merged standalone model. A separate PEFT adapter is not required for inference.
Intended uses
- Mathematical and technical reasoning
- Structured function calling
- Tool-selection experiments
- Agent-loop research
- Continued supervised or preference optimization
- Research on topology-aware distillation
Tool execution
This model can generate tool calls, but it does not execute external tools by itself.
A surrounding runtime must:
- Parse the model's tool call.
- Execute the selected tool.
- Append the tool result to the conversation.
- Invoke the model again for its next action or final response.
Loading
from transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "reaperdoesntknow/DualMind-TKD-Agentic-1.7B"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(
repo_id,
torch_dtype="auto",
device_map="auto",
)
Evaluation status
No formal benchmark results are claimed in this release.
The training pipeline includes held-out loss monitoring and qualitative
generation smoke tests, but external mathematics, function-calling,
retention, and safety benchmarks should be run before production use.
Limitations
The source mathematics dataset is small.
Synthetic or generated reasoning traces may contain incorrect
derivations or contradictory final answers.
Function-call formatting does not guarantee correct tool selection.
External tool outputs must be treated as untrusted input.
Mathematical replay reduces forgetting but does not prove retention.
The model has not been established as safe for autonomous,
high-impact, medical, financial, or legal action.
License note
The Qwen3-1.7B base model uses Apache-2.0 licensing. The Hermes
function-calling dataset also declares Apache-2.0.
The advanced-calculus dataset did not expose a clear license declaration
when this model card was prepared. Consequently, this repository is
temporarily marked license: other. Confirm the source dataset's reuse
terms before assigning a more permissive license to this derivative.
Developer
Convergent Intelligence LLC / Reaper
Hugging Face: reaperdoesntknow
<!-- cix-keeper-ts:2026-10-03T13:15:30Z -->