SPSD-RL Qwen3-4B Instruct 2507 SDFT MCTSStyle ConciseHint
This is the final loadable model root from the 400-step SDFT run qwen3-4b-instruct-2507-sdft-mctsstyle-parity400-concisehint-lr1em6-cumem0-20260615. It starts from Qwen/Qwen3-4B-Instruct-2507 and trains on LorMolf/SPSD-RL using TRL experimental self-distillation with MCTS-style privileged contexts.
Training Summary
- Method: SDFT over prompt plus privileged MCTS-context rows.
- Budget: 400 optimizer steps with
generation_batch_size=128, or 51,200 generated completions. - Learning rate:
1e-6. - Runtime: four H200 GPUs, DDP,
NCCL_CUMEM_ENABLE=0,USE_FSDP=false. - Student concise hint: enabled.
generate_from_teacher: false.- Train-time eval: disabled (
eval_strategy=no) because the TRL SDFT eval path is incompatible with raw prompt/privileged-context batches in this setup. - W&B run:
x2tz41erin projectolmo-spiral-sdft.
The final trainer summary recorded train loss 0.05229, runtime about 1.133e+05 seconds, train samples/s 0.452, and train steps/s 0.004.
Artifact Scope
This Hugging Face repository intentionally contains only the final loadable model payload: model weights, tokenizer/config files, generation config, chat template, and this model card. Intermediate checkpoint-* directories, optimizer/scheduler state, trainer state, logs, caches, and dataset materialization artifacts are not included.
Evaluation
Post-hoc reasoning and OpenReward/CRPT game evaluations should use the repository standard boxed SFT/SDFT profile (sft_boxed_forced) so visible reasoning is preserved while final answers are canonicalized to Final answer: \boxed{...} when needed. No post-hoc benchmark results are included in this model card at upload time.