ps4mas-sft-4b-claude-x5-single-ep3
Full-FT Qwen/Qwen3.5-4B reproducing: 9B best_sft_claude_x5_single_ep3 (Terra final_test 2.970 / 2.036 / 3.180 / 3.117 / 3.547)
| 9B original | this 4B | |
|---|---|---|
| Data | data/sft_splits/claude_distill_x5/topology_splits/sft_claude_teacher_single.jsonl (500 hops) | same |
| Objective | full sequence SFT (no LoRA) | same |
| Epochs / lr | 3 / 2e-5 | same |
| Batch | per-device 1, grad accum 2, 8 GPU ZeRO-2 | same |
| Seq | 4096 | same |
Local path: results/0903/sft_full_4b_claude_x5_single_ep3
Uploaded: 2026-09-03T11:18:17.925980+00:00
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("yinita/ps4mas-sft-4b-claude-x5-single-ep3", trust_remote_code=True)
tok = AutoTokenizer.from_pretrained("yinita/ps4mas-sft-4b-claude-x5-single-ep3", trust_remote_code=True)