Qwen3.5-9B-meSFT GSM8K no-CoT SFT
This checkpoint is a supervised fine-tune of zhengbang0707/Qwen3.5-9B-meSFT on GSM8K. Targets contain the final answer only (no chain-of-thought). Training uses Qwen3.5's multimodal conditional-generation architecture, the native chat template with enable_thinking=False, BF16 parameters, and 4-GPU FSDP. The final model was consolidated without intermediate optimizer checkpoints.
- Source revision:
d7903ad114e77a8481230da2dfdd7668573c9d8e - Dataset:
openai/gsm8k,maintrain split; validation loss on the held-out split - Training: 3 epochs, final-only BF16 checkpoint
- Final training loss: 0.4120
- Final validation loss: 0.7454
- Bedrock-only judge evaluation: 1319 examples, 493 judged correct (37.38%)
- Judge model:
us.anthropic.claude-sonnet-4-6inus-east-2
Usage
Load with AutoModelForMultimodalLM and AutoProcessor from Transformers. Keep the Qwen3.5 native processor/chat-template path and set enable_thinking=False for no-CoT inference.