DAFT Qwen2.5-Coder-7B-Instruct — checkpoint 3500

Latest saved checkpoint from full supervised fine-tuning for NVIDIA GPU assembly to AMD GPU assembly translation. Training was stopped by the user after logged step 3,595. This is the latest saved checkpoint, not an export of the unsaved step-3,595 state.

• Base model: Qwen/Qwen2.5-Coder-7B-Instruct, revision c03e6d358207e414f1eca0bb1891e29f1db0e242.
• Optimizer step: 3,500 of 10,219 planned steps; one epoch, all 163,495 eligible training pairs.
• Dataset: ahmedheakl/daft-sm89-rdna-functions, revision a833e9887bb5e3623c52dc0ce57480784fd77ce6.
• Context: 32,768 total prompt and response tokens; full fine-tuning, BF16, two H200s, ZeRO-3, effective batch 16.
• Leakage policy: benchmarks_exact_v2, excluding only exact whitespace-normalized source OR target benchmark matches from training.
• Validation: target cross-entropy on 281 eligible CASS pairs and 337 eligible Rodinia pairs. These suites are used for checkpoint selection, not independent final testing. Functional correctness has not been established.
• Export includes model weights and tokenizer. DeepSpeed optimizer/RNG state remains in the local training checkpoint and is not included in this model repository.
• Training code: https://github.com/aasim-m/DAFT-experiment-setup
• W&B: https://wandb.ai/daft/daft-asplos/runs/9fd9f1100493

Input format

Use the tokenizer's chat template with a user message containing:

Translate the following NVIDIA GPU assembly function into corresponding AMD GPU assembly. Preserve the function's behavior. Return only the translated assembly, without explanations or Markdown fences.
<your NVIDIA assembly function>

Validation losses at step 3500

• eval_qwen25_cass_validation_loss: 0.07435634732246399
• eval_qwen25_rodinia_validation_loss: 0.15731622278690338