UOPD-Qwen2.5-3B-Instruct-WebShop
Final UOPD student checkpoint trained on WebShop with the frozen teacher
langfeng01/GiGPO-Qwen2.5-7B-Instruct-WebShop.
Usage
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "Wenboz/UOPD-Qwen2.5-3B-Instruct-WebShop"
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(model_id)
Training configuration
| Setting | Value |
|---|---|
| Student initialization | Qwen/Qwen2.5-3B-Instruct |
| Teacher | langfeng01/GiGPO-Qwen2.5-7B-Instruct-WebShop |
| Training steps | 150 |
| Rollout / training batch | 16 / 64 |
| Environment step limit | 15 |
| Max prompt / response tokens | 4,096 / 512 |
| Optimizer | AdamW, learning rate 1e-6 |
| Target intervention rate | linear 0.30 → 0.05 over the first 75 training steps, then 0.05 |
| Triggered-turn loss | Plain SFT, weight 1.0 |
| Teacher takeover | Enabled |