SOLID-StepORLM-Qwen3-8B
This is the step-125 checkpoint of SOLID (Solver-Informed Self-Distillation) built from Chenyu-Zhou/StepORLM-Qwen3-8B for operations-research modeling and solver-backed answer generation.
The model was trained with GRPO and solver-informed token-level KL supervision. It uses the COPT-style StepORLM response template.
Evaluation
Each problem was sampled 64 times. maj@64 is majority-vote accuracy; pass@k uses the unbiased pass-at-k estimator. Objective correctness tolerance is 0.001. The table uses the selected, coherent step-125 generation-B run.
| Dataset | maj@64 | pass@1 | pass@2 | pass@4 |
|---|---|---|---|---|
| OptMATH | 31.33 | 18.25 | 24.40 | 30.28 |
| MAMO-Complex | 70.44 | 66.43 | 71.58 | 74.79 |
| InOR | 48.00 | 39.81 | 46.07 | 50.59 |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "JamesX421/SOLID-StepORLM-Qwen3-8B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype="auto",
device_map="auto",
)
The generated optimization code expects a compatible COPT environment for execution.