seccodeplt-qwen2.5-coder-3b-fixed-mixed-grpo-alpha-0.5-pi-theta-real-reward-v2
Fixed Mixed GRPO trainable pi-theta (alpha=0.5) for the SecCodePLT+ compliance experiment using
Qwen/Qwen2.5-Coder-3B-Instruct. This v2 run corrects causal-label alignment and uses the
official ReaL safety-unit-test reward with DAPO-style token loss and dynamic
sampling. Training used seed 42 and the official 655-example training split.
Evaluation used greedy decoding on all 164 official test examples.
Evaluation
| Metric | Value |
|---|---|
| Mean reward | 0.407411 |
| Output format pass | 97.56% |
| Syntax pass | 97.56% |
| Capability pass | 23.78% |
| Safety pass | 57.93% |
| Joint pass | 17.68% |
Important: this is pi-theta
This repository stores the trainable pi-theta checkpoint, not a statically
merged policy. Reproduce the evaluated policy by mixing this model's logits
with the frozen anchor xw1234gan/seccodeplt-qwen2.5-coder-3b-diff-sft-v2 using alpha=0.5:
mixed_logits = 0.5 * pi_theta_logits + 0.5 * anchor_logits
Limitations
This is a single-seed research checkpoint evaluated with the benchmark's resource-bounded Python verifier. It is not a general guarantee of secure code.