Hemlock-Apothecary-7B-GRPO-e3
A best-of-N specialist variant of hemlang/Hemlock-Apothecary-7B: the epoch-3 checkpoint of an execution-reward GRPO run (grimoire / hemlock-rl) on hemlang/hemlock-codex3-SFT.
Know the trade-off (hembench zero-shot, n=5):
| pass@1 | pass@5 | |
|---|---|---|
| Hemlock-Apothecary-7B | 60.5% | 68.4% |
| Apothecary-GRPO-e3 | 52.6% | 71.1% |
Mid-training RL dispersed the policy: lower first-try reliability, but the highest
any-shot solve rate of any Hemlock model measured to date. Use the base Apothecary for
single-shot generation; use this model when sampling several candidates and verifying with
the interpreter — e.g. hembot --retry — where solve-rate
within k samples is what matters. Notable per-level: systems/concurrency L4 pass@1 4/7 → 5/7,
debugging L6 pass@5 3/5 → 4/5.
GRPO with LoRA r=16, β=0.1 KL, G=8, dynamic sampling, 267 deduplicated verified prompts, constant lr, checkpoint at epoch 3 of 4 (the epoch-4 endpoint re-concentrates and loses the pass@5 advantage). Q8_0 GGUF included.