Viewpoint policy-gradient actor — ADE20K, c64, T=5
Glimpse-placement policy for a frozen CanViT, over a discrete grid of candidate viewpoints (2 scales x 16x16 centres): scores per candidate are policy logits trained on-policy by score-function credit (loss -(z * log pi) - entropy_bonus * H, K=1 fractional-CE rewards); deploy = full-scene glimpse at t0, argmax afterwards — the same deploy rule as the Q-regression policies. Method + code: CanViT-PyTorch-RL.
Provenance: run 20260705-185405_pgfloor_s0, git 4a24a3d0f233c64e2000640d7b36880003d504f7, seed 0, step 7000
(deploy ckpt = best mean(t1-t4) validation CE over the run's evals). Backbone canvit/canvitb16-add-vpe-pretrain-g128px-s512px-in21k-dv3b16-2026-02-02;
probe resolved for canvas grid 64. Full-val metrics at this step:
| glimpse step t | val CE | val mIoU % |
|---|---|---|
| t0 | 0.7649 | 39.60 |
| t1 | 0.7135 | 42.71 |
| t2 | 0.6894 | 43.78 |
| t3 | 0.6752 | 44.42 |
| t4 | 0.6647 | 44.94 |
from canvit_pytorch_rl.policy.net import ViewpointScorer
net = ViewpointScorer.from_pretrained("canvit/pgpolicy-ade20k-c64-t5-floor-2026-07-05-s0").eval()
Drive it through canvit_pytorch_rl.policy.deploy.ArgmaxPolicy + canvit_eval.run_episode for
protocol-exact rollouts; canvit_pytorch_rl.policy.eval is the standalone evaluator.