IntDim-L 50% pruned openai/gpt-oss-120b
This checkpoint was structurally pruned with the released Less-is-MoE
mean-absolute-gradient method. It removes exactly 50% of routed-expert FFN
neurons using 128 calibration samples from
yentinglin/s1K-1.1-trl-format revision
58a01564d278477da20ead1bcf1cde8e31f36251. The released loader settings are preserved:
train, messages, shuffle_seed=1234, seq_length=8192, prefix truncation,
no padding, and BF16, with no optimizer step. The exact model-specific token tensors
are published at jayzou3773/less-is-moe-s1-calibration-128-seq8192 revision
678b4e666183e16ec00376960df03b6381632ed1. The source MXFP4 checkpoint was explicitly dequantized to BF16 before scoring and pruning.
The source-row selection hash is
f261e952d4e6d5dec6d37db4ab22636761b215281d33896060fe4467bb352784 and the model-specific token-file hash
is 1d487883f20fcbc52d7642695c87313d2ea2e9c53c193a3ed7ad6eac8f9d272a. Full export and zero-mask equivalence
metadata are in experiment-export.json.
Inference requires the Less-is-MoE ragged vLLM plugin from the unified Less-is-MoE GPU image. IntDim-E
has one uniform expert width. IntDim-L/G retain the routed MoE topology and
store compact per-expert widths in config.json.