tofu_Llama-3.2-3B-Instruct_forget01_SimNPO
open-unlearning/tofu_Llama-3.2-3B-Instruct_full unlearned on the TOFU forget01 split with SimNPO, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.
Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.
Method hyperparameters
gamma: 0.125
alpha: 1
retain_loss_type: NLL
delta: 1
beta: 3.5
TOFU summary metrics
| metric | value |
|---|---|
| exact_memorization | 0.7596 |
| extraction_strength | 0.1462 |
| forget_Q_A_PARA_Prob | 0.0612 |
| forget_Q_A_gibberish | 0.9033 |
| forget_quality | 0.1650 |
| forget_truth_ratio | 0.5430 |
| mia_loss | 0.8378 |
| mia_min_k | 0.8331 |
| mia_min_k_plus_plus | 0.6225 |
| mia_zlib | 0.7819 |
| model_utility | 0.5663 |
| privleak | -62.2881 |