Olmo-3-7B-Instruct-OPSA-Code

This repository contains the code-domain checkpoint of allenai/Olmo-3-7B-Instruct trained with On-Policy Self-Adaptation (OPSA).

• Checkpoint: step 119 (120 optimizer updates; zero-based checkpoint numbering).
• Format: full model weights in BF16 Safetensors, with configuration and tokenizer files.
• License: Apache 2.0, following the base model.

Paper · Code · Collection

Usage

Install torch, accelerate, and transformers>=4.57.1.

Use the included original OLMo Instruct chat template.

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Tuwhy/Olmo-3-7B-Instruct-OPSA-Code"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
messages = [{"role": "user", "content": "Write a Python function that checks whether a string is a palindrome."}]
inputs = tokenizer.apply_chat_template(
    messages,
    add_generation_prompt=True,
    tokenize=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)
outputs = model.generate(
    **inputs,
    max_new_tokens=2048,
    do_sample=True,
    temperature=0.7,
    top_p=0.8,
    top_k=20,
)
print(tokenizer.decode(outputs[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))