gemma-270m-math-reasoner
Experimental checkpoint. A 270M-parameter Gemma 3 fine-tuned to produce step-by-step math reasoning. It was trained as a quick capacity test and published mainly as a checkpoint — treat it as a research artifact, not a production math model.
What to expect
- It has learned the form of reasoning: it writes out steps and works toward a final answer.
- At 270M parameters it often can't carry the arithmetic through. Expect confident-looking chains that go wrong mid-way, especially on multi-step word problems.
- Useful for: studying how far reasoning-format training transfers at very small scale, edge/on-device experiments, and as a baseline against larger distills.
A larger (1B) variant is planned.
Quick start
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "reaperdoesntknow/gemma-270m-math-reasoner"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
messages = [{"role": "user", "content": "A shop sells pens at 3 for $2. How much do 12 pens cost?"}]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
out = model.generate(inputs, max_new_tokens=256)
print(tok.decode(out[0][inputs.shape[-1]:], skip_special_tokens=True))
Training
- Base: google/gemma-3-270m
- Data:
- Method:
- Hardware:
Evaluation
Not yet formally evaluated.
More from this author
Published by Convergent Intelligence LLC.