translate-en-gem

Part of the Windstorm Labs open model catalogue. Scores, licence and attribution for every model: https://windytranslate.com/models/translate-en-gem

Machine translation model, en to gem, published by Windstorm Labs.

Attribution

Derived from Helsinki-NLP/opus-mt-en-gem, licensed apache-2.0. Windstorm Labs did not train the original model. This notice provides the attribution the licence requires.

What was changed

The weights in this repository have been modified from the original. A LoRA fine-tune trained on parallel corpus data and merged into the base weights.

The comparison is tensor-level rather than file-level: safetensors and PyTorch .bin containers hash differently even when the tensors inside are identical, so a file-hash mismatch would prove nothing.

Contents

A single transformers build in safetensors format, loadable directly:

from transformers import AutoTokenizer, AutoModelForSeq2SeqLM

tok = AutoTokenizer.from_pretrained("WindyTranslate/translate-en-gem")
model = AutoModelForSeq2SeqLM.from_pretrained("WindyTranslate/translate-en-gem")

batch = tok(["<your text here>"], return_tensors="pt", padding=True)
print(tok.batch_decode(model.generate(**batch), skip_special_tokens=True))

Other builds of this pair, including CTranslate2 INT8, are not included in this repository.

Limitations

• A single language direction: en to gem.
• Not yet scored. No quality benchmark has been run on this model yet. The weights are verified to differ from the original; that is a statement about provenance, not about translation quality.
• Quality is not monotonic with model size or with the amount of fine-tuning applied.