Thomson-1.0-Small

[!Note] This repository contains model weights and configuration files in the Hugging Face Transformers format.

For more details, please refer to our technical report, Thomson: Continual Learning of Frontier Models for SovereignAI.

Thomson-1.0-Small is a frontier Foundation Model of high proficiency across a wide range of specialised and general-purpose domains as well as practical deployment settings. It is the open-weight member of the Thomson-1.0 family, developed within a Continual Learning paradigm with a deliberate focus on economically impactful, high-stakes professional work across legal, tax, and journalism domains. It is obtained by repurposing the open-weight Qwen3.6-35B-A3B model and substantially improving it on a wide range of performance domains.

Thomson-1.0 Highlights

The development of frontier models is commonly perceived to be in the exclusive remit of a small number of heavily funded players. Thomson demonstrates that frontier performance can instead be achieved by a wide range of institutions through Continual Learning on readily available open-weight models:

• Continual Learning: as opposed to limited approaches such as small-scale fine-tuning, prompt engineering, or tool-augmentation on a frozen model, the pipeline delivers distinct improvements across a wide range of capabilities, including those not explicitly targeted, while almost eliminating the forgetting problem common to narrow domain adaptation.
• High-stakes professional work: an enhanced focus on legal, tax, and journalism — domains commonly predicted to undergo large productivity improvements through AI, combining the formality and rigorous reasoning of technical fields with the nuance and tolerance for uncertainty of the humanities.
• Value sovereignty: alignment determines which values a model expresses and how it handles questions on which credible narratives diverge. Here it targets the Public AI Constitution, an openly developed document that permits free use and modification, rather than a proprietary value system, and is applied at two points: Constitutional DPO during value re-alignment, and a constitutional conformance reward during reinforcement learning. The normative foundations of a model should themselves be a shared public resource, open to scrutiny and debate.
• Data-centricity: proprietary content is not merely absorbed as knowledge but converted into supervision, with mid-training data curated from a corpus of over 19T tokens and preference data derived from expert-authored material that no annotation budget could reproduce at scale.
• Agentic Deep Research: a full research harness with reward structures designed to incentivise faithful tool use and accurate citation patterns, vital to reducing hallucinations in high-stakes settings.
• Efficiency: the full pipeline consumed approximately 1.63 × 10²³ FLOP over 35,207 B200 GPU-hours, showing that these results are achievable with compute and personnel budgets substantially lower than commonly thought.

Model Overview

• Type: Causal Language Model (Mixture-of-Experts)
• Training Stage: Value re-alignment, Continual pre-training, Post-training
• Base Checkpoint: Snowdon1.1-Small
• Number of Parameters: 35B in total and 3B activated
• Architecture: Qwen3.6-35B-A3B; see config.json for the full specification
• Context Length: 262,144 natively
• Training Compute: 1.63 × 10²³ FLOP / 35,207 B200 GPU-hours
• Precision: BF16 weights

Model Training and Data

The pipeline is organised into three sequential modules with distinct development foci, allowing computational investment to be adjusted to match sovereignty requirements.

Value focus. Starting from an open-weight, instruction-tuned Foundation Model, values are re-aligned through Constitutional DPO, potentially augmented with activation steering, bringing the model's expressed values into line with the Public AI Constitution.

Knowledge focus. Data-centric continual pre-training (CPT) ingests Thomson Reuters' proprietary data — decades of news, contracts, regulatory filings, case law, statutes and practitioner guidance — with model merging protecting general capabilities while the model absorbs domain knowledge. The mid-training corpus comprises 200B tokens curated from a pool of over 19T tokens of permissively public and proprietary data, split roughly equally between curated proprietary documents, synthetic rephrasings of those documents, and general-capability replay data.

Behaviour, skill & agentic focus. Post-training combines Direct Preference Optimisation with reinforcement learning. The underlying data draws on rehearsal data that reinforces knowledge weakened during earlier stages, document-driven preference data derived from Thomson Reuters' own expert-authored content, ontology-driven preference data built from domain schemas such as IRAC for case law, expert-authored diverse queries data capturing how practitioners actually use AI day to day, and agentic data from the Deep Research harness.

Benchmark Results

Cross-Domain Overview

Legal

Results for common open legal benchmarks.

General Capability Preservation

Benchmark results for popular general capability benchmarks.

Quickstart

[!Note] The model weights are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "thomsonreuters/Thomson-1.0-Small"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype="auto",
    device_map="auto",
)

messages = [{"role": "user", "content": "<user query>"}]
inputs = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True, return_tensors="pt"
).to(model.device)

outputs = model.generate(inputs, max_new_tokens=2048)
print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True))

Citation

@misc{chen2026thomsoncontinuallearningfrontier,
      title={Thomson: Continual Learning of Frontier Models for SovereignAI}, 
      author={Shengzhuang Chen and Jerrod Parker and Yejin Bang and Andrew M. Bean and Nabeel Seedat and Stefan Winzeck and Daniil Glazko and Jannik Zgraggen and Fangyi Yu and Scott Arnott and Dietrich Trautmann and Luca Ciuffreda and Guglielmo Bonifazi and Davide Romano and Bradley Bell and Kirsty Fielding and Daniele Giofrè and Tom Zielund and Ipshita Chatterjee and Sneha Murthy Ghantasala and Manpreet Nanreh and John Scoville and Maciej Sakowicz and Wassim Seifeddine and Lukas Thede and Jonathan Richard Schwarz},
      year={2026},
      eprint={2608.27147},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2608.27147}, 
}

Correspondence

{first.last}@thomsonreuters.com

Acknowledgements

Developed by Thomson Reuters, in partnership with Imperial College London, DatologyAI, and Lambda. Value re-alignment was co-authored by Imperial College London; continual pre-training data was curated in partnership with DatologyAI.