Kairos-50M: Adaptive Time Series Foundation Model
This model is presented in the paper Kairos: Toward Adaptive and Parameter-Efficient Time Series Foundation Models.
Model Description
Kairos-50M is a 50-million parameter time series foundation model designed for zero-shot forecasting across diverse domains. It features a dynamic patching tokenizer, mixture-of-size encoding, and Dynamic Rotary Position Embedding (DRoPE) to handle heterogeneous time series data with varying information density.
Key Features
- 🔀 Mixture-of-Size Encoder: Adaptively selects tokenization granularity based on local information density
- 🔄 Dynamic Rotary Position Embedding (DRoPE): Tailors positional encodings to instance-level spectral features and dynamic patching tokenization
- 📊 Zero-shot Forecasting: Strong generalization across domains without fine-tuning
- ⚡ Efficient: Superior performance with fewer parameters
Model Specifications
- Parameters: ~50 million
- Training Data: PreSTS corpus (300+ billion time points)
- Architecture: Transformer-based with adaptive components
Model Family
- Kairos-50M: https://huggingface.co/mldi-lab/Kairos_50m (Current)
- Kairos-23M: https://huggingface.co/mldi-lab/Kairos_23m
- Kairos-10M: https://huggingface.co/mldi-lab/Kairos_10m
Usage
import torch
from tsfm.model.kairos import AutoModel
# load model
model = AutoModel.from_pretrained(
"mldi-lab/Kairos_50m", trust_remote_code=True
)
# forecasting configurations
batch_size, context_length, prediction_length = 1, 2048, 96
seqs = torch.randn(batch_size, context_length)
prediction_length = 96
forecast = model(
past_target=seqs.clone().detach().float(),
prediction_length=prediction_length,
generation=True,
preserve_positivity=True,
average_with_flipped_input=True
)
# extract the prediction results
forecast = forecast["prediction_outputs"]
print(forecast.shape)
For detailed usage examples, please refer to the main repository.
Citation
If you use this model, please cite:
@article{feng2025kairos,
title={Kairos: Toward Adaptive and Parameter-Efficient Time Series Foundation Models},
author={Feng, Kun and Lan, Shaocheng and Fang, Yuchen and He, Wenchao and Ma, Lintao and Lu, Xingyu and Ren, Kan},
journal={arXiv preprint arXiv:2509.25826v2},
year={2025}
}
License
Apache License 2.0