Model Details
The model is trained on optimization trajectories of blackbox optimization methods evaluated on different optimization tasks. It's based on a Qwen3-type architecture. More details are described in the paper:
An Open-Source Training Dataset for Foundation Models for Black-box Optimization Aaron Klein, Herilalaina Rakotoarison, Luca Thale-Bombien, David Salinas arXiv:2605.23417 [cs.LG]
Downstream Use
For an example how to use this model for optimization see the Syne-Tune library.
Training Details
Training Data
The model is trained on the BBO-Pile dataset.
Training Procedure
We used AdamW with β1 = 0.9, β2 = 0.95, weight_decay = 0.1, gradient clipping with max_norm = 1.0, and a cosine learning rate schedule with 10% linear warm-up. All models are trained with bf16-mixed, without gradient accumulation, and a context length of 4096 tokens
Citation
If you want to use this model please cite the following paper:
BibTeX:
@article{bbo-pile2026, title={An Open-Source Training Dataset for Foundation Models for Black-box Optimization}, author={Aaron Klein and Herilalaina Rakotoarison and Luca Thale-Bombien and David Salinas}, year={2026}, journal={arXiv:2605.23417 [cs.LG]} }