RIBOSPAN-10K-15
RIBOSPAN-10K-15 is the 10,240-token, 15%-masking checkpoint of the RIBOSPAN RNA foundation model family.
🏗️ Checkpoint Configuration
| Setting | Configuration |
|---|---|
| Parameters | 1.61B |
| Transformer Layers | 32 |
| Hidden Dimension | 2,048 |
| FFN Intermediate Size | 5,440 |
| Attention Heads | 32 |
| Native Context Length | 10,240 tokens |
| Pretraining Objective | Masked Language Modeling |
| Masking Rate | 15% |
| Training Stage | Initial pretraining |
For full architecture details, pretraining, evaluation, and usage, see the RIBOSPAN model-family page.
📄 License
The RIBOSPAN model weights are provided for non-commercial research use under the RIBOSPAN Non-Commercial Model License 1.0.
📖 Citation
If you use this checkpoint in your research, please cite:
@misc{wang2026ribospan,
title = {{RIBOSPAN}: A Long-Context {RNA} Foundation Model for Versatile {RNA} Modeling},
author = {Wang, Ziyuan and Tang, Bohao and Zhang, Fei and Han, Shuo and Liu, Pengfei},
year = {2026},
eprint = {2608.22849},
archivePrefix = {arXiv},
primaryClass = {cs.LG}
}