SPECTRA ?M Image
Chroma-factorised scale-wise text-to-image transformer (Composer/Refiner), ~?M parameters, no VQGAN -- images are represented as Oklab luma/chroma Haar-FSQ tokens (see spectra_tokenizer.py).
Architecture
- Model: SPECTRA (Composer + Refiner, see spectra_model.py)
- Image tokenizer: fixed (non-learned) Oklab/Haar/FSQ, image_size=128
- Text encoder:
t5-small(T5, encoder-only), frozen + learned cross-attention pooling - Training data:
prithivMLmods/Caption3o-Opt-v3
Loading the tokenizer
from transformers import AutoTokenizer
tok = AutoTokenizer.from_pretrained("eltag-labs/spectra_20m_image/tokenizer")