LFM2.5-2.6B-DSpark
LFM2.5-DSpark is a family of speculative-decoding draft models that adapt DSpark for the LFM2.5 architecture. They allow LFM2.5 models to run faster without degrading quality.
This is a drafter for LiquidAI/LFM2.5-2.6B.
In SGLang, decoding runs about 2.6× faster. It also runs on-device on Apple silicon through the Metal backend.
Find more information about LFM2.5-DSpark in our blog post.
🗒️ Model Details
LFM2.5-2.6B-DSpark is a DSpark speculative-decoding draft model with the following features:
- Target model:
LiquidAI/LFM2.5-2.6B - Draft parameters: 327.7M (BF16)
- Backbone: 5 full attention layers,
hidden_size=2048,intermediate_size=6144with SiLU/SwiGLU, GQA withnum_attention_heads=32/num_key_value_heads=8,head_dim=64 - Extra heads: Markov head (rank 256) + confidence head
- Block size: 9
- Vocabulary: 128,000
Other models in the LFM2.5-DSpark family:
| Drafter | Target |
|---|---|
| LFM2.5-1.2B-Instruct-DSpark | LFM2.5-1.2B-Instruct |
| LFM2.5-8B-A1B-DSpark | LFM2.5-8B-A1B |
| LFM2.5-2.6B-DSpark | LFM2.5-2.6B |
📊 Performance
Benchmarks
Speculative decoding is exact: the target verifies every proposed token, so the generated text is what the target would have produced on its own. You get the speedup, not a different model.
See LiquidAI/LFM2.5-2.6B for performance benchmarks.
Acceptance
Mean accepted tokens per decoding step, by benchmark (1×H100, batch size 1, greedy decoding). Higher means more of the draft's proposed block is accepted per target forward pass, so decoding is faster (at block size 9, the ceiling is 10).
| Benchmark | 1×H100 (SGLang) | Apple M4 Max (Metal) |
|---|---|---|
| MATH-500 | 5.67 | 4.45 |
| GSM8K | 4.32 | 4.91 |
| HumanEval | 4.54 | 5.24 |
| MBPP | 4.92 | 4.19 |
| MT-Bench | 4.69 | 3.33 |
| Mean | 4.83 | 4.42 |
On-device and GPU Inference
| Dataset | Acceptance (of 10) | Speedup on H100 | Speedup on M4 Max |
|---|---|---|---|
| MATH500 | 5.42 | 3.06x(326 → 1000 tok/s) | 2.25x(61 → 137 tok/s) |
| HumanEval | 4.54 | 2.56x(326 → 835 tok/s) | 2.63x(61 → 161 tok/s) |
| MBPP | 4.71 | 2.64x(326 → 861 tok/s) | 2.11x(62 → 132 tok/s) |
| GSM8K | 4.32 | 2.22x(312 → 693 tok/s) | 2.36x(60 → 143 tok/s) |
| MT-Bench | 5.07 | 2.87x(325 → 933 tok/s) | 1.99x(62 → 123 tok/s) |
| Mean | 4.81 | 2.67x(323 → 864 tok/s) | 2.27x(61 → 139 tok/s) |
🏃 How to run (SGLang)
Requires a build of SGLang with DSpark support for LFM2 targets (PR #31041). Launch the target with the draft attached:
python -m sglang.launch_server \
--model-path LiquidAI/LFM2.5-2.6B \
--speculative-algorithm DSPARK \
--speculative-draft-model-path LiquidAI/LFM2.5-2.6B-DSpark \
--speculative-draft-attention-backend flashinfer \
--disable-radix-cache --mem-fraction-static 0.75 --port 30000
Then query the OpenAI-compatible endpoint at http://localhost:30000/v1. The block size is read
from the draft's config.json; the baseline is the same command without the three
--speculative-* flags.
📬 Contact
- Got questions or want to connect? Join our Discord community
- If you are interested in custom solutions with edge deployment, please contact our sales team.
Citation
@article{liquidAI202626B,
author = {Liquid AI},
title = {LFM2.5-2.6B: Agents Everywhere},
journal = {Liquid AI Blog},
year = {2026},
note = {www.liquid.ai/blog/lfm2-5-2-6b},
}
@article{liquidAI2026dspark,
author = {Liquid AI},
title = {LFM2.5-DSpark: Up to 3.2x Faster Inference from H100 to MacBook},
journal = {Liquid AI Blog},
year = {2026},
note = {www.liquid.ai/blog/lfm2.5-dspark},
}