LFM2.5-2.6B-MLX-bf16
MLX export of LFM2.5-2.6B for Apple Silicon inference.
LFM2.5-2.6B is a compact multilingual model built on LiquidAI's hybrid architecture, combining convolutional and attention layers for efficient long-context processing.
Model Details
| Property | Value |
|---|---|
| Parameters | 2.6B |
| Precision | bf16 |
| Size | 5.02 GB |
| Context Length | 131072 |
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
from mlx_lm.sample_utils import make_sampler
model, tokenizer = load("LiquidAI/LFM2.5-2.6B-MLX-bf16")
response = generate(
model,
tokenizer,
prompt="The capital of France is",
max_tokens=100,
sampler=make_sampler(temp=0.7),
verbose=True,
)
Other Precisions
- LFM2.5-2.6B-MLX-bf16 (5.02 GB)
- LFM2.5-2.6B-MLX-8bit (2.67 GB)
- LFM2.5-2.6B-MLX-6bit (2.04 GB)
- LFM2.5-2.6B-MLX-5bit (1.76 GB)
- LFM2.5-2.6B-MLX-4bit (1.47 GB)
- LFM2.5-2.6B-MLX-mxfp8 (2.59 GB)
- LFM2.5-2.6B-MLX-mxfp4 (1.46 GB)
- LFM2.5-2.6B-MLX-nvfp4 (1.53 GB)
License
This model is released under the LFM 1.0 License.