qwen-2.5
This repository hosts the qwen-2.5 models exported for the
React Native ExecuTorch
library as ExecuTorch .pte programs, ready to run on device.
Variants
| Path | Backend | Precision | Context length |
|---|---|---|---|
0_5b/mlx/qwen_2_5_0_5b_mlx_int4.pte | mlx | int4 | 16,384 |
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_8da4w.pte | xnnpack | 8da4w | 16,384 |
1_5b/mlx/qwen_2_5_1_5b_mlx_int4.pte | mlx | int4 | 16,384 |
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_8da4w.pte | xnnpack | 8da4w | 16,384 |
3b/mlx/qwen_2_5_3b_mlx_int4.pte | mlx | int4 | 8,192 |
3b/xnnpack/qwen_2_5_3b_xnnpack_8da4w.pte | xnnpack | 8da4w | 8,192 |
Repository structure
0_5b/mlx/config.json 1.3 KiB
0_5b/mlx/qwen_2_5_0_5b_mlx_int4.pte 510 MiB
0_5b/xnnpack/config.json 1.3 KiB
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_8da4w.pte 412 MiB
1_5b/mlx/config.json 1.3 KiB
1_5b/mlx/qwen_2_5_1_5b_mlx_int4.pte 1.2 GiB
1_5b/xnnpack/config.json 1.3 KiB
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_8da4w.pte 1.1 GiB
3b/mlx/config.json 1.3 KiB
3b/mlx/qwen_2_5_3b_mlx_int4.pte 2.1 GiB
3b/xnnpack/config.json 1.3 KiB
3b/xnnpack/qwen_2_5_3b_xnnpack_8da4w.pte 2.0 GiB
config.json 30 B
tokenizer.json 6.7 MiB
tokenizer_config.json 7.1 KiB
Compatibility
These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.
To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.
To load these files in your own ExecuTorch runtime, read the compatibility note first.