Fun-ASR-Nano-2512 for vLLM
This is the official vLLM-native packaging of
FunAudioLLM/Fun-ASR-Nano-2512.
It preserves the official checkpoint tensors and adds the layout required by
vLLM's FunASRForConditionalGeneration implementation.
This repository does not define a new model and does not add LoRA weights. The
1,261 tensors in model.safetensors are bitwise equal to the tensors in the
official source model.pt at revision
272c57b82523ada6fd87095e955f8e29100979ab.
Run with vLLM
The validated path uses float32 for the highest transcription fidelity:
python -m pip install "vllm==0.27.1"
vllm serve FunAudioLLM/Fun-ASR-Nano-2512-vllm \
--revision vllm-0.27.1-20260830 \
--served-model-name fun-asr-nano \
--dtype float32 \
--gpu-memory-utilization 0.40 \
--enforce-eager
Send an OpenAI-compatible transcription request:
curl -fL \
https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512-vllm/resolve/vllm-0.27.1-20260830/example/zh.mp3 \
-o zh.mp3
curl -sS http://127.0.0.1:8000/v1/audio/transcriptions \
-F file=@zh.mp3 \
-F model=fun-asr-nano \
-F language=zh \
-F temperature=0 \
-F response_format=json
Expected text for the pinned sample:
开饭时间早上九点至下午五点。
Provenance
| Item | Value |
|---|---|
| Official source | FunAudioLLM/Fun-ASR-Nano-2512 |
| Source revision | 272c57b82523ada6fd87095e955f8e29100979ab |
Source model.pt SHA-256 | 55ae0d2fee369f0f11cce0795f6927934ad17cf11b278a7e56a51272074160bb |
| Tensor count | 1,261 |
| LoRA tensors | 0 |
Converted model.safetensors SHA-256 | 96dfbec48282dd24d3334369a01e9e909f321ee39a1b0003c528c5379f68c1a6 |
Sample example/zh.mp3 SHA-256 | 0e64de19e4ff9a02e682955c9112f32d2317cfdbb5bc2f3504664044c993f195 |
The complete machine-readable record is in
MODEL_PROVENANCE.json. The conversion can be
reproduced with convert_from_official.py.
The vLLM-native layout originated in the community work by
allendou/Fun-ASR-Nano-2512-vllm
and vLLM PR #33247, with
subsequent format and initialization fixes in vLLM PRs
#36108 and
#44215. This official
packaging keeps that attribution while anchoring the weights to the official
FunAudioLLM checkpoint.
Validation boundary
The published evidence covers vLLM 0.27.1, PyTorch 2.13.0+cu129, Transformers 5.15.0, and one NVIDIA H100 80 GB GPU. The pinned Chinese sample returned the expected text in three consecutive deterministic requests. Other vLLM releases, accelerators, quantizations, and model quality across broader datasets require separate validation.
For the regular FunASR Python runtime, timestamps, speaker diarization, and
streaming services, use the canonical
modelscope/FunASR toolkit and the
original checkpoint.
License
The official source model declares Apache License 2.0. See
LICENSE. Third-party software such as vLLM remains subject to
its own license.