mlx-community/Irodori-TTS-v4-Small-fp16
This model was converted to MLX format from Aratako/Irodori-TTS-v4-Small using mlx-audio version 0.4.7.
Use with mlx-audio
pip install -U mlx-audio
Command line
mlx_audio.tts.generate --model mlx-community/Irodori-TTS-v4-Small-fp16 --text "こんにちは、Irodori TTSのMLX版です。" --ref_audio reference.wav
Python
from mlx_audio.tts.generate import generate_audio
generate_audio(
text="こんにちは、Irodori TTSのMLX版です。",
model="mlx-community/Irodori-TTS-v4-Small-fp16",
ref_audio="reference.wav",
file_prefix="output",
)
Notes
- Unified v4 model: voice cloning, VoiceDesign (caption) and automatic duration prediction in one checkpoint.
- The ModernBERT-ja-310m text encoder weights and its tokenizer are bundled, and
the Semantic-DACVAE-Japanese-32dim codec ships in
dacvae/, so inference needs no additional downloads. - Reference audio: up to 120s. Passing a list of clips encodes each separately and concatenates them, which matches training better than one long recording.
- With a caption but no reference audio, the duration predictor roughly
doubles the length of short texts (under ~7 tokens) and the model reads the
sentence twice to fill the window. This matches the reference PyTorch
implementation. Pass reference audio, or set
duration_scale/seconds.