Hy-MT2-7B-Abliterated-bf16
This repository contains bf16 MLX weights for an abliterated derivative of tencent/Hy-MT2-7B, Tencent Hunyuan's multilingual translation model.
The abliteration method is based on jim-plus/llm-abliteration. This is a community derivative and is not an official Tencent release.
Model Details
- Base model: tencent/Hy-MT2-7B
- Target repository: mlx-community/hy-mt2-7b-abliterated-bf16
- Runtime: MLX / MLX-LM
- Precision: bf16 MLX weights
- Task: multilingual translation
- License: Apache-2.0, following the upstream model license
The bf16 version preserves higher precision than the 8-bit quantized variant and is intended for users who prefer quality over minimum memory footprint.
Usage
Install MLX-LM:
pip install -U mlx-lm
Generate with the command line:
mlx_lm.generate \
--model mlx-community/hy-mt2-7b-abliterated-bf16 \
--prompt "将以下文本翻译成英语，注意只需要输出翻译后的结果，不要额外解释：\n\n今天天气真好。" \
--max-tokens 4096 \
--temp 0.7 \
--top-p 0.6
Or use Python:
from mlx_lm import load, generate
model_id = "mlx-community/hy-mt2-7b-abliterated-bf16"
model, tokenizer = load(model_id)
prompt = "将以下文本翻译成英语，注意只需要输出翻译后的结果，不要额外解释：\n\n今天天气真好。"
messages = [{"role": "user", "content": prompt}]
formatted_prompt = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
)
response = generate(
model,
tokenizer,
prompt=formatted_prompt,
max_tokens=4096,
temp=0.7,
)
print(response)
Prompting
Hy-MT2 is optimized for translation instructions. Use full language names in prompts when possible.
Example:
Translate the following text into Chinese. Only output the translated result without additional explanation:
The weather is nice today.
Recommended generation settings from the upstream Hy-MT2 model card for 1.8B and 7B models:
{
"temperature": 0.7,
"top_p": 0.6,
"top_k": 20,
"repetition_penalty": 1.05,
"max_tokens": 4096
}
About Abliteration
Abliteration attempts to identify and remove refusal-related directions in model activations or weights. It can reduce explicit refusal behavior, but it does not guarantee that every refusal is removed, and it may affect translation quality or other model behavior.
This model should be evaluated for your own use case before production use.
Limitations
- This model inherits the capabilities and limitations of the upstream Hy-MT2-7B model.
- Abliteration may change behavior in ways that are not captured by standard translation benchmarks.
- Users are responsible for complying with applicable laws, platform policies, and the upstream model license.
References
- Base model: tencent/Hy-MT2-7B
- Abliteration method: jim-plus/llm-abliteration
- Hy-MT2 paper: Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild
Citation
@misc{zheng2026hymt2familyfastefficient,
title={Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild},
author={Mao Zheng and Zheng Li and Tao Chen and Bo Lv and Mingrui Sun and Mingyang Song and Jinlong Song and Hong Huang and Decheng Wu and Hai Wang and Yifan Song and Yanfeng Chen and Guanwei Zhang},
year={2026},
eprint={2605.22064},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2605.22064}
}