🌟 BloomVN-8B-chat 🌟
A fine-tuned multilingual model for Vietnamese language
📋 Overview
- A bilingual text generation model with strong capabilities in both Vietnamese and English languages.
- This base model can handle a wide range of text generation tasks while maintaining high quality output in both languages, making it particularly valuable for Vietnamese-English content creation and language processing applications.
🔧 Method
The training process consists of three main steps:
- Continuous Pre-training (CPT) from Sailor2-8B-Chat using unsloth
- Fine-tuning with Vietnamese instruction dataset
- Applied refusal direction tuning based on "Refusal in LLMs is Mediated by a Single Direction"
📊 VLMU Benchmark
| EVALUATION DATE | STEM 🔬 | SOCIAL SCIENCE 🌍 | HUMANITIES 📚 | OTHERS 🎯 | AVG ⭐ |
|---|---|---|---|---|---|
| 07/02/2025 | 50.72 | 62.81 | 60.47 | 55.4 | 56.56 |
💫 Quantization
- Coming Soon!
🤝 Contributors
Developed with ❤️ by BlossomAI