ZharfaOpen: A State-of-the-Art Persian Language LLM
Model Description
ZharfaOpen is an open-source large language model fine-tuned from the Mistral-7B architecture. Tailored specifically for the Persian language, ZharfaOpen excels in understanding and generating responses for conversations and instruction-following tasks. As the current state-of-the-art (SOTA) in Persian open-source LLMs, ZharfaOpen represents an advancement in natural language processing capabilities for Persian language speakers and developers.
Example Outputs
Below are example outputs demonstrating ZharfaOpen's capabilities in conversation and instruction following:
Example 1: Conversation
- Input: "سلام، خوبی؟"
- Output: "سلام، خوشحالم که با شما صحبت می کنم. چطور می توانم به شما کمک کنم؟"
Example 2: Instruction Following
- Input: "مشتق تابع x*sin(x) را به کمک قانون زنجیره محاسبه کن و تعیین کن که چیست؟"
- Output: "برای محاسبه مشتق تابع x*sin(x) از قاعده زنجیره، ابتدا باید مشتق هر دو عضو توابع را محاسبه کرده و سپس آنها را ضرب نمایید.
-
مشتق توابع x: مشتق تابع x برابر با ۱ است.
-
مشتق توابع sin(x): مشتق تابع sin(x) برابر با cos(x) است.
حال می‌توانیم مشتق تابع x*sin(x) را با ضرب کردن مشتقات هر دوی آنها بدست بیاوریم:
(x * sin(x))' = x * sin'(x) + sin(x) * (x') = x * cos(x) + sin(x) * 1 = x * cos(x) + sin(x)
بنابراین، مشتق تابع x*sin(x) برابر با x * cos(x) + sin(x) است."
Benchmark Results
To be included.
Prompt Format
ZharfaOpen supports the ChatML format for prompting, enabling users to structure their prompts effectively for conversation and instruction-following tasks. Here's an example prompt format:
<|im_start|>system
تو یک مدل زبانی بزرگ هستی به اسم «ژرفا» که به سوالات کاربر به درستی، و با دقت پاسخ می‌دهی
<|im_end|>
<|im_start|>user
لطفا توضیح دهید چگونه یک ایمیل حرفه‌ای بنویسیم.
<|im_end|>
<|im_start|>assistant
Inference Code
Here is a simple Python example for using ZharfaOpen with Hugging Face Transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "ZharfaTech/ZharfaOpen"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
inputs = tokenizer.encode("YOUR_PROMPT_HERE", return_tensors="pt")
outputs = model.generate(inputs, max_length=50)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Replace "YOUR_PROMPT_HERE" with your input in Persian.
Bias, Risks, and Limitations
While ZharfaOpen is a significant step forward in Persian LLM technology, users should be aware of potential biases and limitations inherent in any language model. ZharfaOpen has been trained on diverse datasets, but it may still reflect or amplify societal biases present in the training data. Users are encouraged to critically evaluate outputs and consider these factors in their applications.
How to Cite
If you use ZharfaOpen in your research or application, please cite it as follows:
@misc{zharfaopen2024,
title={ZharfaOpen: A State-of-the-Art Persian Language LLM},
author={ZharfaTech Team},
year={2024},
note={Model fine-tuned over Mistral-7B for Persian language tasks}
}
ZharfaOpen is part of ZharfaTech's commitment to advancing language technologies for the Persian-speaking world. We encourage the community to engage with us in improving and expanding the capabilities of ZharfaOpen.
For more information or to contribute to the project, please visit our Website or contact us directly.