ArmenianGPT v0.5 - Second Iteration Of The First Ever Armenian Reasoning Model
Now With Adaptive Reasoning Intelligence
Developed by Aleksandr Baghramyan
This second version (v0.5) of ArmenianGPT, the first-ever Armenian reasoning model (not only responding, but also thinking natively in Armenian), is currently in a progressive training phase, with more powerful models of various sizes trained on a broader range of disciplines expected soon; to contribute, please send a screenshot or text of your questions along with the model's answers to Baghramyan@PM.ME for us to analyze and prevent such errors in future iterations of this model line.
This model represents a breakthrough in natural language processing for the Armenian language by enabling natural communication through its unique ability to process prompts typed with English characters - a popular, faster, and more convenient method for many users.
Configurations for Optimal Model Performance
A temperature of 0 is recommended for this iteration of the model.
| Desired Output | Recommended Temperature | Use Case Examples |
|---|---|---|
| High Accuracy & Factual Precision | 0.0 - 0.3 | Factual question answering, code generation, summarization. |
| Creative & Diverse Responses | 0.3 - 1.0 | Brainstorming ideas, creative writing, exploring solutions to complex problems. |
Running the Model on a Single / Multi GPU
# pip install -U transformers
# pip install accelerate
from transformers import AutoProcessor, Gemma3ForConditionalGeneration
from huggingface_hub import login
from PIL import Image
import requests
import torch
HUGGINGFACE_TOKEN = "YOUR HUGGINGFACE TOKEN GOES HERE"
login(token=HUGGINGFACE_TOKEN)
model_id = "ArmGPT/ArmenianGPT-0.5-12B"
model = Gemma3ForConditionalGeneration.from_pretrained(
model_id, device_map="auto"
).eval()
processor = AutoProcessor.from_pretrained(model_id)
messages = [
{
"role": "system",
"content": [{"type": "text", "text": "You are an Armenian AI assistant who always thinks before providing the final response."}]
},
{
"role": "user",
"content": [{"type": "text", "text": "YOUR QUESTION/PROBLEM IN ARMENIAN GOES HERE"}]
}
]
inputs = processor.apply_chat_template(
messages, add_generation_prompt=True, tokenize=True,
return_dict=True, return_tensors="pt"
).to(model.device, dtype=torch.bfloat16)
input_len = inputs["input_ids"].shape[-1]
with torch.inference_mode():
generation = model.generate(**inputs, max_new_tokens=5799, do_sample=False)
generation = generation[0][input_len:]
decoded = processor.decode(generation, skip_special_tokens=True)
print(decoded)