Kirim-V2 26B
Kirim-V2 is an advanced general-purpose language model with 26 billion parameters, featuring an innovative sparse activation architecture where 18 billion parameters are actively engaged during inference. This design delivers high performance while maintaining computational efficiency.
Model Architecture
- Total Parameters: 26B
- Active Parameters: ~18B (sparse activation)
- Context Length: Extended context window
- Architecture: Transformer-based with mixture-of-experts components
Key Capabilities
Core Competencies
- Natural language understanding and generation across multiple domains
- Complex reasoning and multi-step problem solving
- Code generation and technical documentation
- Creative writing and content creation
Advanced Features
- Web Search Integration: Built-in capability to search and retrieve real-time information
- Tool Use: Seamless integration with external tools and APIs
- Multilingual Support: Strong performance across multiple languages
- Long-form Generation: Coherent output for extended documents and articles
Performance Highlights
Kirim-V2 represents a significant advancement over Kirim-V1, featuring:
- Enhanced reasoning capabilities for complex tasks
- Improved factual accuracy through integrated search
- Better instruction following and task completion
- More natural and contextually appropriate responses
Use Cases
- Research & Analysis: Information gathering with real-time web search
- Software Development: Code generation, debugging, and documentation
- Content Creation: Articles, reports, creative writing, and technical documentation
- Question Answering: Accurate responses with source verification
- Task Automation: Multi-step workflows with tool integration
Model Specifications
Architecture: Sparse Transformer
Training Data: Diverse web corpus, code, and specialized datasets
Tokenizer: Custom trained tokenizer optimized for multilingual performance
Optimization: Mixed precision training with gradient checkpointing
Inference Example
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "Kirim-ai/Kirim-V2"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name,
device_map="auto",
torch_dtype="auto"
)
prompt = "Explain quantum entanglement in simple terms."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.7)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)
Limitations
- May occasionally generate plausible-sounding but incorrect information
- Performance depends on prompt quality and task complexity
- Web search capability requires appropriate API configuration
- Not specifically fine-tuned for safety-critical applications
Ethical Considerations
This model should be used responsibly. Users should verify critical information independently and be aware of potential biases in generated content. The model is not intended for making decisions in high-stakes scenarios without human oversight.
License
This model is released under the Apache 2.0 License.
Citation
@model{kirimv2_2025,
title={Kirim-V2: A 26B Parameter Sparse Activation Language Model},
author={Qiling Tech},
year={2026},
publisher={Hugging Face},
url={https://huggingface.co/Kirim-ai/Kirim-V2}
}
Release Date: 2026 Model Type: Causal Language Model