RIFA-Edge
Created / maintained by SM Shahbaj
About
RIFA-Edge is a fine-tuned language model maintained by SM Shahbaj.
| Property | Value |
|---|---|
| Model | RIFA-Edge |
| Parameters | 0.6B |
| Creator | SM Shahbaj |
Part of the RIFA model family by SM Shahbaj.
Downloads
| File | Link |
|---|---|
| Safetensors | Browse |
RIFA-Edge-0.6B.F16.gguf | Download |
RIFA-Edge-0.6B.Q3_K_M.gguf | Download |
RIFA-Edge-0.6B.Q4_K_M.gguf | Download |
RIFA-Edge-0.6B.Q5_K_M.gguf | Download |
RIFA-Edge-0.6B.Q6_K.gguf | Download |
RIFA-Edge-0.6B.Q8_0.gguf | Download |
Recommended: Q5_K_M when available.
Quick start
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "smshahbaj/RIFA-Edge-0.6B"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, device_map="auto")
messages = [{"role": "user", "content": "Hello"}]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(text, return_tensors="pt").to(model.device)
print(tok.decode(model.generate(**inputs, max_new_tokens=64)[0], skip_special_tokens=True))
Creator
SM Shahbaj — huggingface.co/smshahbaj
License: Apache 2.0
RIFA Model Family — SM Shahbaj
Documentation
- Series hub (GitHub): https://github.com/smshahbaj/RIFA-Text-Series
- Model page: RIFA-Edge docs
- HF collection: https://huggingface.co/collections/smshahbaj/rifa-text-series