Vorenthos-Instruct-7b — Ollama Export
Exported from a local Ollama installation and uploaded to the Hugging Face Hub by vorenthiclabs.
Model Details
| Field | Value |
|---|---|
| Base model | Vorenthos-Instruct-7b |
| Tag / variant | latest |
| Model type | Text Generation |
| Format | GGUF (llama.cpp-compatible) |
| Total size | 4.37 GB |
| Layers | 4 |
Quick Start
With Ollama (recommended)
ollama pull Vorenthos-Instruct-7b
ollama run Vorenthos-Instruct-7b
With llama.cpp / llama-cpp-python (GGUF)
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="vorenthiclabs/Vorenthos-Instruct-7b",
filename="*.gguf",
)
output = llm("Hello, who are you?", max_tokens=256)
print(output["choices"][0]["text"])
With Hugging Face transformers + GGUF support
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("vorenthiclabs/Vorenthos-Instruct-7b")
model = AutoModelForCausalLM.from_pretrained("vorenthiclabs/Vorenthos-Instruct-7b")
File Structure
| File | Description |
|---|---|
config.json | Ollama model configuration / metadata |
model-*.gguf | Quantised weights in GGUF format |
tokenizer.jinja | Chat template |
params.json | Generation parameters (temperature, top-p, …) |
system_prompt.txt | Default system prompt embedded in the model |
License
Please check the original model's license before redistribution.
This upload is provided as-is for research and experimentation.
About vorenthiclabs
Visit us at https://huggingface.co/vorenthiclabs.