Alduin 4B

This model is a heretic version based on Gemma 3 4B and meant to be an uncensored limitless version of the original model.

I have personally been working on how models can be uncensored and I did this on a single H100 SXM (which I believe is a little bit of an overkill for this model) on RunPod and it took a few hours of my time working and getting things to work.

The name

It comes from The world eater dragon from skyrim.

Legal Responsibility

I personally made it as a personal fun projects. If you do something illegal with this, I will take ABSOLUTELY NO RESPONSIBILITY on that. Be careful with this model.

How to run (it can be executed on Google Colab even unquantized):

from transformers import pipeline
import torch

pipe = pipeline(
    "image-text-to-text",
    model="Muhammadreza/alduin-4b-it-base",
    device="cuda",
    torch_dtype=torch.bfloat16
)

messages = [
    {
        "role": "user",
        "content": "What is the answer to life, universe and everything?"
    }
]

output = pipe(text_inputs=messages, max_new_tokens=1000)
print(output[0]["generated_text"][-1]["content"])

or if you want the vision capabilities:

messages = [
    {
        "role": "system",
        "content": "You are a helpful assistant"
    },
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    }
]

output = pipe(text=messages, max_new_tokens=1000)
print(output[0]["generated_text"][-1]["content"])

P.S : Since I have equipment for executing this model, I personally didn't provide a quantized version. If you can, please provide Ollama friendly quantizations.

Known Issues

• Image input doesn't work (Fixed)