Apertus 1.5 8B — QLoRA (BIOMEDICAL_ADE)

⚠️ CRITICAL DISCLAIMER: HIGHLY EXPERIMENTAL RESEARCH MODEL
This model is a proof-of-concept research artifact developed exclusively for academic experimentation, demonstration, and benchmarking purposes.

• NOT FOR CLINICAL USE: This system is NOT a certified medical device and must NEVER be used to provide medical advice, diagnosis, triage, or clinical decision support.
• INCORRECT OR INCOMPLETE OUTPUT: The outputs may omit severe drug reactions or state side effects that do not exist. Always rely on certified clinical pharmacologists and authorized medical references.
• The authors and contributors assume no liability for any direct or indirect damages resulting from the use or misuse of this model.

Fine-tuned from andreasmartin/apertus-v1.5-8b-text on mihirhirave/entity_extraction_ade_v2_with_validation.

This repository contains the complete standalone fine-tuned model in 16-bit Safetensors format.

Example Prompts & Expected Outputs

Example 1: Multi-Drug Toxicity Detection

Prompt:

You are an expert biomedical information extraction system. Extract all mentioned drugs and adverse drug events (ADEs) from the clinical narrative as JSON.

Clinical Narrative:
"A 64-year-old female patient with chronic atrial fibrillation presented with severe bradycardia, visual yellow halos, and nausea after increasing her digoxin dosage to 0.25 mg daily. Electrocardiogram confirmed digitalis toxicity. Concurrently, she had been prescribed amiodarone two weeks earlier."

Model Output:

{
  "drugs": ["digoxin", "amiodarone"],
  "adverse_drug_events": ["severe bradycardia", "visual yellow halos", "nausea"]
}

Example 2: Negative Control

Prompt:

You are an expert biomedical information extraction system. Extract all mentioned drugs and adverse drug events (ADEs) from the clinical narrative as JSON.

Clinical Narrative:
"The patient was initiated on metformin 500 mg twice daily for type 2 diabetes mellitus and reported good glycemic control without any adverse symptoms."

Model Output:

{
  "drugs": ["metformin"],
  "adverse_drug_events": []
}

Quickstart

vLLM

vllm serve andreasmartin/apertus-1.5-8b-biomedical-ade-qlora-exercise-60steps-20260928-072251 --tensor-parallel-size 1 --gpu-memory-utilization 0.9

Transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("andreasmartin/apertus-1.5-8b-biomedical-ade-qlora-exercise-60steps-20260928-072251")
model = AutoModelForCausalLM.from_pretrained(
    "andreasmartin/apertus-1.5-8b-biomedical-ade-qlora-exercise-60steps-20260928-072251",
    device_map="auto",
)

Training Configuration & Metrics