• 📖 Paper: To Adapt or not to Adapt, Rethinking the Value of Medical Knowledge-Aware Large Language Models

How to Get Started with the Model

You can use the model with the transformers pipeline (it uses the Llama 3.1 chat template):

import torch
from transformers import pipeline

pipe = pipeline(
    "text-generation",
    model="HiTZ/Marmoka-en-Llama-3.1-8B-Instruct",
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "system", "content": "You are a medical expert. Answer the multiple-choice question with only the letter of the correct option."},
    {"role": "user", "content": "Which vitamin deficiency causes scurvy?\nA) Vitamin A\nB) Vitamin B12\nC) Vitamin C\nD) Vitamin D"},
]

outputs = pipe(messages, max_new_tokens=256)
print(outputs[0]["generated_text"][-1]["content"])

Model Description

• Developed by: Ane G. Domingo-Aldama, Iker De La Iglesia, Maitane Urruela, Aitziber Atutxa, and Ander Barrena
• Contact: Ane G. Domingo-Aldama and Iker De La Iglesia
• Language(s) (NLP): English
• License: apache-2.0
• Funding:
  • The Spanish Ministry of Science, Innovation and Universities, MCIN/AEI/10.13039/501100011033 projects:
    • EDHIA PID2022-136522OB-C22 (also supported by FEDER, UE).
    • TRUST-MED PID2025-174880OB-I00 (also supported by FEDER, UE).
    • DeepR3 TED2021-130295B-C31 (also supported by the European Union NextGenerationEU/PRTR).
  • Basque Government:
    • Research group funding IT1570-22.
  • HiTZ Center.
  • Predoctoral grants: FPU23/03347 (I. De La Iglesia, Spanish Ministry of Science, Innovation and Universities), PRE_2024_1_0224 (A. G. Domingo-Aldama) and PRE_2025_1_0177 (M. Urruela), Basque Government.

Model Details

Training Data

Limitation and Bias

Biases

Disclaimer

Citing information

@article{domingo2026adapt,
  title={To Adapt or not to Adapt, Rethinking the Value of Medical Knowledge-Aware Large Language Models},
  author={Domingo-Aldama, Ane G and De La Iglesia, Iker and Urruela, Maitane and Atutxa, Aitziber and Barrena, Ander},
  journal={arXiv preprint arXiv:2604.06854},
  year={2026}
}