Shh, don't say that! Domain Certification in LLMs
Collection: https://huggingface.co/collections/cemde/domain-certification-67ba4fb663f8d1348c3c2263
Certify you Large Language Model (LLM)!
With the code in this repository you can reproduce the workflows we use in our ICLR 2025 paper to achieve Domain Certification using our VALID algorithm.
We provide the guide models for our Medical Question Answering experiments.
| Model | Description |
|---|---|
| cemde/Domain-Certification-MedQA-Guide-Base | This is the base model trained on the ground-truth responses. |
| cemde/Domain-Certification-MedQA-Guide-Finetuned | This is the model trained on responses from Llama-3-8B. |
Citation
@inproceedings{
emde2025shh,
title={Shh, don't say that! Domain Certification in {LLM}s},
author={Cornelius Emde and Alasdair Paren and Preetham Arvind and Maxime Guillaume Kayser and Tom Rainforth and Bernard Ghanem and Thomas Lukasiewicz and Philip Torr and Adel Bibi},
booktitle={The Thirteenth International Conference on Learning Representations},
year={2025},
url={https://arxiv.org/abs/2502.19320}
}