lean-premise-distilroberta-GGUF
f16 GGUF conversion of
l3lab/all-distilroberta-v1-lr2e-4-bs256-nneg3-ml-ne2
(revision v4.30.0), Thomas Zhu's premise-selection embedding model for Lean 4 / Mathlib.
Used by CanonicalDrafter as the
embedding model for premise-server
(from the FrederickPu/llama.cpp fork,
branch canonical-drafter-prefill-hook), serving /cache and /select for the
premiseSelector library-suggestions hook:
premise-server -m thomas-zhu-lean-premise.f16.gguf --host 127.0.0.1 --port 8766 --pooling mean --ctx-size 512
Converted with that fork's convert_hf_to_gguf.py --outtype f16.