Thomas Zhu Lean Premise GGUF
GGUF conversion of the Lean premise embedding model used by hanwenzhu/lean-premise-server.
- Source model:
l3lab/all-distilroberta-v1-lr2e-4-bs256-nneg3-ml-ne2 - Source revision:
v4.30.0 - Architecture:
RobertaModel - Converted file:
thomas-zhu-lean-premise.f16.gguf
Example with joint-server in non-joint premise mode:
server/build/joint-server.exe --host 127.0.0.1 --port 8081 --model D:/hparam_outputs/thomas-zhu-lean-premise.f16.gguf --no-joint --pooling mean --ctx-size 512
Use /version, /cache, and /select for premise retrieval. Autoregressive chat generation is intentionally rejected in --no-joint mode.