multi-qa-MiniLM-L6-cos-v1 (ANEForge)
An unmodified duplicate of sentence-transformers/multi-qa-MiniLM-L6-cos-v1, tagged for use with
ANEForge so the weights load and run directly on the
Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for
the model details. See the original repo for license terms.
Use with ANEForge
# pip install "aneforge[models]"
from aneforge.sentence_transformers import SentenceTransformer
model = SentenceTransformer("aneforge/multi-qa-MiniLM-L6-cos-v1")
emb = model.encode(["Hello from the Neural Engine"], normalize_embeddings=True)
ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo
via huggingface_hub. See the docs and the paper.