all-MiniLM-L6-v2 (ANEForge)
An unmodified duplicate of sentence-transformers/all-MiniLM-L6-v2, tagged for use with
ANEForge so the weights load and run directly on the
Apple Neural Engine (no CoreML). Weights are byte-identical to the source; see the original repo for
the model details. Licensed apache-2.0 from the source.
Use with ANEForge
# pip install "aneforge[models]"
from aneforge.sentence_transformers import SentenceTransformer
model = SentenceTransformer("aneforge/all-MiniLM-L6-v2")
emb = model.encode(["Hello from the Neural Engine"], normalize_embeddings=True)
ANEForge compiles the model's graph into a single ANE program and streams the weights from this repo
via huggingface_hub. See the docs and the
paper.