NV-Embed-v2 (Migrated for transformers 5.0+ compatibility)
This is a migrated version of nvidia/NV-Embed-v2 that is compatible with transformers 5.0.0 and later versions.
Changes from Original
The only change made is adding an all_tied_weights_keys property to the NVEmbedModel class in modeling_nvembed.py. This property provides backward compatibility with the transformers library, which changed from using _tied_weights_keys (a class attribute) to all_tied_weights_keys (a property that returns a dict) in version 5.0.0.
The Patch
@property
def all_tied_weights_keys(self):
"""Compatibility property for transformers >= 5.0.0."""
if hasattr(self, '_tied_weights_keys') and self._tied_weights_keys:
return {key: key for key in self._tied_weights_keys}
return {}
Usage
from transformers import AutoModel, AutoTokenizer
model = AutoModel.from_pretrained("Hyukkyu/nv-embed-v2", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("Hyukkyu/nv-embed-v2", trust_remote_code=True)
Original Model
This model is based on nvidia/NV-Embed-v2. Please refer to the original repository for:
- Model architecture details
- Training information
- Benchmarks and evaluation results
- Citation information
License
This model inherits the license from the original repository. Please check nvidia/NV-Embed-v2 for license details.
Migration Tool
This model was migrated using the GenZ model migration tool. The migration script is available at: https://github.com/your-repo/GenZ/tree/main/scripts/preprocess/model
Compatibility
- transformers: >= 5.0.0
- torch: >= 2.0.0
- Python: >= 3.9