DPO Finetuned Kukedlc/NeuTrixOmniBe-7B-model-remix using argilla/OpenHermes2.5-dpo-binarized-alpha
argilla dpo binarized pairs is a dataset built on top of: https://huggingface.co/datasets/teknium/OpenHermes-2.5 using https://github.com/argilla-io/distilabel if interested.
Thx for the great data sources.
GGUF: https://huggingface.co/eren23/dpo-binarized-NeutrixOmnibe-7B-GGUF
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 76.31 |
| AI2 Reasoning Challenge (25-Shot) | 72.78 |
| HellaSwag (10-Shot) | 89.05 |
| MMLU (5-Shot) | 64.60 |
| TruthfulQA (0-shot) | 76.90 |
| Winogrande (5-shot) | 85.08 |
| GSM8k (5-shot) | 69.45 |