KRONOS V1 P2
This is a merge of Meta Llama 3.1 Instruct and the "Propositional Logic" LORA, created using llm-tools.
The primary purpose of this model is to be merged into other models in the same family using the TIES merge method.
Creating quants for this is entirely unnecessary.
Merge Details
Configuration
The following Bash command was used to produce this model:
python /llm-tools/merge-lora.py -m unsloth/Meta-Llama-3.1-8B-Instruct -l ergotts/llama_3.1_8b_prop_logic_ft
Open LLM Leaderboard Evaluation Results
Detailed results can be found here! Summarized results can be found here!
| Metric | Value (%) |
|---|---|
| Average | 23.99 |
| IFEval (0-Shot) | 67.24 |
| BBH (3-Shot) | 25.86 |
| MATH Lvl 5 (4-Shot) | 12.92 |
| GPQA (0-shot) | 5.59 |
| MuSR (0-shot) | 5.06 |
| MMLU-PRO (5-shot) | 27.26 |