merged
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the TIES merge method using deepseek-ai/DeepSeek-R1-Distill-Llama-8B as a base.
Models Merged
The following models were included in the merge:
- arcee-ai/Llama-3.1-SuperNova-Lite
- FuseAI/FuseChat-Llama-3.1-8B-Instruct
- richardyoung/Llama-3.1-8B-Instruct-abliterated-obliteratus
Configuration
The following YAML configuration was used to produce this model:
base_model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
dtype: bfloat16
merge_method: ties
models:
- model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
parameters:
density: 0.5
weight: 0.35
- model: arcee-ai/Llama-3.1-SuperNova-Lite
parameters:
density: 0.5
weight: 0.3
- model: FuseAI/FuseChat-Llama-3.1-8B-Instruct
parameters:
density: 0.5
weight: 0.25
- model: richardyoung/Llama-3.1-8B-Instruct-abliterated-obliteratus
parameters:
density: 0.5
weight: 0.1
parameters:
normalize: true