Chaotic-Harmony
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using Sorihon/Celestial-Order-24B-V3 as a base.
Models Merged
The following models were included in the merge:
- TheDrummer/Cydonia-24B-v4.2.0
- C:\Chaotic-Order-24B-V3
Configuration
The following YAML configuration was used to produce this model:
merge_method: dare_ties
base_model: Sorihon/Celestial-Order-24B-V3
models:
- model: TheDrummer/Cydonia-24B-v4.2.0
parameters:
density: 0.8
weight: 0.6
- model: C:\Chaotic-Order-24B-V3
parameters:
density: 0.6
weight: 0.4
dtype: bfloat16
normalize: false