A product of an amateur merger. I like it due to the fact that it combines both Orca2 understanding and Pyg's dialogue style (using mythalion for consistency). - shotmisser64
This model was made by ShotMisser64 using the following mergekit yaml:
slices:
- sources:
- model: output/Orca2flat
layer_range: [0, 13]
- sources:
- model: PygmalionAI/mythalion-13b
layer_range: [3, 22]
- sources:
- model: output/Orca2flat
layer_range: [14, 27]
- sources:
- model: PygmalionAI/mythalion-13b
layer_range: [23, 40]
merge_method: passthrough
dtype: float16
The Orca2flat model uses the following mergekit yaml:
merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
- model: TheBloke/Llama-2-13B-fp16
- model: microsoft/Orca-2-13b
parameters:
weight: 1.0
dtype: float16
Found something interesting or would you like your own custom merge? Visit our community at https://koboldai.org/discord
Please respect the license of the origin models.