Description
This repo contains fp16 files of Utopia-13B, a merge I have done with the new task_arithmetic merge method from mergekit.
Models and loras used
- Xwin-LM/Xwin-LM-13B-V0.2
- NeverSleep/Nethena-13B
- PygmalionAI/pygmalion-2-13b
- Undi95/Storytelling-v2.1-13B-lora
- zattio770/120-Days-of-LORA-v2-13B
- lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT
The sauce
Xwin-LM/Xwin-LM-13B-V0.2
Undi95/Storytelling-v2.1-13B-lora
=> p1
NeverSleep/Nethena-13B
zattio770/120-Days-of-LORA-v2-13B
=> p2
PygmalionAI/pygmalion-2-13b
lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT
=> p3
merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
- model: TheBloke/Llama-2-13B-fp16
- model: Undi95/newpart1
parameters:
weight: 1.0
- model: Undi95/newpart2
parameters:
weight: 0.45
- model: Undi95/newpart3
parameters:
weight: 0.33
dtype: float16
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
If you want to support me, you can here.