merged
This is a merge of pre-trained language models created using mergekit.
Data
i didn't add any new data so nothing, I just merged the models
🧪 Intended Use
This model is designed mainly for:
- Roleplay and creative writing
😷 Ethical Containment
This model can:
- ⚠️ Generating unfiltered creative content
- ⚠️ Producing potentially disturbing narratives
- ⚠️ Creating NSFW content
Merge Details
Merge Method
This model was merged using the Model Stock merge method using Retreatcost/KansenSakura-Erosion-RP-12b as a base.
Models Merged
The following models were included in the merge:
- SicariusSicariiStuff/Impish_Nemo_12B
- inflatebot/guns-and-roses-r1
- Retreatcost/Forgotten-directive-Neon-stock
- FallenMerick/MN-Violet-Lotus-12B
⚖️ License
Follow the licensing terms of each merged model:
Each source model’s license applies
Configuration
The following YAML configuration was used to produce this model:
base_model: Retreatcost_KansenSakura-Erosion-RP-12b
dtype: bfloat16
merge_method: model_stock
modules:
default:
slices:
- sources:
- layer_range: [0, 40]
model: Retreatcost/Forgotten-directive-Neon-stock
parameters:
weight: 0.2
- layer_range: [0, 40]
model: Retreatcost/KansenSakura-Erosion-RP-12b
parameters:
weight: 0.3
- layer_range: [0, 40]
model: SicariusSicariiStuff/Impish_Nemo_12B
parameters:
weight: 0.3
- layer_range: [0, 40]
model: inflatebot/guns-and-roses-r1
parameters:
weight: 0.15
- layer_range: [0, 40]
model: FallenMerick/MN-Violet-Lotus-12B
parameters:
weight: 0.15
parameters:
normalize: 1.0
tokenizer:
source: base
✨ Acknowledgements
Thanks to the authors of the original models for their incredible work:
-
SicariusSicariiStuff for Impish Nemo 12B
-
Retreatcost for KansenSakura-Erosion-RP-12b and Forgotten-directive-Neon-stock
-
inflatebot for guns-and-roses-r1
-
FallenMerick for MN-Violet-Lotus-12B