merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using unsloth/Mistral-Small-Instruct-2409 as a base.
Models Merged
The following models were included in the merge:
- TheDrummer/Cydonia-22B-v1.1
- TroyDoesAI/BlackSheep-MermaidMistral-22B
- DigitalSouls/BlackSheep-DigitalSoul-22B
- Kaoeiri/MS_fujin-2409-22B
- Kaoeiri/MS-Inky-2409-22B
- crestf411/MS-sunfall-v0.7.0
- Kaoeiri/MS_Moingooistral-2409-22B
- Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small
- InferenceIllusionist/SorcererLM-22B
- hf-100/Mistral-Small-Spellbound-StoryWriter-22B-instruct-0.2-chkpt-200-16-bit
- Envoid/Mistral-Small-NovusKyver
- Kaoeiri/MS_dampf-2409-22B
- Kaoeiri/MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-6
- Darkknight535/MS-Moonlight-22B-v3
- Kaoeiri/MS_a-coolyte-2409-22B
- ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
Configuration
The following YAML configuration was used to produce this model:
models:
# Primary Fiction Core (Rebalanced for character focus)
- model: Kaoeiri/MS_Moingooistral-2409-22B # Monster fiction core
parameters:
weight: 0.22 # Reduced from 0.28
density: 0.72 # Adjusted for balance
- model: Kaoeiri/MS-Magpantheonsel-lark-v4x1.6.2RP-Cydonia-vXXX-22B-6 # Main writing engine
parameters:
weight: 0.72 # Increased to compensate for other reductions
density: 0.78 # Increased for better detail
# World Building & Character Focus (Enhanced)
- model: Kaoeiri/MS-Inky-2409-22B # World dynamics with character focus
parameters:
weight: 0.42 # Increased for stronger character-world integration
density: 0.85 # Increased for richer character detail
- model: Gryphe/Pantheon-RP-Pure-1.6.2-22b-Small # Character interaction specialist
parameters:
weight: 0.48 # Increased for deeper character development
density: 0.82 # Enhanced for personality detail
# Combat & Magic (Rebalanced)
- model: DigitalSouls/BlackSheep-DigitalSoul-22B # Combat
parameters:
weight: 0.16 # Significantly reduced
density: 0.70 # Maintained for quality
- model: InferenceIllusionist/SorcererLM-22B # Magical elements
parameters:
weight: 0.35 # Increased to maintain magical detail
density: 0.78 # Enhanced for better integration
# Story Elements (Adjusted)
- model: TheDrummer/Cydonia-22B-v1.1
parameters:
weight: 0.22 # Slight increase for narrative depth
density: 0.72
- model: crestf411/MS-sunfall-v0.7.0 # Writing enhancement
parameters:
weight: 0.22 # Increased for better writing quality
density: 0.75
- model: Kaoeiri/MS_a-coolyte-2409-22B # Character style content
parameters:
weight: 0.25 # Increased for better character elements
density: 0.76
# Ideas Generation
- model: Kaoeiri/MS_fujin-2409-22B
parameters:
weight: 0.07 # Significantly reduced
density: 0.62
- model: Kaoeiri/MS_dampf-2409-22B
parameters:
weight: 0.12
density: 0.68
# Story Enhancement & Character Detail
- model: hf-100/Mistral-Small-Spellbound-StoryWriter-22B-instruct-0.2-chkpt-200-16-bit
parameters:
weight: 0.28 # Increased for better story-character integration
density: 0.75
- model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1 # Character interaction
parameters:
weight: 0.18 # Increased for better character dynamics
density: 0.68
- model: Darkknight535/MS-Moonlight-22B-v3 # Character detail specialist
parameters:
weight: 0.22 # Increased for deeper character profiles
density: 0.72
- model: Envoid/Mistral-Small-NovusKyver # Maintained core functionality
parameters:
weight: 0.12 # Reduced to minimize instruction avoidance
density: 0.65 # Adjusted down to reduce negative behaviors
- model: TroyDoesAI/BlackSheep-MermaidMistral-22B # Character moments
parameters:
weight: 0.25 # Slight increase for character interaction
density: 0.74 # Increased for better detail
merge_method: dare_ties
base_model: unsloth/Mistral-Small-Instruct-2409
parameters:
density: 0.98 # Increased for maximum character detail
epsilon: 0.047 # Reduced for better consistency
lambda: 1.58 # Increased for creative elements while maintaining coherence
dtype: bfloat16
tokenizer_source: union