WestLake_Noromaid_OpenHermes_neural-chatv0.1

This is a merge of pre-trained language models created using mergekit. DPO training data has been used to slightly uncensor the LLM. The model's focus is in conversational roleplay. In limited testing, I've been very happy with the result. It has been able to pick up stories where other models have failed or started to loop their responses, and it seems to pace the story well.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using mistralai/Mistral-7B-v0.1 as a base.

Models Merged

The following models were included in the merge:

• cognitivecomputations/WestLake-7B-v2-laser
• NeverSleep/Noromaid-7B-0.4-DPO
• teknium/OpenHermes-2.5-Mistral-7B
• Intel/neural-chat-7b-v3-3

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: mistralai/Mistral-7B-v0.1
    # No parameters necessary for base model
  - model: cognitivecomputations/WestLake-7B-v2-laser
    parameters:
      density: 0.55
      weight: 0.15
  - model: NeverSleep/Noromaid-7B-0.4-DPO
    parameters:
      density: 0.55
      weight: 0.35
  - model: teknium/OpenHermes-2.5-Mistral-7B
    parameters:
      density: 0.55
      weight: 0.30
  - model: Intel/neural-chat-7b-v3-3
    parameters:
      density: 0.55
      weight: 0.20
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
  int8_mask: true
dtype: bfloat16

Benchmark Testing

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

DPO training data used:

• unalignment/toxic-dpo-v0.2 (Curated version)