out_cleanpool_v2_w30
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using Qwen/Qwen3-0.6B as a base.
Models Merged
The following models were included in the merge:
- mrfakename/dreamwriter-0.6b-beta
- prithivMLmods/Cerium-Qwen3-R1-Dev
- suayptalha/Qwen3-0.6B-Treatment
- suayptalha/Qwen3-0.6B-Diagnose
- prithivMLmods/Nenque-MoT-0.6B-Elite14
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Qwen/Qwen3-0.6B
- model: suayptalha/Qwen3-0.6B-Treatment
parameters:
density: 0.53
weight: 0.3
- model: suayptalha/Qwen3-0.6B-Diagnose
parameters:
density: 0.53
weight: 0.3
- model: mrfakename/dreamwriter-0.6b-beta
parameters:
density: 0.53
weight: 0.3
- model: prithivMLmods/Nenque-MoT-0.6B-Elite14
parameters:
density: 0.53
weight: 0.3
- model: prithivMLmods/Cerium-Qwen3-R1-Dev
parameters:
density: 0.53
weight: 0.3
merge_method: dare_ties
base_model: Qwen/Qwen3-0.6B
parameters:
int8_mask: true
dtype: bfloat16