DarkForest 20B v1.1
Model Details
- To create this model two step procedure was used. First a new 20B model was created using microsoft/Orca-2-13b and KoboldAI/LLaMA2-13B-Erebus-v3 , deatils of the merge in mergekit-config_step1.yml
- then jebcarter/psyonic-cetacean-20B was used to produce the final model, merge config in mergekit-config-step2.yml
- instead of linear merge method used in v1.0, this time DARE TIES method was used for step2
- The resulting model has approximately 20 billion parameters.
Warning: This model can produce NSFW content!
Results
- produces SFW nad NSFW content without issues, switches context seamlessly.
- good at following instructions.
- good at tracking multiple characters in one scene.
- very creative, scenarios produced are mature and complicated, model doesn't shy from writing about PTSD, menatal issues or complicated relationships.
- NSFW output is more creative and suprising than typical limaRP output.
- definitely for mature audiences, not only because of vivid NSFW content but also because of overall maturity of stories it produces.
- This is NOT Harry Potter level storytelling.
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 61.46 |
| AI2 Reasoning Challenge (25-Shot) | 63.57 |
| HellaSwag (10-Shot) | 86.42 |
| MMLU (5-Shot) | 59.77 |
| TruthfulQA (0-shot) | 56.31 |
| Winogrande (5-shot) | 77.74 |
| GSM8k (5-shot) | 24.94 |