[!CAUTION] ⚠️ Warning: This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use Mistral Tekken chat template.
This is a merge of pre-trained language models created using mergekit. This model was merged using the Karcher merge method.
Goetia version 1.2 (Checkpoint S) represents a major upgrade over v1.1. Eighteen models were combined for this behemoth merge. The following changes were made to the Goetic pipeline:
Due to storage limits only select GGUFs are available. IQ quants were made with illuminati_imatrix_v1.txt.
Download GGUFs: Naphula/Goetia-24B-v1.2-GGUF
| Quant | Size |
|---|---|
| IQ1_S | 5.27 GB |
| IQ2_M | 8.11 GB |
| IQ3_M | 10.7 GB |
| IQ4_XS | 12.8 GB |
| IQ4_NL | 13.5 GB |
| Q5_K_M | 16.8 GB |
| Q6_K | 19.3 GB |
| Q8_K_XL | 29.8 GB |
I recommend these pages for other quantizations:
- team mradermacher and seeingterra for GGUF
- DeathGodlike and ArtusDev for EXL3
- McG-221 for MLX
architecture: MistralForCausalLM
merge_method: karcher
models:
# WeirdCompound, Circuitry and Rotor removed due to manifold distortion (over-triangulation)
# Dolphin Venice Edition and Broken Tutu removed due to 2501 incompatibility
# NousResearch/DeepHermes-3-Mistral-24B-Preview removed due to spamming <tool_call>
# - model: B:\hub\!models--DarkArtsForge--Morax-24B-v1 # Q0F Pass # Slerp PCA1 variance is too high for Karcher manifold
- model: B:\hub\!BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly # Q0F Pass # Lower PCA1 variance but higher PCA2 variance than MS2506 finetunes, L2 norms consistent
- model: B:\hub\!models--aixonlab--Eurydice-24b-v3.5 # Q0F Pass
- model: B:\hub\!models--allura-forge--ms32-final-TEXTONLY # Q0F Pass
# - model: B:\hub\!models--allura-forge--ms32-sft-merged # No KTO version # Q0F Pass
- model: B:\hub\!models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only
- model: B:\hub\!models--ConicCat--Mistral-Small-3.2-AntiRep-24B # Q0F Fail
# - model: B:\hub\!models--CrucibleLab--M3.2-24B-Loki-V1.3 # Q0F Pass
- model: B:\hub\!models--CrucibleLab--M3.2-24B-Loki-V2 # Q0F Pass # Louder novelty magnitude than 1.3
# - model: B:\hub\!models--Darkhn--M3.2-24B-Animus-V5.1-Pro # Q0F Pass
- model: B:\hub\!models--Darkhn--M3.2-24B-Animus-V7.1 # Q0F Pass # Louder novelty magnitude than 5.1
# - model: B:\hub\!models--Darkhn--Magistral-2509-24B-Text-Only # Scores lower at Q0B than MS2506
# - model: B:\hub\!models--Delta-Vector--Austral-24B-Winton # Q0F Fail # PCA1 variance is too high (manifold outlier)
# - model: B:\hub\!models--Delta-Vector--MS3.2-Austral-Winton # Q0F Fail
# - model: B:\hub\!models--Delta-Vector--Rei-24B-KTO # Q0F Fail
- model: B:\hub\!models--Doctor-Shotgun--MS3.2-24B-Magnum-Diamond # Q0F Pass
- model: B:\hub\!models--Gryphe--Codex-24B-Small-3.2 # Q0F Pass
# - model: B:\hub\!models--Gryphe--Pantheon-RP-1.8-24b-Small-3.1 # Q0F Fail
# - model: B:\hub\!models--LatitudeGames--Harbinger-24B # Q0F Fail
- model: B:\hub\!models--LatitudeGames--Hearthfire-24B # Q0F Pass # Elevated PCA1 and PCA2 variance
- model: B:\hub\!models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b # Q0F Fail
- model: B:\hub\!models--ReadyArt--Dark-Nexus-24B-v2.0 # Q0F Pass
- model: B:\hub\!models--ReadyArt--MS3.2-The-Omega-Directive-24B-Unslop-v2.1 # Q0F Fail
# - model: B:\hub\!models--SicariusSicariiStuff--Impish_Magic_24B\fixed # Q0F Pass # Removed due to tokenizer and lm_head incompatibility
# - model: B:\hub\!models--TheDrummer--Cydonia-24B-v4.3 # Q0F Pass # Swapping this for v4.2.0 results in vastly increased refusals
# - model: B:\hub\!models--TheDrummer--Magidonia-24B-v4.3 # Q0F Pass
- model: B:\hub\!models--TheDrummer--Cydonia-24B-v4.2.0 # Q0F Pass
# - model: B:\hub\!models--TheDrummer--Cydonia-24B-v4.1 # Q0F Fail
# - model: B:\hub\!models--TheDrummer--Cydonia-24B-v4 # Q0F Fail
- model: B:\hub\!models--TheDrummer--Precog-24B-v1 # Q0F Pass # Just as smart as Cydonia v4.3 but less censored
# - model: B:\hub\!models--TheDrummer--Rivermind-24B-v1 # Q0F Pass
- model: B:\hub\!models--trashpanda-org--MS3.2-24B-Mullein-v2 # Q0F Fail (but still impressive)
# - model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-24B # Q0F Fail
- model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-v2-24B # Q0F Pass
- model: B:\hub\!models--zerofata--MS3.2-PaintedFantasy-v3-24B # Q0F Fail
dtype: bfloat16 # normally would be float32, but for this particular 18-set combo bfloat16 helps uncensor it
out_dtype: bloat16 # even more strange is that nulling out dtype and out_dtype is still as uncensored but less smart than both at bfloat16
parameters:
tokenizer:
source: union
chat_template: auto
name: Goetia-24B-v1.2
# --- OUTLIER ANALYSIS --- `audit_karcher_v2.py`
# [OUTLIER] !models--DarkArtsForge--Morax-24B-v1 | Dist: 42.5302 | Norm: 33.1133 | Size: 83886080
# [OK] !BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly | Dist: 3.6364 | Norm: 33.9199 | Size: 83886080
# [OK] !models--aixonlab--Eurydice-24b-v3.5 | Dist: 3.5703 | Norm: 33.9450 | Size: 83886080
# [OK] !models--allura-forge--ms32-final-TEXTONLY | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--allura-forge--ms32-sft-merged | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--anthracite-core--Mistral-Small-3.2-24B-Instruct-2506-Text-Only | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--ConicCat--Mistral-Small-3.2-AntiRep-24B | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--CrucibleLab--M3.2-24B-Loki-V1.3 | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--CrucibleLab--M3.2-24B-Loki-V2 | Dist: 2.9845 | Norm: 33.5444 | Size: 83886080
# [OK] !models--Darkhn--M3.2-24B-Animus-V5.1-Pro | Dist: 2.9710 | Norm: 33.4006 | Size: 83886080
# [OK] !models--Darkhn--M3.2-24B-Animus-V7.1 | Dist: 2.9715 | Norm: 33.4072 | Size: 83886080
# [OUTLIER] !models--Delta-Vector--Austral-24B-Winton | Dist: 43.1327 | Norm: 33.9546 | Size: 83886080
# [OK] !models--Delta-Vector--MS3.2-Austral-Winton | Dist: 2.8134 | Norm: 33.4469 | Size: 83886080
# [OK] !models--Delta-Vector--Rei-24B-KTO | Dist: 2.9708 | Norm: 33.3995 | Size: 83886080
# [OK] !models--Doctor-Shotgun--MS3.2-24B-Magnum-Diamond | Dist: 2.8897 | Norm: 33.4906 | Size: 83886080
# [OK] !models--Gryphe--Codex-24B-Small-3.2 | Dist: 2.8134 | Norm: 33.4469 | Size: 83886080
# [OK] !models--Gryphe--Pantheon-RP-1.8-24b-Small-3.1 | Dist: 3.5656 | Norm: 33.9456 | Size: 83886080
# [OK] !models--LatitudeGames--Harbinger-24B | Dist: 3.5357 | Norm: 33.9544 | Size: 83886080
# [OK] !models--LatitudeGames--Hearthfire-24B | Dist: 2.9205 | Norm: 33.4135 | Size: 83886080
# [OK] !models--PocketDoc--Dans-PersonalityEngine-V1.3.0-24b | Dist: 4.1727 | Norm: 34.3632 | Size: 83886080
# [OK] !models--ReadyArt--Dark-Nexus-24B-v2.0 | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--ReadyArt--MS3.2-The-Omega-Directive-24B-Unslop-v2.1 | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] impish magic fixed | Dist: 3.2572 | Norm: 32.2877 | Size: 83886080
# [OK] !models--TheDrummer--Cydonia-24B-v4.3 | Dist: 2.9062 | Norm: 33.4101 | Size: 83886080
# [OK] !models--TheDrummer--Magidonia-24B-v4.3 | Dist: 4.0489 | Norm: 32.3734 | Size: 83886080
# [OK] !models--TheDrummer--Cydonia-24B-v4.2.0 | Dist: 2.9723 | Norm: 33.4174 | Size: 83886080
# [OK] !models--TheDrummer--Precog-24B-v1 | Dist: 3.7905 | Norm: 32.3252 | Size: 83886080
# [OK] !models--TheDrummer--Rivermind-24B-v1 | Dist: 2.9277 | Norm: 33.3765 | Size: 83886080
# [OK] !models--trashpanda-org--MS3.2-24B-Mullein-v2 | Dist: 2.9708 | Norm: 33.3997 | Size: 83886080
# [OK] !models--zerofata--MS3.2-PaintedFantasy-24B | Dist: 2.9708 | Norm: 33.3995 | Size: 83886080
# [OK] !models--zerofata--MS3.2-PaintedFantasy-v2-24B | Dist: 2.9708 | Norm: 33.3994 | Size: 83886080
# [OK] !models--zerofata--MS3.2-PaintedFantasy-v3-24B | Dist: 4.0706 | Norm: 32.4415 | Size: 83886080
Ban em dashes and ellipses (or set to -50 logit bias) to reduce slop:
—||$||...||$||…
Experiment with these settings:
(bolded kobold non-defaults)
- Temp 1.0
- TopNSigma 1.25
- Min-P 0.1
- Repetition Penalty 1.08
- Top-P 1.0
- Top-K 100
- Top-A 0
- Typical Sampling 1
- Tail-Free Sampling 1
- Presence Penalty 0
- Sampler Seed -1
- Rp.Range 360
- Rp.Slope 0.7
- Smoothing Factor 0
- Smoothing Curve 1
- DynaTemp 0
- Mirostat Mode OFF ("2" enhances creativity but also errors)
- Mirostat Tau 5
- Mirostat Eta 0.1
- DRY Multiplier 0.8
- DRY Base 1.75
- DRY A.Len 2
- DRY L.Len 320
- XTC Threshold 0.1
- XTC Probability 0.08 (The "Anti-Cliche" Shield)
- DynaTemp ON (The "Poor Man's Fading Mirostat")
- Minimum Temperature 0.65
- Maximum Temperature 1.35
- Temperature 1.0
- DynaTemp-Range 0.35
- DynaTemp-Exponent 1