Orythos-9B
While Qwythos is a model specialized in front-end design and reasoning capabilities, it lacks coding and agent-like functionality; therefore, the goal is to port Ornith's agent-like behavior to it.
Merge Details
Merge Method
It was merged using DARE-TIES based on Qwen/Qwen3.5-9B. The merge parameters and method were selected using CloudGoat/RoMM's router.py. The logs from router.py are as follows:
=======================================================================================================================================
[16:37:06] [INFO] RoMM Statistical Routing Summary [Stable Rank (D_eff)] (Z_slerp: +2.5σ, Z_conflict: -2.0σ, Mean ||v||: 8.0807)
[16:37:06] [INFO] =======================================================================================================================================
[16:37:06] [INFO] Layer | Cosine | D_eff | Z-score | Category | Method | ||dA|| | ||dB|| | Calibrated Parameters
[16:37:06] [INFO] ---------------------------------------------------------------------------------------------------------------------------------------
[16:37:06] [INFO] L0 | +0.000859 | 1779.4 | +0.04σ | Orthogonal/Moderate | DARE_TIES | 8.5413 | 1.5908 | w=[A:0.261, B:0.739] d=0.200
[16:37:06] [INFO] L1 | +0.001155 | 1637.9 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 8.7600 | 1.2983 | w=[A:0.246, B:0.754] d=0.200
[16:37:06] [INFO] L2 | +0.001124 | 1729.0 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 9.0479 | 1.2902 | w=[A:0.241, B:0.759] d=0.200
[16:37:06] [INFO] L3 | +0.001131 | 1310.2 | +0.04σ | Orthogonal/Moderate | DARE_TIES | 9.2043 | 1.4826 | w=[A:0.245, B:0.755] d=0.200
[16:37:06] [INFO] L4 | +0.001321 | 1562.7 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 9.9421 | 1.2857 | w=[A:0.227, B:0.773] d=0.200
[16:37:06] [INFO] L5 | +0.001187 | 1677.0 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 10.3982 | 1.3783 | w=[A:0.223, B:0.777] d=0.200
[16:37:06] [INFO] L6 | +0.000930 | 1629.4 | +0.04σ | Orthogonal/Moderate | DARE_TIES | 10.8374 | 1.7191 | w=[A:0.229, B:0.771] d=0.200
[16:37:06] [INFO] L7 | +0.001257 | 2028.2 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 11.0917 | 3.5998 | w=[A:0.297, B:0.703] d=0.200
[16:37:06] [INFO] L8 | +0.001245 | 2318.5 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 12.0419 | 3.6030 | w=[A:0.283, B:0.717] d=0.200
[16:37:06] [INFO] L9 | +0.001184 | 2306.0 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 12.4915 | 3.7002 | w=[A:0.279, B:0.721] d=0.200
[16:37:06] [INFO] L10 | +0.001270 | 1974.7 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 12.6918 | 3.7674 | w=[A:0.279, B:0.721] d=0.200
[16:37:06] [INFO] L11 | +0.001302 | 2190.4 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 12.7971 | 3.8055 | w=[A:0.279, B:0.721] d=0.200
[16:37:06] [INFO] L12 | +0.001218 | 1899.5 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 13.6662 | 3.8524 | w=[A:0.269, B:0.731] d=0.200
[16:37:06] [INFO] L13 | +0.001360 | 1874.0 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 14.0397 | 3.8960 | w=[A:0.266, B:0.734] d=0.200
[16:37:06] [INFO] L14 | +0.001320 | 1620.0 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 13.9480 | 3.8657 | w=[A:0.266, B:0.734] d=0.200
[16:37:06] [INFO] L15 | +0.001323 | 1661.6 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 13.8683 | 3.9140 | w=[A:0.268, B:0.732] d=0.200
[16:37:06] [INFO] L16 | +0.001287 | 1296.4 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 14.7141 | 3.8759 | w=[A:0.257, B:0.743] d=0.200
[16:37:06] [INFO] L17 | +0.001521 | 1421.4 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 15.0858 | 3.8054 | w=[A:0.250, B:0.750] d=0.200
[16:37:06] [INFO] L18 | +0.001550 | 1518.2 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 14.7944 | 3.6716 | w=[A:0.249, B:0.751] d=0.200
[16:37:06] [INFO] L19 | +0.001532 | 1902.5 | +0.07σ | Orthogonal/Moderate | DARE_TIES | 14.4013 | 3.8580 | w=[A:0.260, B:0.740] d=0.200
[16:37:06] [INFO] L20 | +0.001487 | 1690.8 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 14.8436 | 3.7270 | w=[A:0.251, B:0.749] d=0.200
[16:37:06] [INFO] L21 | +0.001540 | 1562.5 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 14.9207 | 3.7038 | w=[A:0.249, B:0.751] d=0.200
[16:37:06] [INFO] L22 | +0.001554 | 1730.2 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 14.7455 | 3.7406 | w=[A:0.252, B:0.748] d=0.200
[16:37:06] [INFO] L23 | +0.001576 | 1751.1 | +0.07σ | Orthogonal/Moderate | DARE_TIES | 14.2006 | 3.8843 | w=[A:0.263, B:0.737] d=0.200
[16:37:06] [INFO] L24 | +0.001638 | 1823.6 | +0.07σ | Orthogonal/Moderate | DARE_TIES | 14.2273 | 3.7918 | w=[A:0.260, B:0.740] d=0.200
[16:37:06] [INFO] L25 | +0.001520 | 1844.2 | +0.07σ | Orthogonal/Moderate | DARE_TIES | 14.1245 | 3.7967 | w=[A:0.261, B:0.739] d=0.200
[16:37:06] [INFO] L26 | +0.001268 | 1750.7 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 13.9964 | 3.7873 | w=[A:0.263, B:0.737] d=0.200
[16:37:06] [INFO] L27 | +0.001319 | 1692.1 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 14.1992 | 4.1041 | w=[A:0.270, B:0.730] d=0.200
[16:37:06] [INFO] L28 | +0.001437 | 1678.2 | +0.06σ | Orthogonal/Moderate | DARE_TIES | 14.1633 | 3.7930 | w=[A:0.261, B:0.739] d=0.200
[16:37:06] [INFO] L29 | +0.001411 | 1195.6 | +0.05σ | Orthogonal/Moderate | DARE_TIES | 13.8456 | 3.8167 | w=[A:0.265, B:0.735] d=0.200
[16:37:06] [INFO] L30 | +0.001404 | 793.4 | +0.04σ | Orthogonal/Moderate | DARE_TIES | 13.9985 | 3.8576 | w=[A:0.265, B:0.735] d=0.200
[16:37:06] [INFO] L31 | +0.001631 | 563.6 | +0.04σ | Orthogonal/Moderate | DARE_TIES | 12.4993 | 3.7773 | w=[A:0.282, B:0.718] d=0.200
[16:37:06] [INFO] =======================================================================================================================================
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
merge_method: dare_ties
base_model: Qwen/Qwen3.5-9B
dtype: bfloat16
parameters:
density: 0.2
models:
- model: ornith-ai/Ornith-1.5-9B
parameters:
weight:
- filter: layers.0.
value: 0.2612
- filter: layers.1.
value: 0.2464
- filter: layers.2.
value: 0.2412
- filter: layers.3.
value: 0.2453
- filter: layers.4.
value: 0.2268
- filter: layers.5.
value: 0.2231
- filter: layers.6.
value: 0.2289
- filter: layers.7.
value: 0.2971
- filter: layers.8.
value: 0.2826
- filter: layers.9.
value: 0.2795
- filter: layers.10.
value: 0.279
- filter: layers.11.
value: 0.2789
- filter: layers.12.
value: 0.2689
- filter: layers.13.
value: 0.2656
- filter: layers.14.
value: 0.2658
- filter: layers.15.
value: 0.2684
- filter: layers.16.
value: 0.2569
- filter: layers.17.
value: 0.2504
- filter: layers.18.
value: 0.2493
- filter: layers.19.
value: 0.26
- filter: layers.20.
value: 0.2506
- filter: layers.21.
value: 0.249
- filter: layers.22.
value: 0.2521
- filter: layers.23.
value: 0.2633
- filter: layers.24.
value: 0.2599
- filter: layers.25.
value: 0.2613
- filter: layers.26.
value: 0.2626
- filter: layers.27.
value: 0.2704
- filter: layers.28.
value: 0.2607
- filter: layers.29.
value: 0.2654
- filter: layers.30.
value: 0.2649
- filter: layers.31.
value: 0.2821
- value: 0.2599
- model: empero-ai/Qwythos-9B-Claude-Mythos-5-1M
parameters:
weight:
- filter: layers.0.
value: 0.7388
- filter: layers.1.
value: 0.7536
- filter: layers.2.
value: 0.7588
- filter: layers.3.
value: 0.7547
- filter: layers.4.
value: 0.7732
- filter: layers.5.
value: 0.7769
- filter: layers.6.
value: 0.7711
- filter: layers.7.
value: 0.7029
- filter: layers.8.
value: 0.7174
- filter: layers.9.
value: 0.7205
- filter: layers.10.
value: 0.721
- filter: layers.11.
value: 0.7211
- filter: layers.12.
value: 0.7311
- filter: layers.13.
value: 0.7344
- filter: layers.14.
value: 0.7342
- filter: layers.15.
value: 0.7316
- filter: layers.16.
value: 0.7431
- filter: layers.17.
value: 0.7496
- filter: layers.18.
value: 0.7507
- filter: layers.19.
value: 0.74
- filter: layers.20.
value: 0.7494
- filter: layers.21.
value: 0.751
- filter: layers.22.
value: 0.7479
- filter: layers.23.
value: 0.7367
- filter: layers.24.
value: 0.7401
- filter: layers.25.
value: 0.7387
- filter: layers.26.
value: 0.7374
- filter: layers.27.
value: 0.7296
- filter: layers.28.
value: 0.7393
- filter: layers.29.
value: 0.7346
- filter: layers.30.
value: 0.7351
- filter: layers.31.
value: 0.7179
- value: 0.7401
Benchmarks
On HumanEval, it ranked second among current community models.
| Rank | Model | HumanEval pass@1 | Solved Problems (equiv.) |
|---|---|---|---|
| 1 | Qwable3.5-9B | 90.24% | ~148/164 |
| 2 | Orythos-9B | 89.0% | ~146/164 |
| 3 | Qwopus3.5-9B-v3 | 87.80% | 144/164 |
| 4 | Qwen3.5-9B-Harmonic | 87.2% | ~143/164 |
| 5 | Qwythos-9B | 79.9% | ~131/164 |
| 6 | Qwythos-9B-v2 | 77.4% | 127/164 |
Credit
- Ornith-Ai: Creator of the Ornith model
- Empero-Ai: Creator of the Qwythos model
- Noitamina: Evaluator for the HumanEval Benchmark