miscii-14b-1028
Role-based Instructions
Just parse the following as your system prompt.
Note there is NO special-tokens here.
An example system prompt:
system_prompt: str = (
"""<|context_start|>personas<|context_sep|>
<|persona_start|>user<|persona_sep|>
{user_persona}<|persona_end|>
<|persona_start|>assistant<|persona_sep|>
{assistant_persona}<|persona_end|><|context_end|>""".format(
user_persona="""I am Miscii.
I am the designer of Sthenno.
[Optional: Additional statements]""",
assistant_persona="""I am Sthenno.
I speak in Chinese.
[Optional: Additional statements]""",
)
)
Training
See Report for miscii-1020 for more details.
Open LLM Leaderboard Evaluation Results (0215)
| Metric | Value |
|---|---|
| Avg. | 35.05 |
| IFEval (0-Shot) | 82.37 |
| BBH (3-Shot) | 49.26 |
| MATH Lvl 5 (4-Shot) | 6.34 |
| GPQA (0-shot) | 14.21 |
| MuSR (0-shot) | 12.00 |
| MMLU-PRO (5-shot) | 46.14 |
Open LLM Leaderboard Evaluation Results
Refined:
| Metric | Value |
|---|---|
| Avg. | 42.38 |
| IFEval (0-Shot) | 82.37 |
| BBH (3-Shot) | 49.26 |
| MATH Lvl 5 (4-Shot) | 50.30 |
| GPQA (0-shot) | 14.21 |
| MuSR (0-shot) | 12.00 |
| MMLU-PRO (5-shot) | 46.14 |
$$\large{\text{There's nothing more to Show}}$$