MiquMaid v3
Check out our blogpost about this model series Here! - Join our Discord server Here!
This model uses the Alpaca prompting format
Model trained for RP conversation on Miqu-70B with our magic sauce. Then we made an enormous merge containing all out old iteration of Miqumaid, and some other RP Miqu based model, with the new Model Stock merging method.
Credits:
- Undi
- IkariDev
Description
This repo contains FP16 files of MiquMaid-v3-70B.
Training data used:
- Aesir datasets
- NoRobots
- limarp - 8k ctx
- toxic-dpo-v0.1-sharegpt
- ToxicQAFinal
- Luminae-i1 - Ikari's Dataset
- Squish42/bluemoon-fandom-1-1-rp-cleaned - 50% (randomly)
- NobodyExistsOnTheInternet/PIPPAsharegptv2test - 5% (randomly)
- cgato/SlimOrcaDedupCleaned - 5% (randomly)
Models used
- NeverSleep/MiquMaid-70B-v3-Base [Private finetune]
- NeverSleep/MiquMaid-v2-70B
- NeverSleep/MiquMaid-v1-70B
- migtissera/Tess-70B-v1.6
- crestf411/daybreak-miqu-1-70b-v1.0-hf
- sophosympatheia/Midnight-Miqu-70B-v1.0
Custom format:
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Mistral [INST][/INST] prompt format should work too.
Others
Undi: If you want to support us, you can here.
IkariDev: Visit my retro/neocities style website please kek