Miqu PlayMaid 2x70B v0.1
This model uses the Alpaca prompting format. Unlike the base model this one is tuned on 16384 sequence length. This was due to memory constraints.
Like Undi and Ikari, I followed my finetune up by making a MoE, made of Miqu PlayMaid 70B and Miqu 70B DPO.
Miqu PlayMaid 70B a roleplay focused finetune using MiquMaid v2 70B DPO by Undi95 and IkariDev as base.
My goal was to further push MiquMaid into creative writing and roleplay, hopefully adding some spice to it.
Credits:
- Netrve
- Special thanks to everyone on TheBloke's Discord who helped me!
Credits for MiquMaid:
- Undi
- IkariDev
Description
This repo contains the BF16 files of Miqu-PlayMaid-2x70B-v0.1
Training data used:
Format:
I can only guarantee that it works with a maximum context length of 16384. Might work with 32768, but no promises.
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Support
- Netrve: If you like what I did, feel free to support future work here
Don't forget to send some love to the original masterminds behind MiquMaid:
- Undi: If you want to support us, you can here
- IkariDev: Visit my retro/neocities style website please kek