MiquMaid v2 2x70B
Check out our blogpost about this model series Here! - Join our Discord server Here!
This model uses the Alpaca prompting format
Model trained for RP conversation on Miqu-70B with our magic sauce.
Then, we have done a MoE, made of MiquMaid-v2-70B and Miqu-70B base, making the model using the finetune AND the base model for each token, working together.
We have seen a significant improvement, so we decided to share that, even if the model is very big.
Credits:
- Undi
- IkariDev
Description
This repo contains FP16 files of MiquMaid-v2-2x70B.
Training data used:
Custom format:
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Others
Undi: If you want to support us, you can here.
IkariDev: Visit my retro/neocities style website please kek