Aurora-m1-instruct
Open Source Continual Pre-training for Multilingual Language and Code
Model Description
This is a experimental research Instruct Version of Aurora-m, a Starcoderplus
Usage
Aurora-m is a continued pretrain model with a very small instruction set mixed in. It was then instruct tuned further, but you will get better performance by further tuning the model. Also, while the model will respond to multilingual instructions, the model was trained on predominantly English instructions, so multilingual instruction finetuning is recommended.
The instruction format we used is:
### Instruction:
{instruction}
### Response: