Instruct_Llama70B_Dolly15k
Fine-tuned from Llama-2-70B，used Dolly15k for the dataset. 80% for training, 15% validation, 5% test. Trained for 1.5 epochs using QLora. Trained with 1024 context window.
Model Details
- Trained by: trained by Brillibits. See YouTube as well.
- Model type: Instruct_Llama70B_Dolly15k is an auto-regressive language model based on the Llama 2 transformer architecture.
- Language(s): English
- License for Instruct_Llama70B_Dolly15ks: llama2 license
Prompting
Prompt Template With Context
Write a 10-line poem about a given topic
Input:
The topic is about racecars
Output:
Prompt Template Without Context
Who was the was the second president of the United States?
Output:
Professional Assistance
This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks
If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me here
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 60.97 |
| ARC (25-shot) | 68.34 |
| HellaSwag (10-shot) | 87.21 |
| MMLU (5-shot) | 69.52 |
| TruthfulQA (0-shot) | 46.46 |
| Winogrande (5-shot) | 84.29 |
| GSM8K (5-shot) | 42.68 |
| DROP (3-shot) | 28.26 |