Instruct_Llama3_8B
Fine-tuned from Llama-3-8B， using a wide variety of sources for the dataset. 84.9% for training, 15% validation, 0.1% test. Trained for 2 epochs using QDora. Trained with 4096 context window.
Model Details
- Trained by: trained by Brillibits. See YouTube as well.
- Model type: Instruct_Llama3_8B is an auto-regressive language model based on the Llama 3 transformer architecture.
- Language(s): English
- License for Instruct_Llama3_8B: llama3 license
Prompting
<s>[SYS] {system prompt or blank space} [/SYS] [INST] {instruction} [/INST] {response}</s>
Professional Assistance
This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks
If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me here