Model Card for Model ID
Model Details
Model Card: llama3-pre1-ds-lora2 with Fine-Tuning Model Overview Model Name: llama3-pre1-ds-lora2
Model Type: Transformer-based Language Model
Model Size: 8 billion parameters
by: 4yo1
Languages: English and Korean
Model Description
llama3-pre1-ds-lora2 is a language model pre-trained on a diverse corpus of English and Korean texts. This fine-tuning approach allows the model to adapt to specific tasks or datasets with a minimal number of additional parameters, making it efficient and effective for specialized applications.
how to use - sample code
from transformers import AutoConfig, AutoModel, AutoTokenizer
config = AutoConfig.from_pretrained("4yo1/llama3-pre1-ds-lora2")
model = AutoModel.from_pretrained("4yo1/llama3-pre1-ds-lora2")
tokenizer = AutoTokenizer.from_pretrained("4yo1/llama3-pre1-ds-lora2")
datasets:
- recipes
license: mit