I came, i saw, i made the v4...
Last version was a mess, it hallucinate code, and can't even tell what's the diff of remote events or type of scripts so this might be the final attempt of fine-tuning with this model. So i fixed the dataset itself, i removed all of the remaining broken refs, fixed the dataset with ChatGPT. Finally my Colab runtime is worth it. (spoiler: next version will add basic roblox knowledge and will use 7b (so please expect smarter and maybe much better models))
Uploaded finetuned model
- Developed by: NoobifiedAIDept
- Training Environment: Google Colab (i ain't gonna use kaggle because my phone number doesn't even support and forces me into verifying with my ID)
- License: apache-2.0
- Finetuned from model : unsloth/qwen2.5-coder-3b-instruct-bnb-4bit
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.