ComputerScience-v1-2B
A fine-tuned version of unsloth/Qwen3.5-2B trained on ComputerScience ML AI Chatml 7.0k 110926 train data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.
The base model was adapted to follow the style and content of the ComputerScience ML AI Chatml 7.0k 110926 train dataset. Expect improved performance on tasks similar to those represented in the training data.
Model Details
| Property | Value |
|---|---|
| Base model | unsloth/Qwen3.5-2B |
| Training data | data/ComputerScience-ML-AI-Chatml-7.0k-110926_train.json |
| Fine-tuning epochs | 2 |
| Fine-tuning date | 2026-09-12 |
| Fine-tuning method | LoRA (merged to full 16-bit) |
Training Hyperparameters
LoRA
| Parameter | Value |
|---|---|
r | 4 |
alpha | 8 |
dropout | 0.02 |
target_modules | ['q_proj', 'v_proj', 'k_proj', 'o_proj', 'gate_proj', 'up_proj', 'down_proj'] |
Training
| Parameter | Value |
|---|---|
learning_rate | 0.0005 |
batch_size | 4 |
gradient_accumulation_steps | 1 |
warmup_ratio | 0.0 |
max_seq_length | 2048 |
quantization | none |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("theprint/ComputerScience-v1-2B")
tokenizer = AutoTokenizer.from_pretrained("theprint/ComputerScience-v1-2B")
Generated by Auto-SFT — automated LoRA fine-tuning with hyperparameter search.