Qwen3.5-4B Model Compression

Model Description

This repository contains a compressed version of Qwen3.5-4B, developed as part of the CS6013: Efficient AI course project. The objective is to reduce model memory while preserving performance on mathematical reasoning tasks using model compression techniques.

• Base model: Qwen/Qwen3.5-4B
• Developed by: Rudrapratap Chinhara
• Course: CS6013 – Efficient AI
• Affliation: IIT Bombay
• Language: English
• License: CC BY-NC 4.0

Citation

If you use this repository, please cite the original Qwen model:

@misc{qwen3.5,
    title  = {{Qwen3.5}: Towards Native Multimodal Agents},
    author = {{Qwen Team}},
    month  = {February},
    year   = {2026},
    url    = {https://qwen.ai/blog?id=qwen3.5}
}

Acknowledgements

This work is based on the Qwen3.5-4B model released by the Qwen Team and was developed for the CS6013 Efficient AI course project.