Gemma 4 E2B Albanian–English v1
Fine-tuned, released, and maintained by Kushtrim Visoka.
Kushtrim/gemma4-e2b-sq-en-v1 is a task- and language-adapted checkpoint from the
Gemma 4 E2B family. The repository name describes the intended variant;
the technical properties below are taken from its saved configuration.
Model details
| Property | Value |
|---|---|
| Model type | Multimodal conditional generation (text, image, and audio) |
| Architecture | Gemma4ForConditionalGeneration |
| Intended language(s) | sq, en |
| Saved precision | FP32 |
| Context or generation limit | 131,072 tokens (configuration maximum) |
Intended use
- Research and evaluation in the languages and task indicated by the repository name.
- Comparison with the upstream model family.
- Further task- or domain-specific adaptation where the applicable license permits.
Evaluation and limitations
- A standardized benchmark suite is not documented in this model card yet.
- Evaluate the checkpoint on representative held-out data before deployment.
- Fine-tuning can preserve or amplify limitations and biases from the upstream model and training data.
- Generated text or transcripts may be inaccurate. Human review is required for consequential use.
- The configured maximum context does not guarantee reliable quality at every sequence length.
Development and attribution
- Original architecture and base-model family: Google DeepMind Gemma Team
- Albanian–English adaptation, fine-tuning, checkpoint packaging, release, and repository maintenance: Kushtrim Visoka
- Model card: Kushtrim Visoka
Acknowledgements
This work builds on Gemma 4 E2B and the work of its original authors. The upstream architecture and base weights remain the work of their respective creators. This repository documents the derivative fine-tuning, packaging, and release work carried out by Kushtrim Visoka and does not claim authorship of the original model. Users should also follow the upstream model's license and citation requirements.
Citation
If you use this checkpoint, please cite this repository and the original upstream model.
@misc{visoka_gemma4_e2b_sq_en_v1_2026,
author = {Visoka, Kushtrim},
title = {Gemma 4 E2B Albanian–English v1},
year = {2026},
publisher = {Hugging Face},
url = {https://huggingface.co/Kushtrim/gemma4-e2b-sq-en-v1},
note = {Fine-tuned derivative of the Gemma 4 E2B family}
}