Gemma 4 E4B IT — TAK reasoning winner
This repository contains the TAK reasoning winner for
google/gemma-4-E4B-it.
It is a reasoning-specialized, mixed-precision GGUF built under a fixed low-bit size budget. No fine-tuning or model merge was applied.
Part of the TAK Reasoning Champions collection.
File
| File | Size | SHA-256 |
|---|---|---|
gemma-4-e4b-it-tak-reasoning.gguf | 3.236 GB | 21782cdf9199cf7d3046705b8111e47a71cb97051d0614ae846db9494bfb67e1 |
Benchmark results
The headline category is reasoning. Other suites are diagnostics, not product claims. The matched low-bit comparator is Unsloth
UD-IQ2_M,
at 3.545 GB. TAK and Unsloth completed all 960 evaluation items with zero failed items. The BF16 source completed all
128 reasoning items with zero failed items.
Reasoning headline
| Artifact | Size | Reasoning | TAK difference |
|---|---|---|---|
| TAK reasoning winner | 3.236 GB | 69.53 | — |
Unsloth UD-IQ2_M | 3.545 GB | 55.47 | +14.06 |
| BF16 source | 15.053 GB | 71.88 | -2.34 |
The last column is TAK minus the listed artifact. Positive values favor TAK.
Full suite diagnostics
| Evaluation suite | TAK | Unsloth | TAK delta |
|---|---|---|---|
| Coding | 35.16 | 35.94 | -0.78 |
| Math | 23.44 | 15.63 | +7.81 |
| Reasoning | 69.53 | 55.47 | +14.06 |
| Knowledge QA | 59.38 | 60.94 | -1.56 |
| Instruction following | 26.56 | 21.88 | +4.69 |
| Summarization and extraction | 45.31 | 40.63 | +4.69 |
| Structured output | 67.19 | 59.38 | +7.81 |
| General fidelity | 37.40 | 35.77 | +1.64 |
| Coherence | 90.63 | 98.44 | -7.81 |
| Stability | 47.99 | 48.59 | -0.60 |
| Context | 100.00 | 77.08 | +22.92 |
Scores are percentages from the same frozen MLab v1 evaluation pack. Full-suite deltas are TAK minus Unsloth in percentage
points. The comparator artifact has SHA-256
ae7c1bd7867d2037c3d5b281c151319380a00f9f9f8de2cc8b507aef5d6a31b9.
Process overview
- Start from the upstream BF16 instruction checkpoint.
- Build a reasoning-oriented calibration sample.
- Evaluate mixed-precision candidates under a fixed byte ceiling.
- Freeze the strongest validated candidate and run the full evaluation pack.
TAK changes weight precision. It does not fine-tune the model, merge weights, or replace the tokenizer or chat template. Internal scoring weights, search heuristics, candidate rules, and the tensor-level allocation recipe are not published.
Usage
Use a recent llama.cpp build:
llama-cli \
-hf ByteOtter/Gemma-4-E4B-IT-TAK-Reasoning-GGUF \
-p "Explain your answer carefully: If all A are B and no B are C, can any A be C?" \
-n 512
Limitations
- This model targets reasoning. The off-target scores only describe diagnostic behavior.
- Quantization can change outputs, accuracy, and stability across prompts and runtimes.
- This repository contains the text-generation GGUF only. It does not include image or audio components.
- Review the base model card and validate the model for your application, especially for high-stakes use.
Related research
- Gemma 4 Technical Report
- You Had One Job: Per-Task Quantization Using LLMs’ Hidden Representations (TAQ)
- Beyond Activation Alignment: The Alignment-Diversity Tradeoff in Task-Aware LLM Quantization (TASA)
TAK was developed independently and is not an official implementation of TAQ or TASA.
Support
If this model is useful to you, you can support ByteOtter on Buy Me a Coffee. You can also follow ByteOtter on X.
License and attribution
This quantized derivative follows the base model’s
Apache License 2.0.
See LICENSE and NOTICE for the included license and attribution notice.