Model card for qwen3_vit_306m_merge.qwen3_5_4b

A Qwen ViT image feature model extracted from Qwen3.5-4B. This is the classifier-ready wrapper retaining the native spatial merger and LLM-width projection, followed by average pooling and affine-free LayerNorm.

NOTE: This checkpoint is a native timm remap of the original vision weights, with no additional training. It contains no language-model weights or trained image-classification head.

Model Notes

• Image inputs repeat one frame across the original temporal patch kernel. The temporal Conv3d weights are summed into a Conv2d for this image-only implementation.
• The backbone uses GELU-tanh MLPs, learned absolute positions and axial 2D RoPE. Absolute positions are interpolated for the input grid; RoPE is regenerated at each size.
• The timm transforms normalize RGB pixels using mean=(0.5, 0.5, 0.5) and std=(0.5, 0.5, 0.5). Rectangular inputs are supported. Each image dimension must be divisible by 16; any variant using the 2×2 merger requires divisibility by 32.
• forward_features() returns projected NLC tokens from the native merger. encoder.forward_features() returns raw NHWC backbone features. forward() returns pooled image embeddings until a classification head is added.

Model Details

• Model Type: Image Feature Encoder
• Model Stats:
  • Params (M): 332.7
  • GMACs: 974.8
  • Activations (M): 2610.9
  • Image size: 768 x 768
• Source revision: 851bf6e806efd8d0a36b00ddf55e13ccb7b8cd0a
• License source: https://huggingface.co/Qwen/Qwen3.5-4B/blob/851bf6e806efd8d0a36b00ddf55e13ccb7b8cd0a/LICENSE
• Original: https://huggingface.co/Qwen/Qwen3.5-4B
• License: Apache 2.0
• Backbone width: 1024
• Projection width: 2560
• Papers:
  • Qwen3.5: Towards Native Multimodal Agents: https://qwen.ai/blog?id=qwen3.5
  • PyTorch Image Models: https://github.com/huggingface/pytorch-image-models

Model Usage

Image Features

import torch
import timm
from PIL import Image

model = timm.create_model('hf-hub:timm/qwen3_vit_306m_merge.qwen3_5_4b', pretrained=True).eval()
data_config = timm.data.resolve_model_data_config(model)
transform = timm.data.create_transform(**data_config, is_training=False)
image = Image.open('image.jpg').convert('RGB')
x = transform(image).unsqueeze(0)

with torch.inference_mode():
    output = model(x)  # (1, 2560): image embeddings
    features = model.forward_features(x)  # (1, 576, 2560): projected spatial tokens (NLC)

Intermediate Feature Maps

with torch.inference_mode():
    maps = model.forward_intermediates(
        x, indices=3, output_fmt='NCHW', intermediates_only=True,
    )
for feature_map in maps:
    print(feature_map.shape)  # (1, 1024, 48, 48)

Classification Fine-tuning

model = timm.create_model(
    'hf-hub:timm/qwen3_vit_306m_merge.qwen3_5_4b', pretrained=True, num_classes=45,
)
logits = model(x)  # (1, 45)

The new linear head is randomly initialized and must be trained on your target dataset.

Citation

@misc{qwen3.5,
  title={{Qwen3.5}: Towards Native Multimodal Agents},
  author={{Qwen Team}},
  month={February},
  year={2026},
  url={https://qwen.ai/blog?id=qwen3.5}
}

@misc{rw2019timm,
  author = {Ross Wightman},
  title = {PyTorch Image Models},
  year = {2019},
  publisher = {GitHub},
  journal = {GitHub repository},
  doi = {10.5281/zenodo.4414861},
  howpublished = {\url{https://github.com/huggingface/pytorch-image-models}}
}