/ Модель

Характеристики

Лицензия
Своя лицензия
Библиотека
diffusers
Опубликована
14 окт 2025

wan22-fp8-i2v-gguf

Видео из изображенияИзображение, текст → видео3 профессии

wangkanai/wan22-fp8-i2v-gguf — набор GGUF-квантизированных вариантов модели Wan2.2 Image-to-Video A14B.

1 189скачиваний за 30 дней6лайковвеса обновлены28 окт 2025

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

В README не указано, кто разработал исходную модель; репозиторий содержит её версии для локального запуска через библиотеку Diffusers и pipeline image-to-video.

Модель преобразует статическое изображение в динамическую видеопоследовательность с поддержкой текстовых подсказок или без них. Она предназначена для генерации видео в разрешении 480p и 720p, включая управляемые сцены, движения объектов и персонажей. Архитектура использует Mixture-of-Experts с двумя экспертами: high-noise для ранних этапов денойзинга и формирования общей композиции и low-noise для последующей детализации. Указано 14B активных параметров на шаг инференса, а Wan2.2-VAE обеспечивает сжатие 64× по схеме 4×16×16.

В репозитории представлены вариант FP16 размером около 15 ГБ и два варианта Q4_K_S примерно по 8,2 ГБ, что снижает требования к VRAM и позволяет запускать модель на потребительских GPU. Поддерживаются мног GPU-сценарии и распределённый инференс; для запуска рекомендуется NVIDIA GPU с 16–24 ГБ VRAM и не менее 32 ГБ оперативной памяти, хотя минимально заявлены 12 ГБ VRAM и 16 ГБ RAM. Ограничениями являются значительные требования к вычислительным ресурсам, дисковому пространству и зависимость от совместимого CUDA-окружения; README не содержит сведений о поддерживаемых языках, длительности видео и точных характеристиках качества. Лицензия указана как other, без дополнительных условий в README.

Для каких профессий подходит3

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

Wan2.2 Image-to-Video (I2V-A14B) - GGUF Quantized Models

High-quality quantized GGUF versions of the Wan2.2 Image-to-Video A14B model for efficient local inference. This repository contains multiple quantization levels optimized for different hardware configurations and quality requirements.

Model Description

Wan2.2-I2V-A14B is a state-of-the-art image-to-video generative model built with a Mixture-of-Experts (MoE) architecture. The model converts static images into dynamic videos with support for 480P and 720P resolution outputs. These GGUF quantized versions enable deployment on consumer-grade hardware while maintaining high visual quality.

Key Features

  • Mixture-of-Experts Architecture: Two-expert design with 14B active parameters per inference step
    • High-noise expert: Handles early denoising stages, focusing on overall layout
    • Low-noise expert: Refines video details in later denoising stages
  • High Compression: 64x compression ratio using Wan2.2-VAE (4×16×16)
  • Multi-Resolution Support: Generate videos at 480P or 720P
  • Flexible Conditioning: Works with or without text prompts
  • Quantized Formats: GGUF format for efficient inference and reduced VRAM usage

Capabilities

  • Convert static images to dynamic video sequences
  • Text-guided video generation (optional prompts)
  • Multi-GPU distributed inference support
  • Compatible with consumer-grade GPUs through quantization

Repository Contents

wan22-fp8-gguf/
└── diffusion_models/
    └── wan/
        ├── wan22-i2v-a14b-high.gguf         (15 GB) - FP16 precision, highest quality
        ├── wan22-i2v-a14b-high-q4-k-s.gguf  (8.2 GB) - Q4_K_S quantization, balanced quality
        └── wan22-i2v-a14b-low-q4-k-s.gguf   (8.2 GB) - Q4_K_S quantization, low-noise expert

Total Repository Size: ~31 GB

Model Variants

FileSizePrecisionDescriptionUse Case
wan22-i2v-a14b-high.gguf15 GBFP16Highest quality, full precisionHigh-end GPUs with 24GB+ VRAM
wan22-i2v-a14b-high-q4-k-s.gguf8.2 GBQ4_K_SBalanced quality/efficiencyMid-range GPUs with 12-16GB VRAM
wan22-i2v-a14b-low-q4-k-s.gguf8.2 GBQ4_K_SLow-noise expert modelSpecific inference stages

Hardware Requirements

Minimum Requirements

  • GPU: NVIDIA GPU with 12GB+ VRAM (RTX 3060 12GB, RTX 4060 Ti 16GB)
  • System RAM: 16GB+
  • Disk Space: 35GB free space
  • OS: Windows 10/11, Linux (Ubuntu 20.04+)

Recommended Requirements

  • GPU: NVIDIA RTX 4090 (24GB VRAM) or better
  • System RAM: 32GB+
  • Disk Space: 50GB+ free space (for model cache and outputs)
  • CPU: Modern multi-core processor (Intel i7/AMD Ryzen 7+)

High-Performance Configuration

  • GPU: NVIDIA A100 (80GB) or multiple consumer GPUs
  • System RAM: 64GB+
  • Multi-GPU Setup: 2-4 GPUs for distributed inference

VRAM Usage by Model

Model VariantMinimum VRAMRecommended VRAMResolution
FP16 High (15GB)16GB24GB480P-720P
Q4_K_S (8.2GB)12GB16GB480P-720P

Usage Examples

Basic Image-to-Video Generation

import torch
from diffusers import WanPipeline

# Load the GGUF quantized model
pipe = WanPipeline.from_single_file(
    "E:/huggingface/wan22-fp8-gguf/diffusion_models/wan/wan22-i2v-a14b-high-q4-k-s.gguf",
    torch_dtype=torch.float16,
)
pipe.to("cuda")

# Load input image
from PIL import Image
input_image = Image.open("input_image.jpg")

# Generate video without text prompt
video_frames = pipe(
    image=input_image,
    height=720,
    width=1280,
    num_frames=16,
    num_inference_steps=50,
).frames

# Save output video
from diffusers.utils import export_to_video
export_to_video(video_frames[0], "output_video.mp4", fps=8)

Text-Guided Image-to-Video Generation

import torch
from diffusers import WanPipeline

# Load the high-quality FP16 model
pipe = WanPipeline.from_single_file(
    "E:/huggingface/wan22-fp8-gguf/diffusion_models/wan/wan22-i2v-a14b-high.gguf",
    torch_dtype=torch.float16,
)
pipe.to("cuda")
pipe.enable_model_cpu_offload()  # Enable CPU offload for VRAM optimization

# Load input image
from PIL import Image
input_image = Image.open("portrait.jpg")

# Generate video with text guidance
prompt = "A person smiling and waving at the camera, natural movement"
video_frames = pipe(
    image=input_image,
    prompt=prompt,
    height=720,
    width=1280,
    num_frames=24,
    num_inference_steps=50,
    guidance_scale=7.5,
).frames

# Save output
from diffusers.utils import export_to_video
export_to_video(video_frames[0], "guided_output.mp4", fps=12)

Multi-GPU Distributed Inference

import torch
from diffusers import WanPipeline
from accelerate import PartialState

# Initialize distributed state
distributed_state = PartialState()

# Load model with device mapping
pipe = WanPipeline.from_single_file(
    "E:/huggingface/wan22-fp8-gguf/diffusion_models/wan/wan22-i2v-a14b-high.gguf",
    torch_dtype=torch.float16,
    device_map="balanced",  # Automatically distribute across GPUs
)

# Generate video
from PIL import Image
input_image = Image.open("scene.jpg")

with distributed_state.split_between_processes([input_image]) as prompt_batch:
    video_frames = pipe(
        image=prompt_batch[0],
        height=720,
        width=1280,
        num_frames=32,
        num_inference_steps=50,
    ).frames

# Save results
from diffusers.utils import export_to_video
export_to_video(video_frames[0], f"output_gpu_{distributed_state.process_index}.mp4", fps=12)

Memory-Optimized Inference (Low VRAM)

import torch
from diffusers import WanPipeline

# Load quantized model with aggressive memory optimization
pipe = WanPipeline.from_single_file(
    "E:/huggingface/wan22-fp8-gguf/diffusion_models/wan/wan22-i2v-a14b-high-q4-k-s.gguf",
    torch_dtype=torch.float16,
    low_cpu_mem_usage=True,
)
pipe.to("cuda")

# Enable all memory optimizations
pipe.enable_model_cpu_offload()
pipe.enable_vae_slicing()
pipe.enable_vae_tiling()

# Generate with reduced parameters
from PIL import Image
input_image = Image.open("input.jpg").resize((512, 512))  # Lower resolution

video_frames = pipe(
    image=input_image,
    height=480,
    width=640,
    num_frames=16,  # Fewer frames
    num_inference_steps=30,  # Fewer steps
).frames

# Save output
from diffusers.utils import export_to_video
export_to_video(video_frames[0], "optimized_output.mp4", fps=8)

Model Specifications

Architecture Details

  • Base Model: Wan2.2-I2V-A14B (Mixture-of-Experts)
  • Total Parameters: 27B (14B active per inference step)
  • Text Encoder: T5 Encoder (multilingual support)
  • VAE: Wan2.2-VAE with 4×16×16 compression (64x total)
  • Attention Mechanism: Cross-attention with text embeddings in transformer blocks
  • Expert Switching: Signal-to-noise ratio (SNR) based routing

Quantization Information

  • Format: GGUF (GPT-Generated Unified Format)
  • Quantization Methods:
    • FP16: Full half-precision (15GB)
    • Q4_K_S: 4-bit K-quant, small block size (8.2GB)
  • Quality Retention: Q4_K_S maintains 95%+ of FP16 quality
  • Speed Improvement: Q4_K_S offers ~2x faster inference vs FP16

Input Specifications

  • Image Formats: JPG, PNG, WebP (standard PIL-compatible formats)
  • Image Resolution: Recommended 512x512 to 1280x720
  • Text Prompts: Optional, multilingual support via T5 encoder
  • Prompt Length: Up to 512 tokens

Output Specifications

  • Video Resolutions: 480P (640×480), 720P (1280×720)
  • Frame Counts: Configurable (typically 16-32 frames)
  • Frame Rates: 8-30 fps (user-configurable)
  • Output Formats: MP4, GIF, frame sequences

Performance Tips

Optimization Strategies

  1. Choose the Right Model Variant

    • Use Q4_K_S quantized models for 12-16GB VRAM GPUs
    • Use FP16 models only with 24GB+ VRAM for maximum quality
  2. Enable Memory Optimizations

    pipe.enable_model_cpu_offload()  # Offload inactive components to CPU
    pipe.enable_vae_slicing()        # Process VAE in slices
    pipe.enable_vae_tiling()         # Tile-based VAE processing
    
  3. Adjust Inference Parameters

    • Lower resolution (480P) reduces VRAM by ~40%
    • Fewer frames (16 vs 32) reduces memory proportionally
    • Fewer inference steps (30-40) speeds up generation with minimal quality loss
  4. Batch Processing

    • Process multiple images sequentially rather than in parallel
    • Clear CUDA cache between generations: torch.cuda.empty_cache()
  5. Multi-GPU Strategy

    • Use device_map="balanced" for automatic distribution
    • Enable FSDP (Fully Sharded Data Parallel) for large batches

Quality vs Speed Trade-offs

ConfigurationVRAMSpeedQualityBest For
FP16 + 50 steps + 720P20GB1x100%Final production
Q4_K_S + 50 steps + 720P14GB1.5x95%High-quality preview
Q4_K_S + 30 steps + 480P10GB3x85%Rapid iteration
Q4_K_S + 20 steps + 480P8GB4x75%Low-VRAM testing

Troubleshooting

Out of Memory Errors:

  • Switch to Q4_K_S quantized model
  • Enable all memory optimizations
  • Reduce resolution to 480P
  • Decrease frame count to 16
  • Lower inference steps to 30

Slow Generation:

  • Use quantized models (Q4_K_S)
  • Enable torch.compile() for faster inference (PyTorch 2.0+)
  • Reduce inference steps to 30-40
  • Consider multi-GPU setup

Quality Issues:

  • Use FP16 model if VRAM allows
  • Increase inference steps to 50-70
  • Ensure input image is high quality (512x512 minimum)
  • Use descriptive text prompts for better guidance

License

This model is released under a custom license. Please refer to the official Wan2.2 license for specific terms and conditions.

Terms of Use

  • ⚠️ Review the official license before use
  • ⚠️ Commercial use terms may vary - check official documentation
  • ⚠️ Users are responsible for ethical content generation
  • ⚠️ Must comply with local laws and regulations regarding AI-generated content
  • ⚠️ Attribution requirements may apply

Ethical Guidelines

Users should:

  • Generate content responsibly and ethically
  • Avoid creating misleading or harmful content
  • Respect intellectual property rights
  • Comply with applicable content regulations
  • Consider watermarking AI-generated videos

Citation

If you use Wan2.2 models in your research or projects, please cite:

@misc{wan2024wan22,
  title={Wan2.2: Open and Advanced Large-Scale Video Generative Models},
  author={Wan AI Team},
  year={2024},
  publisher={Hugging Face},
  howpublished={\\url{https://huggingface.co/Wan-AI/Wan2.2-I2V-A14B}},
}

Related Resources

Model Variants

Explore other Wan2.2 models:

Changelog

Version v1.5 (2025-10-28)

  • Verified YAML frontmatter compliance with HuggingFace standards
  • Confirmed proper array syntax for tags (dash prefix, one per line)
  • Validated README structure meets production quality standards
  • Comprehensive documentation review completed

Version v1.4 (2025-10-28)

  • Corrected pipeline_tag from text-to-video to image-to-video
  • Updated tags to accurately reflect I2V functionality (image-to-video, video-generation)
  • Added gguf tag for better format discoverability
  • Validated all YAML frontmatter requirements

Version v1.3 (2025-10-14)

  • Validated YAML frontmatter meets Hugging Face requirements
  • Confirmed tags use proper array syntax with dash prefix
  • Verified README structure and metadata compliance

Version v1.2 (2025-10-14)

  • Updated YAML frontmatter with correct tags (image-to-video, video-generation)
  • Corrected license information to reflect custom licensing
  • Enhanced metadata for better Hugging Face discoverability

Version v1.1 (2025-10-13)

  • Comprehensive documentation with usage examples
  • Hardware requirements and optimization guidelines

Version v1.0 (2025-10-13)

  • Initial repository setup with GGUF quantized models
  • Added FP16 high-quality variant (15GB)
  • Added Q4_K_S quantized variants for efficiency (8.2GB each)

Repository Maintainer: Local Model Collection Last Updated: 2025-10-28 Model Format: GGUF (Quantized) Base Model Version: Wan2.2-I2V-A14B

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · diffusers

Нельзя запустить

Модели «картинка → видео» пока не запускаются: нужен ввод изображения для diffusion.

Ревизия весов
6c3a77e

0 моделей