/ Модель

Характеристики

Лицензия
Apache 2.0
Библиотека
diffusers
Опубликована
30 сен 2026

Vimoo-1.0

Генерация видеоТекст → видео

Vimoo-1.0 — семейство моделей Vimoo AI для генерации видео по тексту или по референсному изображению с текстовым описанием.

14скачиваний за 30 дней4лайкавеса обновлены7 окт 2026

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

Vimoo-1.0 — семейство моделей генерации видео от Vimoo AI. Эта карточка описывает модели для создания видео по текстовому запросу (T2V) и по изображению с текстовым запросом (I2V); для этих задач используются отдельные модели примерно по 11,7 млрд параметров. Модель работает через Diffusers, веса опубликованы в формате safetensors по лицензии Apache-2.0.

Открытая Vimoo-Base генерирует видео в разрешении 720p. Полная система может дополнительно использовать Vimoo-PE для уточнения мультимодальных инструкций и Vimoo-Enhancer для повышения разрешения до 1080p; эти компоненты не входят в открытую модельную часть целиком. Примеры генерации дают ролики 1280 × 720, 121 кадр при 24 кадрах в секунду.

Модель подходит для создания кинематографических сцен, анимирования референсных изображений и подготовки рекламных или товарных роликов. В открытых моделях проверены только запросы на английском языке, а качество и следование запросам на других языках не подтверждены. Для хорошего результата рекомендуются подробные и последовательные описания сцены и движения.

Сценарии применения

  • создание видео по текстовому описанию сцены
  • анимирование изображения по текстовому запросу
  • генерация кинематографических видеосцен
  • подготовка рекламных роликов для товаров
  • создание роликов для электронной торговли

Ограничения

Открытые модели проверены только на английских запросах, поэтому качество генерации и следование инструкциям на других языках не подтверждены. Открытая Vimoo-Base генерирует 720p; повышение до 1080p требует отдельного компонента Vimoo-Enhancer.

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

Website Hugging Face Vimoo-1.0 ComfyUI-Vimoo Vimoo-1.0-MLX Paper

Vimoo-1.0 generates video from text (T2V) or from a reference image and text (I2V), with a separate ≈11.7B model for each task. It is the highest-quality model in the Vimoo 1.0 family.

🔥 News

  • [2026-10] Release Vimoo 1.0: T2V / I2V models, Diffusers inference examples and ComfyUI workflows.

🎬 Showcase

🌐 Online API

Use Vimoo 1.0 directly via API. https://vimoo.ai

The model API includes three use cases: Vimoo 1.0, Vimoo 1.0 - Ecom, and Vimoo 1.0 - Lite.

🗺️ System Overview

Vimoo system overview: Vimoo-PE structures the user prompt, Vimoo-Base generates 720p video, and Vimoo-Enhancer produces 1080p video.

The complete Vimoo system consists of the following three modules:

  • Vimoo-PE: We developed a dedicated system that deeply interprets and refines incoming multimodal instructions, then transforms them into a format that Vimoo can easily process for generation. Vimoo-PE plays a crucial role in determining the quality of the final output; we highly recommend integrating it into your generation pipeline—or following the 'Prompt Guide' to build your own prompt system.
  • Vimoo-Base: Generates 720p video based on the Vimoo-PE output.
  • Vimoo-Enhancer: Feeds the 720p video to regenerate the output at 1080p resolution. It combines the resolution and clarity enhancement associated with generative repair of defects in appearance and motion, enabling it to produce high-resolution outputs with more accurate details and greater visual fidelity.

To help the community deploy Vimoo correctly, we provide three approaches.

  • Open Platform API: Since Vimoo consists of three modules: Vimoo-PE, Vimoo-Base, and Vimoo-Enhancer, we offer the Open Platform API to support full end-to-end invocation of the complete pipeline, while the Enhancer is optional.
  • OpenSource: We have open-sourced the Vimoo-Base model to enable validation of 720p output. For better results, you can refer to the 'Prompt Guide' section, which provides a detailed tutorial to help the community develop their own prompting systems. You may also further call the standalone Enhancer API to obtain high-definition 1080P results.
  • Run Locally: We provide locally deployable models, including ComfyUI and MLX versions, to support running Vimoo-Base on lower-end devices. Here too, the 'Prompt Guide' section is essential.

In addition, we provide an e-commerce video generation API, specifically designed for product and advertising video generation. It follows the same three-stage pipeline and outputs a 20-second story-driven e-commerce video.

📦 Model Zoo

Vimoo 1.0 comes in two models, Vimoo 1.0 and Vimoo 1.0 - Lite. Each Hugging Face repository packages one of them for one runtime:

Each ComfyUI repository bundles its checkpoints, distilled LoRA adapters, shared encoders and VAE. Distilled models are available only for ComfyUI and MLX. Vimoo-1.0 T2V Distilled and I2V Distilled use different base checkpoints from Vimoo-1.0 T2V and I2V; download each task's matching base and adapter listed in the ComfyUI guide. The Vimoo-1.0 T2V Distilled, Vimoo-1.0 I2V Distilled and Vimoo-1.0-Lite TI2V Distilled adapters are not interchangeable. Parameters count the video denoiser only.

🚀 Quick Start

Installation

Use the Vimoo inference code on Linux with an NVIDIA CUDA GPU:

git clone https://github.com/Vimoo-AI/Vimoo-1.0.git
cd Vimoo-1.0
python -m pip install -r requirements.txt
python -m pip install "git+https://github.com/Vimoo-AI/diffusers.git"

See the installation guide for environment requirements.

The T2V and I2V examples default to PyTorch SDPA, with no additional attention package. To select --attention-backend fa2, fa3, fa4 or sage, first install that backend's dependencies from the runtime options.

Download weights

hf download Vimoo-AI/Vimoo-1.0 --local-dir ./models/Vimoo-1.0

To download one task only, add --exclude "transformer_i2v/*" for T2V or --exclude "transformer/*" for I2V. On the first run, Diffusers downloads Qwen2.5-VL-7B-Instruct, the Wan 2.2 VAE and, for I2V, SigLIP from Hugging Face at the revisions recorded in modular_model_index.json. For offline use, run once with network access, then set HF_HUB_OFFLINE=1.

Generate video

Run from the inference repository root, replacing the image with your own file:

python examples/vimoo_1_0_t2v.py --model ./models/Vimoo-1.0 --prompt 'A young woman in a red coat walks through a snowy city street and looks up at the falling snow.' --output t2v.mp4
python examples/vimoo_1_0_i2v.py --model ./models/Vimoo-1.0 --prompt 'The dog shakes its whole body, then sits back down in the same spot. The camera remains fixed throughout.' --image dog.png --output i2v.mp4

The examples output 1280 × 720, 121 frames at 24 fps.

📝 Prompting Guide

Use English prompts. The current open-source models have been validated only with English prompts. Generation quality and prompt adherence in other languages have not been validated. We recommend translating prompts into English before generation.

Write clear, detailed prompts. Specific descriptions of the subject, scene, action sequence, and camera movement can help produce results that better match your intent than short, vague prompts. See the Prompt Guide for structure and examples, and focus on relevant, consistent visual details.

The Prompt Guide describes automatic prompt enhancement in the hosted service. Local examples use your input prompt directly; follow the guide's writing structure and examples when preparing prompts.

📖 Technical Architecture

Vimoo 1.0 uses a 40-block dual-stream MMDiT backbone. Joint attention connects the video and conditioning streams, combining prompt semantics, in-video text and optional reference-image features. A Wan 2.2 VAE encodes and decodes the video, while flow matching generates video latents.

Vimoo base architecture: text and optional image encoders condition 40 dual-stream MMDiT blocks; the VAE decodes the sampled video latents.

Each Vimoo-1.0 Transformer has ≈11.7B denoiser parameters, excluding encoders and the VAE. See the Vimoo 1.0 README for the model architecture and inference components.

Highlights

  • Prompt adherence: a dedicated text encoder turns prompts into precise generation conditions. An optional prompt enhancer can add visual, cinematic, temporal, and contextual detail, or be disabled to preserve the original wording.
  • Cinematic visual quality: training on carefully curated aesthetic data, with detailed annotations for lighting, composition, contrast, color grading, and more, enables precise control over cinematic styles and a wide range of aesthetic preferences.
  • Advanced motion generation: a larger and more diverse training corpus improves generalization across motion, semantics, and visual aesthetics, delivering leading performance among open-source and proprietary video generation models.
  • E-commerce video generation: by faithfully highlighting product selling points and features while preserving fine-grained product details, it ensures strong product consistency across frames, delivering reliable and visually coherent results that meet the practical demands of e-commerce content creation.
  • Efficient high-definition generation: the lightweight variant uses 32×32×4 spatiotemporal compression and supports T2V and I2V at 720p and 24 fps.

📈 Evaluation & Benchmarks

Generation Quality

Vimoo-VBench is a human evaluation developed by the Vimoo team, with 500 prompts covering advertising, social media, storytelling, education and entertainment. T2V is evaluated for instruction following, frame aesthetics, visual quality and motion; I2V also measures image-video consistency.

The tables compare model families on this evaluation set. Results for individual checkpoints depend on their weights and generation settings.

T2V human evaluation (%)

I2V human evaluation (%)

📁 Model Files

PathPurpose
transformer/Text-to-video model
transformer_i2v/Image-to-video model

modular_model_index.json defines the required components.

Component provenance

The public model index records component locations and upstream revisions. Text conditioning uses Qwen2.5-VL and a Glyph encoder; image conditioning uses SigLIP, and video decoding uses the Wan VAE. Keep the bundled Glyph encoder and tokenizer with the model.

Glyph identities are recorded in glyph_source.json; the public preparation helper is prepare_glyph_encoder.py.

📜 License

Vimoo-authored code and Vimoo model weights in this repository are provided under the Apache License 2.0.

  • Commercial use, modification, and redistribution are permitted under the terms of the license.
  • Redistribution must include a copy of the license, retain applicable copyright and attribution notices, and identify modified files.
  • Attribution and third-party component notices are provided in THIRD_PARTY_NOTICES.md. Third-party components remain subject to their own licenses.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · diffusers

Нельзя запустить

Модель выложена как модульный пайплайн diffusers (modular_model_index.json): рантайм собирает только обычные пайплайны.

Ревизия весов
f5d6adc

0 моделей