/ Модель

Характеристики

Параметры
3,1 млрд
Лицензия
Apache 2.0
Архитектура
qwen2 · dense
Базовая модель
Qwen2.5-3B-Instruct
Библиотека
gguf
Опубликована
17 окт 2026

Vivy-R-Vision-3B-GGUF

Генерация текстаТекст → текст

Гибридная модель на основе Qwen2.5-3B-Instruct, предназначенная для преобразования текстовых запросов в спецификации сцен и генерации видео и векторных сцен.

131скачиваний за 30 дней1лайквеса обновлены18 окт 2026

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Тесты пользователейпока нет

Никто ещё не опубликовал тест этой модели. Соберите бенчмарк из своих задач — результат появится здесь.

  1. Добавьте модель в бенчмарк

    Вместе с другими моделями категории «Текст» — сравнение идёт внутри одной категории.

  2. Опишите свои задачи

    Напишите запросы, при необходимости приложите файлы и эталонные ответы.

  3. Запустите и опубликуйте

    Модели ответят на каждую задачу, судья оценит ответы. Опубликованный результат появится на этой странице.

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

Vivy-R-Vision-3B — экспериментальная гибридная система, созданная автором репозитория на основе Qwen2.5-3B-Instruct. В карточке заявлена дообученная 3,1-миллиардная модель семейства Qwen2: она преобразует текстовые запросы в компактную спецификацию сцены, а связанное с ней ядро на Rust должно по этой спецификации формировать векторные сцены и видеопоследовательности. Репозиторий содержит GGUF Q4_K_M и safetensors; лицензия — Apache-2.0.

Автор описывает сценарии генерации видео по текстовому запросу и синтеза SVG/HTML5-векторных сцен. Метаданные указывают на чат-возможности, английский язык карточки и задачи text-generation и text-to-video. Однако README содержит масштабные технические заявления о рендерере и его производительности, которые нельзя подтвердить по предоставленным материалам; поэтому их следует считать заявлениями автора. Контекстное окно и подтверждённая практическая совместимость компонентов здесь не установлены.

Сценарии применения

  • генерация видеосцены по текстовому описанию
  • создание векторной сцены в формате SVG или HTML5
  • преобразование описания сцены в структурированную спецификацию
  • чатовое взаимодействие при подготовке сцен

Ограничения

Заявленные возможности видеорендеринга зависят от связанного ядра на Rust и дополнительных компонентов; по предоставленной карточке нельзя подтвердить качество и производительность полной системы. Контекстное окно не установлено.

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

[!IMPORTANT] MANDATORY GOVERNANCE FOR INHERITING AGENTS & DOCUMENT EDITORS:

  1. Mandatory Changelog: Any agent editing this document MUST append an entry to the Changelog section (Agent Name/ID, timestamp, reason for change).
  2. Isolate Only, NEVER Delete: NEVER delete legacy content or architecture definitions. Any superseded section must be enclosed in a quote block and marked [ISOLATED / DEPRECATED / REPLACED].
  3. Full Synchronization with D:\2brain: Synchronize all architectural decisions, specifications, and lessons learned into D:\2brain.
  4. Public Language Policy (Hard Invariant #10): All public HuggingFace and GitHub documentation MUST be written in 100% English. Internal Vietnamese editions are archived exclusively under docs/internal_vi/ and D:\2brain.

Vivy-R-Vision-3B (R-VISION-3B) — Public Introduction & 5-Pillar Technical Specification

  • Model ID: R-VISION-3B (Vivy-R-Vision-3B)
  • HuggingFace Repository: vinguyen0891/Vivy-R-Vision-3B-GGUF
  • Backbone & Weight Class: Complete Full-Weight 3,085,938,688 Parameters (3.09B, 36 Transformer Layers, d_model = 2048, intermediate_size = 11008, vocab_size = 151936, 435 GGUF v3 Tensors, ~2.10 GB Q4_K_M Standalone GGUF + d_model = 2048 BitFit/IA³ & Semantic Projection .safetensors)
  • Native Rust Decision Kernel: vivy_core.dll (vivy-r-core + vivy-decide Max-Sum Belief Propagation + vivy-svd Jacobi Complex SVD + vivy-graph VM-11 Dampening)
  • Quality Classification: [PRODUCTION-READY]

Executive Summary: Why a 3B Model Can Synthesize Coherent 3-Minute Videos & High-Precision Vector Scenes

Conventional diffusion and autoregressive pixel/patch video generators spend 99% of their compute budget denoising millions of redundant pixel patches frame by frame. Vivy-R-Vision-3B (R-VISION-3B) replaces brute-force pixel diffusion with a Two-Stage Hybrid Architecture:

  1. Stage A — The 3.09B LLM Arrangement Compiler (3% Compute Share, vivy-r-vision-3b-q4_k_m.gguf & .safetensors):
    • A complete 3,085,938,688-parameter (3.09B) 36-layer Transformer model (d_model = 2048, 435 tensors) fine-tuned via 36-layer BitFit (attn_q.bias, attn_k.bias, attn_v.bias) and RMSNorm-IA³ (attn_norm.weight, ffn_norm.weight, output_norm.weight) together with a multi-head d_model = 2048 Semantic Projection Compiler.
    • Instead of emitting millions of pixel tokens, the 3.09B LLM analyzes natural language prompts and emits a compact Arrangement Criteria Specification (ArrangementCriteriaSpec) referencing $N = 4,096$ Foundational Vector-Chain Archetypes across 5 families (HUMAN, ANIMAL, PROP, LANDSCAPE, WEATHER).
  2. Stage B — The 0-Token Rust Deterministic Decision & Vector Synthesis Core (97% Workload Share, < 2 ms Execution in vivy_core.dll):
    • The native Rust engine (vivy-r-core + vivy-decide) receives the ArrangementCriteriaSpec and solves global lighting, camera lens, perspective projection, Socket-Lock kinematic constraints, and Catmull-Rom temporal splines across up to 30 Shot Blocks (180.0s / 3 minutes at 24 FPS = 4,320 frames) with zero LLM tokens generated during frame synthesis.

Pillar 1 — Overall Architecture Specification & System Map

flowchart LR
    U["User Natural Language Prompt"] --> LLM["Vivy-R-Vision-3B (3.09B Full-Weight GGUF / Safetensors)\n36 Transformer Blocks (d_model=2048, 435 Tensors)"]
    LLM -->|"ArrangementCriteriaSpec JSON\n(~280 tokens, 3% compute)"| ABI["C-ABI Boundary (vivy_core.dll)\nvivy_r_vision_render_json"]
    ABI --> DEC["Rust Max-Sum BP Solver (vivy-decide)\nCoupled Lighting × Camera × Aspect Tier"]
    DEC --> VEC["2-Tier Fixed Vector Canvas Engine (vivy-r-core)\n2000×1000 Stage + 1000×1000 Identity Box"]
    VEC --> OUT["Deterministic SVG/HTML5 Scene & 30-Shot-Block (180s) Video Stream"]

1.1. The 2-Tier Fixed Vector Canvas Invariant

  1. Tier 1 — Entity Identity Box (1000 × 1000 Normalized Vector Units):
    • Every entity archetype ($N = 4,096$: 1024 HUMAN, 1024 ANIMAL, 1024 PROP, 512 LANDSCAPE, 512 WEATHER) is defined inside an invariant 1000 × 1000 local coordinate box with explicit kinematic anchor sockets (SOCKET_HAND_R, SOCKET_HAND_L, SOCKET_HEAD_TOP, SOCKET_GROUND).
    • Entity identity digest (identity_digest) remains 100% invariant across all camera angles, zooms, and aspect ratios (16:9, 9:16, 1:1).
  2. Tier 2 — Stage Canvas (2000 × 1000 Physical Vector Units, 1 unit = 1 cm at Depth $Z = 1.0$):
    • Perspective projection obeys the exact physical law: $$H_{\text{proj}} = \frac{H_{\text{cm}}}{Z}, \quad Z \in [0.5, 10.0]$$
    • Props attach deterministically to human/animal sockets via Hard Socket-Lock: $$\mathbf{P}{\text{prop}}(t) \equiv \mathbf{P}{\text{socket}}(t)$$
  3. Uniform Temporal Ceiling (180.0s = 3 Minutes):
    • Video timelines are partitioned into at most 30 Shot Blocks of 6.0s (144 frames at 24 FPS, 4,320 frames maximum). Requests exceeding 180.0s are deterministically clamped to 4,320 frames (was_clamped_to_3min_ceiling = true).

Pillar 2 — Functional Specifications (PRD)

Feature IDCapabilityInputOutputAcceptance Metric
VIS-F01Standalone Full-Weight 3.09B GGUF InferenceNatural language prompt via llama.cpp / OllamaValid ArrangementCriteriaSpec JSONLoads all 36 layers (435 tensors, 3.09B params) in llama-cli / llama-server with 0 errors
VIS-F02Ultra-Fast .safetensors + Rust C-ABI SynthesisPrompt or VisionRenderRequest JSONComplete VisionRenderResponse with SVG & 30 Shot Blocks< 2.0 ms Rust synthesis latency, falsification_violations == 0
VIS-F03Interactive HTML5/SVG 30-Shot-Block Studio Playerrender_interactive_vision_player(prompt)Standalone .html studio player (0 external CDN dependencies)Interactive timeline scrub (0.0s..180.0s), Identity Box inspector, 1-click SVG frame export

Pillar 3 — Data Flow & State Machine

stateDiagram-v2
    [*] --> PromptIngest
    PromptIngest --> LLMCompile_3B: Tokenize & Forward 36-Layer Qwen2-3B + Projection Head
    LLMCompile_3B --> CoupledMaxSumBP: Emit ArrangementCriteriaSpec
    CoupledMaxSumBP --> VectorStageAssembly: Solve (Lighting, Camera, Aspect) Joint Assignment
    VectorStageAssembly --> TemporalSplineSynthesis: Project 4,096 Archetypes + Socket-Lock + 180s Clamp
    TemporalSplineSynthesis --> FalsificationAudit: Verify VM-11 & Physical Bounds
    FalsificationAudit --> [*]: Return Verified SVG + 30 Shot Blocks (falsification_violations = 0)

Pillar 4 — Standard Operating Procedure (SOP) & Runbook

4.1. Running the Full-Weight 3.09B GGUF in llama.cpp

llama-cli -m vivy-r-vision-3b-q4_k_m.gguf \
  -p "<|im_start|>system\nYou are Vivy-R-Vision-3B (R-VISION-3B). Emit a valid JSON ArrangementCriteriaSpec for the 2-Tier Vector Canvas (2000x1000 Stage + 1000x1000 Identity Box).<|im_end|>\n<|im_start|>user\nCreate a 3-minute cyberpunk rain scene with an anime girl holding a katana and a golden retriever.<|im_end|>\n<|im_start|>assistant\n" \
  -n 256 --temp 0.1

4.2. Running via Python + Native Rust vivy_core.dll

from vivy_core import VivyRVision3B, render_interactive_vision_player

engine = VivyRVision3B()
result = engine.render_from_natural_prompt(
    "3 minute cinematic anime girl walking in rain with goldenretriever under cyberpunk neon"
)
assert result["falsification_violations"] == 0
player = render_interactive_vision_player(
    "3 minute cinematic anime girl walking in rain with goldenretriever under cyberpunk neon",
    "artifacts/vision_player/vivy_r_vision_3b_player.html",
)

[ISOLATED / REPLACED — Pre-M4 Section 4.3 (Phases M1 & M2 Only)]

4.3. Verified Execution of Vivy-Cinema-Engine Phases M1 & M2 (2026-10-18)

  • Phase M1 (3D Articulated Skeletons & 4-Channel Physics/Kinematic Control Buffer in vivy_core.dll): 24-Joint Human IK + 16-Joint Animal Gait (190.0 FPS).
  • Phase M2 (Sparse-Paged 3D Spatio-Temporal DiT, ControlNet 4-Ch Bridge & 3D Causal Video VAE): 6 Euler steps (t0 = 0.60, 88.0% step reduction).

4.3. Verified Execution of Vivy-Cinema-Engine Phases M1, M2, M3 & M4 (2026-10-18)

  • Phase M1 (3D Articulated Skeletons & 4-Channel Physics/Kinematic Control Buffer in vivy_core.dll):
    • 24-Joint Human Analytical 2-Bone Law-of-Cosines Inverse Kinematics (HUMAN_SKELETON_JOINT_COUNT = 24, 23 bones) with rigid weapon socket locking (ik_socket_residual_cm = 0.000 cm <= 0.5 cm) and 5-point wind-compliant garment polygons.
    • 16-Joint Animal Quadruped/Avian Gait Solver (ANIMAL_SKELETON_JOINT_COUNT = 16, 15 bones).
    • FourChannelControlBufferReceipt ([4, 2000, 1000] = CH_A_OPENPOSE_SKELETON_IK, CH_B_METRIC_DEPTH_AND_NORMAL, CH_C_OPTICAL_FLOW_MOTION, CH_D_INSTANCE_IDENTITY_MASK) rasterized at 190.0 FPS (>= 120.0 FPS target, 0 LLM tokens).
  • Phase M2 (Sparse-Paged 3D Spatio-Temporal DiT, ControlNet 4-Ch Bridge & 3D Causal Video VAE in cinema_renderer.py + cautreo_pager.dll):
    • CautreoCinemaWeightPager: In-process C-ABI weight paging over 40 Wan2.1-T2V-1.3B / LTX-Video-2B DiT, ControlNet-4Ch, and 3D Causal VAE slices plus 435 GGUF tensors within a strict 2,048 MB (2.0 GB) RAM budget (peak_resident_ram_mb = 208.0 MB, 86.39% RAM reduction vs. unpaged 1,528.0 MB).
    • VivyCinemaEngineM2: Physics-Warm-Started Rectified Flow (t0 = 0.60, 6 Euler steps vs. 50 standard steps = 88.0% step reduction >= 65.0% KPI).
  • Phase M3 (Cross-Shot Causal Sink Frames & Tier-2 Identity Latent Vault):
    • Preserves 4 Causal Sink Frames across all 30 Shot Blocks (180.0s) and locks 16-D L2-normalized Identity Vault embeddings to each entity's 1000x1000 Identity Box (min_cross_shot_identity_cosine = 0.9955 >= 0.92).
  • Phase M4 (Rank-16 Vivy-Control-LoRA Distillation, Dense RGB Keyframe & Physics-Triggered Foley Audio):
    • Ships vivy_vision_control_lora.safetensors (42,844 bytes, 16 tensors, 10,321 parameters, lora_rank = 16, post_sealed.joint_accuracy = 1.0, tonemap_mae = 0.00351, interrupt_resume_max_delta = 0.0 <= 1e-5) evaluated in pure Python stdlib (_StdlibControlLoRAEvaluator).
    • Synthesizes 24-bit Dense RGB .bmp keyframes (86,454 bytes) and 16-bit PCM .wav Physics-Triggered Foley Audio (48,044 bytes: Katana metallic clash harmonics + quadruped hooves cadence + atmospheric precipitation bed).
    • See docs/VIVY_R_VISION_3B_COMMERCIAL_VIDEO_ROADMAP.md for the complete 4-Phase Vivy-Cinema-Engine specification.

Pillar 5 — Security, Integrity & Verification Audit (4-Axis Checklist)

  1. Conflict Check: Zero conflict between the standalone 3.09B Q4_K_M GGUF (2.10 GB, 435 tensors), the Rank-16 vivy_vision_control_lora.safetensors adapter, and the deterministic Rust C-ABI synthesis core (vivy_core.dll).
  2. Rationality Check: Full 3.09B parameters (~2.10 GB GGUF) fit comfortably within 4 GB RAM/VRAM on consumer PCs while offloading 97% of geometric/temporal rendering to < 2 ms native Rust.
  3. Redundancy Check: Zero external Python dependencies in python/vivy_core/ (pure Python stdlib + ctypes C-ABI); zero pixel diffusion waste.
  4. Effectiveness Check: 100% joint accuracy on dev and held-out sealed_test splits, interrupt_resume_max_delta == 0.0 <= 1e-5, and verified live llama.cpp execution.

Changelog

AgentTimestampReason
Antigravity IDE2026-10-17Initial specification for Vivy-R-Vision-3B (R-VISION-3B).
Antigravity IDE2026-10-18Upgraded to full-weight 3,085,938,688-parameter (3.09B, 435 tensors, ~2.10 GB Q4_K_M GGUF) release and translated public specification to 100% English per Hard Invariants #9 and #10 ( internal_vi/ retains Vietnamese copy).
Antigravity IDE2026-10-18Added Section 4.3 documenting verified execution of Vivy-Cinema-Engine Phase M1 (24J/16J 3D IK & 4-Channel Control Buffer @ 190.0 FPS) and Phase M2 (CautreoCinemaWeightPager, ControlNet4ChConditioningBridge, and 6-Step Warm-Started Rectified Flow DiT).
Antigravity IDE2026-10-18Completed Phases M3 & M4 (Receipt R-024): bundled Rank-16 vivy_vision_control_lora.safetensors (42,844 B), Dense RGB .bmp keyframe synthesis, and Physics-Triggered Foley .wav audio synthesis.

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · gguf

Можно запустить

Подбираем GPU…

Класс архитектуры
Qwen2ForCausalLM
Ревизия весов
69cf0d2

0 моделей