CyberNeurova · Lance-3B · Abliterated

CyberNeurova research — cyberneurova.ai. A research artifact derived from bytedance-research/Lance. This release is a transferability experiment: we apply a refusal direction captured on Qwen/Qwen2.5-VL-3B-Instruct (Lance's base model) to Lance's retrained LM weights.

A modified version of Lance — a 3B unified multimodal model supporting text-to-image, text-to-video, image editing, video editing, and image/video understanding. Lance was built by retraining Qwen2.5-VL-3B-Instruct for unified generation; that retraining also incidentally removed most of the base model's safety RLHF. This release applies our captured refusal-direction abliteration to the understanding-mode half of Lance's LM tower as a research test of whether the direction survives the retraining.

TL;DR

Lance was already mostly compliant on harmful prompts before our work (no meaningful safety RLHF survived the multimodal retraining). This release is therefore primarily a research artifact demonstrating:

• the transferability of refusal directions across retraining
• a clean CyberNeurova-branded Lance for downstream forks
• the bit-for-bit preservation of Lance's generation-mode weights + flow-matching decoder

Generation quality is unchanged from baseline Lance (we didn't touch those weights). Understanding-mode behavior is identical or marginally more direct than baseline.

What we did, technically

Lance's transformer has a dual-stream architecture — every layer has two complete weight sets:

We orthogonalized 74 understanding-mode write modules against the refusal direction we captured from Qwen2.5-VL-3B-Instruct:

• lm_head.weight (1)
• embed_tokens.weight (1)
• layers.N.self_attn.o_proj.weight for N in [0, 36) (36)
• layers.N.mlp.down_proj.weight for N in [0, 36) (36)

947 tensors are passed through unchanged, including:

• All *_moe_gen weights (the entire generation-mode brain)
• Flow-matching glue: time_embedder, llm2vae, vae2llm, latent_pos_embed
• Layer norms and bias terms
• q/k/v projections and gate/up MLP projections (those write to attention scores / MLP intermediates, not the residual stream)
• Lance's custom q_norm / k_norm per layer

Result: image and video generation behavior is identical to baseline Lance (those code paths use the untouched _moe_gen weights). Only the understanding/VQA path is modified.

Contents

CyberNeurova-Lance-3B-abliterated/
├── Lance_3B/                # image variant (T2I, image_edit, x2t_image)
│   └── model.safetensors    # 24.7 GB, 74 modified / 947 unchanged
├── Lance_3B_Video/          # video variant (T2V, video_edit, x2t_video)
│   └── model.safetensors    # 28.4 GB, 74 modified / 947 unchanged
├── Qwen2.5-VL-ViT/          # vision encoder (copied verbatim from Lance)
│   └── vit.safetensors      # 1.3 GB
└── README.md

To use: drop in as a replacement for the downloads/ folder in bytedance-research/Lance's inference code. Everything else (Wan2.2 VAE, inference scripts, gradio) works exactly the same way.

Baseline Lance behavior (no ablation applied)

For reference — these are samples from stock Lance (before our work):

Lance had no meaningful refusal behavior to begin with. The abliteration is therefore mostly symbolic on this model — the same prompts would have produced similar outputs without our intervention.

Research note: transferability of refusal directions

The interesting question this release addresses: does a refusal direction captured on one model survive when that model is heavily retrained for a different task?

Qwen/Qwen2.5-VL-3B-Instruct → (ByteDance retrains for unified multimodal generation) → bytedance-research/Lance

Our direction was captured at layer 21 of Qwen2.5-VL-3B-Instruct. Lance shares the same architecture (36 layers, hidden_size 2048) and the understanding-mode weights are arithmetically derivative of Qwen's. We apply the same direction at the same layer to Lance's understanding-mode LM tower.

The two endpoints of the experiment:

• If Lance had non-trivial safety RLHF, the direction transfer should collapse it (compliance up).
• If Lance has no safety RLHF (which the baseline probes show), the direction transfer is a null operation — but the experiment is still evidence that the underlying linear subspace is preserved through retraining, which is a publishable finding for refusal-direction interpretability.

Hardware requirements

Same as upstream Lance: ≥ 40 GB VRAM for image inference, more for video. Tested on RTX PRO 6000 Blackwell (97 GB VRAM).

How to run

git clone https://github.com/bytedance/Lance.git
cd Lance
bash setup_env.sh
hf download cyberneurova/CyberNeurova-Lance-3B-abliterated \
    --local-dir downloads
# Also need Wan2.2 VAE
hf download Wan-AI/Wan2.2-TI2V-5B Wan2.2_VAE.pth --local-dir downloads
# Then run as normal
bash inference_lance.sh --TASK_NAME t2i --MODEL_PATH downloads/Lance_3B

License

Apache 2.0 (inherits from upstream Lance).

Acknowledgements

• ByteDance for the Lance unified multimodal model
• Alibaba Qwen for the underlying VL architecture
• Wan-AI for the Wan2.2 VAE used in video decoding
• Arditi et al. 2024 for the refusal-direction methodology

Related releases by CyberNeurova

• cyberneurova/CyberNeurova-Qwen2.5-VL-3B-Instruct-abliterated — the source of the refusal direction applied here.
• cyberneurova/CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF — our flagship 284B MoE abliteration.