SoteDiffusion Wuerstchen3
Anime finetune of Würstchen V3.
Usage
Please refer to the main model: https://huggingface.co/Disty0/sotediffusion-wuerstchen3
Dataset
Trained with 512K images.
Training:
GPU used for training: 1x AMD RX 7900 XTX 24GB
GPU Hours: 100
Software used: https://github.com/2kpr/StableCascade
Config:
experiment_id: sotediffusion-wr3_3b-stage_b-alpha3
model_version: 3B
dtype: bfloat16
use_fsdp: False
batch_size: 16
grad_accum_steps: 16
updates: 102400
backup_every: 2048
save_every: 1024
warmup_updates: 128
lr: 1.0e-5
optimizer_type: Adafactor
adaptive_loss_weight: False
stochastic_rounding: True
image_size: 768
multi_aspect_ratio: [1/1, 1/2, 1/3, 2/3, 3/4, 1/5, 2/5, 3/5, 4/5, 1/6, 5/6, 9/16]
shift: 4
checkpoint_path: /mnt/DataSSD/AI/SoteDiffusion/Wuerstchen3/
output_path: /mnt/DataSSD/AI/SoteDiffusion/Wuerstchen3/
webdataset_path: file:/mnt/DataSSD/AI/anime_image_dataset/best/newest_best.tar
effnet_checkpoint_path: /mnt/DataSSD/AI/models/wuerstchen3/effnet_encoder.safetensors
stage_a_checkpoint_path: /mnt/DataSSD/AI/models/wuerstchen3/stage_a.safetensors
generator_checkpoint_path: /mnt/DataSSD/AI/SoteDiffusion/Wuerstchen3/generator_4k-016384.safetensors
Limitations and Bias
Bias
- This model is intended for anime illustrations.
Realistic capabilites are not tested at all.
Limitations
- Far shot eyes are can bad.
License
SoteDiffusion models falls under Fair AI Public License 1.0-SD license, which is compatible with Stable Diffusion models’ license. Key points:
- Modification Sharing: If you modify SoteDiffusion models, you must share both your changes and the original license.
- Source Code Accessibility: If your modified version is network-accessible, provide a way (like a download link) for others to get the source code. This applies to derived models too.
- Distribution Terms: Any distribution must be under this license or another with similar rules.
- Compliance: Non-compliance must be fixed within 30 days to avoid license termination, emphasizing transparency and adherence to open-source values.
Notes: Anything not covered by Fair AI license is inherited from Stability AI Non-Commercial license which is named as LICENSE_INHERIT.