Min-Illust-Background-Diffusion
This fine-tuned Stable Diffusion v1.5 model was trained for 2250 iterations with a batch size of 4, on a selection of artistic works by Sin Jong Hun. Training was performed using ShivamShrirao/diffusers with full precision, prior-preservation loss, the train-text-encoder feature, and the new 1.5 MSE VAE from Stability AI. A total of 4120 regularization / class images were used from here. Regularization images were generated using the prompt "artwork style", 50 DDIM steps, and a CFG of 7.
Use the tokens sjh style in your prompts for the effect. Note that the effect also appears to occur at a much weaker strength on prompts that steer the output towards specific artistic styles.
This model will likely not perform well on generating portraits and related tasks, as the training data was primarily composed of landscapes.
Example images were generated with the v1 2250 iteration model using 50 steps of DPM++ 2M Karras with a format of:
<prompt>, sjh style