Dreambooth Hackaton 23': How can we use a text-to-image generative model to explore the cinematographic appeal of Torres del Paine 🇨🇱?
Torres del Paine National Park is a national park encompassing mountains, glaciers, lakes, and rivers in southern Chilean Patagonia. It is also part of the End of the World Route, a tourist scenic route. Wikipedia
- Reddit post #1: Dreambooth Hackaton: How can we use a text-to-image model to explore the cinematographic appeal of Torres del Paine 🇨🇱?
- Reddit post #2: Animal statues at Torres del Paine, ppain landscape model; Dreambooth + StableDiffusion
Description
DreamBooth model for the ppaine concept trained by alkzar90 on the alkzar90/torres-del-paine dataset.
This is a Stable Diffusion model fine-tuned on the ppaine concept with DreamBooth. It can be used by modifying the instance_prompt: a photo of ppaine landscape
This model was created as part of the DreamBooth Hackathon 🔥. Visit the organisation page for instructions on how to take part!
This is a Stable Diffusion model fine-tuned on landscape images for the landscape theme.
Cinematographics rendering & Object/Artifacts insertion
Object/Artifact insertions
Director's eye view
What does the director's cut concept mean? The definition by the Merriam-Webster dictionary is: "a version of a motion picture that is edited according to the director's wishes and that usually includes scenes cut from the version created for general distribution".
Artistic Style Transfer
One way to monitor the fine-tuning process is to look at the model capabilities for transferring well-known artistic styles into the Torres del Paine landscape.
Usage
from diffusers import StableDiffusionPipeline
pipeline = StableDiffusionPipeline.from_pretrained('alkzar90/ppaine-landscape')
image = pipeline().images[0]
image
References
- DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation (Ruiz et al. 2022)
- High-Resolution Image Synthesis with Latent Diffusion Models (Rombach et al., 2022 )
- Training Stable Diffusion with Dreambooth using 🧨 Diffusers (Post)
- Hugging Face DreamBooth Hackathon
Thanks to John Whitaker and Lewis Tunstall
Thanks to John Whitaker and Lewis Tunstall for writing out and describing the initial hackathon parameters at https://huggingface.co/dreambooth-hackathon.