/ Модель

Характеристики

Лицензия
CreativeML OpenRAIL-M
Библиотека
diffusers
Опубликована
1 июн 2023

di.ffusion.ai.Beta512

Генерация изображенийТекст → изображение3 профессии

Бета-модель FFUSION Ai на основе Stable Diffusion 2.1 для генерации художественных изображений по английским текстовым описаниям.

61скачиваний за 30 дней12лайковвеса обновлены9 июл 2023

Бенчмарки

Как модель справилась с задачами пользователей ailist и что о ней публикуют открытые лидерборды

Тесты пользователейпока нет

Никто ещё не опубликовал тест этой модели. Соберите бенчмарк из своих задач — результат появится здесь.

  1. Добавьте модель в бенчмарк

    Вместе с другими моделями категории «Изображения» — сравнение идёт внутри одной категории.

  2. Опишите свои задачи

    Напишите запросы, при необходимости приложите файлы и эталонные ответы.

  3. Запустите и опубликуйте

    Модели сгенерируют результат по каждой задаче. Опубликованный тест появится на этой странице.

Публичные оценки

Из открытых лидербордов. Сравнивайте результаты одного теста при одинаковых условиях — отсутствие оценки не значит, что модель хуже.

В подключённых источниках результатов для этой модели пока нет.

Что умеет модель

Описание составлено по карточке модели и метаданным Hugging Face

FFUSION Ai Beta512 — модель генерации изображений по текстовому описанию, разработанная Idle Stoev, Source Code Bulgaria, Praesidium CX и BlackSwan Technologies. Это модель диффузии в латентном пространстве на основе Stable Diffusion 2.1 512; используется фиксированный текстовый энкодер OpenCLIP-ViT/H. Репозиторий предоставляет веса в форматах Diffusers, PyTorch и SafeTensors.

Модель предназначена для создания художественных изображений и экспериментов с сочетаниями промптов. Разработчики отмечают, что эта бета обучена на части заявленного набора изображений и лучше работает примерно при разрешении до 600–700 пикселей. Качество генерации некоторых объектов и лиц ещё дорабатывается; увеличение разрешения рекомендуется выполнять отдельно.

Модель ориентирована на английские текстовые запросы. Лицензия в метаданных указана как CreativeML OpenRAIL-M; README называет её CreativeML Open RAIL++-M и перечисляет ограничения на вредоносное, дискриминационное, несанкционированное и незаконное использование.

Сценарии применения

  • создание художественных изображений по текстовому промпту
  • эксперименты с объединением и эффектами промптов
  • визуализация творческих идей
  • изучение ограничений и смещений генеративных моделей

Ограничения

Это ранняя бета, обученная на части заявленного набора изображений; разработчики отмечают недостатки при генерации некоторых объектов и лиц. Оптимальное разрешение составляет примерно 600–700 пикселей, а качество и условия лицензии описаны в README и метаданных по-разному.

Для каких профессий подходит3

Разделы каталога профессий, в задачах которых используется эта модель

Все профессии

Карточка модели

README от автора на Hugging Face, как он его опубликовал

Открыть на Hugging Face

diffusion1.png

📣 Important Announcement: FFUSION Ai Public Beta Release is Here!

🔭 We are thrilled to launch the public beta release of FFUSION Ai, though we want to clarify that it's currently limited in its breadth. Having been trained on just a fraction of our full image collection (20%), the capabilities of the model are not yet fully realized. This early version is primarily intended for experimentation with various prompt combinations and initial testing.

💡 While we're committed to delivering the highest level of excellence, we want to highlight that our model, notably the Unet component, is still developing its proficiency with certain objects and faces. But fear not, we're actively fine-tuning these areas as we progress towards the final release.

🙏 A huge shout out to our Reddit community for their support in alpha testing and for helping the text encoder respond to some exciting fuse ideas. We couldn't have come this far without you!

💡 Your contribution in this beta testing phase is extremely crucial to us. We invite you to explore the model extensively, experiment with it, and do not hesitate to report any prompts that don't meet your expectations. Your feedback is our guiding light in refining the performance and overall quality of FFUSION Ai.

⚠️ Attention: The model is based on Stable Diffusion 2.1 - 512 and is designed for optimal performance up to a resolution of approximately 600-700 pixels. For larger image sizes, we recommend upscaling them independently or patiently waiting for our final release that's just around the corner. This forthcoming release will enhance performance and support for higher resolutions.

👥 Thank you for being part of the FFUSION Ai beta testing community. Your support, feedback, and passion inspire us to continually develop a pioneering tool that is set to revolutionize creativity and visualization. Together, we can shape the future of storytelling and creativity.

🔮 Why not add some effects to your favorite prompts or fuse them together for a surreal twist? (Please note, Pen Pineapple Apple Pan effects and FUSIONS are excluded in this beta version)

🔒 With over 730.9449 hours of dedicated training sessions, our Fusion AI model offers a wealth of data subsets and robust datasets developed in collaboration with two enterprise corporate accounts for Mid Journey. We also pride ourselves in having an effective utilization of GPU usage, making the most out of our partnership with Idle Stoev, Source Code Bulgaria, Praesidium CX & BlackSwan Technologies. 🚀

Full transparency on our extensive 700,000-image dataset, training methodologies, classifications, and successful experiments is on its way. This information will be released shortly after the final version, further establishing FFUSION Ai as a trusted tool in the world of AI-powered creativity. Let's continue to imagine, create and explore together!

download the di.FFUSION.ai-512-beta-BFG-build.0401.safetensors here.

🚀 Model Overview: Unleashing the Power of Imagination! 🌠

Introducing FFUSION AI - a groundbreaking tool for image generation and transformation, crafted around the cutting-edge Latent Diffusion Model. We build on the impressive capabilities of Stability AI's Stable Diffusion v2.1 512 & 768 models, harnessing the power of a fixed, pre-trained text encoder (OpenCLIP-ViT/H). Let's delve into a universe where creativity knows no bounds!

Developed by: Idle Stoev, Source Code Bulgaria, Praesidium CX & BlackSwan Technologies

Model type: Diffusion-based text-to-image generation model

Language(s): English

License: CreativeML Open RAIL++-M License

🔬 Intended Use: From Research to Artistry 🎨

FFUSION AI is a multi-faceted tool that shines in various applications. Primarily envisioned for research, FFUSION AI has potential to:

  • Securely deploy models that could generate sensitive content, making AI safer.
  • Examine the limitations and inherent biases in generative models.
  • Unleash the artist within, aiding in creative processes or artistic endeavours.
  • Reinvent educational or creative utilities with AI-driven innovations.
  • Propel the research in the fascinating domain of generative models.

However, it's crucial to note that certain uses of FFUSION AI are strictly prohibited, as outlined below.

🚫 Forbidden Use: Setting Boundaries for Safe AI 🛑

Our policy, adopted from the principles of the Stable Diffusion v2.1 model card, ensures the responsible use of Fusion AI beta and final releases. We expressly prohibit the utilization of our model for generating or distributing images that might incite hostility or exclusion. This includes:

  • Content that is distressing, offensive, or perpetuates harmful stereotypes.
  • Misuse or malicious use that harms individuals or communities, including creating demeaning or harmful representations, or promoting discriminatory content.
  • Using the model for impersonation without consent or creating non-consensual explicit content.
  • Generating or spreading mis- and disinformation, violent, gory imagery, or violating copyright terms.

🔭 Model Limitations and Bias: Acknowledging Imperfections 🌐

While our model leaps toward the future of AI-driven creativity, it's essential to recognize its current limitations:

  • The quest for perfect photorealism continues.
  • Rendering legible text remains a challenge.
  • Even more complex tasks, such as depicting "A red cube on top of a blue sphere in the middle of the ocean in a desert" may pose difficulty (but still processable).
  • Human figures, particularly faces, may not be accurately generated.

The power of generative models also brings with it the potential for bias. As Stable Diffusion v2 trains primarily on subsets of LAION-2B(en) with English descriptions, the representations of non-English communities may be insufficient, often defaulting to white-biased and western cultures. As such, discretion is advised, recognizing that the model may unintentionally amplify biases, irrespective of input or intent. At FFUSION AI, we're committed to bringing your wildest imaginations to life, while maintaining a safe, inclusive, and responsible use of AI. Together, let's revolutionize the world of creativity! 🌟

Version Releases

We are excited to unveil the following versions:

Version 512 Beta – LiTE, MiD BFG model variations:

  • FFUSION.ai-512-beta-BFG-build.0401.safetensors
  • FFUSION.ai-512-beta-LiTE-build.0201.safetensors
  • FFUSION.ai-512-beta-MiD-build.0401.safetensors

Version 768 Alpha - BaSE, FUSION, FFUSION:

BaSE and FUSION models will soon come with enhanced training capabilities including LoRa, LyCORIS, Dylora & Kohya-ss/sd-scripts. More information will be revealed upon release.

FUSION AI Text Encoders:

  • di.FFUSION.ai-tXe-FXAA: Trained on "121361" images. Enhance your model's quality and sharpness using the pre-trained Unet.
  • di.FFUSION.ai-tXe-fX: Trained on "211924" images. Amplify your model's surrealism and effects.

Environmental Impact

Our dedication to sustainable development is reflected in the model's carbon footprint. The CO2 emissions, calculated using the Machine Learning Impact calculator, stand at 124.95 kg for a total of 1190 hours of usage with an A100 PCIe 40GB GPU.

Hardware Type: A100 PCIe 40GB

Hours used: 1190

Cloud Provider: CoreWeave & Runpod (official partner)

Compute Region: US Cyxtera Chicago Data Center - ORD1 / EU - CZ & EU - RO

  • Carbon Emitted (Power consumption x Time x Carbon produced based on the location of the power grid): 124.95 kg of CO2 emitted.
  • Power consumption x Time x Carbon Produced Based on the Local Power Grid: 250W x 1190h = 297.5 kWh x 0.42 kg eq. CO2/kWh = 124.95 kg eq. CO2
  • Local Hardware Storage 4x16TB Raid5 WD Gold Optimizer: AdamW & Dadaptation

This model card was written by: Idle Stoev and is based on the Stability AI - Stable Diffusion 2.1 model card.

Models:

FFusion-BaSE di.FFUSION.ai-v2.1-768-BaSE-alpha di.ffusion.ai.Beta512 FFUSION.ai-Text-Encoder-LyCORIS-SD-2.1

Contact:

Email

00013-1036284071.png 00015-3985469761.png 00330-2956498776.png 00337-1810773926.png 00482-1197426562.png 00661-664664665.png 00788-664664664.png 00948-2727167565.png 01157-1892899058.png 01501-1164179986.png 01590-2916583255.png 01610-3979970458.png 07469-623330035.png 07515-1211575330.png 08289-3770274505.png 08299-2395122416.png 08345-3851437841.png 08526-556556182.png 09163-1297586713.png

Как запустить

На своей GPU в ailist. Цена — по текущим предложениям провайдеров

GPU в ailist

Универсальный рантайм · diffusers

Можно запустить

Подбираем GPU…

Ревизия весов
13c58bd

0 моделей