|
--- |
|
license: creativeml-openrail-m |
|
language: |
|
- en |
|
pipeline_tag: text-to-image |
|
tags: |
|
- stable-diffusion |
|
- text-to-image |
|
- di.ffusion.ai |
|
- art |
|
- base model |
|
library_name: diffusers |
|
widget: |
|
- text: >- |
|
a sprinkled donut sitting on top of a table, blender donut tutorial, |
|
colorful hyperrealism, everything is made of candy, hyperrealistic digital |
|
painting, covered in sprinkles and crumbs, vibrant colors hyper realism, |
|
colorful smoke explosion background |
|
example_title: Donut Fusion |
|
- text: >- |
|
a cup of coffee with a tree in it, surreal art, awesome great composition, |
|
surrealism!!!!, cafe in the clouds, perfectly realistic yet surreal, surreal |
|
realistic, floating trees, amazing composition, dream scenery art, whimsical |
|
surrealism, surreal composition, trending artistic art, surrealism art, |
|
surreal scene, surrealistic painting, surreal style, surreal illustration, |
|
dreamlike surrealism colorful smoke and fire coming out of it,explosion of |
|
data fragments,exploding background,realistic explosion,3d digital art |
|
4k,fire and explosion,explosion,background explosion,cinema 4 d |
|
art,shattering,beeple. hyperrealism,explosion background,rendered in cinema |
|
4 d,rendered in cinema4d,explosive background, |
|
example_title: Coffee Fusion |
|
- text: >- |
|
brightly colored headphones with a splash of paint and music notes, vibing |
|
to music, artistic illustration, stunning artwork, music is life, beautiful |
|
digital artwork, headphones on, listening to music, music poster, |
|
synesthesia, music in the air, listening to godly music, style hybrid mix of |
|
beeple, headphones, digital artwork 4 k, side profile artwork, no humans, |
|
planet, space, black background, cable, simple background, concept art, |
|
cinematic, dramatic, intricate details, dark lighting |
|
example_title: Headset Fusion |
|
- text: >- |
|
a group of three blocks with a picture of a boat in the middle of them, |
|
surreal 3 d render, 3 d epic illustrations, 3 d artistic render, inspired by |
|
Matthias Jung, environmental key art, erik johansson style, surreal concept |
|
art, alexander jansson style, cube portals, beeple masterpiece, 3 d render |
|
beeple, surrealistic digital artwork |
|
example_title: Digital Fusion |
|
--- |
|
 |
|
|
|
📣 **Important Announcement:** FFUSION Ai Public Beta Release is Here! |
|
|
|
🔭 We are thrilled to launch the public beta release of FFUSION Ai, though we want to clarify that it's currently limited in its breadth. Having been trained on just a fraction of our full image collection (20%), the capabilities of the model are not yet fully realized. This early version is primarily intended for experimentation with various prompt combinations and initial testing. |
|
|
|
💡 While we're committed to delivering the highest level of excellence, we want to highlight that our model, notably the Unet component, is still developing its proficiency with certain objects and faces. But fear not, we're actively fine-tuning these areas as we progress towards the final release. |
|
|
|
🙏 A huge shout out to our Reddit community for their support in alpha testing and for helping the text encoder respond to some exciting fuse ideas. We couldn't have come this far without you! |
|
|
|
💡 Your contribution in this beta testing phase is extremely crucial to us. We invite you to explore the model extensively, experiment with it, and do not hesitate to report any prompts that don't meet your expectations. Your feedback is our guiding light in refining the performance and overall quality of FFUSION Ai. |
|
|
|
⚠️ **Attention:** The model is based on Stable Diffusion 2.1 - 512 and is designed for optimal performance up to a resolution of approximately 600-700 pixels. For larger image sizes, we recommend upscaling them independently or patiently waiting for our final release that's just around the corner. This forthcoming release will enhance performance and support for higher resolutions. |
|
|
|
👥 Thank you for being part of the FFUSION Ai beta testing community. Your support, feedback, and passion inspire us to continually develop a pioneering tool that is set to revolutionize creativity and visualization. Together, we can shape the future of storytelling and creativity. |
|
|
|
🔮 Why not add some effects to your favorite prompts or fuse them together for a surreal twist? (Please note, Pen Pineapple Apple Pan effects and FUSIONS are excluded in this beta version) |
|
|
|
🔒 With over 730.9449 hours of dedicated training sessions, our Fusion AI model offers a wealth of data subsets and robust datasets developed in collaboration with two enterprise corporate accounts for Mid Journey. We also pride ourselves in having an effective utilization of GPU usage, making the most out of our partnership with Idle Stoev, Source Code Bulgaria, Praesidium CX & BlackSwan Technologies. 🚀 |
|
|
|
Full transparency on our extensive 700,000-image dataset, training methodologies, classifications, and successful experiments is on its way. This information will be released shortly after the final version, further establishing FFUSION Ai as a trusted tool in the world of AI-powered creativity. Let's continue to imagine, create and explore together! |
|
|
|
download the **`di.FFUSION.ai-512-beta-BFG-build.0401.safetensors`** [here](https://huggingface.co/FFusion/di.ffusion.ai.Beta512/blob/main/di.FFUSION.ai-512-beta-BFG-build.0401.safetensors). |
|
|
|
# 🚀 Model Overview: Unleashing the Power of Imagination! 🌠 |
|
Introducing FFUSION AI - a groundbreaking tool for image generation and transformation, crafted around the cutting-edge Latent Diffusion Model. We build on the impressive capabilities of Stability AI's Stable Diffusion v2.1 512 & 768 models, harnessing the power of a fixed, pre-trained text encoder (OpenCLIP-ViT/H). |
|
Let's delve into a universe where creativity knows no bounds! |
|
|
|
**Developed by:** Idle Stoev, Source Code Bulgaria, Praesidium CX & BlackSwan Technologies |
|
|
|
**Model type:** Diffusion-based text-to-image generation model |
|
|
|
**Language(s):** English |
|
|
|
**License:** CreativeML Open RAIL++-M License |
|
|
|
|
|
# 🔬 Intended Use: From Research to Artistry 🎨 |
|
|
|
FFUSION AI is a multi-faceted tool that shines in various applications. Primarily envisioned for research, FFUSION AI has potential to: |
|
- Securely deploy models that could generate sensitive content, making AI safer. |
|
- Examine the limitations and inherent biases in generative models. |
|
- Unleash the artist within, aiding in creative processes or artistic endeavours. |
|
- Reinvent educational or creative utilities with AI-driven innovations. |
|
- Propel the research in the fascinating domain of generative models. |
|
|
|
However, it's crucial to note that certain uses of FFUSION AI are strictly prohibited, as outlined below. |
|
|
|
# 🚫 Forbidden Use: Setting Boundaries for Safe AI 🛑 |
|
Our policy, adopted from the principles of the Stable Diffusion v2.1 model card, ensures the responsible use of Fusion AI beta and final releases. |
|
We expressly prohibit the utilization of our model for generating or distributing images that might incite hostility or exclusion. This includes: |
|
- Content that is distressing, offensive, or perpetuates harmful stereotypes. |
|
- Misuse or malicious use that harms individuals or communities, including creating demeaning or harmful representations, or promoting discriminatory content. |
|
- Using the model for impersonation without consent or creating non-consensual explicit content. |
|
- Generating or spreading mis- and disinformation, violent, gory imagery, or violating copyright terms. |
|
|
|
# 🔭 Model Limitations and Bias: Acknowledging Imperfections 🌐 |
|
While our model leaps toward the future of AI-driven creativity, it's essential to recognize its current limitations: |
|
- The quest for perfect photorealism continues. |
|
- Rendering legible text remains a challenge. |
|
- Even more complex tasks, such as depicting "A red cube on top of a blue sphere in the middle of the ocean in a desert" may pose difficulty (but still processable). |
|
- Human figures, particularly faces, may not be accurately generated. |
|
|
|
The power of generative models also brings with it the potential for bias. As Stable Diffusion v2 trains primarily on subsets of LAION-2B(en) with English descriptions, the representations of non-English communities may be insufficient, often defaulting to white-biased and western cultures. As such, discretion is advised, recognizing that the model may unintentionally amplify biases, irrespective of input or intent. |
|
At FFUSION AI, we're committed to bringing your wildest imaginations to life, while maintaining a safe, inclusive, and responsible use of AI. Together, let's revolutionize the world of creativity! 🌟 |
|
|
|
# Version Releases |
|
We are excited to unveil the following versions: |
|
|
|
## Version 512 Beta – LiTE, MiD BFG model variations: |
|
|
|
- FFUSION.ai-512-beta-BFG-build.0401.safetensors |
|
- FFUSION.ai-512-beta-LiTE-build.0201.safetensors |
|
- FFUSION.ai-512-beta-MiD-build.0401.safetensors |
|
|
|
|
|
### Version 768 Alpha - BaSE, FUSION, FFUSION: |
|
BaSE and FUSION models will soon come with enhanced training capabilities including LoRa, LyCORIS, Dylora & Kohya-ss/sd-scripts. More information will be revealed upon release. |
|
|
|
|
|
|
|
|
|
# FUSION AI Text Encoders: |
|
- **di.FFUSION.ai-tXe-FXAA:** Trained on "121361" images. Enhance your model's quality and sharpness using the pre-trained Unet. |
|
- **di.FFUSION.ai-tXe-fX:** Trained on "211924" images. Amplify your model's surrealism and effects. |
|
|
|
|
|
|
|
|
|
# Environmental Impact |
|
Our dedication to sustainable development is reflected in the model's carbon footprint. The CO2 emissions, calculated using the Machine Learning Impact calculator, stand at 124.95 kg for a total of 1190 hours of usage with an A100 PCIe 40GB GPU. |
|
|
|
**Hardware Type:** A100 PCIe 40GB |
|
|
|
**Hours used:** 1190 |
|
|
|
**Cloud Provider:** CoreWeave & Runpod (official partner) |
|
|
|
**Compute Region**: US Cyxtera Chicago Data Center - ORD1 / EU - CZ & EU - RO |
|
|
|
- Carbon Emitted (Power consumption x Time x Carbon produced based on the location of the power grid): 124.95 kg of CO2 emitted. |
|
- Power consumption x Time x Carbon Produced Based on the Local Power Grid: |
|
250W x 1190h = 297.5 kWh x 0.42 kg eq. CO2/kWh = 124.95 kg eq. CO2 |
|
- Local Hardware Storage 4x16TB Raid5 WD Gold |
|
Optimizer: AdamW & Dadaptation |
|
|
|
**This model card was written by: Idle Stoev and is based on the Stability AI - Stable Diffusion 2.1 model card.** |
|
|
|
Models: |
|
|
|
[](https://huggingface.co/FFusion/FFusion-BaSE) |
|
[](https://huggingface.co/FFusion/di.FFUSION.ai-v2.1-768-BaSE-alpha) |
|
[](https://huggingface.co/FFusion/di.ffusion.ai.Beta512) |
|
[](https://huggingface.co/FFusion/FFUSION.ai-Text-Encoder-LyCORIS-SD-2.1) |
|
|
|
Contact: |
|
|
|
[](mailto:[email protected]) |
|
|
|
|
|
|
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
 |
|
|
|
|
