Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,73 @@
|
|
1 |
---
|
2 |
license: creativeml-openrail-m
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: creativeml-openrail-m
|
3 |
+
language:
|
4 |
+
- en
|
5 |
---
|
6 |
+
![diffusion1.png](https://s3.amazonaws.com/moonup/production/uploads/6380cf05f496d57325c12194/COUyHLQYxy-4bp7bocO6j.png)
|
7 |
+
# π Model Overview: Unleashing the Power of Imagination! π
|
8 |
+
Introducing FFUSION AI - a groundbreaking tool for image generation and transformation, crafted around the cutting-edge Latent Diffusion Model. We build on the impressive capabilities of Stability AI's Stable Diffusion v2.1 512 & 768 models, harnessing the power of a fixed, pre-trained text encoder (OpenCLIP-ViT/H).
|
9 |
+
Let's delve into a universe where creativity knows no bounds!
|
10 |
+
|
11 |
+
**Developed by:** Idle Stoev, Source Code Bulgaria, Praesidium CX & BlackSwan Technologies
|
12 |
+
**Model type:** Diffusion-based text-to-image generation model
|
13 |
+
**Language(s):** English
|
14 |
+
**License:** CreativeML Open RAIL++-M License
|
15 |
+
|
16 |
+
|
17 |
+
# π¬ Intended Use: From Research to Artistry π¨
|
18 |
+
FFUSION AI is a multi-faceted tool that shines in various applications. Primarily envisioned for research, FFUSION AI has potential to:
|
19 |
+
Securely deploy models that could generate sensitive content, making AI safer.
|
20 |
+
Examine the limitations and inherent biases in generative models.
|
21 |
+
Unleash the artist within, aiding in creative processes or artistic endeavours.
|
22 |
+
Reinvent educational or creative utilities with AI-driven innovations.
|
23 |
+
Propel the research in the fascinating domain of generative models.
|
24 |
+
However, it's crucial to note that certain uses of FFUSION AI are strictly prohibited, as outlined below.
|
25 |
+
|
26 |
+
# π« Forbidden Use: Setting Boundaries for Safe AI π
|
27 |
+
Our policy, adopted from the principles of the Stable Diffusion v2.1 model card, ensures the responsible use of Fusion AI beta and final releases. We expressly prohibit the utilization of our model for generating or distributing images that might incite hostility or exclusion. This includes:
|
28 |
+
Content that is distressing, offensive, or perpetuates harmful stereotypes.
|
29 |
+
Misuse or malicious use that harms individuals or communities, including creating demeaning or harmful representations, or promoting discriminatory content.
|
30 |
+
Using the model for impersonation without consent or creating non-consensual explicit content.
|
31 |
+
Generating or spreading mis- and disinformation, violent, gory imagery, or violating copyright terms.
|
32 |
+
|
33 |
+
# π Model Limitations and Bias: Acknowledging Imperfections π
|
34 |
+
While our model leaps toward the future of AI-driven creativity, it's essential to recognize its current limitations:
|
35 |
+
The quest for perfect photorealism continues.
|
36 |
+
Rendering legible text remains a challenge.
|
37 |
+
Even more complex tasks, such as depicting "A red cube on top of a blue sphere in the middle of the ocean in a desert" may pose difficulty (but still processable).
|
38 |
+
Human figures, particularly faces, may not be accurately generated.
|
39 |
+
The power of generative models also brings with it the potential for bias. As Stable Diffusion v2 trains primarily on subsets of LAION-2B(en) with English descriptions, the representations of non-English communities may be insufficient, often defaulting to white-biased and western cultures. As such, discretion is advised, recognizing that the model may unintentionally amplify biases, irrespective of input or intent.
|
40 |
+
At FFUSION AI, we're committed to bringing your wildest imaginations to life, while maintaining a safe, inclusive, and responsible use of AI. Together, let's revolutionize the world of creativity! π
|
41 |
+
|
42 |
+
# Version Releases
|
43 |
+
We are excited to unveil the following versions:
|
44 |
+
|
45 |
+
## Version 512 Beta β LiTE, MiD BFG model variations:
|
46 |
+
|
47 |
+
**FFUSION.ai-512-beta-BFG-build.0401.safetensors**
|
48 |
+
**FFUSION.ai-512-beta-LiTE-build.0201.safetensors**
|
49 |
+
**FFUSION.ai-512-beta-MiD-build.0401.safetensors**
|
50 |
+
|
51 |
+
### Version 768 Alpha - BaSE, FUSION, FFUSION:
|
52 |
+
BaSE and FUSION models will soon come with enhanced training capabilities including LoRa, LyCORIS, Dylora & Kohya-ss/sd-scripts. More information will be revealed upon release.
|
53 |
+
|
54 |
+
|
55 |
+
# FUSION AI Text Encoders:
|
56 |
+
**di.FFUSION.ai-tXe-FXAA:** Trained on "121361" images. Enhance your model's quality and sharpness using the pre-trained Unet.
|
57 |
+
**di.FFUSION.ai-tXe-fX:** Trained on "211924" images. Amplify your model's surrealism and effects.
|
58 |
+
|
59 |
+
# Environmental Impact
|
60 |
+
Our dedication to sustainable development is reflected in the model's carbon footprint. The CO2 emissions, calculated using the Machine Learning Impact calculator, stand at 124.95 kg for a total of 1190 hours of usage with an A100 PCIe 40GB GPU.
|
61 |
+
|
62 |
+
**Hardware Type:** A100 PCIe 40GB
|
63 |
+
**Hours used:** 1190
|
64 |
+
**Cloud Provider:** CoreWeave & Runpod (official partner)
|
65 |
+
**Compute Region**: US Cyxtera Chicago Data Center - ORD1 / EU - CZ & EU - RO
|
66 |
+
|
67 |
+
Carbon Emitted (Power consumption x Time x Carbon produced based on the location of the power grid): 124.95 kg of CO2 emitted.
|
68 |
+
Power consumption x Time x Carbon Produced Based on the Local Power Grid:
|
69 |
+
250W x 1190h = 297.5 kWh x 0.42 kg eq. CO2/kWh = 124.95 kg eq. CO2
|
70 |
+
Local Hardware Storage 4x16TB Raid5 WD Gold
|
71 |
+
Optimizer: AdamW & Dadaptation
|
72 |
+
|
73 |
+
**This model card was written by: Idle Stoev and is based on the Stability AI - Stable Diffusion 2.1 model card.**
|