TheyCallMeHex commited on
Commit
660ccfe
·
1 Parent(s): 4c995cd

Updated new readme

Browse files
Assets/OnnxStack - 640x320.png ADDED
Assets/modi_ddim_30_7.5_2092464983.png ADDED
Assets/modi_ddpm_30_7.5_2092464983.png ADDED
Assets/modi_euler_30_7.5_2092464983.png ADDED
Assets/modi_eulerancestral_30_7.5_2092464983.png ADDED
Assets/modi_kdpm2_30_7.5_2092464983.png ADDED
Assets/modi_lms_30_7.5_2092464983.png ADDED
README.md CHANGED
@@ -1,66 +1,40 @@
1
  ---
 
 
2
  license: creativeml-openrail-m
3
  tags:
4
  - stable-diffusion
 
5
  - text-to-image
 
 
6
  ---
7
- **Mo Di Diffusion**
8
 
9
- This is the fine-tuned Stable Diffusion 1.5 model trained on screenshots from a popular animation studio.
10
- Use the tokens **_modern disney style_** in your prompts for the effect.
 
11
 
12
- **If you enjoy my work, please consider supporting me**
13
- [![Become A Patreon](https://badgen.net/badge/become/a%20patron/F96854)](https://patreon.com/user?u=79196446)
14
 
15
- **Videogame Characters rendered with the model:**
16
- ![Videogame Samples](https://huggingface.co/nitrosocke/mo-di-diffusion/resolve/main/modi-samples-01s.jpg)
17
- **Animal Characters rendered with the model:**
18
- ![Animal Samples](https://huggingface.co/nitrosocke/mo-di-diffusion/resolve/main/modi-samples-02s.jpg)
19
- **Cars and Landscapes rendered with the model:**
20
- ![Misc. Samples](https://huggingface.co/nitrosocke/mo-di-diffusion/resolve/main/modi-samples-03s.jpg)
21
- #### Prompt and settings for Lara Croft:
22
- **modern disney lara croft**
23
- _Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 3940025417, Size: 512x768_
24
 
25
- #### Prompt and settings for the Lion:
26
- **modern disney (baby lion) Negative prompt: person human**
27
- _Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 1355059992, Size: 512x512_
28
 
29
- This model was trained using the diffusers based dreambooth training by ShivamShrirao using prior-preservation loss and the _train-text-encoder_ flag in 9.000 steps.
30
 
31
- ### 🧨 Diffusers
 
32
 
33
- This model can be used just like any other Stable Diffusion model. For more information,
34
- please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
 
35
 
36
- You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX]().
37
 
38
- ```python
39
- from diffusers import StableDiffusionPipeline
40
- import torch
41
 
42
- model_id = "nitrosocke/mo-di-diffusion"
43
- pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
44
- pipe = pipe.to("cuda")
45
-
46
- prompt = "a magical princess with golden hair, modern disney style"
47
- image = pipe(prompt).images[0]
48
-
49
- image.save("./magical_princess.png")
50
- ```
51
-
52
- # Gradio & Colab
53
-
54
- We also support a [Gradio](https://github.com/gradio-app/gradio) Web UI and Colab with Diffusers to run fine-tuned Stable Diffusion models:
55
- [![Open In Spaces](https://camo.githubusercontent.com/00380c35e60d6b04be65d3d94a58332be5cc93779f630bcdfc18ab9a3a7d3388/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f25463025394625413425393725323048756767696e67253230466163652d5370616365732d626c7565)](https://huggingface.co/spaces/anzorq/finetuned_diffusion)
56
- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1j5YvfMZoGdDGdj3O3xRU1m4ujKYsElZO?usp=sharing)
57
-
58
- ## License
59
-
60
- This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage.
61
- The CreativeML OpenRAIL License specifies:
62
-
63
- 1. You can't use the model to deliberately produce nor share illegal or harmful outputs or content
64
- 2. The authors claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
65
- 3. You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully)
66
- [Please read the full license here](https://huggingface.co/spaces/CompVis/stable-diffusion-license)
 
1
  ---
2
+ language:
3
+ - en
4
  license: creativeml-openrail-m
5
  tags:
6
  - stable-diffusion
7
+ - stable-diffusion-diffusers
8
  - text-to-image
9
+ - diffusers
10
+ inference: true
11
  ---
 
12
 
13
+ <p align="center" width="100%">
14
+ <img width="80%" src="Assets/OnnxStack - 640x320.png">
15
+ </p>
16
 
17
+ ### OnnxStack
18
+ This model has been converted to ONNX and tested with OnnxStack
19
 
20
+ - [OnnxStack](https://github.com/saddam213/OnnxStack)
 
 
 
 
 
 
 
 
21
 
22
+ ### Mo-Di Diffusion
23
+ This model was converted to ONNX from Mo-Di Diffusion
 
24
 
25
+ - [Mo-Di](https://huggingface.co/nitrosocke/mo-di-diffusion)
26
 
27
+ ### Sample Images
28
+ *An modern disney style ironman*
29
 
30
+ | LMS Scheduler | Euler Scheduler | Euler Ancestral Scheduler | DDPM Scheduler | DDIM Scheduler | KDPM2 Scheduler
31
+ | :--- | :--- | :--- | :--- | :--- | :--- |
32
+ <img src="Assets/modi_lms_30_7.5_2092464983.png" width="256" alt="Image of browser inferencing on sample images."/> | <img src="Assets/modi_euler_30_7.5_2092464983.png" width="256" alt="Image of browser inferencing on sample images."/> | <img src="Assets/modi_eulerancestral_30_7.5_2092464983.png" width="256" alt="Image of browser inferencing on sample images."/> | <img src="Assets/modi_ddpm_30_7.5_2092464983.png" width="256" alt="Image of browser inferencing on sample images."/> | <img src="Assets/modi_ddim_30_7.5_2092464983.png" width="256" alt="Image of browser inferencing on sample images."/> | <img src="Assets/modi_kdpm2_30_7.5_2092464983.png" width="256" alt="Image of browser inferencing on sample images."/> |
33
 
34
+ Seed: 207582124 GuidanceScale: 7.5 NumInferenceSteps: 30
35
 
36
+ __________________________
 
 
37
 
38
+ ### Mo-Di Diffusion Tokens
39
+ The tokens for Mo-Di Diffusion are:
40
+ - modern disney style