Mike Dite
commited on
Commit
·
b760595
1
Parent(s):
6ff4368
add sliver comparison
Browse files- README.md +113 -41
- examples/sliver/fantasycarddiffusion-v1/1111.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/2345.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/3579.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/4813.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/6047.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/7281.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/8515.png +0 -0
- examples/sliver/fantasycarddiffusion-v1/9749.png +0 -0
- examples/sliver/magicdiffusion-v2/1111.png +0 -0
- examples/sliver/magicdiffusion-v2/2345.png +0 -0
- examples/sliver/magicdiffusion-v2/3579.png +0 -0
- examples/sliver/magicdiffusion-v2/4813.png +0 -0
- examples/sliver/magicdiffusion-v2/6047.png +0 -0
- examples/sliver/magicdiffusion-v2/7281.png +0 -0
- examples/sliver/magicdiffusion-v2/8515.png +0 -0
- examples/sliver/magicdiffusion-v2/9749.png +0 -0
- examples/sliver/openjourney-v2/1111.png +0 -0
- examples/sliver/openjourney-v2/2345.png +0 -0
- examples/sliver/openjourney-v2/3579.png +0 -0
- examples/sliver/openjourney-v2/4813.png +0 -0
- examples/sliver/openjourney-v2/6047.png +0 -0
- examples/sliver/openjourney-v2/7281.png +0 -0
- examples/sliver/openjourney-v2/8515.png +0 -0
- examples/sliver/openjourney-v2/9749.png +0 -0
- examples/sliver/stablediffusion-v1.5/1111.png +0 -0
- examples/sliver/stablediffusion-v1.5/2345.png +0 -0
- examples/sliver/stablediffusion-v1.5/3579.png +0 -0
- examples/sliver/stablediffusion-v1.5/4813.png +0 -0
- examples/sliver/stablediffusion-v1.5/6047.png +0 -0
- examples/sliver/stablediffusion-v1.5/7281.png +0 -0
- examples/sliver/stablediffusion-v1.5/8515.png +0 -0
- examples/sliver/stablediffusion-v1.5/9749.png +0 -0
README.md
CHANGED
@@ -12,6 +12,16 @@ A text2img model derived from StableDiffusion 1.5, fine-tuned with [EveryDream-t
|
|
12 |
|
13 |
## Comparison
|
14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
* Magic Diffusion v2 – this model
|
16 |
* Fantasy Card Diffusion v1 – https://huggingface.co/volrath50/fantasy-card-diffusion
|
17 |
* Open Journey v2 – https://huggingface.co/prompthero/openjourney-v2
|
@@ -20,16 +30,78 @@ A text2img model derived from StableDiffusion 1.5, fine-tuned with [EveryDream-t
|
|
20 |
All images were generated with identical settings:
|
21 |
* 40 steps
|
22 |
* 512x512
|
23 |
-
* seed `1111
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
|
25 |
-
1111
|
26 |
-
2345
|
27 |
-
3579
|
28 |
-
4813
|
29 |
-
6047
|
30 |
-
7281
|
31 |
-
8515
|
32 |
-
9749
|
33 |
|
34 |
### Taylor
|
35 |
|
@@ -49,51 +121,51 @@ Negative Prompt
|
|
49 |
<th>Stable Diffusion 1.5</th>
|
50 |
</tr>
|
51 |
<tr>
|
52 |
-
<td><img
|
53 |
-
<td><img
|
54 |
-
<td><img
|
55 |
-
<td><img
|
56 |
</tr>
|
57 |
<tr>
|
58 |
-
<td><img
|
59 |
-
<td><img
|
60 |
-
<td><img
|
61 |
-
<td><img
|
62 |
</tr>
|
63 |
<tr>
|
64 |
-
<td><img
|
65 |
-
<td><img
|
66 |
-
<td><img
|
67 |
-
<td><img
|
68 |
</tr>
|
69 |
<tr>
|
70 |
-
<td><img
|
71 |
-
<td><img
|
72 |
-
<td><img
|
73 |
-
<td><img
|
74 |
</tr>
|
75 |
<tr>
|
76 |
-
<td><img
|
77 |
-
<td><img
|
78 |
-
<td><img
|
79 |
-
<td><img
|
80 |
</tr>
|
81 |
<tr>
|
82 |
-
<td><img
|
83 |
-
<td><img
|
84 |
-
<td><img
|
85 |
-
<td><img
|
86 |
</tr>
|
87 |
<tr>
|
88 |
-
<td><img
|
89 |
-
<td><img
|
90 |
-
<td><img
|
91 |
-
<td><img
|
92 |
</tr>
|
93 |
<tr>
|
94 |
-
<td><img
|
95 |
-
<td><img
|
96 |
-
<td><img
|
97 |
-
<td><img
|
98 |
</tr>
|
99 |
</table>
|
|
|
12 |
|
13 |
## Comparison
|
14 |
|
15 |
+
For MtG card art, this model performs comparably to Fantasy Card Diffusion v1. Both outperform generic models such as Open Journey v2, and baseline Stable Diffusion 1.5.
|
16 |
+
|
17 |
+
Conclusions:
|
18 |
+
* Fantasy Card Diffusion v1 better preserves the MtG art style than Magic Diffusion v2, but it suffers from halftone/rosetta artifacts
|
19 |
+
* OpenJourney v2 is much hornier than the rest of the models, but the results for generic concepts are comparable
|
20 |
+
* Stable Diffusion v1.5 produces noticeably worse results than the other models, and requires a lot of negative keywords
|
21 |
+
* All models seem to benefit from
|
22 |
+
|
23 |
+
### Settings
|
24 |
+
|
25 |
* Magic Diffusion v2 – this model
|
26 |
* Fantasy Card Diffusion v1 – https://huggingface.co/volrath50/fantasy-card-diffusion
|
27 |
* Open Journey v2 – https://huggingface.co/prompthero/openjourney-v2
|
|
|
30 |
All images were generated with identical settings:
|
31 |
* 40 steps
|
32 |
* 512x512
|
33 |
+
* seed `1111`, `2345`, `3579`, `4813`, `6047`, `7281`, `8515`, `9749`
|
34 |
+
|
35 |
+
Presumably the results could be further improved with better prompts, targeted at specific models, but that is not the point of this comparison. Magic Diffusion does better without “artist signature”, Fantasy Card Diffusion may benefit from “halftone rosetta”, and Stable Diffusion 1.5 likes to draw the card frames.
|
36 |
+
|
37 |
+
### Sliver
|
38 |
+
|
39 |
+
Prompt
|
40 |
+
|
41 |
+
> speedy sliver creature Creature a fast sliver is speeding through the Mardu steppe landscape Khans of tarkir beautiful composition, MTG card art by John avon
|
42 |
+
|
43 |
+
Negative Prompt
|
44 |
+
|
45 |
+
> text frame card border human humanoid artist signature
|
46 |
+
|
47 |
+
|
48 |
+
<table>
|
49 |
+
<tr>
|
50 |
+
<th><strong>Magic Diffusion v2</strong></th>
|
51 |
+
<th>Fantasy Card Diffusion v1</th>
|
52 |
+
<th>Openjourney v2</th>
|
53 |
+
<th>Stable Diffusion 1.5</th>
|
54 |
+
</tr>
|
55 |
+
<tr>
|
56 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/1111.png" alt="mdv2 1111"></td>
|
57 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/1111.png" alt="fcd v1 1111"></td>
|
58 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/1111.png" alt="oj v2 1111"></td>
|
59 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/1111.png" alt="sd 1.5 1111"></td>
|
60 |
+
</tr>
|
61 |
+
<tr>
|
62 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/2345.png" alt="mdv2 2345"></td>
|
63 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/2345.png" alt="fcd v1 2345"></td>
|
64 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/2345.png" alt="oj v2 2345"></td>
|
65 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/2345.png" alt="sd 1.5 2345"></td>
|
66 |
+
</tr>
|
67 |
+
<tr>
|
68 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/3579.png" alt="mdv2 3579"></td>
|
69 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/3579.png" alt="fcd v1 3579"></td>
|
70 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/3579.png" alt="oj v2 3579"></td>
|
71 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/3579.png" alt="sd 1.5 3579"></td>
|
72 |
+
</tr>
|
73 |
+
<tr>
|
74 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/4813.png" alt="mdv2 4813"></td>
|
75 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/4813.png" alt="fcd v1 4813"></td>
|
76 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/4813.png" alt="oj v2 4813"></td>
|
77 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/4813.png" alt="sd 1.5 4813"></td>
|
78 |
+
</tr>
|
79 |
+
<tr>
|
80 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/6047.png" alt="mdv2 6047"></td>
|
81 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/6047.png" alt="fcd v1 6047"></td>
|
82 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/6047.png" alt="oj v2 6047"></td>
|
83 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/6047.png" alt="sd 1.5 6047"></td>
|
84 |
+
</tr>
|
85 |
+
<tr>
|
86 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/7281.png" alt="mdv2 7281"></td>
|
87 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/7281.png" alt="fcd v1 7281"></td>
|
88 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/7281.png" alt="oj v2 7281"></td>
|
89 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/7281.png" alt="sd 1.5 7281"></td>
|
90 |
+
</tr>
|
91 |
+
<tr>
|
92 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/8515.png" alt="mdv2 8515"></td>
|
93 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/8515.png" alt="fcd v1 8515"></td>
|
94 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/8515.png" alt="oj v2 8515"></td>
|
95 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/8515.png" alt="sd 1.5 8515"></td>
|
96 |
+
</tr>
|
97 |
+
<tr>
|
98 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/9749.png" alt="mdv2 9749"></td>
|
99 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/9749.png" alt="fcd v1 9749"></td>
|
100 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/9749.png" alt="oj v2 9749"></td>
|
101 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/9749.png" alt="sd 1.5 9749"></td>
|
102 |
+
</tr>
|
103 |
+
</table>
|
104 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
105 |
|
106 |
### Taylor
|
107 |
|
|
|
121 |
<th>Stable Diffusion 1.5</th>
|
122 |
</tr>
|
123 |
<tr>
|
124 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/1111.png" alt="mdv2 1111"></td>
|
125 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/1111.png" alt="fcd v1 1111"></td>
|
126 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/1111.png" alt="oj v2 1111"></td>
|
127 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/1111.png" alt="sd 1.5 1111"></td>
|
128 |
</tr>
|
129 |
<tr>
|
130 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/2345.png" alt="mdv2 2345"></td>
|
131 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/2345.png" alt="fcd v1 2345"></td>
|
132 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/2345.png" alt="oj v2 2345"></td>
|
133 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/2345.png" alt="sd 1.5 2345"></td>
|
134 |
</tr>
|
135 |
<tr>
|
136 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/3579.png" alt="mdv2 3579"></td>
|
137 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/3579.png" alt="fcd v1 3579"></td>
|
138 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/3579.png" alt="oj v2 3579"></td>
|
139 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/3579.png" alt="sd 1.5 3579"></td>
|
140 |
</tr>
|
141 |
<tr>
|
142 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/4813.png" alt="mdv2 4813"></td>
|
143 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/4813.png" alt="fcd v1 4813"></td>
|
144 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/4813.png" alt="oj v2 4813"></td>
|
145 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/4813.png" alt="sd 1.5 4813"></td>
|
146 |
</tr>
|
147 |
<tr>
|
148 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/6047.png" alt="mdv2 6047"></td>
|
149 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/6047.png" alt="fcd v1 6047"></td>
|
150 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/6047.png" alt="oj v2 6047"></td>
|
151 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/6047.png" alt="sd 1.5 6047"></td>
|
152 |
</tr>
|
153 |
<tr>
|
154 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/7281.png" alt="mdv2 7281"></td>
|
155 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/7281.png" alt="fcd v1 7281"></td>
|
156 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/7281.png" alt="oj v2 7281"></td>
|
157 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/7281.png" alt="sd 1.5 7281"></td>
|
158 |
</tr>
|
159 |
<tr>
|
160 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/8515.png" alt="mdv2 8515"></td>
|
161 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/8515.png" alt="fcd v1 8515"></td>
|
162 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/8515.png" alt="oj v2 8515"></td>
|
163 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/8515.png" alt="sd 1.5 8515"></td>
|
164 |
</tr>
|
165 |
<tr>
|
166 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/9749.png" alt="mdv2 9749"></td>
|
167 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/9749.png" alt="fcd v1 9749"></td>
|
168 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/9749.png" alt="oj v2 9749"></td>
|
169 |
+
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/9749.png" alt="sd 1.5 9749"></td>
|
170 |
</tr>
|
171 |
</table>
|
examples/sliver/fantasycarddiffusion-v1/1111.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/2345.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/3579.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/4813.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/6047.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/7281.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/8515.png
ADDED
![]() |
examples/sliver/fantasycarddiffusion-v1/9749.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/1111.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/2345.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/3579.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/4813.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/6047.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/7281.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/8515.png
ADDED
![]() |
examples/sliver/magicdiffusion-v2/9749.png
ADDED
![]() |
examples/sliver/openjourney-v2/1111.png
ADDED
![]() |
examples/sliver/openjourney-v2/2345.png
ADDED
![]() |
examples/sliver/openjourney-v2/3579.png
ADDED
![]() |
examples/sliver/openjourney-v2/4813.png
ADDED
![]() |
examples/sliver/openjourney-v2/6047.png
ADDED
![]() |
examples/sliver/openjourney-v2/7281.png
ADDED
![]() |
examples/sliver/openjourney-v2/8515.png
ADDED
![]() |
examples/sliver/openjourney-v2/9749.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/1111.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/2345.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/3579.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/4813.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/6047.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/7281.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/8515.png
ADDED
![]() |
examples/sliver/stablediffusion-v1.5/9749.png
ADDED
![]() |