Commit
•
60efcc1
1
Parent(s):
842d2d0
Upload folder using huggingface_hub
Browse files- 4857923.jpeg +0 -0
- 4857954.jpeg +0 -0
- 4857994.jpeg +0 -0
- 4857995.jpeg +0 -0
- 4857996.jpeg +0 -0
- 4858004.jpeg +0 -0
- 4858005.jpeg +0 -0
- 4858026.jpeg +0 -0
- 4858028.jpeg +0 -0
- 4858031.jpeg +0 -0
- README.md +98 -0
- SDXL-DreamDisPix-Lora-r32.safetensors +3 -0
4857923.jpeg
ADDED
4857954.jpeg
ADDED
4857994.jpeg
ADDED
4857995.jpeg
ADDED
4857996.jpeg
ADDED
4858004.jpeg
ADDED
4858005.jpeg
ADDED
4858026.jpeg
ADDED
4858028.jpeg
ADDED
4858031.jpeg
ADDED
README.md
ADDED
@@ -0,0 +1,98 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: bespoke-lora-trained-license
|
4 |
+
license_link: https://multimodal.art/civitai-licenses?allowNoCredit=True&allowCommercialUse=Rent&allowDerivatives=True&allowDifferentLicense=False
|
5 |
+
tags:
|
6 |
+
- text-to-image
|
7 |
+
- stable-diffusion
|
8 |
+
- lora
|
9 |
+
- diffusers
|
10 |
+
- template:sd-lora
|
11 |
+
- disney
|
12 |
+
- pixar
|
13 |
+
- dreamworks
|
14 |
+
- style
|
15 |
+
- cartoon
|
16 |
+
- sdxl style lora
|
17 |
+
|
18 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
19 |
+
instance_prompt: DreamDisPix style
|
20 |
+
widget:
|
21 |
+
- text: 'Shrek playing with olaf in a frozen field DreamDisPix style '
|
22 |
+
output:
|
23 |
+
url: >-
|
24 |
+
4857923.jpeg
|
25 |
+
- text: 'The girl from the incredibles shooting a laser gun DreamDisPix style '
|
26 |
+
output:
|
27 |
+
url: >-
|
28 |
+
4857954.jpeg
|
29 |
+
- text: 'The girl with a pearl earring DreamDisPix style '
|
30 |
+
output:
|
31 |
+
url: >-
|
32 |
+
4857994.jpeg
|
33 |
+
- text: 'Snoop Dogg DreamDisPix style '
|
34 |
+
output:
|
35 |
+
url: >-
|
36 |
+
4857995.jpeg
|
37 |
+
- text: 'A mighty dragon at the dentist DreamDisPix style '
|
38 |
+
output:
|
39 |
+
url: >-
|
40 |
+
4858005.jpeg
|
41 |
+
- text: 'A cute dragon playing with Eevee DreamDisPix style '
|
42 |
+
output:
|
43 |
+
url: >-
|
44 |
+
4857996.jpeg
|
45 |
+
- text: 'Zombie Cinderella has rissen from the dead DreamDisPix style '
|
46 |
+
output:
|
47 |
+
url: >-
|
48 |
+
4858004.jpeg
|
49 |
+
- text: 'Santa riding a might dragon DreamDisPix style '
|
50 |
+
output:
|
51 |
+
url: >-
|
52 |
+
4858026.jpeg
|
53 |
+
- text: 'Pocahontas riding a Zebra DreamDisPix style '
|
54 |
+
output:
|
55 |
+
url: >-
|
56 |
+
4858031.jpeg
|
57 |
+
- text: 'American gothic DreamDisPix style '
|
58 |
+
output:
|
59 |
+
url: >-
|
60 |
+
4858028.jpeg
|
61 |
+
|
62 |
+
---
|
63 |
+
|
64 |
+
# Dream Dis Pix XL
|
65 |
+
|
66 |
+
<Gallery />
|
67 |
+
|
68 |
+
|
69 |
+
|
70 |
+
([CivitAI](https://civitai.com/models/242711))
|
71 |
+
|
72 |
+
## Model description
|
73 |
+
|
74 |
+
<p><span>A (kinda failed) attempt to train an SDXL LoRA model upon on a mixed style dataset of images from </span><strong><span>Dream</span></strong><span>works, </span><strong><span>Dis</span></strong><span>ney and </span><strong><span>Pix</span></strong><span>ar. I have uploaded this</span><a rel="ugc" href="https://huggingface.co/datasets/Norod78/DreamDisPix-blip2-captions"><span> Blip2-Captioned Dataset to Huggingface</span></a><span>. </span><br /><br /><span>I usually prefer to train in LoRA ranks 4-16 because so far it always seemed to be enough and provided a reasonably small checkpoint but in this case, I only started getting results when I went for Rank-32, even tried 24 and it was not enough.</span><br /><br />M<span>y conclusion is that it should have probably been trained as several different lower ranked LoRAs each for the specific visual sub-style and it would have probably looked way better for each.</span></p>
|
75 |
+
|
76 |
+
## Trigger words
|
77 |
+
You should use `DreamDisPix style` to trigger the image generation.
|
78 |
+
|
79 |
+
|
80 |
+
## Download model
|
81 |
+
|
82 |
+
Weights for this model are available in Safetensors format.
|
83 |
+
|
84 |
+
[Download](/Norod78/dream-dis-pix-xl/tree/main) them in the Files & versions tab.
|
85 |
+
|
86 |
+
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
|
87 |
+
|
88 |
+
```py
|
89 |
+
from diffusers import AutoPipelineForText2Image
|
90 |
+
import torch
|
91 |
+
|
92 |
+
pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
|
93 |
+
pipeline.load_lora_weights('Norod78/dream-dis-pix-xl', weight_name='SDXL-DreamDisPix-Lora-r32.safetensors')
|
94 |
+
image = pipeline('American gothic DreamDisPix style ').images[0]
|
95 |
+
```
|
96 |
+
|
97 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|
98 |
+
|
SDXL-DreamDisPix-Lora-r32.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8233dbcf24a610701686c5eb096aa02aa18f7c5d14db9009e53fcc9973acff00
|
3 |
+
size 228504012
|