simonschoe commited on
Commit
53b00c0
·
1 Parent(s): cc8a1ca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -7
README.md CHANGED
@@ -7,29 +7,83 @@ tags:
7
  - text-to-image
8
  - diffusion-models-class
9
  - dreambooth-hackathon
10
- - animal
11
  widget:
12
  - text: a photo of a ðŁĴŁ jellyfish in the snow
 
 
13
  ---
14
 
15
- # DreamBooth model for the ðŁĴŁ concept trained by simonschoe on a dataset of basic pokeballs (the plain white-red ones).
16
 
17
- This is a Stable Diffusion model fine-tuned on the ðŁĴŁ concept with DreamBooth. It can be used by modifying the `instance_prompt`: **a photo of ðŁĴŁ jellyfish**
 
 
 
18
 
19
  This model was created as part of the DreamBooth Hackathon 🔥. Visit the [organisation page](https://huggingface.co/dreambooth-hackathon) for instructions on how to take part!
20
 
21
- ## Description
22
 
 
 
 
 
 
23
 
24
- This is a Stable Diffusion model fine-tuned on `jellyfish` images for the animal theme.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
 
26
 
27
  ## Usage
28
 
29
  ```python
30
  from diffusers import StableDiffusionPipeline
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
- pipeline = StableDiffusionPipeline.from_pretrained('simonschoe/iridescent-jellyfish')
33
- image = pipeline().images[0]
34
  image
35
  ```
 
7
  - text-to-image
8
  - diffusion-models-class
9
  - dreambooth-hackathon
10
+ - wildcard
11
  widget:
12
  - text: a photo of a ðŁĴŁ jellyfish in the snow
13
+ - text: a photo of a ðŁĴŁ jellyfish next to a dog
14
+ - text: a photo of a ðŁĴŁ jellyfish on top of a mountain
15
  ---
16
 
17
+ # Iridescent Jellyfish
18
 
19
+ **Iridescent Jellyfish** is a Dreambooth model for the `iridescent` jellyfish concept (represented by the `ðŁĴŁ` identifier).
20
+ It applies to the *animal* theme.
21
+ It is fine-tuned from `runwayml/stable-diffusion-v1-5` checkpoint on a small dataset of jellyfish images.
22
+ It can be used by modifying the `instance_prompt`: **a photo of a ðŁĴŁ jellyfish in the snow**
23
 
24
  This model was created as part of the DreamBooth Hackathon 🔥. Visit the [organisation page](https://huggingface.co/dreambooth-hackathon) for instructions on how to take part!
25
 
26
+ #### Fine-Tuning Details
27
 
28
+ - Number of training images: 17
29
+ - Learning rate: 2e-06
30
+ - Training steps: 800
31
+ - Guidance Scale: 7
32
+ - Inference Steps: 50
33
 
34
+ #### Output Examples
35
+
36
+ <table>
37
+ <tr>
38
+ <td>a colorful sketch of a <b>ðŁĴŁ</b> jellyfish</td>
39
+ <td>a photo of a <b>ðŁĴŁ</b> jellyfish in the jungle</td>
40
+ <td>a mystic <b>ðŁĴŁ</b> jellyfish, trending on artstation</td>
41
+ </tr>
42
+ <tr>
43
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(1).png" style="height:200px"> </td>
44
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(2).png" style="height:200px"> </td>
45
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(3).png" style="height:200px"> </td>
46
+ </tr>
47
+ <tr>
48
+ <td>a oil painting of a <b>ðŁĴŁ</b> jellyfish</td>
49
+ <td>a photo of a <b>ðŁĴŁ</b> jellyfish next to a dog</td>
50
+ <td>a photo of a <b>ðŁĴŁ</b> jellyfish in the snow</td>
51
+ </tr>
52
+ <tr>
53
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(4).png" style="height:200px"> </td>
54
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(5).png" style="height:200px"> </td>
55
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(6).png" style="height:200px"> </td>
56
+ </tr>
57
+ <tr>
58
+ <td>a photo of a <b>ðŁĴŁ</b> jellyfish on top of a mountain</td>
59
+ <td>a photo of a <b>ðŁĴŁ</b> jellyfish in the sky</td>
60
+ <td>a photo of a <b>ðŁĴŁ</b> jellyfish</td>
61
+ </tr>
62
+ <tr>
63
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(7).png" style="height:200px"> </td>
64
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(8).png" style="height:200px"> </td>
65
+ <td align="center"><img src="https://huggingface.co/simonschoe/iridescent-jellyfish/resolve/main/output/jelly%20(9).png" style="height:200px"> </td>
66
+ </tr>
67
+ </table>
68
 
69
 
70
  ## Usage
71
 
72
  ```python
73
  from diffusers import StableDiffusionPipeline
74
+ import torch
75
+
76
+ device = torch.device('cuda:0' if torch.cuda.is_available() else 'cpu')
77
+ pipeline = StableDiffusionPipeline.from_pretrained('simonschoe/iridescent-jellyfish').to(device)
78
+
79
+ prompt = "a photo of a ðŁĴŁ jellyfish in the snow"
80
+
81
+ image = pipeline(
82
+ prompt,
83
+ num_inference_steps=50,
84
+ guidance_scale=7,
85
+ num_images_per_prompt=1
86
+ ).images[0]
87
 
 
 
88
  image
89
  ```