Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,29 @@ sdk: static
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
We explore instruction-tuning to teach Stable Diffusion to follow instructions to translate or
|
11 |
+
process input images. With this method, we can prompt our model using an input image and an
|
12 |
+
“instruction”, such as - _Apply a cartoon filter to the natural image_.
|
13 |
+
|
14 |
+
<p align=center>
|
15 |
+
<img src="https://huggingface.co/datasets/sayakpaul/sample-datasets/resolve/main/instruction-tuning-sd.png" width=600/>
|
16 |
+
</p>
|
17 |
+
|
18 |
+
Please follow our blog post to know more about this: TODO.
|
19 |
+
|
20 |
+
|
21 |
+
Below we provide links to our training code, models, and datasets:
|
22 |
+
|
23 |
+
* [Training and inference code](https://github.com/sayakpaul/instruction-tuned-sd)
|
24 |
+
|
25 |
+
* Models:
|
26 |
+
* [instruction-tuning-sd/instruction-tuned-image-proc](https://huggingface.co/instruction-tuning-sd/instruction-tuned-image-proc)
|
27 |
+
* [instruction-tuning-sd/instruction-tuned-cartoonizer](https://huggingface.co/instruction-tuning-sd/instruction-tuned-cartoonizer)
|
28 |
+
* [instruction-tuning-sd/scratch-instruction-tuned-image-proc](instruction-tuning-sd/scratch-instruction-tuned-image-proc)
|
29 |
+
* [instruction-tuning-sd/scratch-instruction-tuned-cartoonizer](https://huggingface.co/instruction-tuning-sd/scratch-instruction-tuned-cartoonizer)
|
30 |
+
|
31 |
+
* Datasets:
|
32 |
+
* [Instruction-prompted cartoonization](https://huggingface.co/datasets/instruction-tuning-sd/cartoonizer-dataset)
|
33 |
+
* [Instruction-prompted low-level image processing](https://huggingface.co/datasets/instruction-tuning-sd/instruct-tuned-image-processing)
|
34 |
+
|
35 |
+
Happy instruction-tuning 🤗
|