File size: 1,577 Bytes
aad203f
 
 
 
 
 
 
 
 
991e9da
 
 
 
 
 
 
 
01a55bc
991e9da
 
 
 
dea0fd8
991e9da
b1eb3f8
adb335f
 
 
 
991e9da
b1eb3f8
adb335f
 
991e9da
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
title: README
emoji: 📈
colorFrom: pink
colorTo: blue
sdk: static
pinned: false
---

We explore instruction-tuning to teach Stable Diffusion to follow instructions to translate or
process input images. With this method, we can prompt our model using an input image and an
“instruction”, such as - _Apply a cartoon filter to the natural image_.

<p align=center>
<img src="https://huggingface.co/datasets/sayakpaul/sample-datasets/resolve/main/instruction-tuning-sd.png" width=600/>
</p>

Please follow our blog post for more details: [https://huggingface.co/blog/instruction-tuning-sd](https://huggingface.co/blog/instruction-tuning-sd).


Below we provide links to our training code, models, and datasets:

* ### [**Training and inference code**](https://github.com/huggingface/instruction-tuned-sd)

* ### **Models**:
  * [instruction-tuning-sd/scratch-low-level-img-proc](https://huggingface.co/instruction-tuning-sd/scratch-low-level-img-proc)
  * [instruction-tuning-sd/scratch-cartoonizer](https://huggingface.co/instruction-tuning-sd/scratch-cartoonizer)
  * [instruction-tuning-sd/cartoonizer](https://huggingface.co/instruction-tuning-sd/cartoonizer)
  * [instruction-tuning-sd/low-level-img-proc](https://huggingface.co/instruction-tuning-sd/low-level-img-proc)

* ### **Datasets**:
  * [Instruction-prompted cartoonization](https://huggingface.co/datasets/instruction-tuning-sd/cartoonization)
  * [Instruction-prompted low-level image processing](https://huggingface.co/datasets/instruction-tuning-sd/low-level-image-proc) 

Happy instruction-tuning 🤗