README.md

metadata

title: README
emoji: 📈
colorFrom: pink
colorTo: blue
sdk: static
pinned: false

We explore instruction-tuning to teach Stable Diffusion to follow instructions to translate or process input images. With this method, we can prompt our model using an input image and an “instruction”, such as - Apply a cartoon filter to the natural image.

Please follow our blog post to know more about this: TODO.

Below we provide links to our training code, models, and datasets:

• Training and inference code

• Models:

  • instruction-tuning-sd/instruction-tuned-image-proc
  • instruction-tuning-sd/instruction-tuned-cartoonizer
  • instruction-tuning-sd/scratch-instruction-tuned-image-proc
  • instruction-tuning-sd/scratch-instruction-tuned-cartoonizer

• Datasets:

  • Instruction-prompted cartoonization
  • Instruction-prompted low-level image processing

Happy instruction-tuning 🤗