|
--- |
|
base_model: runwayml/stable-diffusion-v1-5 |
|
tags: |
|
- controlnet |
|
- stable-diffusion |
|
- image-to-image |
|
- mask-to-cloth |
|
language: |
|
- en |
|
library_name: diffusers |
|
widget: |
|
- src: https://huggingface.co/phucleh2/controlnet_mask2cloth/resolve/main/Examples/mask1.jpg |
|
prompt: a red top with a lace - trimmed neckline |
|
- src: https://huggingface.co/phucleh2/controlnet_mask2cloth/resolve/main/Examples/mask2.jpg |
|
prompt: a long sleeved top - black |
|
- src: https://huggingface.co/phucleh2/controlnet_mask2cloth/resolve/main/Examples/mask3.jpg |
|
prompt: a blue blouse with a tie neck and a floral prints |
|
- src: https://huggingface.co/phucleh2/controlnet_mask2cloth/resolve/main/Examples/mask4.jpg |
|
prompt: a light pink blouse with rose patterns |
|
- src: https://huggingface.co/phucleh2/controlnet_mask2cloth/resolve/main/Examples/mask5.jpg |
|
prompt: t-shirt - black |
|
--- |
|
|
|
# Mask + Prompt → Cloth |
|
- This model is still in development for better realistic-ness of the output. Stay tuned 🤗 |
|
- This model is a fine-tuned version of ControlNet, tailored to utilize a black-and-white outline of an upper garment (mask) and a descriptive prompt to generate a garment that aligns with the mask's outline. |
|
- It's important to note that this model exclusively operates with upper garments. Please refrain from inputting masks for pants or jeans, as this could yield unexpected outcomes. |
|
- Input mask size: 384 x 512 |
|
- Each time the model is executed, **even with the same mask and prompt**, it will generate a distinct output. |
|
- This model is a fine-tuned of [ControlNet](https://arxiv.org/abs/2302.05543) using [VITON-HD](https://github.com/shadow2496/VITON-HD) dataset |