Update README.md

README.md

@@ -1,3 +1,51 @@
----
-license: mit
----
+---
+license: mit
+---
+# Diffusers API of Transparent Image Layer Diffusion using Latent Transparency
+Create transparent image with Diffusers!
+
+Please check the Github repo [here](https://github.com/rootonchair/diffuser_layerdiffuse)
+
+This is a port to Diffuser from original [SD Webui's Layer Diffusion](https://github.com/layerdiffusion/sd-forge-layerdiffuse) to extend the ability to generate transparent image with your favorite API
+
+
+Paper: [Transparent Image Layer Diffusion using Latent Transparency](https://arxiv.org/abs/2402.17113)
+## Quickstart
+
+Generate transparent image with SD1.5 models. In this example, we will use [digiplay/Juggernaut_final](https://huggingface.co/digiplay/Juggernaut_final) as the base model
+
+```python
+from huggingface_hub import hf_hub_download
+from safetensors.torch import load_file
+import torch
+
+from diffusers import StableDiffusionPipeline
+
+from models import TransparentVAEDecoder
+from loaders import load_lora_to_unet
+
+
+
+if __name__ == "__main__":
+
+    model_path = hf_hub_download(
+        'LayerDiffusion/layerdiffusion-v1',
+        'layer_sd15_vae_transparent_decoder.safetensors',
+    )
+
+    vae_transparent_decoder = TransparentVAEDecoder.from_pretrained("digiplay/Juggernaut_final", subfolder="vae", torch_dtype=torch.float16).to("cuda")
+    vae_transparent_decoder.set_transparent_decoder(load_file(model_path))
+
+    pipeline = StableDiffusionPipeline.from_pretrained("digiplay/Juggernaut_final", vae=vae_transparent_decoder, torch_dtype=torch.float16, safety_checker=None).to("cuda")
+
+    model_path = hf_hub_download(
+        'LayerDiffusion/layerdiffusion-v1',
+        'layer_sd15_transparent_attn.safetensors'
+    )
+
+    load_lora_to_unet(pipeline.unet, model_path, frames=1)
+    
+    image = pipeline(prompt="a dog sitting in room, high quality", 
+                       width=512, height=512,
+                       num_images_per_prompt=1, return_dict=False)[0]
+```