XuehangCang/NSAQTUP2018
Viewer
โข
Updated
โข
124
โข
15
XuehangCang
XuehangCang
AI & ML interests
Pretraining, NLP, CV
Recent Activity
updated
a dataset
4 days ago
XuehangCang/NSAQTUP2018
published
a dataset
5 days ago
XuehangCang/NSAQTUP2018
upvoted
an
article
7 days ago
The Large Language Model Course
Organizations
XuehangCang's activity
updated
a
dataset
4 days ago
published
a
dataset
5 days ago
upvoted
an
article
7 days ago
Article
The Large Language Model Course
By
โข
โข
76
updated
a
dataset
7 days ago
updated
a
model
7 days ago
published
a
model
7 days ago
published
a
dataset
7 days ago
updated
a
model
7 days ago
updated
a
dataset
7 days ago
reacted to
sanaka87's
post with ๐ฅ
9 days ago
Post
1714
๐ Excited to Share Our Latest Work: 3DIS & 3DIS-FLUX for Multi-Instance Layout-to-Image Generation! โค๏ธโค๏ธโค๏ธ
๐จ Daily Paper: 3DIS-FLUX: simple and efficient multi-instance generation with DiT rendering (2501.05131)
๐ Code is now open source!
๐ Project Website: https://limuloo.github.io/3DIS/
๐ GitHub Repository: https://github.com/limuloo/3DIS
๐ 3DIS Paper: https://arxiv.org/abs/2410.12669
๐ 3DIS-FLUX Tech Report: https://arxiv.org/abs/2501.05131
๐ฅ Why 3DIS & 3DIS-FLUX?
Current SOTA multi-instance generation methods are typically adapter-based, requiring additional control modules trained on pre-trained models for layout and instance attribute control. However, with the emergence of more powerful models like FLUX and SD3.5, these methods demand constant retraining and extensive resources.
โจ Our Solution: 3DIS
We introduce a decoupled approach that only requires training a low-resolution Layout-to-Depth model to convert layouts into coarse-grained scene depth maps. Leveraging community and company pre-trained models like ControlNet + SAM2, we enable training-free controllable image generation on high-resolution models such as SDXL and FLUX.
๐ Benefits of Our Decoupled Multi-Instance Generation:
1. Enhanced Control: By constructing scenes using depth maps in the first stage, the model focuses on coarse-grained scene layout, improving control over instance placement.
2. Flexibility & Preservation: The second stage employs training-free rendering methods, allowing seamless integration with various models (e.g., fine-tuned weights, LoRA) while maintaining the generative capabilities of pre-trained models.
Join us in advancing Layout-to-Image Generation! Follow and star our repository to stay updated! โญ
๐จ Daily Paper: 3DIS-FLUX: simple and efficient multi-instance generation with DiT rendering (2501.05131)
๐ Code is now open source!
๐ Project Website: https://limuloo.github.io/3DIS/
๐ GitHub Repository: https://github.com/limuloo/3DIS
๐ 3DIS Paper: https://arxiv.org/abs/2410.12669
๐ 3DIS-FLUX Tech Report: https://arxiv.org/abs/2501.05131
๐ฅ Why 3DIS & 3DIS-FLUX?
Current SOTA multi-instance generation methods are typically adapter-based, requiring additional control modules trained on pre-trained models for layout and instance attribute control. However, with the emergence of more powerful models like FLUX and SD3.5, these methods demand constant retraining and extensive resources.
โจ Our Solution: 3DIS
We introduce a decoupled approach that only requires training a low-resolution Layout-to-Depth model to convert layouts into coarse-grained scene depth maps. Leveraging community and company pre-trained models like ControlNet + SAM2, we enable training-free controllable image generation on high-resolution models such as SDXL and FLUX.
๐ Benefits of Our Decoupled Multi-Instance Generation:
1. Enhanced Control: By constructing scenes using depth maps in the first stage, the model focuses on coarse-grained scene layout, improving control over instance placement.
2. Flexibility & Preservation: The second stage employs training-free rendering methods, allowing seamless integration with various models (e.g., fine-tuned weights, LoRA) while maintaining the generative capabilities of pre-trained models.
Join us in advancing Layout-to-Image Generation! Follow and star our repository to stay updated! โญ