|
--- |
|
tags: |
|
- text-to-image |
|
- flux |
|
- lora |
|
- diffusers |
|
- template:sd-lora |
|
- ai-toolkit |
|
base_model: black-forest-labs/FLUX.1-dev |
|
instance_prompt: in the style of TOK |
|
license: other |
|
license_name: flux-1-dev-non-commercial-license |
|
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md |
|
widget: |
|
- text: a coi fish. in the style of TOK |
|
output: |
|
url: images/example_3buowzz1z.png |
|
- text: a panda on eucalyptus branch, sleeping. in the style of TOK |
|
output: |
|
url: images/example_7wb9y3owz.png |
|
- text: a boy snowboarding. in the style of TOK |
|
output: |
|
url: images/example_0s2fzx9kd.png |
|
- text: a man tennis player playing tennis on tennis court. in the style of TOK |
|
output: |
|
url: images/example_u2i3ke60c.png |
|
- text: playing curling. in the style of TOK |
|
output: |
|
url: images/example_is3gxmf20.png |
|
- text: a man playing billard. in the style of TOK |
|
output: |
|
url: images/example_9j8fzdhey.png |
|
- text: a bartender shaking a cocktail. in the style of TOK |
|
output: |
|
url: images/example_s2xhwvsmw.png |
|
- text: >- |
|
old fierce pirate holding a shovel digging to find a treasure. in the style |
|
of TOK |
|
output: |
|
url: images/example_afdbsemxc.png |
|
- text: >- |
|
a picturesque village nestled amidst rolling hills and colorful meadows. We |
|
see quaint houses with smoke curling from chimneys and children playing in |
|
the streets.. in the style of TOK |
|
output: |
|
url: images/example_mu38m53gb.png |
|
- text: a panda playing football. in the style of TOK |
|
output: |
|
url: images/example_om6c5d6bt.png |
|
- text: an illustration of a chameleon on a old wall. in the style of TOK |
|
output: |
|
url: images/example_8dc7wfv48.png |
|
|
|
--- |
|
|
|
# sweet-brush |
|
Model trained with [AI Toolkit by Ostris](https://github.com/ostris/ai-toolkit) |
|
<Gallery /> |
|
|
|
## Trigger words |
|
|
|
You should use `in the style of TOK` to trigger the image generation. |
|
|
|
## Download model and use it with ComfyUI, AUTOMATIC1111, SD.Next, Invoke AI, etc. |
|
|
|
Weights for this model are available in Safetensors format. |
|
|
|
[Download](/fffiloni/sweet-brush/tree/main) them in the Files & versions tab. |
|
|
|
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers) |
|
|
|
```py |
|
from diffusers import AutoPipelineForText2Image |
|
import torch |
|
|
|
pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.bfloat16).to('cuda') |
|
pipeline.load_lora_weights('fffiloni/sweet-brush', weight_name='sweet-brush.safetensors') |
|
image = pipeline('A person in a bustling cafe. in the style of TOK').images[0] |
|
image.save("my_image.png") |
|
``` |
|
|
|
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters) |
|
|
|
|