File size: 3,369 Bytes
6886d08
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
cc14925
6886d08
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f59e568
6886d08
 
2164e42
6886d08
 
cc14925
 
 
 
 
6886d08
 
cc14925
6886d08
 
 
cc14925
 
 
 
 
6886d08
 
cc14925
 
 
 
 
 
 
 
 
 
6886d08
64da190
6886d08
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
---
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.
language:
- en
pipeline_tag: text-to-image
tags:
- LoRA
- Stable Diffusion
- image-generation
- Flux
---
This repository provides a checkpoint with trained LoRA for
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs
[<img src="https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/join-our-discord-rev1.png?raw=true">](https://discord.gg/FHY2guThfy)

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/furry2.png?raw=true)

# Training details
[XLabs AI](https://github.com/XLabs-AI) team is happy to publish fune-tuning Flux scripts, including:

- **LoRA** πŸ”₯
- **ControlNet** πŸ”₯

[See our github](https://github.com/XLabs-AI/x-flux) for train script and train configs.

# Training Dataset
Dataset has the following format for the training process:

```
β”œβ”€β”€ images/
β”‚    β”œβ”€β”€ 1.png
β”‚    β”œβ”€β”€ 1.json
β”‚    β”œβ”€β”€ 2.png
β”‚    β”œβ”€β”€ 2.json
β”‚    β”œβ”€β”€ ...
```
A .json file contains "caption" field with a text prompt.

Thank https://civitai.com/user/dobrosketchkun and https://civitai.com/user/AlexV0iceh_DreamForge for datasets for loras

# Inference
## furry lora
```bash
python3 main.py \
 --prompt "Female Orc with tribal face paint in fierce warrior armor, wielding a massive battle axe, standing in the midst of a battlefield, victorious warrior scene, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5

```

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/furry1.png?raw=true)

```bash
python3 main.py \
 --prompt "Male furry Lycanthrope with fur-covered body in ancient ruins, howling at the full moon, surrounded by eerie mist, werewolf transformation, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5

```

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/furry2.png?raw=true)

```bash
python3 main.py \
 --prompt "Female furry Pixie with iridescent wings in whimsical fairy attire, spreading pixie dust in a moonlit forest, mischievous sprite depiction, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \
 --lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \
 --model_type flux-dev-fp8 --width 1024 --height 1024 \
 --timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5

```

![Example Picture 1](https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/examples/furry3.png?raw=true)

lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/>