|
--- |
|
license: other |
|
license_name: flux-1-dev-non-commercial-license |
|
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE. |
|
language: |
|
- en |
|
pipeline_tag: text-to-image |
|
tags: |
|
- LoRA |
|
- Stable Diffusion |
|
- image-generation |
|
- Flux |
|
--- |
|
This repository provides a checkpoint with trained LoRA for |
|
[FLUX.1-dev model](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs |
|
[<img src="https://github.com/XLabs-AI/x-flux/blob/main/assets/readme/light/join-our-discord-rev1.png?raw=true">](https://discord.gg/FHY2guThfy) |
|
|
|
 |
|
|
|
# Training details |
|
[XLabs AI](https://github.com/XLabs-AI) team is happy to publish fune-tuning Flux scripts, including: |
|
|
|
- **LoRA** 🔥 |
|
- **ControlNet** 🔥 |
|
|
|
[See our github](https://github.com/XLabs-AI/x-flux) for train script and train configs. |
|
|
|
# Training Dataset |
|
Dataset has the following format for the training process: |
|
|
|
``` |
|
├── images/ |
|
│ ├── 1.png |
|
│ ├── 1.json |
|
│ ├── 2.png |
|
│ ├── 2.json |
|
│ ├── ... |
|
``` |
|
A .json file contains "caption" field with a text prompt. |
|
|
|
Thank https://civitai.com/user/dobrosketchkun and https://civitai.com/user/AlexV0iceh_DreamForge for datasets for loras |
|
|
|
# Inference |
|
## furry lora |
|
```bash |
|
python3 main.py \ |
|
--prompt "Female Orc with tribal face paint in fierce warrior armor, wielding a massive battle axe, standing in the midst of a battlefield, victorious warrior scene, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \ |
|
--lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \ |
|
--model_type flux-dev-fp8 --width 1024 --height 1024 \ |
|
--timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5 |
|
|
|
``` |
|
|
|
 |
|
|
|
```bash |
|
python3 main.py \ |
|
--prompt "Male furry Lycanthrope with fur-covered body in ancient ruins, howling at the full moon, surrounded by eerie mist, werewolf transformation, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \ |
|
--lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \ |
|
--model_type flux-dev-fp8 --width 1024 --height 1024 \ |
|
--timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5 |
|
|
|
``` |
|
|
|
 |
|
|
|
```bash |
|
python3 main.py \ |
|
--prompt "Female furry Pixie with iridescent wings in whimsical fairy attire, spreading pixie dust in a moonlit forest, mischievous sprite depiction, elder scrolls, eslweyr, glitch aesthetic, anime-inspired, digital illustration, artstation, furry" \ |
|
--lora_repo_id XLabs-AI/flux-furry-lora --lora_name furry_lora.safetensors --device cuda --offload --use_lora \ |
|
--model_type flux-dev-fp8 --width 1024 --height 1024 \ |
|
--timestep_to_start_cfg 1 --num_steps 25 --true_gs 3.5 |
|
|
|
``` |
|
|
|
 |
|
|
|
lora.safetensors falls under the [FLUX.1 [dev]](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) Non-Commercial License<br/> |
