awoo

Signed-off-by: Balazs Horvath <[email protected]>

README.md

@@ -42,8 +42,8 @@ The Yiff Toolkit is a comprehensive set of tools designed to enhance your creati
         - [`--dataset_repeats`](#--dataset_repeats)
         - [`--max_train_steps`](#--max_train_steps)
         - [`--shuffle_caption`](#--shuffle_caption)
-      - [`--sdpa` or `--xformers` or `--mem_eff_attn`](#--sdpa-or---xformers-or---mem_eff_attn)
-      - [`--sample_prompts` and `--sample_sampler` and `--sample_every_n_steps`](#--sample_prompts-and---sample_sampler-and---sample_every_n_steps)
+        - [`--sdpa` or `--xformers` or `--mem_eff_attn`](#--sdpa-or---xformers-or---mem_eff_attn)
+        - [`--sample_prompts` and `--sample_sampler` and `--sample_every_n_steps`](#--sample_prompts-and---sample_sampler-and---sample_every_n_steps)
     - [CosXL Training](#cosxl-training)
   - [Embeddings for 1.5 and SDXL](#embeddings-for-15-and-sdxl)
   - [ComfyUI Walkthrough any%](#comfyui-walkthrough-any)
@@ -136,6 +136,8 @@ I'm using the diffusers version for training I converted, you can download it us
 git clone https://huggingface.co/k4d3/ponydiffusers
 ```
 
+---
+
 #### Sample Prompt File
 
 A sample prompt file is used during training to sample images. A sample prompt for example might look like this for Pony:
@@ -147,7 +149,9 @@ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo
 score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo, anthro female wolf, sexy pose, standing, gray fur, brown fur, canine pussy, black nose, blue eyes, pink areola, pink nipples, detailed background, amazing_background, realistic, photo --n low quality, worst quality, blurred background, blurry, simple background --w 1024 --h 1024 --d 1 --l 6.0 --s 40
 ```
 
-Please note that sample prompts should not exceed 77 tokens, you can use
+Please note that sample prompts should not exceed 77 tokens, you can use [Count Tokens in Sample Prompts](https://huggingface.co/k4d3/yiff_toolkit/blob/main/dataset_tools/Count%20Tokens%20in%20Sample%20Prompts.ipynb) from [/dataset_tools](https://huggingface.co/k4d3/yiff_toolkit/tree/main/dataset_tools) to analyze your prompts.
+
+If you are training with multiple GPUs, ensure that the total number of prompts is divisible by the number of GPUs without any remainder.
 
 ---
 
@@ -262,11 +266,13 @@ NOTE: `--cache_text_encoder_outputs` and `--cache_text_encoder_outputs_to_disk`
 
 ---
 
-#### `--sdpa` or `--xformers` or `--mem_eff_attn`
+##### `--sdpa` or `--xformers` or `--mem_eff_attn`
 
 The choice between `--xformers` or `--mem_eff_attn` and `--spda` will depend on your GPU. You can benchmark it by repeating a training with them!
 
-#### `--sample_prompts` and `--sample_sampler` and `--sample_every_n_steps`
+---
+
+##### `--sample_prompts` and `--sample_sampler` and `--sample_every_n_steps`
 
 You have the option of generating images during training so you can check the progress, the argument let's you pick between different samplers, by default it is on `ddim`, so you better change it!
 
@@ -286,9 +292,13 @@ Your sampler options include the following:
 ddim, pndm, lms, euler, euler_a, heun, dpm_2, dpm_2_a, dpmsolver, dpmsolver++, dpmsingle, k_lms, k_euler, k_euler_a, k_dpm_2, k_dpm_2_a
 ```
 
+---
+
 ### CosXL Training
 
+<!--
 The only difference between CosXL training is that you need to enable `--v_parameterization`, and you can't sample the images. 😹 I also don't recommend using the `block_dims` and `block_alphas` from Pony.
+-->
 
 ---