awoo

Signed-off-by: Balazs Horvath <[email protected]>

README.md

@@ -30,17 +30,18 @@ The Yiff Toolkit is a comprehensive set of tools designed to enhance your creati
     - [Pony Training](#pony-training)
       - [Download Pony in Diffusers Format](#download-pony-in-diffusers-format)
       - [Sample Prompt File](#sample-prompt-file)
-      - [`--lowram`](#--lowram)
-      - [`--pretrained_model_name_or_path`](#--pretrained_model_name_or_path)
-      - [`--output_dir`](#--output_dir)
-      - [`--train_data_dir`](#--train_data_dir)
-      - [`--resolution`](#--resolution)
-      - [`--enable_bucket`](#--enable_bucket)
-      - [`--min_bucket_reso` and `--max_bucket_reso`](#--min_bucket_reso-and---max_bucket_reso)
-      - [`--optimizer_type`](#--optimizer_type)
-      - [`--dataset_repeats`](#--dataset_repeats)
-      - [`--max_train_steps`](#--max_train_steps)
-      - [`--shuffle_caption`](#--shuffle_caption)
+      - [Training Commands](#training-commands)
+        - [`--lowram`](#--lowram)
+        - [`--pretrained_model_name_or_path`](#--pretrained_model_name_or_path)
+        - [`--output_dir`](#--output_dir)
+        - [`--train_data_dir`](#--train_data_dir)
+        - [`--resolution`](#--resolution)
+        - [`--enable_bucket`](#--enable_bucket)
+        - [`--min_bucket_reso` and `--max_bucket_reso`](#--min_bucket_reso-and---max_bucket_reso)
+        - [`--optimizer_type`](#--optimizer_type)
+        - [`--dataset_repeats`](#--dataset_repeats)
+        - [`--max_train_steps`](#--max_train_steps)
+        - [`--shuffle_caption`](#--shuffle_caption)
       - [`--sdpa` or `--xformers` or `--mem_eff_attn`](#--sdpa-or---xformers-or---mem_eff_attn)
       - [`--sample_prompts` and `--sample_sampler` and `--sample_every_n_steps`](#--sample_prompts-and---sample_sampler-and---sample_every_n_steps)
     - [CosXL Training](#cosxl-training)
@@ -141,18 +142,24 @@ A sample prompt file is used during training to sample images. A sample prompt f
 
 ```py
 # anthro female kindred
-score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo, female anthro kindred presenting, white pillow, bedroom, looking at viewer, detailed background, amazing_background, scenery porn, realistic, photo, photo (medium), photography (artwork) --n blurry, blurred background, simple background, low quality, worst quality --w 1024 --h 1024 --d 1 --l 6.0 --s 40
+score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo, female anthro kindred presenting, white pillow, bedroom, looking at viewer, detailed background, amazing_background, scenery porn, realistic, photo --n low quality, worst quality, blurred background, blurry, simple background --w 1024 --h 1024 --d 1 --l 6.0 --s 40
 # anthro female wolf
-score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo, anthro female wolf, sexy pose, standing, gray fur, brown fur, canine pussy, black nose, presenting pussy, blue eyes, pink areola, pink nipples, detailed background, amazing_background, scenery porn, realistic, photo, photo (medium), photography (artwork) --n low quality, worst quality --w 1024 --h 1024 --d 1 --l 6.0 --s 40
-# anthro male fox
-score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo, anthro male fox, glowing yellow eyes, night, crescent moon, tibetan necklace, gold bracers, blue and gold adorned loincloth, canine genitalia, knot, amazing_background, scenery porn, white marble ruins in the background, realistic, photo, photo (medium), photography (artwork) --n low quality, worst quality --w 1024 --h 1024 --d 1 --l 6.0 --s 40
+score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo, anthro female wolf, sexy pose, standing, gray fur, brown fur, canine pussy, black nose, blue eyes, pink areola, pink nipples, detailed background, amazing_background, realistic, photo --n low quality, worst quality, blurred background, blurry, simple background --w 1024 --h 1024 --d 1 --l 6.0 --s 40
 ```
 
-#### `--lowram`
+Please note that sample prompts should not exceed 77 tokens, you can use
+
+---
+
+#### Training Commands
+
+##### `--lowram`
 
 If you are running running out of RAM like I do with 2 GPUs and a really fat model, this option will help you save a bit of it and might get you out of OOM hell.
 
-#### `--pretrained_model_name_or_path`
+---
+
+##### `--pretrained_model_name_or_path`
 
 The directory containing the checkpoint you just downloaded. I recommend closing the path if you are using a local model with a `/`.
 
@@ -160,7 +167,9 @@ The directory containing the checkpoint you just downloaded. I recommend closing
     --pretrained_model_name_or_path="/ponydiffusers/" \
 ```
 
-#### `--output_dir`
+---
+
+##### `--output_dir`
 
 This is where all the saved epochs or steps will be saved, including the last one. If y
 
@@ -168,7 +177,9 @@ This is where all the saved epochs or steps will be saved, including the last on
     --output_dir="/output_dir" \
 ```
 
-#### `--train_data_dir`
+---
+
+##### `--train_data_dir`
 
 The directory containing the dataset. We prepared this earlier together.
 
@@ -176,7 +187,9 @@ The directory containing the dataset. We prepared this earlier together.
     --train_data_dir="/training_dir" \
 ```
 
-#### `--resolution`
+---
+
+##### `--resolution`
 
 Always set this to match the model's resolution, which in Pony's case it is 1024x1024. If you can't fit into the VRAM, you can decrease it to `512,512` as a last resort.
 
@@ -184,7 +197,9 @@ Always set this to match the model's resolution, which in Pony's case it is 1024
     --resolution="1024,1024" \
 ```
 
-#### `--enable_bucket`
+---
+
+##### `--enable_bucket`
 
 ⚠️
 
@@ -192,7 +207,9 @@ Always set this to match the model's resolution, which in Pony's case it is 1024
     --enable_bucket \
 ```
 
-#### `--min_bucket_reso` and `--max_bucket_reso`
+---
+
+##### `--min_bucket_reso` and `--max_bucket_reso`
 
 ⚠️
 
@@ -201,15 +218,19 @@ Always set this to match the model's resolution, which in Pony's case it is 1024
     --max_bucket_reso=1024 \
 ```
 
-#### `--optimizer_type`
+---
+
+##### `--optimizer_type`
 
-The default optimizer is `AdamW` and there are a bunch of them added every month or so, therefore I'm not listing it. You can find the list if you really want. But `AdamW` is the best as of this writing so we use that!
+The default optimizer is `AdamW` and there are a bunch of them added every month or so, therefore I'm not listing them all, you can find the list if you really want, but `AdamW` is the best as of this writing so we use that!
 
 ```py
     --optimizer_type="AdamW" \
 ```
 
-#### `--dataset_repeats`
+---
+
+##### `--dataset_repeats`
 
 Repeats the dataset when training with captions, by default it is set to `1` so we'll set this to `0` with:
 
@@ -217,7 +238,9 @@ Repeats the dataset when training with captions, by default it is set to `1` so
     --dataset_repeats=0 \
 ```
 
-#### `--max_train_steps`
+---
+
+##### `--max_train_steps`
 
 Specify the number of steps or epochs to train. If both `--max_train_steps` and `--max_train_epochs` are specified, the number of epochs takes precedence.
 
@@ -225,7 +248,9 @@ Specify the number of steps or epochs to train. If both `--max_train_steps` and
     --max_train_steps=500 \
 ```
 
-#### `--shuffle_caption`
+---
+
+##### `--shuffle_caption`
 
 Shuffles the captions set by `--caption_separator`, it is a comma `,` by default which will work perfectly for our case since our captions look like this:
 
@@ -233,6 +258,10 @@ Shuffles the captions set by `--caption_separator`, it is a comma `,` by default
 
 As you can tell, I have separated the caption part not just the tags with a `,` to make sure everything gets shuffled. I'm at this point pretty certain this is beneficial especially when your caption file contains more than 77 tokens.
 
+NOTE: `--cache_text_encoder_outputs` and `--cache_text_encoder_outputs_to_disk` can't be used together with `--shuffle_caption`. Both of these aim to reduce VRAM usage, you will need to decide between these yourself!
+
+---
+
 #### `--sdpa` or `--xformers` or `--mem_eff_attn`
 
 The choice between `--xformers` or `--mem_eff_attn` and `--spda` will depend on your GPU. You can benchmark it by repeating a training with them!

dataset_tools/Count Tokens in Sample Prompts.ipynb

@@ -0,0 +1,193 @@
+{
+ "cells": [
+  {
+   "cell_type": "code",
+   "execution_count": 4,
+   "metadata": {},
+   "outputs": [
+    {
+     "data": {
+      "text/html": [
+       "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-style: italic\">                                                  Prompt Analysis                                                  </span>\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃<span style=\"font-weight: bold\"> Prompt Type </span>┃<span style=\"font-weight: bold\"> Prompt                                                                              </span>┃<span style=\"font-weight: bold\"> Token Count </span>┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo,   │          57 │\n",
+       "│             │ female anthro kindred presenting, white pillow, bedroom, looking at viewer,         │             │\n",
+       "│             │ detailed background, amazing_background, scenery porn, realistic, photo             │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n",
+       "</pre>\n"
+      ],
+      "text/plain": [
+       "\u001b[3m                                                  Prompt Analysis                                                  \u001b[0m\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃\u001b[1m \u001b[0m\u001b[1mPrompt Type\u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mPrompt                                                                             \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mToken Count\u001b[0m\u001b[1m \u001b[0m┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo,   │          57 │\n",
+       "│             │ female anthro kindred presenting, white pillow, bedroom, looking at viewer,         │             │\n",
+       "│             │ detailed background, amazing_background, scenery porn, realistic, photo             │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n"
+      ]
+     },
+     "metadata": {},
+     "output_type": "display_data"
+    },
+    {
+     "data": {
+      "text/html": [
+       "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-style: italic\">                                                  Prompt Analysis                                                  </span>\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃<span style=\"font-weight: bold\"> Prompt Type </span>┃<span style=\"font-weight: bold\"> Prompt                                                                              </span>┃<span style=\"font-weight: bold\"> Token Count </span>┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo,   │          70 │\n",
+       "│             │ anthro female wolf, sexy pose, standing, gray fur, brown fur, canine pussy, black   │             │\n",
+       "│             │ nose, blue eyes, pink areola, pink nipples, detailed background,                    │             │\n",
+       "│             │ amazing_background, realistic, photo                                                │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n",
+       "</pre>\n"
+      ],
+      "text/plain": [
+       "\u001b[3m                                                  Prompt Analysis                                                  \u001b[0m\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃\u001b[1m \u001b[0m\u001b[1mPrompt Type\u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mPrompt                                                                             \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mToken Count\u001b[0m\u001b[1m \u001b[0m┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo,   │          70 │\n",
+       "│             │ anthro female wolf, sexy pose, standing, gray fur, brown fur, canine pussy, black   │             │\n",
+       "│             │ nose, blue eyes, pink areola, pink nipples, detailed background,                    │             │\n",
+       "│             │ amazing_background, realistic, photo                                                │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n"
+      ]
+     },
+     "metadata": {},
+     "output_type": "display_data"
+    },
+    {
+     "data": {
+      "text/html": [
+       "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-style: italic\">                                                  Prompt Analysis                                                  </span>\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃<span style=\"font-weight: bold\"> Prompt Type </span>┃<span style=\"font-weight: bold\"> Prompt                                                                              </span>┃<span style=\"font-weight: bold\"> Token Count </span>┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo,   │          73 │\n",
+       "│             │ anthro male fox, glowing yellow eyes, night, crescent moon, gold bracers and        │             │\n",
+       "│             │ necklace, loincloth, canine genitalia, knot, amazing_background, scenery porn,      │             │\n",
+       "│             │ white marble ruins, realistic, photo                                                │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n",
+       "</pre>\n"
+      ],
+      "text/plain": [
+       "\u001b[3m                                                  Prompt Analysis                                                  \u001b[0m\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃\u001b[1m \u001b[0m\u001b[1mPrompt Type\u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mPrompt                                                                             \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mToken Count\u001b[0m\u001b[1m \u001b[0m┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_explicit, source_furry, solo,   │          73 │\n",
+       "│             │ anthro male fox, glowing yellow eyes, night, crescent moon, gold bracers and        │             │\n",
+       "│             │ necklace, loincloth, canine genitalia, knot, amazing_background, scenery porn,      │             │\n",
+       "│             │ white marble ruins, realistic, photo                                                │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n"
+      ]
+     },
+     "metadata": {},
+     "output_type": "display_data"
+    },
+    {
+     "data": {
+      "text/html": [
+       "<pre style=\"white-space:pre;overflow-x:auto;line-height:normal;font-family:Menlo,'DejaVu Sans Mono',consolas,'Courier New',monospace\"><span style=\"font-style: italic\">                                                  Prompt Analysis                                                  </span>\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃<span style=\"font-weight: bold\"> Prompt Type </span>┃<span style=\"font-weight: bold\"> Prompt                                                                              </span>┃<span style=\"font-weight: bold\"> Token Count </span>┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    ��� score_9, score_8_up, score_7_up, score_6_up, rating_safe, source_furry, solo,       │          74 │\n",
+       "│             │ full-length portrait, anthro female red panda, detailed background,                 │             │\n",
+       "│             │ amazing_background, pussy, scenery porn, photo, realistic, looking at viewer, on    │             │\n",
+       "│             │ back, sexy pose, humanoid hands, claws, pink areola, pink nipples                   │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n",
+       "</pre>\n"
+      ],
+      "text/plain": [
+       "\u001b[3m                                                  Prompt Analysis                                                  \u001b[0m\n",
+       "┏━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓\n",
+       "┃\u001b[1m \u001b[0m\u001b[1mPrompt Type\u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mPrompt                                                                             \u001b[0m\u001b[1m \u001b[0m┃\u001b[1m \u001b[0m\u001b[1mToken Count\u001b[0m\u001b[1m \u001b[0m┃\n",
+       "┡━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩\n",
+       "│ Positive    │ score_9, score_8_up, score_7_up, score_6_up, rating_safe, source_furry, solo,       │          74 │\n",
+       "│             │ full-length portrait, anthro female red panda, detailed background,                 │             │\n",
+       "│             │ amazing_background, pussy, scenery porn, photo, realistic, looking at viewer, on    │             │\n",
+       "│             │ back, sexy pose, humanoid hands, claws, pink areola, pink nipples                   │             │\n",
+       "│ Negative    │ low quality, worst quality, blurred background, blurry, simple background           │          13 │\n",
+       "└─────────────┴─────────────────────────────────────────────────────────────────────────────────────┴─────────────┘\n"
+      ]
+     },
+     "metadata": {},
+     "output_type": "display_data"
+    }
+   ],
+   "source": [
+    "import tiktoken\n",
+    "from rich.console import Console\n",
+    "from rich.table import Table\n",
+    "\n",
+    "def count_tokens(text):\n",
+    "    enc = tiktoken.get_encoding(\"cl100k_base\")\n",
+    "    tokens = enc.encode(text)\n",
+    "    return len(tokens)\n",
+    "\n",
+    "console = Console()\n",
+    "\n",
+    "with open(\"C:\\\\Users\\\\kade\\\\Desktop\\\\training_dir_staging\\\\sample-prompts.txt\", \"r\") as file:\n",
+    "    lines = file.readlines()\n",
+    "\n",
+    "for line in lines:\n",
+    "    if line.startswith(\"#\"):\n",
+    "        continue\n",
+    "\n",
+    "    parts = line.split(\"--n\")\n",
+    "    positive_prompt = parts[0].strip()\n",
+    "    negative_prompt = parts[1].strip().split(\" --\")[0]\n",
+    "\n",
+    "    positive_token_count = count_tokens(positive_prompt)\n",
+    "    negative_token_count = count_tokens(negative_prompt)\n",
+    "\n",
+    "    table = Table(title=\"Prompt Analysis\")\n",
+    "    table.add_column(\"Prompt Type\", justify=\"left\")\n",
+    "    table.add_column(\"Prompt\", justify=\"left\")\n",
+    "    table.add_column(\"Token Count\", justify=\"right\")\n",
+    "\n",
+    "    table.add_row(\"Positive\", positive_prompt, str(positive_token_count))\n",
+    "    table.add_row(\"Negative\", negative_prompt, str(negative_token_count))\n",
+    "\n",
+    "    console.print(table)\n",
+    "\n",
+    "    if positive_token_count > 77:\n",
+    "        console.print(f\"[bold red]Warning: Positive prompt token count exceeds 75.[/bold red]\")"
+   ]
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "base",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.12.2"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 2
+}