k4d3 commited on
Commit
c513f21
1 Parent(s): 8684e1f

Signed-off-by: Balazs Horvath <[email protected]>

dataset_tools/Escape Parentheses.ipynb CHANGED
@@ -66,94 +66,105 @@
66
  },
67
  {
68
  "cell_type": "code",
69
- "execution_count": 6,
70
  "metadata": {},
71
  "outputs": [
72
  {
73
- "name": "stdout",
74
- "output_type": "stream",
75
- "text": [
76
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\1vw3q7q5knu71.txt' was modified.\n",
77
- "Original: jex, dharrel, feathered ears, rating_safe, anthro, clothing, solo, outside, clothed, 3d \\(artwork\\), detailed background, fur, water, black fur, white fur, white body, black body, feet, underwater, in the image anthro male dharrel jex a species characterized by its white and black furred head is depicted in a solo adventure underwater., this canine-like mammal is clothed in dark bottomwear and topwear in the 3d artwork., the jex’s dominantly white fur contrasts with the dark surroundings making it a focal point in the scene., the detailed background reveals ancient city submerged in water its ruins hinting at a forgotten past., small fish and aquatic plants add life to the scene their presence illuminated by the light filtering through the water., the feet of the dharrel are visible suggesting movement and exploration., he has small black and white feathers on his ears., open eyes, purple eyes, there are small air bubbles around the character and a few big ones in the scene.\n",
78
- "Modified: jex, dharrel, feathered ears, rating_safe, anthro, clothing, solo, outside, clothed, 3d \\\\(artwork\\\\), detailed background, fur, water, black fur, white fur, white body, black body, feet, underwater, in the image anthro male dharrel jex a species characterized by its white and black furred head is depicted in a solo adventure underwater., this canine-like mammal is clothed in dark bottomwear and topwear in the 3d artwork., the jex’s dominantly white fur contrasts with the dark surroundings making it a focal point in the scene., the detailed background reveals ancient city submerged in water its ruins hinting at a forgotten past., small fish and aquatic plants add life to the scene their presence illuminated by the light filtering through the water., the feet of the dharrel are visible suggesting movement and exploration., he has small black and white feathers on his ears., open eyes, purple eyes, there are small air bubbles around the character and a few big ones in the scene.\n",
79
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\2h164c8us2b61.txt' was modified.\n",
80
- "Original: jex, dharrel, feathered ears, rating_safe, solo, anthro, plant, mammal, outside, clothing, clothed, detailed background, fur, white body, 3d \\(artwork\\), water, male, white fur, black fur, black body, In this 3D artwork a solo anthro male dharrel jex stands outside his black body and white fur contrasting sharply against the detailed background., He is clothed in dark purple topwear that complements his mammal features with fur that glistens from the surrounding water., The scene is set amidst vibrant plants and the character’s white body stands out., open eyes, purple eyes, \n",
81
- "Modified: jex, dharrel, feathered ears, rating_safe, solo, anthro, plant, mammal, outside, clothing, clothed, detailed background, fur, white body, 3d \\\\(artwork\\\\), water, male, white fur, black fur, black body, In this 3D artwork a solo anthro male dharrel jex stands outside his black body and white fur contrasting sharply against the detailed background., He is clothed in dark purple topwear that complements his mammal features with fur that glistens from the surrounding water., The scene is set amidst vibrant plants and the character’s white body stands out., open eyes, purple eyes, \n",
82
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\3yjns0br1xv31.txt' was modified.\n",
83
- "Original: jex, dharrel, feathered ears, rating_safe, solo, anthro, clothing, mammal, outside, clothed, fur, 3d \\(artwork\\), beverage, white body, topwear, white fur, container, cup, detailed background, coffee, male, holding object\n",
84
- "Modified: jex, dharrel, feathered ears, rating_safe, solo, anthro, clothing, mammal, outside, clothed, fur, 3d \\\\(artwork\\\\), beverage, white body, topwear, white fur, container, cup, detailed background, coffee, male, holding object\n",
85
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\8174w4ticq431.txt' was modified.\n",
86
- "Original: jex, dharrel, feathered ears, rating_safe, solo, anthro, clothing, outside, male, detailed background, water, clothed, 3d \\(artwork\\), topwear, fur, pants, bottomwear, tail, white body\n",
87
- "Modified: jex, dharrel, feathered ears, rating_safe, solo, anthro, clothing, outside, male, detailed background, water, clothed, 3d \\\\(artwork\\\\), topwear, fur, pants, bottomwear, tail, white body\n",
88
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\br9aqfq4fzn31.txt' was modified.\n",
89
- "Original: jex, dharrel, feathered ears, solo, rating_safe, 3d \\(artwork\\), mammal, anthro, clothing, hoodie, furniture, looking at viewer, male, clothed, purple eyes, bed, inside, topwear,\n",
90
- "Modified: jex, dharrel, feathered ears, solo, rating_safe, 3d \\\\(artwork\\\\), mammal, anthro, clothing, hoodie, furniture, looking at viewer, male, clothed, purple eyes, bed, inside, topwear,\n",
91
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\dhar_sleeps_2.txt' was modified.\n",
92
- "Original: jex, dharrel, feathered ears, lying on bed, solo, rating_safe, 3d \\(artwork\\), mammal, anthro, furniture, looking at viewer, male, clothed, closed eyes, bed, inside\n",
93
- "Modified: jex, dharrel, feathered ears, lying on bed, solo, rating_safe, 3d \\\\(artwork\\\\), mammal, anthro, furniture, looking at viewer, male, clothed, closed eyes, bed, inside\n",
94
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\fbhwa0y9w4s21.txt' was modified.\n",
95
- "Original: jex, dharrel, feathered ears, rating_safe, solo, anthro, outside, clothing, hoodie, fur, clothed, detailed background, 3d \\(artwork\\), tree, topwear, night, male, water\n",
96
- "Modified: jex, dharrel, feathered ears, rating_safe, solo, anthro, outside, clothing, hoodie, fur, clothed, detailed background, 3d \\\\(artwork\\\\), tree, topwear, night, male, water\n",
97
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\freg1n3a2ko21.txt' was modified.\n",
98
- "Original: jex, dharrel, feathered ears, anthro, duo, 3d \\(artwork\\), rating_safe, night, male, outside, kissing, clothing, hair, water, green body, clothed, fur, eyes closed, green hair, felid, female, moon, plant, green fur\n",
99
- "Modified: jex, dharrel, feathered ears, anthro, duo, 3d \\\\(artwork\\\\), rating_safe, night, male, outside, kissing, clothing, hair, water, green body, clothed, fur, eyes closed, green hair, felid, female, moon, plant, green fur\n",
100
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\hxrxro437u461.txt' was modified.\n",
101
- "Original: jex, dharrel,feathered ears, rating_safe, solo, mammal, anthro, clothing, purple eyes, city, clothed, fur, 3d \\(artwork\\), detailed background, eyewear, horn, white body, male, looking at viewer, white fur, night, fingers, feathered ears\n",
102
- "Modified: jex, dharrel,feathered ears, rating_safe, solo, mammal, anthro, clothing, purple eyes, city, clothed, fur, 3d \\\\(artwork\\\\), detailed background, eyewear, horn, white body, male, looking at viewer, white fur, night, fingers, feathered ears\n",
103
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\iee8nodoji731.txt' was modified.\n",
104
- "Original: jex, dharrel, rating_safe, solo, mammal, anthro, clothing, purple eyes, clothed, fur, detailed background, eyewear, white body, male, looking at viewer, white fur, fingers, holding object, feathered ears, 3d \\(artwork\\)\n",
105
- "Modified: jex, dharrel, rating_safe, solo, mammal, anthro, clothing, purple eyes, clothed, fur, detailed background, eyewear, white body, male, looking at viewer, white fur, fingers, holding object, feathered ears, 3d \\\\(artwork\\\\)\n",
106
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\iqs60ikmcgw21.txt' was modified.\n",
107
- "Original: jex, dharrel, feathered ears, rating_safe, anthro, 3d \\(artwork\\), outside, female, hair, detailed background, tree, water, night, clothing, forest, plant, fur, lamp, solo, lantern, male, clothed\n",
108
- "Modified: jex, dharrel, feathered ears, rating_safe, anthro, 3d \\\\(artwork\\\\), outside, female, hair, detailed background, tree, water, night, clothing, forest, plant, fur, lamp, solo, lantern, male, clothed\n",
109
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\jn9rvqwuya241.txt' was modified.\n",
110
- "Original: jex, dharrel, feathered ears, blep, solo, rating_safe, clothing, mammal, hoodie, anthro, fur, clothed, 3d \\(artwork\\), topwear, looking at viewer, outside, tongue, white body, white fur, male\n",
111
- "Modified: jex, dharrel, feathered ears, blep, solo, rating_safe, clothing, mammal, hoodie, anthro, fur, clothed, 3d \\\\(artwork\\\\), topwear, looking at viewer, outside, tongue, white body, white fur, male\n",
112
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\mpcr44i6q0z21.txt' was modified.\n",
113
- "Original: jex, dharrel, feathered ears, solo, rating_safe, anthro, underwater, clothing, water, male, topless, clothed, hair, fur, 3d \\(artwork\\)\n",
114
- "Modified: jex, dharrel, feathered ears, solo, rating_safe, anthro, underwater, clothing, water, male, topless, clothed, hair, fur, 3d \\\\(artwork\\\\)\n",
115
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\promising-weather-second-life-v0-wdbxcxkftsh81.txt' was modified.\n",
116
- "Original: jex, dharrel, feathered ears, rating_safe, solo, clothing, anthro, water, outside, 3d \\(artwork\\), clothed, detailed background, male, fur, standing, topwear, plant, bottomwear, tree, pants, white fur, river, white body\n",
117
- "Modified: jex, dharrel, feathered ears, rating_safe, solo, clothing, anthro, water, outside, 3d \\\\(artwork\\\\), clothed, detailed background, male, fur, standing, topwear, plant, bottomwear, tree, pants, white fur, river, white body\n",
118
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\rdjho7a12w781.txt' was modified.\n",
119
- "Original: jex, dharrel, feathered ears, rating_safe, solo, anthro, clothing, mammal, fur, clothed, blurred background, purple eyes, topwear, 3d \\(artwork\\), beverage, outside, holding object, jacket, hair, male, black hair\n",
120
- "Modified: jex, dharrel, feathered ears, rating_safe, solo, anthro, clothing, mammal, fur, clothed, blurred background, purple eyes, topwear, 3d \\\\(artwork\\\\), beverage, outside, holding object, jacket, hair, male, black hair\n",
121
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\s0v2nbu28m031.txt' was modified.\n",
122
- "Original: jex, dharrel, rating_safe, anthro, clothing, solo, male, clothed, fur, topwear, 3d \\(artwork\\), bottomwear, shirt, pants, hair, group, white fur, white body, crowd\n",
123
- "Modified: jex, dharrel, rating_safe, anthro, clothing, solo, male, clothed, fur, topwear, 3d \\\\(artwork\\\\), bottomwear, shirt, pants, hair, group, white fur, white body, crowd\n",
124
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\viicura4r3u51.txt' was modified.\n",
125
- "Original: jex, feathered ears, dharrel, rating_safe, solo, mammal, clothing, anthro, outside, fur, clothed, 3d \\(artwork\\), detailed background, white fur, topwear, red clothing, hoodie, white body, male, day, tree, red topwear\n",
126
- "Modified: jex, feathered ears, dharrel, rating_safe, solo, mammal, clothing, anthro, outside, fur, clothed, 3d \\\\(artwork\\\\), detailed background, white fur, topwear, red clothing, hoodie, white body, male, day, tree, red topwear\n",
127
- "Warning: File 'C:\\Users\\kade\\Desktop\\training_dir_staging\\1_dharrel\\z9122r3siwm31.txt' was modified.\n",
128
- "Original: jex, dharrel, rating_safe, solo, anthro, 3d \\(artwork\\), clothing, fur, clothed, eyewear, male, glasses, topwear, white fur, photo background, blurred background, feathered ears\n",
129
- "Modified: jex, dharrel, rating_safe, solo, anthro, 3d \\\\(artwork\\\\), clothing, fur, clothed, eyewear, male, glasses, topwear, white fur, photo background, blurred background, feathered ears\n"
130
  ]
131
  }
132
  ],
133
  "source": [
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
134
  "import re\n",
135
- "from pathlib import Path\n",
 
136
  "\n",
137
  "def escape_parentheses(file_path):\n",
138
  " with open(file_path, \"r\") as file:\n",
139
  " content = file.read()\n",
140
  " original_content = content\n",
 
141
  " # Escape unescaped opening parentheses\n",
142
- " content = re.sub(r\"(?<!\\\\)(?<!\\\\\\\\)(\\\\\\\\\\*)\\\\(\", r\"\\\\1\\\\\\\\(\", content)\n",
143
  " # Escape unescaped closing parentheses\n",
144
- " content = re.sub(r\"(?<!\\\\)(?<!\\\\\\\\)(\\\\\\\\\\*)\\\\)\", r\"\\\\1\\\\\\\\)\", content)\n",
145
- " if content != original_content:\n",
146
- " print(f\"Warning: File '{file_path}' was modified.\")\n",
147
- " print(f\"Original: {original_content}\")\n",
148
- " print(f\"Modified: {content}\")\n",
149
- " with open(file_path, \"w\") as file:\n",
150
- " file.write(content)\n",
 
 
 
151
  "\n",
152
  "def process_directory(directory):\n",
153
- " for file_path in Path(directory).rglob(\"*.txt\"):\n",
154
- " escape_parentheses(str(file_path))\n",
155
  "\n",
156
- "directory_path = r\"C:\\Users\\kade\\Desktop\\training_dir_staging\"\n",
 
 
157
  "process_directory(directory_path)"
158
  ]
159
  }
 
66
  },
67
  {
68
  "cell_type": "code",
69
+ "execution_count": 8,
70
  "metadata": {},
71
  "outputs": [
72
  {
73
+ "ename": "error",
74
+ "evalue": "missing ), unterminated subpattern at position 26",
75
+ "output_type": "error",
76
+ "traceback": [
77
+ "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
78
+ "\u001b[1;31merror\u001b[0m Traceback (most recent call last)",
79
+ "Cell \u001b[1;32mIn[8], line 31\u001b[0m\n\u001b[0;32m 27\u001b[0m escape_parentheses(\u001b[38;5;28mstr\u001b[39m(file_path))\n\u001b[0;32m 30\u001b[0m directory_path \u001b[38;5;241m=\u001b[39m \u001b[38;5;124mr\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mE:\u001b[39m\u001b[38;5;124m\\\u001b[39m\u001b[38;5;124mtraining_dir\u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[1;32m---> 31\u001b[0m \u001b[43mprocess_directory\u001b[49m\u001b[43m(\u001b[49m\u001b[43mdirectory_path\u001b[49m\u001b[43m)\u001b[49m\n",
80
+ "Cell \u001b[1;32mIn[8], line 27\u001b[0m, in \u001b[0;36mprocess_directory\u001b[1;34m(directory)\u001b[0m\n\u001b[0;32m 25\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21mprocess_directory\u001b[39m(directory):\n\u001b[0;32m 26\u001b[0m \u001b[38;5;28;01mfor\u001b[39;00m file_path \u001b[38;5;129;01min\u001b[39;00m Path(directory)\u001b[38;5;241m.\u001b[39mrglob(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m*.txt\u001b[39m\u001b[38;5;124m\"\u001b[39m):\n\u001b[1;32m---> 27\u001b[0m \u001b[43mescape_parentheses\u001b[49m\u001b[43m(\u001b[49m\u001b[38;5;28;43mstr\u001b[39;49m\u001b[43m(\u001b[49m\u001b[43mfile_path\u001b[49m\u001b[43m)\u001b[49m\u001b[43m)\u001b[49m\n",
81
+ "Cell \u001b[1;32mIn[8], line 11\u001b[0m, in \u001b[0;36mescape_parentheses\u001b[1;34m(file_path)\u001b[0m\n\u001b[0;32m 8\u001b[0m original_content \u001b[38;5;241m=\u001b[39m content\n\u001b[0;32m 10\u001b[0m \u001b[38;5;66;03m# Escape unescaped opening parentheses\u001b[39;00m\n\u001b[1;32m---> 11\u001b[0m content \u001b[38;5;241m=\u001b[39m \u001b[43mre\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43msub\u001b[49m\u001b[43m(\u001b[49m\u001b[38;5;124;43mr\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43m(?<!\u001b[39;49m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;124;43m)(?<!\u001b[39;49m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;124;43m)(\u001b[39;49m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;124;43m\\\u001b[39;49m\u001b[38;5;124;43m*)\u001b[39;49m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;124;43m(\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;124;43mr\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;124;43m1\u001b[39;49m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;130;43;01m\\\\\u001b[39;49;00m\u001b[38;5;124;43m(\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mcontent\u001b[49m\u001b[43m)\u001b[49m\n\u001b[0;32m 13\u001b[0m \u001b[38;5;66;03m# Escape unescaped closing parentheses\u001b[39;00m\n\u001b[0;32m 14\u001b[0m content \u001b[38;5;241m=\u001b[39m re\u001b[38;5;241m.\u001b[39msub(\u001b[38;5;124mr\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m(?<!\u001b[39m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;124m)(?<!\u001b[39m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;124m)(\u001b[39m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;124m\\\u001b[39m\u001b[38;5;124m*)\u001b[39m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;124m)\u001b[39m\u001b[38;5;124m\"\u001b[39m, \u001b[38;5;124mr\u001b[39m\u001b[38;5;124m\"\u001b[39m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;124m1\u001b[39m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;130;01m\\\\\u001b[39;00m\u001b[38;5;124m)\u001b[39m\u001b[38;5;124m\"\u001b[39m, content)\n",
82
+ "File \u001b[1;32mC:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.12_3.12.1008.0_x64__qbz5n2kfra8p0\\Lib\\re\\__init__.py:186\u001b[0m, in \u001b[0;36msub\u001b[1;34m(pattern, repl, string, count, flags)\u001b[0m\n\u001b[0;32m 179\u001b[0m \u001b[38;5;28;01mdef\u001b[39;00m \u001b[38;5;21msub\u001b[39m(pattern, repl, string, count\u001b[38;5;241m=\u001b[39m\u001b[38;5;241m0\u001b[39m, flags\u001b[38;5;241m=\u001b[39m\u001b[38;5;241m0\u001b[39m):\n\u001b[0;32m 180\u001b[0m \u001b[38;5;250m \u001b[39m\u001b[38;5;124;03m\"\"\"Return the string obtained by replacing the leftmost\u001b[39;00m\n\u001b[0;32m 181\u001b[0m \u001b[38;5;124;03m non-overlapping occurrences of the pattern in string by the\u001b[39;00m\n\u001b[0;32m 182\u001b[0m \u001b[38;5;124;03m replacement repl. repl can be either a string or a callable;\u001b[39;00m\n\u001b[0;32m 183\u001b[0m \u001b[38;5;124;03m if a string, backslash escapes in it are processed. If it is\u001b[39;00m\n\u001b[0;32m 184\u001b[0m \u001b[38;5;124;03m a callable, it's passed the Match object and must return\u001b[39;00m\n\u001b[0;32m 185\u001b[0m \u001b[38;5;124;03m a replacement string to be used.\"\"\"\u001b[39;00m\n\u001b[1;32m--> 186\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[43m_compile\u001b[49m\u001b[43m(\u001b[49m\u001b[43mpattern\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mflags\u001b[49m\u001b[43m)\u001b[49m\u001b[38;5;241m.\u001b[39msub(repl, string, count)\n",
83
+ "File \u001b[1;32mC:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.12_3.12.1008.0_x64__qbz5n2kfra8p0\\Lib\\re\\__init__.py:307\u001b[0m, in \u001b[0;36m_compile\u001b[1;34m(pattern, flags)\u001b[0m\n\u001b[0;32m 301\u001b[0m \u001b[38;5;28;01mimport\u001b[39;00m \u001b[38;5;21;01mwarnings\u001b[39;00m\n\u001b[0;32m 302\u001b[0m warnings\u001b[38;5;241m.\u001b[39mwarn(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mThe re.TEMPLATE/re.T flag is deprecated \u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m 303\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mas it is an undocumented flag \u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m 304\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mwithout an obvious purpose. \u001b[39m\u001b[38;5;124m\"\u001b[39m\n\u001b[0;32m 305\u001b[0m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mDon\u001b[39m\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mt use it.\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[0;32m 306\u001b[0m \u001b[38;5;167;01mDeprecationWarning\u001b[39;00m)\n\u001b[1;32m--> 307\u001b[0m p \u001b[38;5;241m=\u001b[39m \u001b[43m_compiler\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mcompile\u001b[49m\u001b[43m(\u001b[49m\u001b[43mpattern\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mflags\u001b[49m\u001b[43m)\u001b[49m\n\u001b[0;32m 308\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m flags \u001b[38;5;241m&\u001b[39m DEBUG:\n\u001b[0;32m 309\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m p\n",
84
+ "File \u001b[1;32mC:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.12_3.12.1008.0_x64__qbz5n2kfra8p0\\Lib\\re\\_compiler.py:745\u001b[0m, in \u001b[0;36mcompile\u001b[1;34m(p, flags)\u001b[0m\n\u001b[0;32m 743\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m isstring(p):\n\u001b[0;32m 744\u001b[0m pattern \u001b[38;5;241m=\u001b[39m p\n\u001b[1;32m--> 745\u001b[0m p \u001b[38;5;241m=\u001b[39m \u001b[43m_parser\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mparse\u001b[49m\u001b[43m(\u001b[49m\u001b[43mp\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mflags\u001b[49m\u001b[43m)\u001b[49m\n\u001b[0;32m 746\u001b[0m \u001b[38;5;28;01melse\u001b[39;00m:\n\u001b[0;32m 747\u001b[0m pattern \u001b[38;5;241m=\u001b[39m \u001b[38;5;28;01mNone\u001b[39;00m\n",
85
+ "File \u001b[1;32mC:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.12_3.12.1008.0_x64__qbz5n2kfra8p0\\Lib\\re\\_parser.py:979\u001b[0m, in \u001b[0;36mparse\u001b[1;34m(str, flags, state)\u001b[0m\n\u001b[0;32m 976\u001b[0m state\u001b[38;5;241m.\u001b[39mflags \u001b[38;5;241m=\u001b[39m flags\n\u001b[0;32m 977\u001b[0m state\u001b[38;5;241m.\u001b[39mstr \u001b[38;5;241m=\u001b[39m \u001b[38;5;28mstr\u001b[39m\n\u001b[1;32m--> 979\u001b[0m p \u001b[38;5;241m=\u001b[39m \u001b[43m_parse_sub\u001b[49m\u001b[43m(\u001b[49m\u001b[43msource\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mstate\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mflags\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m&\u001b[39;49m\u001b[43m \u001b[49m\u001b[43mSRE_FLAG_VERBOSE\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m0\u001b[39;49m\u001b[43m)\u001b[49m\n\u001b[0;32m 980\u001b[0m p\u001b[38;5;241m.\u001b[39mstate\u001b[38;5;241m.\u001b[39mflags \u001b[38;5;241m=\u001b[39m fix_flags(\u001b[38;5;28mstr\u001b[39m, p\u001b[38;5;241m.\u001b[39mstate\u001b[38;5;241m.\u001b[39mflags)\n\u001b[0;32m 982\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m source\u001b[38;5;241m.\u001b[39mnext \u001b[38;5;129;01mis\u001b[39;00m \u001b[38;5;129;01mnot\u001b[39;00m \u001b[38;5;28;01mNone\u001b[39;00m:\n",
86
+ "File \u001b[1;32mC:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.12_3.12.1008.0_x64__qbz5n2kfra8p0\\Lib\\re\\_parser.py:460\u001b[0m, in \u001b[0;36m_parse_sub\u001b[1;34m(source, state, verbose, nested)\u001b[0m\n\u001b[0;32m 458\u001b[0m start \u001b[38;5;241m=\u001b[39m source\u001b[38;5;241m.\u001b[39mtell()\n\u001b[0;32m 459\u001b[0m \u001b[38;5;28;01mwhile\u001b[39;00m \u001b[38;5;28;01mTrue\u001b[39;00m:\n\u001b[1;32m--> 460\u001b[0m itemsappend(\u001b[43m_parse\u001b[49m\u001b[43m(\u001b[49m\u001b[43msource\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mstate\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mverbose\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mnested\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m+\u001b[39;49m\u001b[43m \u001b[49m\u001b[38;5;241;43m1\u001b[39;49m\u001b[43m,\u001b[49m\n\u001b[0;32m 461\u001b[0m \u001b[43m \u001b[49m\u001b[38;5;129;43;01mnot\u001b[39;49;00m\u001b[43m \u001b[49m\u001b[43mnested\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;129;43;01mand\u001b[39;49;00m\u001b[43m \u001b[49m\u001b[38;5;129;43;01mnot\u001b[39;49;00m\u001b[43m \u001b[49m\u001b[43mitems\u001b[49m\u001b[43m)\u001b[49m)\n\u001b[0;32m 462\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;129;01mnot\u001b[39;00m sourcematch(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m|\u001b[39m\u001b[38;5;124m\"\u001b[39m):\n\u001b[0;32m 463\u001b[0m \u001b[38;5;28;01mbreak\u001b[39;00m\n",
87
+ "File \u001b[1;32mC:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.12_3.12.1008.0_x64__qbz5n2kfra8p0\\Lib\\re\\_parser.py:864\u001b[0m, in \u001b[0;36m_parse\u001b[1;34m(source, state, verbose, nested, first)\u001b[0m\n\u001b[0;32m 862\u001b[0m p \u001b[38;5;241m=\u001b[39m _parse_sub(source, state, sub_verbose, nested \u001b[38;5;241m+\u001b[39m \u001b[38;5;241m1\u001b[39m)\n\u001b[0;32m 863\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;129;01mnot\u001b[39;00m source\u001b[38;5;241m.\u001b[39mmatch(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m)\u001b[39m\u001b[38;5;124m\"\u001b[39m):\n\u001b[1;32m--> 864\u001b[0m \u001b[38;5;28;01mraise\u001b[39;00m source\u001b[38;5;241m.\u001b[39merror(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mmissing ), unterminated subpattern\u001b[39m\u001b[38;5;124m\"\u001b[39m,\n\u001b[0;32m 865\u001b[0m source\u001b[38;5;241m.\u001b[39mtell() \u001b[38;5;241m-\u001b[39m start)\n\u001b[0;32m 866\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m group \u001b[38;5;129;01mis\u001b[39;00m \u001b[38;5;129;01mnot\u001b[39;00m \u001b[38;5;28;01mNone\u001b[39;00m:\n\u001b[0;32m 867\u001b[0m state\u001b[38;5;241m.\u001b[39mclosegroup(group, p)\n",
88
+ "\u001b[1;31merror\u001b[0m: missing ), unterminated subpattern at position 26"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
89
  ]
90
  }
91
  ],
92
  "source": [
93
+ "import os\n",
94
+ "import re\n",
95
+ "\n",
96
+ "\n",
97
+ "def escape_parentheses(file_path):\n",
98
+ " with open(file_path, \"r\") as file:\n",
99
+ " content = file.read()\n",
100
+ " original_content = content\n",
101
+ "\n",
102
+ " # Escape unescaped opening parentheses\n",
103
+ " content = re.sub(r\"(?<!\\\\)(\\\\*)(\\()\", r\"\\1\\\\\\2\", content)\n",
104
+ " # Escape unescaped closing parentheses\n",
105
+ " content = re.sub(r\"(?<!\\\\)(\\\\*)(\\))\", r\"\\1\\\\\\2\", content)\n",
106
+ "\n",
107
+ " if content != original_content:\n",
108
+ " print(f\"Warning: File '{file_path}' was modified.\")\n",
109
+ " print(f\"Original: {original_content}\")\n",
110
+ " print(f\"Modified: {content}\")\n",
111
+ "\n",
112
+ " with open(file_path, \"w\") as file:\n",
113
+ " file.write(content)\n",
114
+ "\n",
115
+ "\n",
116
+ "def process_directory(directory):\n",
117
+ " for root, dirs, files in os.walk(directory):\n",
118
+ " for file in files:\n",
119
+ " if file.endswith(\".txt\"):\n",
120
+ " file_path = os.path.join(root, file)\n",
121
+ " escape_parentheses(file_path)\n",
122
+ " for dir in dirs:\n",
123
+ " process_directory(os.path.join(root, dir))\n",
124
+ "\n",
125
+ "\n",
126
+ "directory_path = r\"E:\\training_dir\"\n",
127
+ "# directory_path = r\"C:\\Users\\kade\\Desktop\\training_dir_staging\"\n",
128
+ "process_directory(directory_path)"
129
+ ]
130
+ },
131
+ {
132
+ "cell_type": "code",
133
+ "execution_count": null,
134
+ "metadata": {},
135
+ "outputs": [],
136
+ "source": [
137
+ "import os\n",
138
  "import re\n",
139
+ "import glob\n",
140
+ "\n",
141
  "\n",
142
  "def escape_parentheses(file_path):\n",
143
  " with open(file_path, \"r\") as file:\n",
144
  " content = file.read()\n",
145
  " original_content = content\n",
146
+ "\n",
147
  " # Escape unescaped opening parentheses\n",
148
+ " content = re.sub(r\"(?<!\\\\)(\\\\*)(\\()\", r\"\\1\\\\\\2\", content)\n",
149
  " # Escape unescaped closing parentheses\n",
150
+ " content = re.sub(r\"(?<!\\\\)(\\\\*)(\\))\", r\"\\1\\\\\\2\", content)\n",
151
+ "\n",
152
+ " if content != original_content:\n",
153
+ " print(f\"Warning: File '{file_path}' was modified.\")\n",
154
+ " print(f\"Original: {original_content}\")\n",
155
+ " print(f\"Modified: {content}\")\n",
156
+ "\n",
157
+ " with open(file_path, \"w\") as file:\n",
158
+ " file.write(content)\n",
159
+ "\n",
160
  "\n",
161
  "def process_directory(directory):\n",
162
+ " for file_path in glob.glob(directory + \"/**/*.txt\", recursive=True):\n",
163
+ " escape_parentheses(file_path)\n",
164
  "\n",
165
+ "\n",
166
+ "directory_path = r\"E:\\training_dir\"\n",
167
+ "# directory_path = r\"C:\\Users\\kade\\Desktop\\training_dir_staging\"\n",
168
  "process_directory(directory_path)"
169
  ]
170
  }
dataset_tools/Pony2Seaart.ipynb ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cells": [
3
+ {
4
+ "cell_type": "markdown",
5
+ "metadata": {},
6
+ "source": [
7
+ "# Pony2Seaart\n",
8
+ "\n",
9
+ "---\n",
10
+ "\n",
11
+ "This script converts Pony captions to Seaart."
12
+ ]
13
+ },
14
+ {
15
+ "cell_type": "code",
16
+ "execution_count": 8,
17
+ "metadata": {},
18
+ "outputs": [],
19
+ "source": [
20
+ "import os\n",
21
+ "import glob\n",
22
+ "\n",
23
+ "def pony2seaart(file_path):\n",
24
+ " if os.path.basename(file_path).endswith(\"sample-prompts.txt\"):\n",
25
+ " return\n",
26
+ " with open(file_path, \"r\") as file:\n",
27
+ " lines = file.readlines()\n",
28
+ " new_lines = []\n",
29
+ " for line in lines:\n",
30
+ " parts = line.strip().split(\", \")\n",
31
+ " tags = []\n",
32
+ " caption = \"\"\n",
33
+ " for part in parts:\n",
34
+ " if \".\" in part:\n",
35
+ " if not caption:\n",
36
+ " caption = part\n",
37
+ " else:\n",
38
+ " caption += \", \" + part\n",
39
+ " else:\n",
40
+ " tag = part.replace(\" \", \"_\")\n",
41
+ " if tag == \"rating_explicit\":\n",
42
+ " tag = \"explicit\"\n",
43
+ " elif tag == \"rating_safe\":\n",
44
+ " tag = \"safe\"\n",
45
+ " elif tag == \"rating_questionable\":\n",
46
+ " tag = \"questionable\"\n",
47
+ " tags.append(tag)\n",
48
+ " new_line = \", \".join(tags) + (\", \" + caption if caption else \"\")\n",
49
+ " new_lines.append(new_line + \"\\n\")\n",
50
+ "\n",
51
+ " new_file_name = os.path.splitext(os.path.basename(file_path))[0] + \".seaart\"\n",
52
+ " new_file_path = os.path.join(os.path.dirname(file_path), new_file_name)\n",
53
+ " with open(new_file_path, \"w\") as new_file:\n",
54
+ " new_file.writelines(new_lines)\n",
55
+ "\n",
56
+ "def process_directory(directory):\n",
57
+ " txt_files = glob.glob(os.path.join(directory, \"**\", \"*.txt\"), recursive=True)\n",
58
+ " for file_path in txt_files:\n",
59
+ " pony2seaart(file_path)\n",
60
+ "\n",
61
+ "if __name__ == \"__main__\":\n",
62
+ " input_dir = \"C:\\\\Users\\\\kade\\\\Desktop\\\\training_dir_staging\"\n",
63
+ " process_directory(input_dir)"
64
+ ]
65
+ }
66
+ ],
67
+ "metadata": {
68
+ "kernelspec": {
69
+ "display_name": "Python 3",
70
+ "language": "python",
71
+ "name": "python3"
72
+ },
73
+ "language_info": {
74
+ "codemirror_mode": {
75
+ "name": "ipython",
76
+ "version": 3
77
+ },
78
+ "file_extension": ".py",
79
+ "mimetype": "text/x-python",
80
+ "name": "python",
81
+ "nbconvert_exporter": "python",
82
+ "pygments_lexer": "ipython3",
83
+ "version": "3.12.3"
84
+ }
85
+ },
86
+ "nbformat": 4,
87
+ "nbformat_minor": 2
88
+ }
ponyxl_loras/arielsatyr-v1e400.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"modelspec.implementation": "https://github.com/Stability-AI/generative-models", "ss_prior_loss_weight": 1.0, "modelspec.architecture": "stable-diffusion-xl-v1-base/lora", "ss_full_fp16": true, "ss_network_module": "lycoris.kohya", "ss_learning_rate": 0.0001, "ss_shuffle_caption": true, "ss_unet_lr": 0.0001, "ss_bucket_no_upscale": true, "ss_new_sd_model_hash": "IsADirectory", "ss_min_bucket_reso": 256, "ss_training_finished_at": "2024-04-21 14:01:13.328836", "ss_multires_noise_iterations": 10.0, "ss_cache_latents": true, "ss_lowram": true, "ss_bucket_info": {"buckets": {"0": {"resolution": [416, 608], "count": 2}, "1": {"resolution": [480, 544], "count": 4}, "2": {"resolution": [512, 512], "count": 4}, "3": {"resolution": [544, 480], "count": 2}, "4": {"resolution": [576, 448], "count": 2}, "5": {"resolution": [608, 416], "count": 2}, "6": {"resolution": [672, 384], "count": 2}, "7": {"resolution": [704, 352], "count": 2}}, "mean_img_ar_error": 0.03945710544849258}, "ss_max_train_steps": 400, "ss_huber_c": "0.1", "ss_network_args": {"preset": "full", "conv_dim": "256", "conv_alpha": "4", "rank_dropout": "0", "module_dropout": "0", "use_tucker": "False", "use_scalar": "False", "rank_dropout_scale": "False", "algo": "locon", "train_norm": "False", "block_dims": "8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8", "block_alphas": "0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625", "dropout": 0.0}, "ss_max_token_length": null, "ss_face_crop_aug_range": "None", "ss_noise_offset": null, "ss_resolution": "(512, 512)", "ss_min_snr_gamma": null, "ss_caption_dropout_rate": 0.0, "ss_network_dim": 8.0, "ss_caption_tag_dropout_rate": 0.0, "ss_ip_noise_gamma": null, "ss_sd_model_hash": "IsADirectory", "ss_sd_scripts_commit_hash": "71e2c91330a9d866ec05cdd10584bbb962896a99", "ss_gradient_checkpointing": true, "ss_huber_schedule": "snr", "ss_color_aug": true, "ss_reg_dataset_dirs": {}, "ss_epoch": 400, "ss_keep_tokens": true, "ss_network_dropout": 0.0, "ss_mixed_precision": "fp16", "ss_lr_scheduler": "cosine", "ss_output_name": "arielsatyr", "ss_ip_noise_gamma_random_strength": "False", "ss_seed": 624553646, "ss_text_encoder_lr": 0.0001, "ss_multires_noise_discount": 0.1, "ss_scale_weight_norms": 1.0, "ss_total_batch_size": 192, "ss_training_started_at": "2024-04-21 12:10:42.853301", "ss_session_id": "3405220309", "ss_loss_type": "l2", "modelspec.title": "arielsatyr", "ss_enable_bucket": true, "sshs_legacy_hash": "b0c00b23", "modelspec.resolution": "512x512", "ss_gradient_accumulation_steps": 12, "ss_max_grad_norm": 1.0, "ss_debiased_estimation": true, "ss_noise_offset_random_strength": "False", "ss_zero_terminal_snr": true, "modelspec.date": "2024-04-21T12:01:13", "ss_num_epochs": 400, "ss_num_batches_per_epoch": 4, "ss_max_bucket_reso": 1024, "modelspec.sai_model_spec": "1.0.0", "ss_sd_model_name": "", "ss_num_reg_images": 0, "ss_base_model_version": "sdxl_base_v1-0", "ss_flip_aug": true, "ss_v2": true, "ss_adaptive_noise_scale": null, "ss_network_alpha": 4.0, "ss_tag_frequency": {"2_arielsatyr": {"mammal": 10, "explicit": 9, "male": 10, "genitals": 8, "duo": 7, "penis": 5, "caprine": 7, "anthro": 8, "bodily fluids": 6, "animal genitalia": 2, "bovid": 8, "animal penis": 2, "horn": 8, "male/male": 2, "hooves": 9, "anus": 2, "genital fluids": 4, "on back": 2, "balls": 7, "kissing": 2, "erection": 2, "clothing": 2, "lying": 3, "cloven hooves": 1, "hair": 9, "fur": 8, "kitchen": 1, "canis": 3, "detailed background": 3, "cervine genitalia": 1, "sex": 2, "goat": 5, "penile": 1, "nude": 9, "bound": 2, "satyr": 7, "deer": 4, "human": 3, "inside": 2, "canid": 3, "interspecies": 2, "cervine penis": 1, "canine": 3, "handjob": 1, "white fur": 1, "white body": 3, "this image depicts an anthropomorphic border collie with a white and grey coat wearing a turquoise apron next to a satyr character who appears to be lying on a wooden kitchen table.": 1, "the satyr has curly blonde hair and goat horns.": 1, "the dog is gently placing its right paw on the satyr's tapering penis and holding a pair of scissors in their left hand.": 1, "the kitchen table is next to a sink and there are various kitchen utensils hanging on the wall.": 1, "the overall style of the image is that of a digital illustration": 1, "with a focus on detailed character design and a warm color palette.": 1, "solo": 4, "blush": 1, "monochrome": 1, "humanoid": 7, "simple background": 1, "noose": 2, "hanged": 2, "necklace": 1, "mammal humanoid": 1, "animal humanoid": 1, "white background": 1, "surprise": 1, "flaccid": 1, "sketch": 1, "nipples": 5, "avian": 1, "bird": 1, "cum": 2, "pussy": 2, "tree": 4, "butt": 1, "plant": 4, "outside": 3, "cum inside": 2, "female": 5, "after sex": 1, "accipitriform": 1, "talons": 1, "stuck": 1, "beak": 1, "ass up": 1, "pussy juice": 1, "accipitrid": 1, "forest": 3, "holidays": 1, "fireplace": 1, "christmas tree": 1, "safe": 1, "romantic": 1, "black hair": 1, "romantic couple": 1, "container": 1, "smile": 2, "blanket": 1, "fire": 1, "gift": 1, "wreath": 1, "brown body": 1, "cup": 1, "black body": 1, "scarf": 1, "looking at another": 1, "digital media (artwork)": 1, "blood": 1, "gore": 1, "death": 2, "snuff": 2, "sheep": 1, "sofa": 1, "feral": 2, "bestiality": 1, "male/female": 1, "penetration": 1, "male on feral": 1, "anthro penetrating feral": 1, "humanoid on feral": 1, "feral penetrated": 1, "anthro on feral": 1, "wolf": 2, "female penetrated": 1, "female on anthro": 1, "from behind position": 1, "male penetrating female": 1, "human on feral": 1, "quadruped": 1, "blonde hair": 3, "tail": 1, "male penetrating": 1, "doggystyle": 1, "eyes closed": 3, "human penetrating": 1, "all fours": 1, "grey body": 2, "grey fur": 2, "small dom big sub": 1, "cooking with furs": 1, "food": 1, "text": 1, "vegetable": 1, "carrot": 1, "piercing": 2, "food play": 1, "navel": 2, "feces": 1, "scat": 1, "food fetish": 1, "young": 1, "ear piercing": 1, "breasts": 1, "hands behind back": 1, "small breasts": 1, "border": 1, "black border": 1, "suspension": 1, "imminent death": 1, "bondage": 1, "bdsm": 1, "cub": 1, "loli": 1, "ring piercing": 1, "flat chested": 1, "asphyxiation": 1, "corpse": 1, "dying": 1, "execution": 1, "open mouth": 1, "rope": 1, "group": 1, "tongue": 1, "sheath": 2, "tongue out": 1, "licking": 1, "grass": 1, "nature": 1, "fully sheathed": 1, "canine penis": 1}}, "modelspec.prediction_type": "epsilon", "ss_num_train_images": 20, "ss_caption_dropout_every_n_epochs": 0, "ss_training_comment": "None", "ss_optimizer": "torch.optim.adamw.AdamW", "ss_lr_warmup_steps": 0, "ss_steps": 400, "ss_batch_size_per_device": 8, "ss_clip_skip": null, "sshs_model_hash": "f2f6dd3c8cc7aefb2fabb99a164ce28c699085912507fa22e8fa1fe93a34f521", "ss_dataset_dirs": {"2_arielsatyr": {"n_repeats": 2, "img_count": 10}}, "ss_random_crop": true, "dtype": "F16", "file": "Desktop\\yiff_toolkit\\ponyxl_loras\\arielsatyr-v1e400.safetensors", "filename": "arielsatyr-v1e400.safetensors"}
ponyxl_loras/arielsatyr-v1e400.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4df766832fc4d069058c3c55fc67729decb880010cc212a7c88be603cc3ef26f
3
+ size 240578248
ponyxl_loras/arielsatyr-v2e400.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"ss_huber_c": "0.1", "ss_keep_tokens": true, "ss_text_encoder_lr": 0.0001, "ss_debiased_estimation": true, "ss_loss_type": "l2", "ss_noise_offset_random_strength": "False", "ss_face_crop_aug_range": "None", "ss_huber_schedule": "snr", "ss_reg_dataset_dirs": {}, "ss_sd_scripts_commit_hash": "71e2c91330a9d866ec05cdd10584bbb962896a99", "ss_total_batch_size": 192, "ss_batch_size_per_device": 8, "ss_network_dim": 8.0, "ss_sd_model_name": "", "ss_max_bucket_reso": 1024, "ss_resolution": "(512, 512)", "ss_optimizer": "torch.optim.adamw.AdamW", "ss_sd_model_hash": "IsADirectory", "modelspec.architecture": "stable-diffusion-xl-v1-base/lora", "ss_cache_latents": true, "ss_noise_offset": null, "ss_dataset_dirs": {"2_arielsatyr": {"n_repeats": 2, "img_count": 10}}, "modelspec.date": "2024-04-21T14:08:18", "ss_training_comment": "None", "ss_enable_bucket": true, "modelspec.resolution": "512x512", "modelspec.prediction_type": "epsilon", "ss_new_sd_model_hash": "IsADirectory", "ss_num_epochs": 400, "ss_min_bucket_reso": 256, "ss_clip_skip": null, "sshs_legacy_hash": "78f35a9e", "ss_network_dropout": 0.0, "ss_network_alpha": 4.0, "ss_multires_noise_discount": 0.1, "modelspec.sai_model_spec": "1.0.0", "ss_unet_lr": 0.0001, "ss_network_args": {"preset": "full", "conv_dim": "256", "conv_alpha": "4", "rank_dropout": "0", "module_dropout": "0", "use_tucker": "False", "use_scalar": "False", "rank_dropout_scale": "False", "algo": "locon", "train_norm": "False", "block_dims": "8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8,8", "block_alphas": "0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625,0.0625", "dropout": 0.0}, "ss_num_train_images": 20, "ss_steps": 400, "ss_random_crop": true, "ss_max_token_length": null, "ss_color_aug": true, "ss_lr_warmup_steps": 0, "ss_lowram": true, "ss_v2": true, "ss_num_batches_per_epoch": 4, "ss_ip_noise_gamma": null, "ss_seed": 3949175371, "ss_gradient_accumulation_steps": 12, "ss_caption_tag_dropout_rate": 0.0, "ss_training_finished_at": "2024-04-21 16:08:18.764037", "ss_ip_noise_gamma_random_strength": "False", "ss_gradient_checkpointing": true, "ss_prior_loss_weight": 1.0, "ss_zero_terminal_snr": true, "ss_multires_noise_iterations": 10.0, "ss_session_id": "850672712", "ss_mixed_precision": "fp16", "ss_learning_rate": 0.0001, "modelspec.implementation": "https://github.com/Stability-AI/generative-models", "modelspec.title": "arielsatyr", "ss_training_started_at": "2024-04-21 14:17:10.578935", "ss_network_module": "lycoris.kohya", "ss_shuffle_caption": true, "ss_base_model_version": "sdxl_base_v1-0", "ss_output_name": "arielsatyr", "ss_lr_scheduler": "cosine", "ss_flip_aug": true, "ss_caption_dropout_every_n_epochs": 0, "ss_bucket_info": {"buckets": {"0": {"resolution": [416, 608], "count": 2}, "1": {"resolution": [480, 544], "count": 4}, "2": {"resolution": [512, 512], "count": 4}, "3": {"resolution": [544, 480], "count": 2}, "4": {"resolution": [576, 448], "count": 2}, "5": {"resolution": [608, 416], "count": 2}, "6": {"resolution": [672, 384], "count": 2}, "7": {"resolution": [704, 352], "count": 2}}, "mean_img_ar_error": 0.03945710544849258}, "ss_full_fp16": true, "ss_num_reg_images": 0, "ss_caption_dropout_rate": 0.0, "sshs_model_hash": "5acd2bd9dbcc06bf0d37a3c7eb205b26daefe1b9bdef3ded913ccfe3a8aa2818", "ss_tag_frequency": {"2_arielsatyr": {"arielsatyr": 10, "mammal": 10, "rating_explicit": 8, "male": 10, "genitals": 8, "duo": 7, "penis": 5, "caprine": 7, "anthro": 8, "bodily fluids": 6, "animal genitalia": 2, "bovid": 8, "animal penis": 2, "horn": 8, "male/male": 2, "hooves": 9, "anus": 2, "genital fluids": 4, "on back": 2, "balls": 7, "kissing": 2, "erection": 2, "clothing": 2, "lying": 3, "cloven hooves": 1, "hair": 9, "fur": 8, "kitchen": 1, "canis": 3, "detailed background": 3, "cervine genitalia": 1, "sex": 2, "goat": 5, "penile": 1, "nude": 9, "bound": 2, "satyr": 7, "human": 3, "inside": 2, "canid": 3, "interspecies": 2, "cervine penis": 1, "canine": 3, "handjob": 1, "white fur": 1, "white body": 3, "this image depicts an anthropomorphic border collie with a white and grey coat wearing a turquoise apron next to a satyr character who appears to be lying on a wooden kitchen table.": 1, "the satyr has curly blonde hair and goat horns.": 1, "the dog is gently placing its right paw on the satyr's tapering penis and holding a pair of scissors in their left hand.": 1, "the kitchen table is next to a sink and there are various kitchen utensils hanging on the wall.": 1, "the overall style of the image is that of a digital illustration with a focus on detailed character design and a warm color palette.": 1, "solo": 4, "blush": 1, "monochrome": 1, "humanoid": 7, "simple background": 1, "noose": 2, "hanged": 2, "necklace": 1, "mammal humanoid": 1, "animal humanoid": 1, "white background": 1, "surprise": 1, "flaccid": 1, "sketch": 1, "nipples": 5, "avian": 1, "bird": 1, "cum": 2, "pussy": 2, "tree": 4, "butt": 1, "plant": 4, "outside": 3, "cum inside": 2, "female": 5, "after sex": 1, "accipitriform": 1, "talons": 1, "stuck": 1, "beak": 1, "ass up": 1, "pussy juice": 1, "accipitrid": 1, "forest": 3, "rating_safe": 1, "holidays": 1, "fireplace": 1, "christmas tree": 1, "romantic": 1, "black hair": 1, "romantic couple": 1, "container": 1, "smile": 2, "blanket": 1, "fire": 1, "gift": 1, "wreath": 1, "brown body": 1, "cup": 1, "black body": 1, "scarf": 1, "looking at another": 1, "digital media \\(artwork\\)": 1, "blood": 1, "gore": 1, "death": 2, "snuff": 2, "blonde hair": 4, "sofa": 1, "feral": 2, "bestiality": 1, "male/female": 1, "penetration": 1, "male on feral": 1, "anthro penetrating feral": 1, "humanoid on feral": 1, "feral penetrated": 1, "anthro on feral": 1, "wolf": 2, "female penetrated": 1, "female on anthro": 1, "from behind position": 1, "male penetrating female": 1, "human on feral": 1, "quadruped": 1, "tail": 1, "male penetrating": 1, "doggystyle": 1, "eyes closed": 3, "human penetrating": 1, "all fours": 1, "grey body": 2, "grey fur": 2, "small dom big sub": 1, "cooking with furs": 1, "food": 1, "text": 1, "vegetable": 1, "carrot": 1, "piercing": 1, "food play": 1, "navel": 2, "feces": 1, "scat": 1, "food fetish": 1, "young": 1, "ear piercing": 1, "breasts": 1, "hands behind back": 1, "small breasts": 1, "border": 1, "black border": 1, "suspension": 1, "imminent death": 1, "bondage": 1, "bdsm": 1, "cub": 1, "loli": 1, "flat chested": 1, "asphyxiation": 1, "corpse": 1, "dying": 1, "execution": 1, "open mouth": 1, "rope": 1, "groups": 1, "tongue": 1, "sheath": 2, "tongue out": 1, "licking": 1, "grass": 1, "nature": 1, "fully sheathed": 1, "tapering penis": 1, "rating_explcit": 1}}, "ss_adaptive_noise_scale": null, "ss_scale_weight_norms": 1.0, "ss_min_snr_gamma": null, "ss_bucket_no_upscale": true, "ss_epoch": 400, "ss_max_grad_norm": 1.0, "ss_max_train_steps": 400, "dtype": "F16", "file": "Desktop\\yiff_toolkit\\ponyxl_loras\\arielsatyr-v2e400.safetensors", "filename": "arielsatyr-v2e400.safetensors"}
ponyxl_loras/arielsatyr-v2e400.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b1c382001371a5e1f0121d4a0b64061f588b55055964aed8aeaa5ab4ffc792a
3
+ size 240578256
training_images/arielsatyr_000100_00_20240421103857_1.png ADDED

Git LFS Details

  • SHA256: 9b61680303776f55ef738f587f7e89a570d632830c5ecb11751332fa057032e3
  • Pointer size: 132 Bytes
  • Size of remote file: 1.49 MB
training_images/arielsatyr_000100_00_20240421124542_1.png ADDED

Git LFS Details

  • SHA256: 9cd390b8543b696da1fe9cf218edd0987f6eefae85587eb00135771c3d118464
  • Pointer size: 132 Bytes
  • Size of remote file: 1.85 MB
training_images/arielsatyr_000100_01_20240421103857_1.png ADDED

Git LFS Details

  • SHA256: 5867275af127e7bfc25f94cf930464ccd43eedd14110fbb51d61a56a18972a44
  • Pointer size: 132 Bytes
  • Size of remote file: 1.67 MB
training_images/arielsatyr_000100_01_20240421124542_1.png ADDED

Git LFS Details

  • SHA256: a2b1e85cb5d49d8cfc53d98206ca5a8685befb48ed247eae457ac1106caad0c9
  • Pointer size: 132 Bytes
  • Size of remote file: 1.56 MB
training_images/arielsatyr_000200_00_20240421110623_1.png ADDED

Git LFS Details

  • SHA256: 4863d9d4bb01a7927b2d3af5dd73580361d92ce1b4d4efc064dee9ff6fecd51d
  • Pointer size: 132 Bytes
  • Size of remote file: 1.53 MB
training_images/arielsatyr_000200_00_20240421131314_1.png ADDED

Git LFS Details

  • SHA256: d5251b1729ff6e38b0c18ea85307d29f8b0dbd91d37bfe1d5a2f2a45fa707808
  • Pointer size: 132 Bytes
  • Size of remote file: 1.72 MB
training_images/arielsatyr_000200_01_20240421110622_1.png ADDED

Git LFS Details

  • SHA256: 58c3bc667c001cef500595b797e6ae4d8559f54b8ecedf7124520f2c8b8d35ff
  • Pointer size: 132 Bytes
  • Size of remote file: 1.67 MB
training_images/arielsatyr_000200_01_20240421131313_1.png ADDED

Git LFS Details

  • SHA256: 59fdf3c245f0763eb10a6a08bbfa8027d6794fc7534af0109bc107fe59c3d9a4
  • Pointer size: 132 Bytes
  • Size of remote file: 1.59 MB
training_images/arielsatyr_000300_00_20240421113348_1.png ADDED

Git LFS Details

  • SHA256: c950fc25791376edc8a8dc5bda5b4677e59e8853eb11ef8551b0e769d677818d
  • Pointer size: 132 Bytes
  • Size of remote file: 1.5 MB
training_images/arielsatyr_000300_00_20240421134050_1.png ADDED

Git LFS Details

  • SHA256: ce341db4828a94a55b9df0c7520a306156af4eaf52dc1cccf247fdbd4644edeb
  • Pointer size: 132 Bytes
  • Size of remote file: 1.7 MB
training_images/arielsatyr_000300_01_20240421113347_1.png ADDED

Git LFS Details

  • SHA256: 51ef233fc8da5bb0f913be13581588c9a2e5a764b11bc1834af236970633c4a2
  • Pointer size: 132 Bytes
  • Size of remote file: 1.7 MB
training_images/arielsatyr_000300_01_20240421134049_1.png ADDED

Git LFS Details

  • SHA256: 7d3c9c316b9d70eba5a87d33c20ecc1038615f4824a2f310b195137977aa8620
  • Pointer size: 132 Bytes
  • Size of remote file: 1.55 MB
training_images/arielsatyr_000400_00_20240421120111_1.png ADDED

Git LFS Details

  • SHA256: 4f666cbebb22b632901bbd6ccb2d8f83934beddd1af04f5878e665258b472e25
  • Pointer size: 132 Bytes
  • Size of remote file: 1.48 MB
training_images/arielsatyr_000400_00_20240421140817_1.png ADDED

Git LFS Details

  • SHA256: 8d8eea1edf9d2858251b9c07c42e41322b04c3ed5bcdb87404f0914de032ee3b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.71 MB
training_images/arielsatyr_000400_01_20240421120110_1.png ADDED

Git LFS Details

  • SHA256: db894b9df1edb31d729248691097fb03719eb0fafc9f91de9632ff6819e82ab2
  • Pointer size: 132 Bytes
  • Size of remote file: 1.69 MB
training_images/arielsatyr_000400_01_20240421140816_1.png ADDED

Git LFS Details

  • SHA256: 89328642a95f38067a8bf535f3cd5249236c3841683420cea3cee94e5d5f0c4e
  • Pointer size: 132 Bytes
  • Size of remote file: 1.54 MB