metadata

license: other
license_name: faipl-1.0-sd
license_link: https://freedevproject.org/faipl-1.0-sd/
language:
  - en
tags:
  - text-to-image
  - stable-diffusion
  - safetensors
  - stable-diffusion-xl

models

Zipanoob_XL_Vpred_v1 (Noob AI Base): v1:2024-12-28
Zipang XL test03.1 (Animagine Base): 3.1b:2024-07-22
Ponypang_XL_giveup (Pony Base): fix5:2024-07-03

Zipanoob XL Vpred v1

-20000+ images Finetune trained

-Base model:NoobAI XL V-Pred 0.75s
-not good...
-ADetailer and HiresFix Recommendation.
-(forge)turn on Zero Terminal SNR
***Turn off when using flux or other epred models

Download: v1

- base model

-NoobAI XL V-Pred 0.75s -great XL model!

- trigger

japanese
european
myjd, myjk, myjc, myjsh, myjsm, myjsl, myjy (one of these)

- quality tags

masterpiece, best quality, realistic, photorealistic, mole, body freckles,

- negative tags

low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits

- prompt

danbooru tag + natural english

- Sampling method

Euler, Euler a :12-30 steps
(dmd2_sdxl_4step_lora):4-8 steps

dmd2_sdxl_4step_lora

- Schedule type

simple, Uniform
(dmd2):SGM Uniform

- cfg scale

3-5
1-1.5 (dmd2)

- Resolution

768 x1024, 1024 x 768
1024 x 1024
896 x 1152, 1152 x 896
512 x 768, 768 x 512

sample prompt

masterpiece, best quality, realistic, photorealistic, natural lighting, mole, body freckles,
22yo, myjd, japanese, 1girl, solo, black hair, bangs, ponytail, black eyes, grin,
sitting, wooden chair, holding teacup,
lace jacket, long sleeve, black T-shirt, blue denim pants,
looking at viewer, indoors, window, room
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 16, Sampler: Euler a, Schedule type: Simple, CFG scale: 5, Seed: 893132215, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.1, ADetailer model: face_yolov8n.pt, ADetailer confidence: 0.3, ADetailer dilate erode: 4, ADetailer mask blur: 4, ADetailer denoising strength: 0.4, ADetailer inpaint only masked: True, ADetailer inpaint padding: 32, ADetailer version: 24.11.1, Hires Module 1: Use same choices, Hires CFG Scale: 5, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

masterpiece, best quality, realistic, photorealistic, mole, body freckles, cute,
myjk, japanese, 1girl, solo, black long hair, blunt bangs, black eyes, smile, parted lips, upper body, looking to the side,
singing, holding microphone, aqua dress, standing, sleeveless, bow, white hair ribbon, lace trim flared skirt,
indoors, live stage, spot lighting, confetti
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 16, Sampler: Euler, Schedule type: Simple, CFG scale: 5, Seed: 1048352230, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.3, ADetailer model: face_yolov8n.pt, ADetailer confidence: 0.3, ADetailer dilate erode: 4, ADetailer mask blur: 4, ADetailer denoising strength: 0.4, ADetailer inpaint only masked: True, ADetailer inpaint padding: 32, ADetailer version: 24.11.1, Hires Module 1: Use same choices, Hires CFG Scale: 5, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

masterpiece, best quality, realistic, photorealistic, mole, body freckles,
myjc, japanese, 1girl, solo, black hair, very long hair, low twintails, bangs, black eyes, smile, upper body, looking at viewer,
school uniform, white shirt, red bowtie,
outdoors, at night, flash lighting
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 16, Sampler: Euler, Schedule type: Simple, CFG scale: 3, Seed: 3987637380, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.3, ADetailer model: face_yolov8n.pt, ADetailer confidence: 0.3, ADetailer dilate erode: 4, ADetailer mask blur: 4, ADetailer denoising strength: 0.4, ADetailer inpaint only masked: True, ADetailer inpaint padding: 32, ADetailer version: 24.11.1, Hires Module 1: Use same choices, Hires CFG Scale: 5, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

masterpiece, best quality, realistic, photorealistic, mole, body freckles,
myjsm, japanese, 1girl, solo, black hair, twintails, bangs, black eyes, grin, looking at viewer, side stance,
white shirt, black suspenders, black preated skirt, randoseru, red backpack,
outdoors, street, day, natural lighting
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 16, Sampler: Euler a, Schedule type: Simple, CFG scale: 3, Seed: 3912949133, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.3, Hires Module 1: Use same choices, Hires CFG Scale: 5, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

masterpiece, best quality, realistic, photorealistic, mole, body freckles,
29yo, european, 1girl, solo, blonde hair, very long hair, fore head, blue eyes, looking away, walking, from below,
black gothic dress, dark old castle, candlestick, candle, holding sword
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 16, Sampler: Euler a, Schedule type: Simple, CFG scale: 3, Seed: 461278772, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.3, ADetailer model: face_yolov8n.pt, ADetailer confidence: 0.3, ADetailer dilate erode: 4, ADetailer mask blur: 4, ADetailer denoising strength: 0.4, ADetailer inpaint only masked: True, ADetailer inpaint padding: 32, ADetailer version: 24.11.1, Hires Module 1: Use same choices, Hires CFG Scale: 5, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

dmd2

<lora:dmd2_sdxl_4step_lora:1>
masterpiece, best quality, realistic, photorealistic, mole, body freckles,
myjc, european, 1girl, solo, pom pom \(cheerleading\), cheerleader, red hair, white socks, long hair, sitting, crossed legs, pink skirt, smile, pink shirt, arm up, looking at viewer, holding, sleeveless, blue eyes, sleeveless shirt, armpits, feet out of frame, hair ribbon, room, white ribbon, hair bow, holding pom poms, pleated skirt, braid
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.1, Seed: 1116379006, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.3, Hires Module 1: Use same choices, Hires CFG Scale: 3, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Lora hashes: "dmd2_sdxl_4step_lora: 725166dddee2", Emphasis: No norm, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

<lora:dmd2_sdxl_4step_lora:1>
masterpiece, best quality, realistic, photorealistic, (mole, body freckles:0.8),
japanese, 19yo, myjd, 1girl, solo, standing on one leg, long hair, gym uniform, red long pants, standing split, leg up, looking at viewer, black hair, smile, indoors, flexible, bangs, leg lift, close-up, from below, bright day lighting, room
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 3560748860, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Lora hashes: "dmd2_sdxl_4step_lora: 725166dddee2", Emphasis: No norm, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

<lora:dmd2_sdxl_4step_lora:1>
masterpiece, best quality, realistic, photorealistic, (mole, body freckles:0.8),
myjk, japanese, sunset, 1girl, ocean, beach, outdoors, standing, backlighting, very long hair, silhouette, horizon, hat, from behind, water, long hair, arm up, orange sky, long dress, wind, seagull
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 1710971105, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Denoising strength: 0.2, Hires Module 1: Use same choices, Hires CFG Scale: 5, Hires upscale: 2, Hires upscaler: TGHQFace8x_500k, Lora hashes: "dmd2_sdxl_4step_lora: 725166dddee2", Emphasis: No norm, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

<lora:dmd2_sdxl_4step_lora:1>
masterpiece, best quality, realistic, photorealistic, (mole, body freckles:0.8),
japanese, myjd, 1girl, solo, long hair, black hair, looking through legs, upside-down, kneepits, bent over, legwear, kneehighs, denim long pants, jacket, from behind, from below,at night, flash lighting
Negative prompt: low quality, worst quality, artist name, signature, dated, watermark, lowres, bad, bad anatomy, bad hands, multiple hands, mutation hands, fewer, extra, missing, displeasing, extra digits
Steps: 6, Sampler: Euler a, Schedule type: SGM Uniform, CFG scale: 1.3, Seed: 3991331176, Size: 896x1152, Model hash: 7ea6b42d4e, Model: Zipanoob_XL_Vpred_v1, Lora hashes: "dmd2_sdxl_4step_lora: 725166dddee2", Emphasis: No norm, Noise Schedule: Zero Terminal SNR, Version: f2.0.1v1.10.1-previous-634-g37301b22, Module 1: sdxl.vae

-Train Settings

sd-scripts (SD3 branch)

base model: NoobAI-XL-Vpred-v0.75s.safetensors

caption: JoyCaption Alpha Two
tags: WD EVA02-Large Tagger v3

    --network_module "sdxl_train.py" ^
    --caption_dropout_rate="0" ^
    --vae_batch_size="1" ^
    --gradient_checkpointing ^
    --persistent_data_loader_workers ^
    --cache_latents ^
    --cache_latents_to_disk ^
    --max_data_loader_n_workers=2 ^
    --enable_bucket ^
    --bucket_no_upscale ^
    --save_model_as "safetensors" ^
    --mixed_precision "bf16" ^
    --learning_rate=5e-6 ^
    --train_text_encoder ^
    --learning_rate_te1=5e-6 ^
    --learning_rate_te2=5e-6 ^
    --resolution=1024,1024 ^
    --train_batch_size 2 ^
    --optimizer_type "adafactor" ^
    --optimizer_args "relative_step=False" "scale_parameter=False" "warmup_init=False"  ^
    --lr_scheduler "constant_with_warmup" ^
    --save_precision "bf16" ^
    --caption_extension ".txt" ^
    --no_half_vae ^
    --full_bf16 ^
    --max_grad_norm=0 ^
    --min_snr_gamma=5 ^
    --max_token_length=225 ^
    --fused_backward_pass ^
    --v_parameterization ^
    --zero_terminal_snr ^
    --save_state ^
    --xformers

Zipang XL test3.1

-4000+ twitter images trained & 10000+ images merged model

-Animagine XL 3.1 Base
-Good Lighting
-photoreal like tag: shadow, flash lighting, backlighting, silhouette, sunset, night, day, bokeh, etc.

Download:test3.1 (Recommended)
Download:test3.1b (Newer isn't always better)

These images are test3.1.

-refer to pnginfo

- base model

-Animagine XL 3.1 -great XL model!

- trigger

japanese
european
yo tag and myjs, myjc, myjk (e.g.:18yo, myjk)

- quality tags

masterpiece, best quality, very aesthetic, absurdres,

- negative tags

lowres, (bad), error, fewer, extra, missing, worst quality, low quality, extra digits

- sampler

DPM++ 2M SDE Heun Karras :24-28 steps
(Lightning)DPM++ 2M SGMUniform :8-14 steps
(Hyper-SD XL 8steps)DPM++ 2s a,DPM++ 2M SGM Uniform ;8-16 steps (Bad)

- cfg scale

3-5
(Lightning):1-3
(Hyper-SD XL):1

- Resolution

768 x1024, 1024 x 768
1024 x 1024
896 x 1152, 1152 x 896
512 x 768, 768 x 512 (hires.fix required)

Sample prompt

-SDXL Lightning (too fast: recommended)

masterpiece, best quality, very aesthetic, absurdres,
16yo, japanese, myjk, 1girl, solo, backlighting, silhouette, horizon, sunset, wind, water, outdoors, wading, scenery, white dress, photo background, skirt hold, realistic, long hair, standing, barefoot, from behind, facing away, close-up
Negative prompt: lowres, (bad), error, fewer, extra, missing, worst quality, low quality, extra digits

Steps: 24, Sampler: DPM++ 2M SDE Heun Karras, CFG scale: 3, Seed: 2770074115, Size: 896x1152, Model hash: 90bbe169ac, Model: zipang_XL_test3.1.fp16, Denoising strength: 0.3, Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Version: f0.0.17v1.8.0rc-latest-276-g29be1da7

-train

base1:trained 4000+images:manual tagging (Prodigy:70epoch)
model:trained 10000+images:wd14 tagger(swinv2 tagger v3) (base model:base1)(Nadam:lr:1e-04:27epoch)

Ponypang XL giveup

This is an incomplete model.

Mixed LoRA due to problems with training not being able to continue.
e621 tag might be better than danbooru tag.

-4000+ twitter images trained & 10000+ images merged model

-experimental
-Might look like Zipang.
-Hand is not good.
-ADetailer and HiresFix Recommendation.

Download: fix5
Download: fix4

These images are fix4.

-refer to pnginfo

- base model

-Pony Diffusion V6 XL -great XL model!
-ebara pony 2.1 -great XL model! too

- trigger

japanese
european
yo tag and myjs, myjc, myjk (e.g.:18yo, myjk)

- quality tags

score_9, score_8_up, score_7_up, masterpiece, best quality, realistic, photorealistic,

- negative tags

worst quality, low quality, normal quality, messy drawing, amateur drawing, lowres, bad anatomy, bad hands, source furry, source pony, source cartoon, comic, source filmmaker, 3d, \(bad\), error, fewer, missing, extra digits

- sampler

DPM++ 2M SDE Heun Karras :24-28 steps
DPM++ SGM Uniform, DPM++ 2s a :8-16 steps (HyperSDXL)

Hyper-SDXL-8steps-lora

- cfg scale

3-7
1-1.5 (HyperSDXL)

- Resolution

768 x1024, 1024 x 768
1024 x 1024
896 x 1152, 1152 x 896
512 x 768, 768 x 512 (hires.fix required)

sample prompt

score_9, score_8_up, score_7_up, masterpiece, best quality,
18yo, myjk, japanese, realistic, photorealistic,
1girl, solo, black hair, long hair, bangs, brown eyes, animal ears,school uniform,
stuffed toy, stuffed animal, teddy bear,
looking at viewer, grin, holding stuffed toy, upper body, sitting, hairband
Negative prompt: worst quality, low quality, normal quality, messy drawing, amateur drawing, lowres, bad anatomy, bad hands, source furry, source pony, source cartoon, comic, source filmmaker, 3d, \(bad\), error, fewer, missing, extra digits
Steps: 28, Sampler: DPM++ 2M SDE Heun Karras, CFG scale: 4, Seed: 2317472872, Size: 896x1152, Model hash: 58cd1b19e0, Model: ponypang_XL_giveup_fix4.fp16, Version: f0.0.17v1.8.0rc-latest-287-g77bdb9208

-merge & train

base1:ebara pony 2.1 base Trained.
base2:base1 x ebara base LoRA (1,1,1,1,0.3,0.3,0.3,0.3,0.5,0.75,0,0,0,0.75,1,0.9,0.5,0.3,0.3,0.3,1,1,0,0,0,0)
base3:Merge Zipang test3.1 (0,0,0,0,0,0,0,0,0,0.5,0,0.3,0,0.1,0,0,0,0,0,0)
base4:base3 x pony base LoRA (0,0,0,0,0,0.1,0.25,0,0,0.7,0,0,0,0.5,0.25,1,0,0.1,0.75,0.65,0,0,0,0,0,0)
fix: base4 base trained (Lion 1e-07)