dream-textures/texture-diffusion

Texture Diffusion

This DreamBooth model is fine-tuned for diffuse textures. It produces flat textures with very little visible lighting/shadows.

Samples

Here are a few example images (generated with 50 steps).

pbr uneven stone wall	pbr dirt with weeds	pbr bright white marble

Usage

Use the token pbr in your prompts to invoke the style.

This model was made for use in Dream Textures, a Stable Diffusion add-on for Blender.

You can also use it with 🧨 diffusers:

from diffusers import StableDiffusionPipeline
import torch

model_id = "dream-textures/texture-diffusion"

pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

prompt = "pbr brick wall"
image = pipe(prompt).images[0]  
    
image.save("bricks.png")

Training Details

• Base Model: stabilityai/stable-diffusion-2-base
• Resolution: 512
• Prior Loss Weight: 1.0
• Class Prompt: texture
• Batch Size: 1
• Learning Rate: 1e-6
• Precision: fp16
• Steps: 4000
• GPU: Tesla T4

Dataset

This model was trained on 278 CC0 textures from PolyHaven.