327 17 139

Sayak Paul

sayakpaul

https://sayak.dev

AI & ML interests

Diffusion models, representation learning

Articles

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Feb 10, 2023

• 35

A Dive into Pretraining Strategies for Vision-Language Models

Feb 3, 2023

• 32

The State of Computer Vision at Hugging Face 🤗

Jan 30, 2023

• 5

Using LoRA for Efficient Stable Diffusion Fine-Tuning

Jan 26, 2023

• 32

Image Similarity with Hugging Face Datasets and Transformers

Jan 16, 2023

• 12

Deploying 🤗 ViT on Vertex AI

Aug 19, 2022

• 2

Deploying 🤗 ViT on Kubernetes with TF Serving

Aug 11, 2022

Deploying TensorFlow Vision Models in Hugging Face with TF Serving

Jul 25, 2022

Organizations

sayakpaul's activity

New activity in huggingface/documentation-images 6 days ago

Upload astronaut.jpg

#367 opened 6 days ago by

a-r-r-o-w

New activity in sayakpaul/flux.1-schell-int8wo-improved 13 days ago

what's the difference between the imporved version with the last verison?

#1 opened 13 days ago by

pockygg

New activity in qwertyforce/watermark_detection 15 days ago

Usage

#1 opened 15 days ago by

sayakpaul

New activity in sayakpaul/flux.1-dev-nf4-pkg 17 days ago

if not use enable_model_cpu_offload(); How much does it take to run all on the gpu?

#2 opened 18 days ago by

loong

New activity in sayakpaul/flux.1-dev-nf4-pkg 18 days ago

A request or wish for the final specification to be like this

#1 opened 18 days ago by

John6666

New activity in sayakpaul/flux.1-dev-nf4-with-bnb-integration 19 days ago

ValueError

#1 opened 19 days ago by

froilo

ImportError: Using `bitsandbytes` 4-bit quantization requires the latest version of bitsandbytes: `pip install -U bitsandbytes`

#2 opened 19 days ago by

loong

New activity in sayakpaul/poses-controlnet-dataset 21 days ago

Update task tag

#1 opened 21 days ago by

merve

New activity in sayakpaul/flux.1-dev-nf4 25 days ago

Apology and Notification

#2 opened 26 days ago by

John6666

New activity in dataautogpt3/FluxteusV1 29 days ago

On the Diffusers code example

#1 opened 30 days ago by

tintwotin

New activity in sayakpaul/flux.1-dev-nf4 about 1 month ago

Not load with nf4

#1 opened about 1 month ago by

Shero-Safwat

commented a paper about 1 month ago

CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer

Paper • 2408.06072 • Published Aug 12 • 35 •

New activity in sayakpaul/FLUX.1-merged about 1 month ago

Why does it work?

#10 opened about 1 month ago by

linhhoang100

Upload config.json

#8 opened about 1 month ago by

explorewithai

does not appear to have a file named config.json

#9 opened about 1 month ago by

doevent

New activity in black-forest-labs/FLUX.1-dev about 1 month ago

Update README.md

#46 opened about 1 month ago by

sayakpaul

New activity in black-forest-labs/FLUX.1-schnell about 1 month ago

Update README.md

#31 opened about 1 month ago by

sayakpaul

New activity in diffusers/README about 1 month ago

update org card

#3 opened about 1 month ago by

stevhliu

New activity in sayakpaul/FLUX.1-merged about 1 month ago

Test it out here

#7 opened about 1 month ago by

drbaph

Dev + Schnell (50 steps)?

#1 opened about 2 months ago by

bjohnson22

Create LICENSE.md

#3 opened about 2 months ago by

Midpash

Update README.md

#4 opened about 2 months ago by

Midpash

Can you publish single file version too? so people can use easily in SwarmUI

#5 opened about 1 month ago by

MonsterMMORPG

ComfyUI

#6 opened about 1 month ago by

nhathoangfoto

New activity in sayakpaul/FLUX.1-merged about 2 months ago

how do i use it

#2 opened about 2 months ago by

hantiun

New activity in black-forest-labs/FLUX.1-dev about 2 months ago

The whimsical creature

#4 opened about 2 months ago by

sayakpaul

New activity in black-forest-labs/FLUX.1-dev about 2 months ago

Why 12b? Who could run that locally?

#1 opened about 2 months ago by

kaidu88

New activity in black-forest-labs/FLUX.1-schnell about 2 months ago

Add diffusers to the model card

#2 opened about 2 months ago by

multimodalart

Fine tuning code

#3 opened about 2 months ago by

alfredplpl

New activity in fusing/instructpix2pix-1000-samples about 2 months ago

make dataset

#4 opened 9 months ago by

kigy1

New activity in probing-vits/attention-heat-maps about 2 months ago

fix ModuleNotFoundError: No module named 'altair.vegalite.v4'

#3 opened about 2 months ago by

fcakyon

New activity in PixArt-alpha/PixArt-Sigma-XL-2-1024-MS 2 months ago

A smaller version of text_encoder, please.

#3 opened 3 months ago by

razvanab

New activity in fal/AuraFlow 2 months ago

Add fp16 variants to speedup loading and relax memory constraints

#15 opened 2 months ago by

sayakpaul

New activity in TencentARC/PhotoMaker 3 months ago

[ BUG ] An error is reported directly without any information.

#40 opened 3 months ago by

Paper99

New activity in mapo-t2i/mapo-beta 3 months ago

mapo-beta ? don't know about this model from paper.

#1 opened 3 months ago by

pljj315

New activity in hf-internal-testing/tiny-sdxl-custom-all 3 months ago

Fix imports for PR 8623

#5 opened 3 months ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-components 3 months ago

remove deprecated LoRA blocks

#1 opened 3 months ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-all 3 months ago

fix import wr.t. PR #6630

#2 opened 8 months ago by

sayakpaul

New activity in diffusers/community-pipelines-mirror 3 months ago

Revert incorrect commit

#2 opened 3 months ago by

Wauplin

New activity in stabilityai/stable-diffusion-3-medium 3 months ago

fix the diffusers documentation link

#73 opened 3 months ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 3 months ago

fix the documentation link

#12 opened 3 months ago by

sayakpaul

Delete transformer/diffusion_pytorch_model-00001-of-00002.safetensors

#11 opened 3 months ago by

sayakpaul

Upload folder using huggingface_hub

#7 opened 3 months ago by

sayakpaul

Upload folder using huggingface_hub

#6 opened 3 months ago by

sayakpaul

Upload folder using huggingface_hub

#5 opened 3 months ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium 3 months ago

Update README.md to include a note on diffusers

#62 opened 3 months ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 3 months ago

Upload folder using huggingface_hub

#4 opened 3 months ago by

sayakpaul

New activity in mapo-t2i/mapo-pick-safety 3 months ago

Update README for MaPO Pick-Safety checkpoint

#1 opened 3 months ago by

JW17

New activity in mapo-t2i/pick-safety 3 months ago

Add disclaimer for harmful contents

#2 opened 3 months ago by

JW17

New activity in mapo-t2i/pick-style-cartoon 3 months ago

Initial update for Pick-Style cartoon split

#1 opened 3 months ago by

JW17

New activity in mapo-t2i/pick-safety 3 months ago

Update model card for Pick-Safety

#1 opened 3 months ago by

JW17

New activity in mapo-t2i/pick-style-pixel-art 3 months ago

Update dataset card for pixel art split

#1 opened 3 months ago by

JW17

New activity in mapo-t2i/mapo-pick-style-cartoon 3 months ago

Update README for Pick-Style cartoon split MaPO checkpoint

#1 opened 3 months ago by

JW17

New activity in mapo-t2i/mapo-pick-style-pixel-art 3 months ago

Update README for pixel art MaPO checkpoint

#1 opened 3 months ago by

JW17

New activity in diffusers/community-pipelines-mirror 3 months ago

Create README.md

#1 opened 3 months ago by

Wauplin

New activity in anyMODE/extraMODE-PixArtSigma 3 months ago

Hello from the 🧨 Diffusers team

#1 opened 3 months ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-all 4 months ago

Update unet/my_unet_model.py

#4 opened 4 months ago by

sayakpaul

New activity in huggingface/documentation-images 4 months ago

Marigold for ControlNet example images

#341 opened 4 months ago by

toshas

marigold documentation files

#338 opened 4 months ago by

toshas

marigold documentation files (2)

#339 opened 4 months ago by

toshas

Sayak Paul

AI & ML interests

Articles

Memory-efficient Diffusion Transformers with Quanto and Diffusers

🧨 Diffusers welcomes Stable Diffusion 3

🤗 PEFT welcomes new merging methods

Welcome aMUSEd: Efficient Text-to-Image Generation

SDXL in 4 steps with Latent Consistency LoRAs

Personal Copilot: Train Your Own Coding Assistant

Exploring simple optimizations for SDXL

Finetune Stable Diffusion Models with DDPO via TRL

Introducing Würstchen: Fast Diffusion for Image Generation

Efficient Controllable Generation for SDXL with T2I-Adapters

Happy 1st anniversary 🤗 Diffusers!

Optimizing Stable Diffusion for Intel CPUs with NNCF and 🤗 Optimum

Instruction-tuning Stable Diffusion with InstructPix2Pix

Training a language model with 🤗 Transformers using TensorFlow and TPUs

ControlNet in Diffusers 🧨

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

A Dive into Pretraining Strategies for Vision-Language Models

The State of Computer Vision at Hugging Face 🤗

Using LoRA for Efficient Stable Diffusion Fine-Tuning

Image Similarity with Hugging Face Datasets and Transformers

Deploying 🤗 ViT on Vertex AI

Deploying 🤗 ViT on Kubernetes with TF Serving

Deploying TensorFlow Vision Models in Hugging Face with TF Serving

Organizations

sayakpaul's activity

Upload astronaut.jpg

what's the difference between the imporved version with the last verison?

Usage

if not use enable_model_cpu_offload(); How much does it take to run all on the gpu?

A request or wish for the final specification to be like this

ValueError

ImportError: Using `bitsandbytes` 4-bit quantization requires the latest version of bitsandbytes: `pip install -U bitsandbytes`

Update task tag

Apology and Notification

On the Diffusers code example

Not load with nf4

Why does it work?

Upload config.json

does not appear to have a file named config.json

Update README.md

Update README.md

update org card

Test it out here

Dev + Schnell (50 steps)?

Create LICENSE.md

Update README.md

Can you publish single file version too? so people can use easily in SwarmUI

ComfyUI

how do i use it

The whimsical creature

Why 12b? Who could run that locally?

Add diffusers to the model card

Fine tuning code

make dataset

fix ModuleNotFoundError: No module named 'altair.vegalite.v4'

A smaller version of text_encoder, please.

Add fp16 variants to speedup loading and relax memory constraints

[ BUG ] An error is reported directly without any information.

mapo-beta ? don't know about this model from paper.

Fix imports for PR 8623

remove deprecated LoRA blocks

fix import wr.t. PR #6630

Revert incorrect commit

fix the diffusers documentation link

fix the documentation link

Delete transformer/diffusion_pytorch_model-00001-of-00002.safetensors

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Update README.md to include a note on diffusers

Upload folder using huggingface_hub

Update README for MaPO Pick-Safety checkpoint

Add disclaimer for harmful contents

Initial update for Pick-Style cartoon split

Update model card for Pick-Safety

Update dataset card for pixel art split

Update README for Pick-Style cartoon split MaPO checkpoint