Accelerate with `enable_model_cpu_offload()`

#28
by landmann - opened

Whenever I run pipe.enable_model_cpu_offload(), I get that my version of accelerate should be 0.17. However, when I try to upgrade my accelerate to 0.17, I get the following

ERROR: No matching distribution found for accelerate~=0.17.0```

Its not pushed to pypi because its in development.
You can clone the repo from github, which is the 0.17.0.dev0

Be warned, as though diffusers say "Almost as fast inference as when the pipeline is used without any type of offloading." I did experience significant performance loss.

Sign up or log in to comment