Help! Hope to get an inference configuration that can run on multiple GPUs.

#25

by Lokis - opened Sep 7

Sep 7

I have an 8*A100 80Gb server, but I've been testing for a long time and can't use the multi-GPU configuration stably. When using Auto, the output is very slow. Are there any documents or open-source configuration files that I can learn from?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment