textgen-webui / run.py
lonestar108's picture
updates
a6c6ee5
raw
history blame contribute delete
178 Bytes
import os
os.system('python3 download-model.py TheBloke/Pygmalion-2-13B-SuperCOT2-GPTQ --branch main')
os.system('python3 server.py --auto-devices --gpu-memory 24 --public-api')