gradio
transformers
torch
optimum
auto-gptq