bitsandbytes
einops
fastapi
gradio
gradio_client
markdown2
nh3
openai
peft
ray
shortuuid
uvicorn