bitsandbytes
einops
fastapi
gradio
gradio_client
markdown2
nh3
numpy
openai
opencv-python-headless
packaging
peft
pycocotools
ray
scipy
sentencepiece
shortuuid
torch
torchvision
tqdm
transformers
uvicorn