requirements.txt

fastapi
optimum
torch
transformers
pydantic
uvicorn[standard]
peft
accelerate
trl
auto-gptq