Where are the vllm files?
#1
by
iheycc
- opened
Copy vllm/zhinao.py into vllm/model_executor/models in your vllm installation directory (in python/conda env).
Copy vllm/serving_chat.py into vllm/entrypoints/openai in your vllm installation directory.
Where are these two files? vllm/zhinao.py and vllm/serving_chat.py
iheycc
changed discussion title from
Where is the vllm files?
to Where are the vllm files?
Copy vllm/zhinao.py into vllm/model_executor/models in your vllm installation directory (in python/conda env). Copy vllm/serving_chat.py into vllm/entrypoints/openai in your vllm installation directory.Where are these two files?
vllm/zhinao.pyandvllm/serving_chat.py
zhaicunqi
changed discussion status to
closed