does not start

#20
by Verzull - opened

What am i doing wrong?

$ PYTHONPATH=$(git rev-parse --show-toplevel) torchrun models/scripts/example_chat_completion.py $CHECKPOINT_DIR
fatal: not a git repository (or any of the parent directories): .git
W1026 14:25:47.033000 7524 site-packages\torch\distributed\elastic\multiprocessing\redirects.py:29] NOTE: Redirects are currently not supported in Windows or MacOs.
Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "E:\miniconda\Scripts\torchrun.exe_main
.py", line 7, in
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\multiprocessing\errors_init
.py", line 355, in wrapper
return f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\run.py", line 919, in main
run(args)
File "E:\miniconda\Lib\site-packages\torch\distributed\run.py", line 910, in run
elastic_launch(
File "E:\miniconda\Lib\site-packages\torch\distributed\launcher\api.py", line 138, in call
return launch_agent(self._config, self._entrypoint, list(args))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\launcher\api.py", line 260, in launch_agent
result = agent.run()
^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\metrics\api.py", line 137, in wrapper
result = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\agent\server\api.py", line 696, in run
result = self._invoke_run(role)
^^^^^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\agent\server\api.py", line 849, in _invoke_run
self._initialize_workers(self._worker_group)
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\metrics\api.py", line 137, in wrapper
result = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\agent\server\api.py", line 668, in _initialize_workers
self._rendezvous(worker_group)
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\metrics\api.py", line 137, in wrapper
result = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\agent\server\api.py", line 500, in _rendezvous
rdzv_info = spec.rdzv_handler.next_rendezvous()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\miniconda\Lib\site-packages\torch\distributed\elastic\rendezvous\static_tcp_rendezvous.py", line 67, in next_rendezvous
self._store = TCPStore( # type: ignore[call-arg]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: use_libuv was requested but PyTorch was build without libuv support

have you solved it yet? i have the same problem

have you solved it yet? i have the same problem

yes, I downloaded GPT4ALL and downloaded the model there)
Or you can try using OLLAMA
I don't know any other ways

thanks, i will give it a try

what are you planning to do with this model

Sign up or log in to comment