Google Colab code Problem
#14
by
Aliw7979
- opened
Hi, I want to test this model in google colab but get this error after running "3.Launch" cell:
/content/drive/MyDrive/text-generation-webui
python server.py --share --model TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g --model_type LLaMa --settings settings-colab.json --chat --wbits 4 --groupsize 128 --extensions gallery
WARNING:The gradio "share link" feature uses a proprietary executable to create a reverse tunnel. Use it with care.
2023-05-31 13:27:29.074805: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
bin /usr/local/lib/python3.10/dist-packages/bitsandbytes/libbitsandbytes_cuda118.so
INFO:Loading settings from settings-colab.json...
INFO:Loading TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g...
INFO:Found the following quantized model: models/TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g/vicuna-13B-1.1-GPTQ-4bit-128g.latest.safetensors
INFO:Loaded the model in 57.58 seconds.
INFO:Loading the extension "gallery"...
╭───────────────────── Traceback (most recent call last) ──────────────────────╮
│ /content/drive/MyDrive/text-generation-webui/server.py:1108 in <module> │
│ │
│ 1105 │ │
│ 1106 │ shared.generation_lock = Lock() │
│ 1107 │ # Launch the web UI │
│ ❱ 1108 │ create_interface() │
│ 1109 │ while True: │
│ 1110 │ │ time.sleep(0.5) │
│ 1111 │ │ if shared.need_restart: │
│ │
│ /content/drive/MyDrive/text-generation-webui/server.py:632 in │
│ create_interface │
│ │
│ 629 │ │ │ │ with gr.Row(): │
│ 630 │ │ │ │ │ with gr.Column(scale=8): │
│ 631 │ │ │ │ │ │ with gr.Row(): │
│ ❱ 632 │ │ │ │ │ │ │ shared.gradio['character_menu'] = gr.Drop │
│ 633 │ │ │ │ │ │ │ ui.create_refresh_button(shared.gradio['c │
│ 634 │ │ │ │ │ │ │ shared.gradio['save_character'] = ui.crea │
│ 635 │ │ │ │ │ │ │ shared.gradio['delete_character'] = ui.cr │
│ │
│ /content/drive/MyDrive/text-generation-webui/modules/utils.py:47 in │
│ get_available_characters │
│ │
│ 44 │
│ 45 def get_available_characters(): │
│ 46 │ paths = (x for x in Path('characters').iterdir() if x.suffix in ('. │
│ ❱ 47 │ return ['None'] + sorted(set((k.stem for k in paths if k.stem != "i │
│ 48 │
│ 49 │
│ 50 def get_available_instruction_templates(): │
│ │
│ /content/drive/MyDrive/text-generation-webui/modules/utils.py:47 in │
│ <genexpr> │
│ │
│ 44 │
│ 45 def get_available_characters(): │
│ 46 │ paths = (x for x in Path('characters').iterdir() if x.suffix in ('. │
│ ❱ 47 │ return ['None'] + sorted(set((k.stem for k in paths if k.stem != "i │
│ 48 │
│ 49 │
│ 50 def get_available_instruction_templates(): │
│ │
│ /content/drive/MyDrive/text-generation-webui/modules/utils.py:46 in │
│ <genexpr> │
│ │
│ 43 │
│ 44 │
│ 45 def get_available_characters(): │
│ ❱ 46 │ paths = (x for x in Path('characters').iterdir() if x.suffix in ('. │
│ 47 │ return ['None'] + sorted(set((k.stem for k in paths if k.stem != "i │
│ 48 │
│ 49 │
│ │
│ /usr/lib/python3.10/pathlib.py:1017 in iterdir │
│ │
│ 1014 │ │ """Iterate over the files in this directory. Does not yield │
│ 1015 │ │ result for the special paths '.' and '..'. │
│ 1016 │ │ """ │
│ ❱ 1017 │ │ for name in self._accessor.listdir(self): │
│ 1018 │ │ │ if name in {'.', '..'}: │
│ 1019 │ │ │ │ # Yielding a path object for these makes little sense │
│ 1020 │ │ │ │ continue │
╰──────────────────────────────────────────────────────────────────────────────╯
OSError: [Errno 5] Input/output error: 'characters'
I tried it many times and restarted runtime but still get this error.
@eucdee created the notebook, perhaps he can help
Or follow the link to the Github at the top of the notebook, maybe there's a new one.