Wont load in TextGen Webui
Error:
15:55:07-762426 INFO Loading "LoneStriker_Gemmalpaca-7B-8.0bpw-h8-exl2"
15:55:15-341666 ERROR Failed to load the model.
Traceback (most recent call last):
File "H:\AiStuff\text-generation-webui\modules\ui_model_menu.py", line 242, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "H:\AiStuff\text-generation-webui\modules\models.py", line 95, in load_model
tokenizer = load_tokenizer(model_name, model)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "H:\AiStuff\text-generation-webui\modules\models.py", line 119, in load_tokenizer
tokenizer = AutoTokenizer.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "H:\AiStuff\text-generation-webui\installer_files\env\Lib\site-packages\transformers\models\auto\tokenization_auto.py", line 811, in from_pretrained
raise ValueError(
ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported.
Completly reinstalled Textgen webui incase its pre-reqs were old but alas same error
Loads fine in exui with latest exllamav2. You will have to make sure that your exllamav2 module is up-to-date as this is based on the Google Gemma model; the exl2 support for Gemma was only recently added.