Config references 13 model files, repo only contains 5
#1
by
tensiondriven
- opened
Hola,
Is it possible that this repo is bugged/corrupt?
The model.safetensors.index.json file references model-00001-of-00013.safetensors, however the safetensors files only seem to go to output-00005-of-00005.safetensors.
That's the original config file before the model was quantized so the files referenced will be different. Using exllamav2 to load this model works fine and does not reference that file. In general, you should be using something like ooba's text generation webui with the exllamav2 or exllamav2_hf loader for this model.