TheBloke

/

Llama-2-7B-Chat-GGUF

like 439

Hi, thank you very much for your work. It saved me a lot of time finding models of correct versions.

I found that in your example download command, the model name is not capitalized so it causes an error in running, could you take a look at this? e.g. Look at q4 in this model llama-2-7b-chat.q4_K_M.gguf -> llama-2-7b-chat.Q4_K_M.gguf

huggingface-cli download TheBloke/Llama-2-7b-Chat-GGUF llama-2-7b-chat.q4_K_M.gguf --local-dir . --local-dir-use-symlinks False