jeffmeloy
/

WestLake-7B-v2.Q8_0.gguf

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Quantized this https://huggingface.co/senseable/WestLake-7B-v2 using the config.json and tokenizer_config.json parameters from this: https://huggingface.co/NurtureAI/OpenHermes-2.5-Mistral-7B-16k

Downloads last month: 5

GGUF

Model size

7.24B params

Architecture

llama

8-bit

Inference API

Unable to determine this model's library. Check the docs .