File size: 963 Bytes
71f9e3c 84a3761 71f9e3c c214907 3fc03e2 71f9e3c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
tags:
- llamafile
- GGUF
base_model: TheBloke/openchat-3.5-0106-GGUF
---
## openchat-3.5-0106-llamafile
llamafile lets you distribute and run LLMs with a single file. [announcement blog post](https://hacks.mozilla.org/2023/11/introducing-llamafile/)
#### Downloads
- [openchat-3.5-0106.Q2_K.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q2_K.llamafile)
- [openchat-3.5-0106.Q4_K_M.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q4_K_M.llamafile)
- [openchat-3.5-0106.Q5_K_M.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q5_K_M.llamafile)
- [openchat-3.5-0106.Q8_0.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q8_0.llamafile)
This repository was created using the [llamafile-builder](https://github.com/rabilrbl/llamafile-builder)
|