File size: 492 Bytes
fc0e06a 2fc0b0e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
license: apache-2.0
---
# Open Llama 7b GGML Models
This repository contains the GGML models for the latest 700 billion token (700bt) preview of the Open Llama 7b model.
The following files can be used with `llama.cpp` or `kobold.cpp`:
- `ggml-model-q4_0.bin`: Quantized model, 3.79 GB
- `ggml-model-q4_1.bin`: Quantized model, 4.21 GB
- `ggml-model-q5_0.bin`: Quantized model, 4.63 GB
- `ggml-model-q5_1.bin`: Quantized model, 5.06 GB
- `ggml-model-q8_0.bin`: Quantized model, 7.16 GB |