| license: apache-2.0 | |
| # Open Llama 7b GGML Models | |
| This repository contains the GGML models for the latest 700 billion token (700bt) preview of the Open Llama 7b model. | |
| The following files can be used with `llama.cpp` or `kobold.cpp`: | |
| - `ggml-model-q4_0.bin`: Quantized model, 3.79 GB | |
| - `ggml-model-q4_1.bin`: Quantized model, 4.21 GB | |
| - `ggml-model-q5_0.bin`: Quantized model, 4.63 GB | |
| - `ggml-model-q5_1.bin`: Quantized model, 5.06 GB | |
| - `ggml-model-q8_0.bin`: Quantized model, 7.16 GB |