README.md

metadata

license: apache-2.0

Open Llama 7b GGML Models

This repository contains the GGML models for the latest 700 billion token (700bt) preview of the Open Llama 7b model.

The following files can be used with llama.cpp or kobold.cpp:

• ggml-model-q4_0.bin: Quantized model, 3.79 GB
• ggml-model-q4_1.bin: Quantized model, 4.21 GB
• ggml-model-q5_0.bin: Quantized model, 4.63 GB
• ggml-model-q5_1.bin: Quantized model, 5.06 GB
• ggml-model-q8_0.bin: Quantized model, 7.16 GB