File size: 646 Bytes
5aefdb7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
license: apache-2.0
tags:
- llama
---
# TinyLlama-1.1B-ckpt-2.5T-exl2
EXL2 quants of [TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T) intended for use in speculative decoding.
- [3.0bpw-h6](https://huggingface.co/royallab/TinyLlama-1.1B-ckpt-2.5T-exl2/tree/3.0bpw-h6)
- [4.0bpw-h6](https://huggingface.co/royallab/TinyLlama-1.1B-ckpt-2.5T-exl2/tree/4.0bpw-h6)
- [6.0bpw-h6](https://huggingface.co/royallab/TinyLlama-1.1B-ckpt-2.5T-exl2/tree/6.0bpw-h6)
- [8.0bpw-h8](https://huggingface.co/royallab/TinyLlama-1.1B-ckpt-2.5T-exl2/tree/8.0bpw-h8) |