README.md

metadata

license: apache-2.0
tags:
  - llama

TinyLlama-1.1B-ckpt-2.5T-exl2

EXL2 quants of TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T intended for use in speculative decoding.

• 3.0bpw-h6
• 4.0bpw-h6
• 6.0bpw-h6
• 8.0bpw-h8