Some GGUF v2 quantizations of the model PY007/TinyLlama-1.1B-Chat-v0.3
2-bit
4-bit
5-bit
6-bit
8-bit
16-bit