File size: 593 Bytes
4bbea43 d31d5da 4bbea43 4ac7ecb |
1 2 3 4 5 6 7 8 9 10 |
---
base_model: kromeurus/L3.1-Tivir-v0.1-10B
library_name: transformers
quantized_by: kromeurus
---
# This repo only contains the Q8, Q6, Q5, & Q4 GGUF files of Tivir v0.1
For the details of this model, please refer to the orginal model card [here](https://huggingface.co/kromeurus/L3.1-Tivir-v0.1-10B).
Additionally, there is another Q_8 quant in this repo named 'fQ_8'. It's not a new type of quant, rather a Q_8 quant that has the full float32 tokenizer. It's slightly larger then a normal Q_8 and meant to be an alternative quant. If it's giving you shitty outputs, use the normal Q_8. |