| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hf --> | |
| <!-- ### vocab_type: --> | |
| weighted/imatrix quants of https://huggingface.co/Hastagaras/Halu-8B-Llama3-v0.3 | |
| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hf --> | |
| <!-- ### vocab_type: --> | |
| weighted/imatrix quants of https://huggingface.co/Hastagaras/Halu-8B-Llama3-v0.3 | |