metadata
license: apache-2.0
base_model:
- Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v3
pipeline_tag: text-generation
tags:
- chat
library_name: transformers
About
imatrix quants of Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v3
File Name | Description |
---|---|
nqlsg_Q5_K_M.gguf | This file contains the quantized model weights using the Q5_K_M quantization type. |
nqlsg_dynamic.gguf | This file contains the model weights with experimental dynamic IQ3_XXS quantization applied. |
For more information on dynamic quantization, see (https://huggingface.co/Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v3-GGUF/discussions/1).