Lunzima's picture
Update README.md
c96cabc verified
metadata
license: apache-2.0
base_model:
  - Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v3
pipeline_tag: text-generation
tags:
  - chat
library_name: transformers

About

imatrix quants of Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v3

File Name Description
nqlsg_Q5_K_M.gguf This file contains the quantized model weights using the Q5_K_M quantization type.
nqlsg_dynamic.gguf This file contains the model weights with experimental dynamic IQ3_XXS quantization applied.

For more information on dynamic quantization, see (https://huggingface.co/Lunzima/NQLSG-Qwen2.5-14B-MegaFusion-v3-GGUF/discussions/1).