Hugging Face's logo

datatab
/
Yugo45-GPT-Quantized-GGUF

Transformers
GGUF
Serbian
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
datatab commited on
Commit
d79d13a
·
verified ·
1 Parent(s): a366733

q3_k_m: Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Yugo45-GPT-Quantized-GGUF-unsloth.Q3_K_M.gguf → Yugo45-GPT-Quantized-GGUF.Q3_K_M.gguf +0 -0
.gitattributes CHANGED
@@ -35,3 +35,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  Yugo45-GPT-Quantized-GGUF-unsloth.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
36
  Yugo45-GPT-Quantized-GGUF.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
  Yugo45-GPT-Quantized-GGUF-unsloth.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
35
  Yugo45-GPT-Quantized-GGUF-unsloth.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
36
  Yugo45-GPT-Quantized-GGUF.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
  Yugo45-GPT-Quantized-GGUF-unsloth.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Yugo45-GPT-Quantized-GGUF.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Yugo45-GPT-Quantized-GGUF-unsloth.Q3_K_M.gguf → Yugo45-GPT-Quantized-GGUF.Q3_K_M.gguf RENAMED
File without changes