Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
datatab
/
YugoGPT-Quantized-GGUF
like
2
Transformers
GGUF
Serbian
mistral
text-generation-inference
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
0d26fa1
YugoGPT-Quantized-GGUF
1 contributor
History:
52 commits
datatab
q3_k_s: Uses Q3_K for all tensors
0d26fa1
verified
12 months ago
.gitattributes
Safe
3.72 kB
q3_k_s: Uses Q3_K for all tensors
12 months ago
README.md
Safe
3.42 kB
Update README.md
about 1 year ago
YugoGPT-Quantized-GGUF.Q3_K_XS.gguf
Safe
3 GB
LFS
q3_k_xs" : "3-bit extra small quantization
about 1 year ago
YugoGPT-Quantized-GGUF.Q4_0.gguf
Safe
4.11 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q4_0.gguf to YugoGPT-Quantized-GGUF.Q4_0.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q4_K_M.gguf
Safe
4.37 GB
LFS
Rename YugoGPT-Quantize-GGUF.Q4_K_M.gguf to YugoGPT-Quantized-GGUF.Q4_K_M.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q4_K_S.gguf
Safe
4.14 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q4_K_S.gguf to YugoGPT-Quantized-GGUF.Q4_K_S.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q5_0.gguf
Safe
5 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q5_0.gguf to YugoGPT-Quantized-GGUF.Q5_0.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q5_K_M.gguf
Safe
5.13 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q5_K_M.gguf to YugoGPT-Quantized-GGUF.Q5_K_M.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q5_K_S.gguf
Safe
5 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q5_K_S.gguf to YugoGPT-Quantized-GGUF.Q5_K_S.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q6_K.gguf
Safe
5.94 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q6_K.gguf to YugoGPT-Quantized-GGUF.Q6_K.gguf
about 1 year ago
YugoGPT-Quantized-GGUF.Q8_0.gguf
Safe
7.7 GB
LFS
Rename YugoGPT-Quantized-GGUF-unsloth.Q8_0.gguf to YugoGPT-Quantized-GGUF.Q8_0.gguf
about 1 year ago
YugoGPT-Quantized.GGUF.Q2_K.gguf
Safe
2.72 GB
LFS
q2_k: Uses Q4_K for the attention.vw and feed_forward.w2 tensors, Q2_K for the other tensors.
12 months ago
YugoGPT-Quantized.GGUF.Q3_K_L.gguf
Safe
3.82 GB
LFS
q3_k_l: Uses Q5_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K
12 months ago
YugoGPT-Quantized.GGUF.Q3_K_M.gguf
Safe
3.52 GB
LFS
q3_k_m: Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K
12 months ago
YugoGPT-Quantized.GGUF.Q3_K_S.gguf
Safe
3.16 GB
LFS
q3_k_s: Uses Q3_K for all tensors
12 months ago
config.json
Safe
31 Bytes
Create config.json
about 1 year ago
