Clevyby
/

DarkSapling-v2.0-7B-Q5_K_S-GGUF-iMatrix

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Clevyby commited on May 8, 2024

Commit

cd74b78

·

verified ·

1 Parent(s): 278d08b

Update README.md

Files changed (1) hide show

README.md +4 -7

README.md CHANGED Viewed

@@ -9,11 +9,8 @@ tags:
 - sillytavern
 - quantized
 ---
-**Model request:**
-As per request [#20](https://huggingface.co/Lewdiculous/Model-Requests/discussions/20) I'll be uploading additional GGUF-IQ-Imatrix quants for [**TeeZee/DarkSapling-7B-v2.0**](https://huggingface.co/TeeZee/DarkSapling-7B-v2.0).
-         "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
-         "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/3NdasDn51w7uas_rVHqeC.png)

 - sillytavern
 - quantized
 ---
+## Note:
+This repo hosts only a Q5_K_S iMatrix of [Dark Sapling v2.0 7B](https://huggingface.co/TeeZee/DarkSapling-7B-v2.0).
+GGUF quant is from [Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix](https://huggingface.co/Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix).
+The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.