InferenceIllusionist
/

Fimbulvetr-11B-v2-iMat-GGUF

Model card Files Files and versions Community

InferenceIllusionist commited on Mar 4

Commit

9f4bd62

•

1 Parent(s): 9d2b4e9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ license: cc-by-nc-4.0
 * Model creator: [Sao10K](https://huggingface.co/Sao10K/)
 * Original model: [Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
-<b>Update 3/4/24: </b> Newest I-Quant format <b>[IQ4_XS](https://huggingface.co/InferenceIllusionist/Fimbulvetr-11B-v2-iMat-GGUF/blob/main/Fimbulvetr-11B-v2-iMat-IQ4_NL.gguf)</b> shows superior [performance] to previous I-quants @ a whopping 4.25 bpw in [benchmarks](https://github.com/ggerganov/llama.cpp/pull/5747)
 Tested on latest llama.cpp & koboldcpp v.1.60.

 * Model creator: [Sao10K](https://huggingface.co/Sao10K/)
 * Original model: [Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
+<b>Update 3/4/24: </b> Newest I-Quant format <b>[IQ4_XS](https://huggingface.co/InferenceIllusionist/Fimbulvetr-11B-v2-iMat-GGUF/blob/main/Fimbulvetr-11B-v2-iMat-IQ4_NL.gguf)</b> shows superior performance to previous I-quants @ a whopping 4.25 bpw in [benchmarks](https://github.com/ggerganov/llama.cpp/pull/5747)
 Tested on latest llama.cpp & koboldcpp v.1.60.