legraphista
commited on
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -24,7 +24,7 @@ _Llama.cpp imatrix quantization of internlm/internlm2-math-plus-mixtral8x22b_
|
|
24 |
|
25 |
Original Model: [internlm/internlm2-math-plus-mixtral8x22b](https://huggingface.co/internlm/internlm2-math-plus-mixtral8x22b)
|
26 |
Original dtype: `BF16` (`bfloat16`)
|
27 |
-
Quantized by: llama.cpp [
|
28 |
IMatrix dataset: [here](https://gist.githubusercontent.com/legraphista/d6d93f1a254bcfc58e0af3777eaec41e/raw/d380e7002cea4a51c33fffd47db851942754e7cc/imatrix.calibration.medium.raw)
|
29 |
|
30 |
- [internlm2-math-plus-mixtral8x22b-IMat-GGUF](#internlm2-math-plus-mixtral8x22b-imat-gguf)
|
|
|
24 |
|
25 |
Original Model: [internlm/internlm2-math-plus-mixtral8x22b](https://huggingface.co/internlm/internlm2-math-plus-mixtral8x22b)
|
26 |
Original dtype: `BF16` (`bfloat16`)
|
27 |
+
Quantized by: llama.cpp [b3010](https://github.com/ggerganov/llama.cpp/releases/tag/b3010)
|
28 |
IMatrix dataset: [here](https://gist.githubusercontent.com/legraphista/d6d93f1a254bcfc58e0af3777eaec41e/raw/d380e7002cea4a51c33fffd47db851942754e7cc/imatrix.calibration.medium.raw)
|
29 |
|
30 |
- [internlm2-math-plus-mixtral8x22b-IMat-GGUF](#internlm2-math-plus-mixtral8x22b-imat-gguf)
|