Hugging Face's logo

legraphista
/
internlm2-math-plus-mixtral8x22b-IMat-GGUF

Text Generation
GGUF
English
Chinese
math
quantized
GGUF
imatrix
quantization
imat
static
Model card Files Community
legraphista commited on
Commit
a335358
·
verified ·
1 Parent(s): 2669d75

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -66,7 +66,7 @@ Link: [here](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b
66
  | [internlm2-math-plus-mixtral8x22b.FP16/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.FP16) | F16 | 281.25GB | ✅ Available | ⚪ Static | ✂ Yes
67
  | [internlm2-math-plus-mixtral8x22b.Q5_K/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.Q5_K) | Q5_K | 99.97GB | ✅ Available | ⚪ Static | ✂ Yes
68
  | [internlm2-math-plus-mixtral8x22b.Q5_K_S/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.Q5_K_S) | Q5_K_S | 96.98GB | ✅ Available | ⚪ Static | ✂ Yes
69
- | internlm2-math-plus-mixtral8x22b.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
70
  | internlm2-math-plus-mixtral8x22b.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
71
  | internlm2-math-plus-mixtral8x22b.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
72
  | internlm2-math-plus-mixtral8x22b.Q2_K_S | Q2_K_S | - | ⏳ Processing | 🟢 IMatrix | -
 
66
  | [internlm2-math-plus-mixtral8x22b.FP16/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.FP16) | F16 | 281.25GB | ✅ Available | ⚪ Static | ✂ Yes
67
  | [internlm2-math-plus-mixtral8x22b.Q5_K/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.Q5_K) | Q5_K | 99.97GB | ✅ Available | ⚪ Static | ✂ Yes
68
  | [internlm2-math-plus-mixtral8x22b.Q5_K_S/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.Q5_K_S) | Q5_K_S | 96.98GB | ✅ Available | ⚪ Static | ✂ Yes
69
+ | [internlm2-math-plus-mixtral8x22b.Q4_K_S/*](https://huggingface.co/legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF/tree/main/internlm2-math-plus-mixtral8x22b.Q4_K_S) | Q4_K_S | 80.48GB | ✅ Available | 🟢 IMatrix | ✂ Yes
70
  | internlm2-math-plus-mixtral8x22b.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
71
  | internlm2-math-plus-mixtral8x22b.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
72
  | internlm2-math-plus-mixtral8x22b.Q2_K_S | Q2_K_S | - | ⏳ Processing | 🟢 IMatrix | -