GGUF
Inference Endpoints
conversational
File size: 545 Bytes
8157d71
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
Qwen1.5-8x7b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-8x7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text