neopolita
/

numinamath-7b-tir-gguf

Inference Endpoints

Model card Files Files and versions Community

numinamath-7b-tir-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload numinamath-7b-tir_q8_0.gguf with huggingface_hub

51c96fc verified 4 months ago

.gitattributes

1.97 kB

Upload numinamath-7b-tir_q8_0.gguf with huggingface_hub 4 months ago
README.md

1.41 kB

Upload README.md with huggingface_hub 4 months ago
ggml-model-f16.gguf

13.8 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 4 months ago
numinamath-7b-tir_q2_k.gguf

2.72 GB
LFS

Upload numinamath-7b-tir_q2_k.gguf with huggingface_hub 4 months ago
numinamath-7b-tir_q3_k_m.gguf

3.46 GB
LFS

Upload numinamath-7b-tir_q3_k_m.gguf with huggingface_hub 4 months ago
numinamath-7b-tir_q4_k_m.gguf

4.22 GB
LFS

Upload numinamath-7b-tir_q4_k_m.gguf with huggingface_hub 4 months ago
numinamath-7b-tir_q5_k_m.gguf

4.93 GB
LFS

Upload numinamath-7b-tir_q5_k_m.gguf with huggingface_hub 4 months ago
numinamath-7b-tir_q6_k.gguf

5.67 GB
LFS

Upload numinamath-7b-tir_q6_k.gguf with huggingface_hub 4 months ago
numinamath-7b-tir_q8_0.gguf

7.35 GB
LFS

Upload numinamath-7b-tir_q8_0.gguf with huggingface_hub 4 months ago