tensorblock
/

small-llama2-GGUF

Inference Endpoints

Model card Files Files and versions Community

small-llama2-GGUF

1 contributor

History: 2 commits

morriszms's picture

Upload folder using huggingface_hub

ac7b685 verified about 1 month ago

.gitattributes

2.24 kB

Upload folder using huggingface_hub about 1 month ago
README.md

4.41 kB

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q2_K.gguf

78.1 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q3_K_L.gguf

97.1 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q3_K_M.gguf

93.2 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q3_K_S.gguf

87.5 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q4_0.gguf

103 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q4_K_M.gguf

110 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q4_K_S.gguf

106 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q5_0.gguf

120 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q5_K_M.gguf

124 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q5_K_S.gguf

121 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q6_K.gguf

142 MB
LFS

Upload folder using huggingface_hub about 1 month ago
small-llama2-Q8_0.gguf

178 MB
LFS

Upload folder using huggingface_hub about 1 month ago