Felladrin
/

gguf-falcon-mamba-7b-instruct

Inference Endpoints

Model card Files Files and versions Community

gguf-falcon-mamba-7b-instruct

1 contributor

History: 3 commits

Felladrin's picture

Delete broken file

28979f7 verified about 2 months ago

.gitattributes

2.21 kB

Upload folder using huggingface_hub about 2 months ago
README.md

160 Bytes

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.IQ3_XXS.gguf

3.19 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.IQ4_XS.gguf

4.19 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.Q2_K.gguf

2.83 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.Q3_K.gguf

3.51 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.Q4_K.gguf

4.4 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.Q5_K.gguf

5.24 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.Q6_K.gguf

6.14 GB
LFS

Upload folder using huggingface_hub about 2 months ago
falcon-mamba-7b-instruct.Q8_0.gguf

7.77 GB
LFS

Upload folder using huggingface_hub about 2 months ago
imatrix.dat

6.12 MB
LFS

Upload folder using huggingface_hub about 2 months ago