tensorblock
/

MiniMerlin-3b-v0.1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

MiniMerlin-3b-v0.1-GGUF

1 contributor

History: 2 commits

morriszms's picture

Upload folder using huggingface_hub

3562839 verified about 2 months ago

.gitattributes

2.31 kB

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q2_K.gguf

1.17 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q3_K_L.gguf

1.63 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q3_K_M.gguf

1.5 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q3_K_S.gguf

1.36 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q4_0.gguf

1.74 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q4_K_M.gguf

1.85 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q4_K_S.gguf

1.75 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q5_0.gguf

2.1 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q5_K_M.gguf
2.15 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q5_K_S.gguf

2.1 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q6_K.gguf
2.48 GB
LFS

Upload folder using huggingface_hub about 2 months ago
MiniMerlin-3b-v0.1-Q8_0.gguf
3.21 GB
LFS

Upload folder using huggingface_hub about 2 months ago
README.md

4.75 kB

Upload folder using huggingface_hub about 2 months ago