neopolita
/

qwen2.5-3b-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

qwen2.5-3b-instruct-gguf

1 contributor

History: 5 commits

neopolita's picture

Upload qwen2.5-3b-instruct_q3_k_m.gguf with huggingface_hub

8c91c7c verified about 2 months ago

.gitattributes

1.71 kB

Upload qwen2.5-3b-instruct_q3_k_m.gguf with huggingface_hub about 2 months ago
README.md

1.42 kB

Upload README.md with huggingface_hub about 2 months ago
ggml-model-f16.gguf

6.18 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub about 2 months ago
qwen2.5-3b-instruct_q2_k.gguf

1.27 GB
LFS

Upload qwen2.5-3b-instruct_q2_k.gguf with huggingface_hub about 2 months ago
qwen2.5-3b-instruct_q3_k_m.gguf

1.59 GB
LFS

Upload qwen2.5-3b-instruct_q3_k_m.gguf with huggingface_hub about 2 months ago