Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
matrixportal
/
deepseek-llm-7b-chat-GGUF
like
0
GGUF
llama-cpp
gguf-my-repo
Inference Endpoints
conversational
License:
deepseek
Model card
Files
Files and versions
Community
Deploy
Use this model
main
deepseek-llm-7b-chat-GGUF
1 contributor
History:
26 commits
matrixportal
Upload README.md with huggingface_hub
9bf1993
verified
5 days ago
.gitattributes
2.34 kB
Upload deepseek-llm-7b-chat-q8_0.gguf with huggingface_hub
5 days ago
README.md
1.83 kB
Upload README.md with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q2_k.gguf
2.72 GB
LFS
Upload deepseek-llm-7b-chat-q2_k.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q3_k_l.gguf
3.75 GB
LFS
Upload deepseek-llm-7b-chat-q3_k_l.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q3_k_m.gguf
3.46 GB
LFS
Upload deepseek-llm-7b-chat-q3_k_m.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q3_k_s.gguf
3.14 GB
LFS
Upload deepseek-llm-7b-chat-q3_k_s.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q4_0.gguf
4 GB
LFS
Upload deepseek-llm-7b-chat-q4_0.gguf with huggingface_hub
6 days ago
deepseek-llm-7b-chat-q4_k_m.gguf
4.22 GB
LFS
Upload deepseek-llm-7b-chat-q4_k_m.gguf with huggingface_hub
6 days ago
deepseek-llm-7b-chat-q4_k_s.gguf
4.03 GB
LFS
Upload deepseek-llm-7b-chat-q4_k_s.gguf with huggingface_hub
6 days ago
deepseek-llm-7b-chat-q5_0.gguf
4.81 GB
LFS
Upload deepseek-llm-7b-chat-q5_0.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q5_k_m.gguf
4.93 GB
LFS
Upload deepseek-llm-7b-chat-q5_k_m.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q5_k_s.gguf
4.81 GB
LFS
Upload deepseek-llm-7b-chat-q5_k_s.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q6_k.gguf
5.67 GB
LFS
Upload deepseek-llm-7b-chat-q6_k.gguf with huggingface_hub
5 days ago
deepseek-llm-7b-chat-q8_0.gguf
7.35 GB
LFS
Upload deepseek-llm-7b-chat-q8_0.gguf with huggingface_hub
5 days ago
