Nondzu
/

Llama-PLLuM-70B-chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-PLLuM-70B-chat-GGUF

1 contributor

History: 11 commits

Nondzu's picture

Add Llama-PLLuM-70B-chat-Q3_K_M.gguf

4b01cc5 verified 7 days ago

.gitattributes

2.27 kB

Add Llama-PLLuM-70B-chat-Q3_K_M.gguf 7 days ago
Llama-PLLuM-70B-chat-Q2_K.gguf

26.4 GB
LFS

Add Llama-PLLuM-70B-chat-Q2_K.gguf 7 days ago
Llama-PLLuM-70B-chat-Q3_K.gguf

34.3 GB
LFS

Add Llama-PLLuM-70B-chat-Q3_K.gguf 7 days ago
Llama-PLLuM-70B-chat-Q3_K_M.gguf

34.3 GB
LFS

Add Llama-PLLuM-70B-chat-Q3_K_M.gguf 7 days ago
Llama-PLLuM-70B-chat-Q3_K_S.gguf

30.9 GB
LFS

Add Llama-PLLuM-70B-chat-Q3_K_S.gguf 7 days ago
Llama-PLLuM-70B-chat-Q4_0.gguf

40 GB
LFS

Upload Llama-PLLuM-70B-chat-Q4_0.gguf with huggingface_hub 7 days ago
Llama-PLLuM-70B-chat-Q5_K_S.gguf

48.7 GB
LFS

Upload Llama-PLLuM-70B-chat-Q5_K_S.gguf with huggingface_hub 7 days ago
Llama-PLLuM-70B-chat-Q6_K-00001-of-00002.gguf

39 GB
LFS

Upload ./Llama-PLLuM-70B-chat-Q6_K-00001-of-00002.gguf with huggingface_hub 7 days ago
Llama-PLLuM-70B-chat-Q6_K-00002-of-00002.gguf

18.9 GB
LFS

Upload ./Llama-PLLuM-70B-chat-Q6_K-00002-of-00002.gguf with huggingface_hub 7 days ago
Llama-PLLuM-70B-chat-Q8_0.gguf-00001-of-00002.gguf

38.8 GB
LFS

Upload Llama-PLLuM-70B-chat-Q8_0.gguf-00001-of-00002.gguf with huggingface_hub 7 days ago
Llama-PLLuM-70B-chat-Q8_0.gguf-00002-of-00002.gguf

36.2 GB
LFS

Upload Llama-PLLuM-70B-chat-Q8_0.gguf-00002-of-00002.gguf with huggingface_hub 7 days ago
README.md

29 Bytes

initial commit 7 days ago