shaowenchen
/

longchat-13b-16k-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

longchat-13b-16k-gguf

2 contributors

History: 21 commits

shaowenchen's picture

Merge branch 'main' of https://huggingface.co/shaowenchen/longchat-13b-16k-gguf

0720046 over 1 year ago

.gitattributes

1.56 kB

add meta files over 1 year ago
README.md

2.1 kB

minor over 1 year ago
configuration.json

191 Bytes

add meta files over 1 year ago
longchat-13b-16k.Q2_K.gguf

5.43 GB
LFS

add ./longchat-13b-16k.Q2_K.gguf over 1 year ago
longchat-13b-16k.Q3_K.gguf

6.34 GB
LFS

add ./longchat-13b-16k.Q3_K.gguf over 1 year ago
longchat-13b-16k.Q3_K_L.gguf

6.93 GB
LFS

add ./longchat-13b-16k.Q3_K_L.gguf over 1 year ago
longchat-13b-16k.Q3_K_S.gguf

5.66 GB
LFS

add ./longchat-13b-16k.Q3_K_S.gguf over 1 year ago
longchat-13b-16k.Q4_0.gguf

7.37 GB
LFS

add ./longchat-13b-16k.Q4_0.gguf over 1 year ago
longchat-13b-16k.Q4_1.gguf

8.17 GB
LFS

add ./longchat-13b-16k.Q4_1.gguf over 1 year ago
longchat-13b-16k.Q4_K.gguf

7.87 GB
LFS

add ./longchat-13b-16k.Q4_K.gguf over 1 year ago
longchat-13b-16k.Q4_K_S.gguf

7.41 GB
LFS

add ./longchat-13b-16k.Q4_K_S.gguf over 1 year ago
longchat-13b-16k.Q5_0.gguf

8.97 GB
LFS

add ./longchat-13b-16k.Q5_0.gguf over 1 year ago
longchat-13b-16k.Q5_1.gguf

9.78 GB
LFS

add ./longchat-13b-16k.Q5_1.gguf over 1 year ago
longchat-13b-16k.Q5_K.gguf

9.23 GB
LFS

add ./longchat-13b-16k.Q5_K.gguf over 1 year ago
longchat-13b-16k.Q5_K_S.gguf

8.97 GB
LFS

add ./longchat-13b-16k.Q5_K_S.gguf over 1 year ago
longchat-13b-16k.Q6_K.gguf

10.7 GB
LFS

add ./longchat-13b-16k.Q6_K.gguf over 1 year ago
longchat-13b-16k.Q8_0.gguf

13.8 GB
LFS

add ./longchat-13b-16k.Q8_0.gguf over 1 year ago
longchat-13b-16k.gguf

26 GB
LFS

add ./longchat-13b-16k.gguf over 1 year ago