TheBloke
/

vicuna-13B-v1.5-16K-GGML

text-generation-inference

Model card Files Files and versions Community

vicuna-13B-v1.5-16K-GGML

1 contributor

History: 16 commits

TheBloke's picture

Initial GGML model commit

cfb8d12 about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
config.json

29 Bytes

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q2_K.bin

5.51 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q3_K_L.bin

6.93 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q3_K_M.bin

6.31 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q3_K_S.bin

5.66 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q4_0.bin

7.37 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q4_1.bin

8.17 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q4_K_M.bin

7.87 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q4_K_S.bin

7.37 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q5_0.bin

8.97 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q5_1.bin

9.78 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q5_K_M.bin

9.23 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q5_K_S.bin

8.97 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q6_K.bin

10.7 GB
LFS

Initial GGML model commit about 1 year ago
vicuna-13b-v1.5-16k.ggmlv3.q8_0.bin

13.8 GB
LFS

Initial GGML model commit about 1 year ago