1 contributor

History: 19 commits

bartowski

Upload Phi-3-medium-4k-instruct-Q2_K_L.gguf with huggingface_hub

6e2ffe2 verified 6 months ago

Phi-3-medium-4k-instruct-f32.gguf
Llamacpp quants 8 months ago
.gitattributes

3.79 kB

Upload Phi-3-medium-4k-instruct-Q2_K_L.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-IQ1_M.gguf

3.24 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ1_S.gguf

2.96 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ2_M.gguf

4.72 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ2_S.gguf

4.34 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ2_XS.gguf

4.13 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ2_XXS.gguf

3.72 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ3_M.gguf

6.47 GB
LFS

Upload Phi-3-medium-4k-instruct-IQ3_M.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-IQ3_S.gguf

6.06 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ3_XS.gguf

5.81 GB
LFS

Upload Phi-3-medium-4k-instruct-IQ3_XS.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-IQ3_XXS.gguf

5.45 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ4_NL.gguf

7.9 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-IQ4_XS.gguf

7.47 GB
LFS

Upload Phi-3-medium-4k-instruct-IQ4_XS.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q2_K.gguf

5.14 GB
LFS

Llamacpp quants 8 months ago
Phi-3-medium-4k-instruct-Q2_K_L.gguf

5.3 GB
LFS

Upload Phi-3-medium-4k-instruct-Q2_K_L.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q3_K_L.gguf

7.49 GB
LFS

Upload Phi-3-medium-4k-instruct-Q3_K_L.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q3_K_M.gguf

6.92 GB
LFS

Upload Phi-3-medium-4k-instruct-Q3_K_M.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q3_K_S.gguf

6.06 GB
LFS

Upload Phi-3-medium-4k-instruct-Q3_K_S.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q3_K_XL.gguf

7.63 GB
LFS

Upload Phi-3-medium-4k-instruct-Q3_K_XL.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q4_K_L.gguf

8.69 GB
LFS

Upload Phi-3-medium-4k-instruct-Q4_K_L.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q4_K_M.gguf

8.57 GB
LFS

Upload Phi-3-medium-4k-instruct-Q4_K_M.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q4_K_S.gguf

7.95 GB
LFS

Upload Phi-3-medium-4k-instruct-Q4_K_S.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q5_K_L.gguf

10.2 GB
LFS

Upload Phi-3-medium-4k-instruct-Q5_K_L.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q5_K_M.gguf

10.1 GB
LFS

Upload Phi-3-medium-4k-instruct-Q5_K_M.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q5_K_S.gguf

9.62 GB
LFS

Upload Phi-3-medium-4k-instruct-Q5_K_S.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q6_K.gguf

11.5 GB
LFS

Upload Phi-3-medium-4k-instruct-Q6_K.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q6_K_L.gguf

11.5 GB
LFS

Upload Phi-3-medium-4k-instruct-Q6_K_L.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct-Q8_0.gguf

14.8 GB
LFS

Upload Phi-3-medium-4k-instruct-Q8_0.gguf with huggingface_hub 6 months ago
Phi-3-medium-4k-instruct.imatrix

5.33 MB
LFS

Llamacpp quants 8 months ago
README.md

8.7 kB

Llamacpp quants 8 months ago