Hugging Face's logo

bartowski
/
Phi-3-medium-4k-instruct-GGUF

Text Generation
GGUF
multilingual
nlp
code
Inference Endpoints
Model card Files Community
2
bartowski commited on
Commit
2e47877
•
1 Parent(s): d78e228

Remove files and update readme

Browse files
Files changed (11) hide show
  1. Phi-3-medium-4k-instruct-IQ1_M.gguf +0 -3
  2. Phi-3-medium-4k-instruct-IQ1_S.gguf +0 -3
  3. Phi-3-medium-4k-instruct-IQ2_S.gguf +0 -3
  4. Phi-3-medium-4k-instruct-IQ2_XS.gguf +0 -3
  5. Phi-3-medium-4k-instruct-IQ2_XXS.gguf +0 -3
  6. Phi-3-medium-4k-instruct-IQ3_S.gguf +0 -3
  7. Phi-3-medium-4k-instruct-IQ3_XXS.gguf +0 -3
  8. Phi-3-medium-4k-instruct-IQ4_NL.gguf +0 -3
  9. Phi-3-medium-4k-instruct-f32.gguf/Phi-3-medium-4k-instruct-f32-00001-of-00002.gguf +0 -3
  10. Phi-3-medium-4k-instruct-f32.gguf/Phi-3-medium-4k-instruct-f32-00002-of-00002.gguf +0 -3
  11. README.md +3 -0
Phi-3-medium-4k-instruct-IQ1_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3d38863ab5df738f8e850b74d0fcf171407df83354594f3497d0e162f1bcff6
3
- size 3242156416
 
 
 
 
Phi-3-medium-4k-instruct-IQ1_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:1887a4327b27c24d144ca07412a951d0ad7f9a363c11b88c8c105cbfe65b5577
3
- size 2957996416
 
 
 
 
Phi-3-medium-4k-instruct-IQ2_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:89c959cd98489636f4e6f0b836dfdec037a2e6e29916adc371451f8f84f26cb4
3
- size 4338125696
 
 
 
 
Phi-3-medium-4k-instruct-IQ2_XS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7db65e82dc6ef2d3c70a50a8ef55d0df86f0c2b31a3628378af13c2cb89b22ee
3
- size 4127404416
 
 
 
 
Phi-3-medium-4k-instruct-IQ2_XXS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7347fa08025daa6ee9e17adfda98201de665ec077ef5b12a62a842c2bdd1d2cb
3
- size 3715756416
 
 
 
 
Phi-3-medium-4k-instruct-IQ3_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d9a41c187c10ba30c64ce921bef3f009dd6959f68278fbbbf62d2215c5f89687
3
- size 6064889216
 
 
 
 
Phi-3-medium-4k-instruct-IQ3_XXS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:eb18a383bc03fb6d5bd83f6370297e8ecc41eb42abecaa4c69e4cdfde690ebe2
3
- size 5453261696
 
 
 
 
Phi-3-medium-4k-instruct-IQ4_NL.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:182fd7e5943a059de0d41879668570978d4d3480dc8814a1a90a7b8a6bd8b17c
3
- size 7897124736
 
 
 
 
Phi-3-medium-4k-instruct-f32.gguf/Phi-3-medium-4k-instruct-f32-00001-of-00002.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d7629f441f213a77ae9a431121871166d465080eeb17c9a2dd8c66f5c6fc967b
3
- size 32010790080
 
 
 
 
Phi-3-medium-4k-instruct-f32.gguf/Phi-3-medium-4k-instruct-f32-00002-of-00002.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7dfac002b696364bbd2d4f7186e5363e39372c021fef6994444e87fb5a006dda
3
- size 23830902880
 
 
 
 
README.md CHANGED
@@ -34,6 +34,9 @@ Run them in [LM Studio](https://lmstudio.ai/)
34
  <|user|> {prompt}<|end|><|assistant|><|end|>
35
  ```
36
 
 
 
 
37
  ## Download a file (not the whole branch) from below:
38
 
39
  | Filename | Quant type | File Size | Split | Description |
 
34
  <|user|> {prompt}<|end|><|assistant|><|end|>
35
  ```
36
 
37
+ ## What's new
38
+ - Updated to latest llama.cpp to fix rope scaling
39
+
40
  ## Download a file (not the whole branch) from below:
41
 
42
  | Filename | Quant type | File Size | Split | Description |