Upload folder using huggingface_hub
Browse files- Phi-3-medium-128k-instruct.q8_0.gguf +2 -2
- README.md +2 -0
Phi-3-medium-128k-instruct.q8_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a3e46cfc88b6c0f304a7b749747f1fa5c67069e5191a27cf4b014f2c05b1a2b2
|
3 |
+
size 7691739136
|
README.md
CHANGED
@@ -12,3 +12,5 @@ all other tensors quantized to q5_k or q6_k.
|
|
12 |
Result:
|
13 |
both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
|
14 |
and they perform as well as the pure f16.
|
|
|
|
|
|
12 |
Result:
|
13 |
both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
|
14 |
and they perform as well as the pure f16.
|
15 |
+
|
16 |
+
Updated on: Tue Jul 3, 09:54:00
|