Commit
·
5cbb997
1
Parent(s):
dc2ce3e
"Update README.md"
Browse files
README.md
CHANGED
|
@@ -53,7 +53,7 @@ The core project making use of the ggml library is the [llama.cpp](https://githu
|
|
| 53 |
|
| 54 |
There is a bunch of quantized files available. How to choose the best for you:
|
| 55 |
|
| 56 |
-
#
|
| 57 |
|
| 58 |
Q4_0, Q4_1, Q5_0, Q5_1 and Q8 are `legacy` quantization types.
|
| 59 |
Nevertheless, they are fully supported, as there are several circumstances that cause certain model not to be compatible with the modern K-quants.
|
|
@@ -67,6 +67,7 @@ With a Q6_K you should find it really hard to find a quality difference to the o
|
|
| 67 |
|
| 68 |
|
| 69 |
|
|
|
|
| 70 |
# Original Model Card:
|
| 71 |
# Open-Assistant Falcon 40B SFT OASST-TOP1 Model
|
| 72 |
|
|
@@ -138,6 +139,7 @@ oasst-top1:
|
|
| 138 |
```
|
| 139 |
|
| 140 |
***End of original Model File***
|
|
|
|
| 141 |
|
| 142 |
|
| 143 |
## Please consider to support my work
|
|
|
|
| 53 |
|
| 54 |
There is a bunch of quantized files available. How to choose the best for you:
|
| 55 |
|
| 56 |
+
# Legacy quants
|
| 57 |
|
| 58 |
Q4_0, Q4_1, Q5_0, Q5_1 and Q8 are `legacy` quantization types.
|
| 59 |
Nevertheless, they are fully supported, as there are several circumstances that cause certain model not to be compatible with the modern K-quants.
|
|
|
|
| 67 |
|
| 68 |
|
| 69 |
|
| 70 |
+
---
|
| 71 |
# Original Model Card:
|
| 72 |
# Open-Assistant Falcon 40B SFT OASST-TOP1 Model
|
| 73 |
|
|
|
|
| 139 |
```
|
| 140 |
|
| 141 |
***End of original Model File***
|
| 142 |
+
---
|
| 143 |
|
| 144 |
|
| 145 |
## Please consider to support my work
|