Commit
•
0f37fdf
1
Parent(s):
928cac9
auto-patch README.md
Browse files
README.md
CHANGED
|
@@ -3,7 +3,7 @@ base_model: ZZichen/DeepSeek-V2-Lite
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
library_name: transformers
|
| 6 |
-
no_imatrix:
|
| 7 |
quantized_by: mradermacher
|
| 8 |
---
|
| 9 |
## About
|
|
@@ -16,7 +16,6 @@ quantized_by: mradermacher
|
|
| 16 |
static quants of https://huggingface.co/ZZichen/DeepSeek-V2-Lite
|
| 17 |
|
| 18 |
<!-- provided-files -->
|
| 19 |
-
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
|
| 20 |
## Usage
|
| 21 |
|
| 22 |
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
|
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
library_name: transformers
|
| 6 |
+
no_imatrix: 'GGML_ASSERT: llama.cpp/ggml-cuda/concat.cu:107: ggml_is_contiguous(src0)'
|
| 7 |
quantized_by: mradermacher
|
| 8 |
---
|
| 9 |
## About
|
|
|
|
| 16 |
static quants of https://huggingface.co/ZZichen/DeepSeek-V2-Lite
|
| 17 |
|
| 18 |
<!-- provided-files -->
|
|
|
|
| 19 |
## Usage
|
| 20 |
|
| 21 |
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|