leafspark commited on
Commit
306744b
1 Parent(s): 5e9b0bc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -6
README.md CHANGED
@@ -1,7 +1,16 @@
1
  ---
2
- license: unknown
3
  library_name: transformers
4
  pipeline_tag: text-generation
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # Deepseek-V2-Chat-GGUF
@@ -20,13 +29,13 @@ Using llama.cpp fork: [https://github.com/fairydreaming/llama.cpp/tree/deepseek-
20
  - Merged GGUF should appear
21
 
22
  # Quants:
23
- - bf16 (finished, uploading) [size: 439gb]
24
  - q8_0 (after q2_k) [estimated size: 233.27gb]
25
- - q4_k_m (uploading) [size: 132gb]
26
- - q2_k (generating) [size: ~65gb]
27
- - q3_k_s (low priority) [estimated size: 96.05gb]
28
 
29
- Note: the bf16 GGUF does not have some DeepSeek v2 specific parameters, will look into adding them
30
 
31
  Please use commit 039896407afd40e54321d47c5063c46a52da3e01, otherwise use these metadata KV overrides:
32
  ```
 
1
  ---
2
+ license: mit
3
  library_name: transformers
4
  pipeline_tag: text-generation
5
+ tags:
6
+ - code
7
+ - deepseek
8
+ - gguf
9
+ - bf16
10
+ - chinese
11
+ - english
12
+ metrics:
13
+ - accuracy
14
  ---
15
 
16
  # Deepseek-V2-Chat-GGUF
 
29
  - Merged GGUF should appear
30
 
31
  # Quants:
32
+ - bf16 [size: 439gb]
33
  - q8_0 (after q2_k) [estimated size: 233.27gb]
34
+ - q4_k_m [size: 132gb]
35
+ - q2_k (uploading) [size: 80gb]
36
+ - q3_k_s (generating) [estimated size: 96.05gb]
37
 
38
+ Note: the model files do not have some DeepSeek v2 specific parameters, will look into adding them
39
 
40
  Please use commit 039896407afd40e54321d47c5063c46a52da3e01, otherwise use these metadata KV overrides:
41
  ```