roleplaiapp commited on
Commit
b1ec081
·
verified ·
1 Parent(s): d0523aa

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-generation
4
+ tags:
5
+ - 32b
6
+ - 6-bit
7
+ - Q6_K
8
+ - deepseek
9
+ - distill
10
+ - gguf
11
+ - japanese
12
+ - llama-cpp
13
+ - qwen
14
+ - text-generation
15
+ ---
16
+
17
+ # roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q6_K-GGUF
18
+
19
+ **Repo:** `roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf-Q6_K-GGUF`
20
+ **Original Model:** `DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf`
21
+ **Quantized File:** `DeepSeek-R1-Distill-Qwen-32B-Japanese-Q6_K.gguf`
22
+ **Quantization:** `GGUF`
23
+ **Quantization Method:** `Q6_K`
24
+
25
+ ## Overview
26
+ This is a GGUF Q6_K quantized version of DeepSeek-R1-Distill-Qwen-32B-Japanese-gguf
27
+ ## Quantization By
28
+ I often have idle GPUs while building/testing for the RP app, so I put them to use quantizing models.
29
+ I hope the community finds these quantizations useful.
30
+
31
+ Andrew Webby @ [RolePlai](https://roleplai.app/).