roleplaiapp commited on
Commit
bd27f76
·
verified ·
1 Parent(s): ab78a69

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ base_model:
5
+ - mistralai/Mistral-Nemo-Base-2407
6
+ tags:
7
+ - llama-cpp
8
+ - Wayfarer-12B
9
+ - gguf
10
+ - Q4_K_S
11
+ - 12B
12
+ - 4-bit
13
+ - Wayfarer
14
+ - llama-cpp
15
+ - LatitudeGames
16
+ - code
17
+ - math
18
+ - chat
19
+ - roleplay
20
+ - text-generation
21
+ - safetensors
22
+ - nlp
23
+ - code
24
+ library_name: transformers
25
+ pipeline_tag: text-generation
26
+ ---
27
+
28
+ # roleplaiapp/Wayfarer-12B-Q4_K_S-GGUF
29
+
30
+ **Repo:** `roleplaiapp/Wayfarer-12B-Q4_K_S-GGUF`
31
+ **Original Model:** `Wayfarer-12B`
32
+ **Organization:** `LatitudeGames`
33
+ **Quantized File:** `wayfarer-12b-q4_k_s.gguf`
34
+ **Quantization:** `GGUF`
35
+ **Quantization Method:** `Q4_K_S`
36
+ **Use Imatrix:** `False`
37
+ **Split Model:** `False`
38
+
39
+ ## Overview
40
+ This is an GGUF Q4_K_S quantized version of [Wayfarer-12B](https://huggingface.co/LatitudeGames/Wayfarer-12B).
41
+
42
+ ## Quantization By
43
+ I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models.
44
+ I hope the community finds these quantizations useful.
45
+
46
+ Andrew Webby @ [RolePlai](https://roleplai.app/)