snakech commited on
Commit
8c886ae
·
verified ·
1 Parent(s): 33a1b68

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -31
README.md CHANGED
@@ -1,34 +1,15 @@
1
  ---
2
  library_name: transformers
3
  tags:
4
- - TensorBlock
5
  - GGUF
6
  base_model: FabienRoger/cot_5k
7
  ---
8
 
9
- <div style="width: auto; margin-left: auto; margin-right: auto">
10
- <img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
11
- </div>
12
- <div style="display: flex; justify-content: space-between; width: 100%;">
13
- <div style="display: flex; flex-direction: column; align-items: flex-start;">
14
- <p style="margin-top: 0.5em; margin-bottom: 0em;">
15
- Feedback and support: TensorBlock's <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
16
- </p>
17
- </div>
18
- </div>
19
-
20
  ## FabienRoger/cot_5k - GGUF
21
 
22
  This repo contains GGUF format model files for [FabienRoger/cot_5k](https://huggingface.co/FabienRoger/cot_5k).
23
 
24
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
25
-
26
-
27
- <div style="text-align: left; margin: 20px 0;">
28
- <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
29
- Run them on the TensorBlock client using your local machine ↗
30
- </a>
31
- </div>
32
 
33
  ## Prompt template
34
 
@@ -46,17 +27,6 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
46
  | Filename | Quant type | File Size | Description |
47
  | -------- | ---------- | --------- | ----------- |
48
  | [cot_5k-Q2_K.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q2_K.gguf) | Q2_K | 0.646 GB | smallest, significant quality loss - not recommended for most purposes |
49
- | [cot_5k-Q3_K_S.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q3_K_S.gguf) | Q3_K_S | 0.737 GB | very small, high quality loss |
50
- | [cot_5k-Q3_K_M.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q3_K_M.gguf) | Q3_K_M | 0.799 GB | very small, high quality loss |
51
- | [cot_5k-Q3_K_L.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q3_K_L.gguf) | Q3_K_L | 0.852 GB | small, substantial quality loss |
52
- | [cot_5k-Q4_0.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q4_0.gguf) | Q4_0 | 0.915 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
53
- | [cot_5k-Q4_K_S.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q4_K_S.gguf) | Q4_K_S | 0.921 GB | small, greater quality loss |
54
- | [cot_5k-Q4_K_M.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q4_K_M.gguf) | Q4_K_M | 0.961 GB | medium, balanced quality - recommended |
55
- | [cot_5k-Q5_0.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q5_0.gguf) | Q5_0 | 1.083 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
56
- | [cot_5k-Q5_K_S.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q5_K_S.gguf) | Q5_K_S | 1.083 GB | large, low quality loss - recommended |
57
- | [cot_5k-Q5_K_M.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q5_K_M.gguf) | Q5_K_M | 1.106 GB | large, very low quality loss - recommended |
58
- | [cot_5k-Q6_K.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q6_K.gguf) | Q6_K | 1.261 GB | very large, extremely low quality loss |
59
- | [cot_5k-Q8_0.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q8_0.gguf) | Q8_0 | 1.632 GB | very large, extremely low quality loss - not recommended |
60
 
61
 
62
  ## Downloading instruction
 
1
  ---
2
  library_name: transformers
3
  tags:
 
4
  - GGUF
5
  base_model: FabienRoger/cot_5k
6
  ---
7
 
 
 
 
 
 
 
 
 
 
 
 
8
  ## FabienRoger/cot_5k - GGUF
9
 
10
  This repo contains GGUF format model files for [FabienRoger/cot_5k](https://huggingface.co/FabienRoger/cot_5k).
11
 
12
+ they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
 
 
 
 
 
 
 
13
 
14
  ## Prompt template
15
 
 
27
  | Filename | Quant type | File Size | Description |
28
  | -------- | ---------- | --------- | ----------- |
29
  | [cot_5k-Q2_K.gguf](https://huggingface.co/tensorblock/cot_5k-GGUF/blob/main/cot_5k-Q2_K.gguf) | Q2_K | 0.646 GB | smallest, significant quality loss - not recommended for most purposes |
 
 
 
 
 
 
 
 
 
 
 
30
 
31
 
32
  ## Downloading instruction