Hugging Face's logo

lmstudio-community
/
Meta-Llama-3-120B-Instruct-GGUF

Text Generation
GGUF
Merge
mergekit
lazymergekit
Inference Endpoints
imatrix
conversational
Model card Files Community
Meta-Llama-3-120B-Instruct-GGUF
File size: 31,775 Bytes 
afb9a3d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
 

  0%|          | 0/4 [00:00<?, ?it/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:   0%|          | 0.00/32.2G [00:00<?, ?B/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:   0%|          | 32.2M/32.2G [00:32<9:01:15, 990kB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:   1%|▏         | 418M/32.2G [00:32<29:36, 17.9MB/s]  

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:   4%|▎         | 1.13G/32.2G [00:32<08:23, 61.7MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:   6%|▌         | 1.90G/32.2G [00:32<03:54, 129MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:   8%|▊         | 2.64G/32.2G [00:32<02:15, 219MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  10%|█         | 3.28G/32.2G [00:33<01:28, 326MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  11%|█         | 3.57G/32.2G [01:01<09:44, 49.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  11%|█         | 3.57G/32.2G [01:01<09:44, 49.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  11%|█         | 3.60G/32.2G [01:03<10:15, 46.4MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  13%|█▎        | 4.02G/32.2G [01:05<07:11, 65.2MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  14%|█▍        | 4.51G/32.2G [01:05<04:34, 101MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  17%|█▋        | 5.31G/32.2G [01:05<02:24, 185MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  18%|█▊        | 5.92G/32.2G [01:05<01:35, 274MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  21%|██        | 6.63G/32.2G [01:05<01:01, 415MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  23%|██▎       | 7.37G/32.2G [01:05<00:40, 616MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  24%|██▍       | 7.69G/32.2G [01:37<07:47, 52.4MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  24%|██▍       | 7.69G/32.2G [01:37<07:47, 52.4MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  25%|██▍       | 7.98G/32.2G [01:38<06:17, 64.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  26%|██▋       | 8.50G/32.2G [01:38<04:13, 93.6MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  28%|██▊       | 9.11G/32.2G [01:38<02:41, 143MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  30%|███       | 9.69G/32.2G [01:38<01:47, 209MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  32%|███▏      | 10.3G/32.2G [01:38<01:13, 300MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  34%|███▍      | 11.1G/32.2G [01:38<00:44, 475MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  35%|███▌      | 11.3G/32.2G [02:04<06:04, 57.4MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  35%|███▌      | 11.3G/32.2G [02:04<06:04, 57.4MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  35%|███▌      | 11.3G/32.2G [02:05<05:59, 58.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  37%|███▋      | 11.7G/32.2G [02:10<05:27, 62.3MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  38%|███▊      | 12.2G/32.2G [02:11<03:40, 91.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  39%|███▉      | 12.6G/32.2G [02:11<02:29, 131MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  41%|████      | 13.1G/32.2G [02:11<01:32, 205MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  42%|████▏     | 13.6G/32.2G [02:11<01:04, 288MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  44%|████▍     | 14.3G/32.2G [02:11<00:37, 472MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  47%|████▋     | 15.1G/32.2G [02:11<00:23, 735MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  48%|████▊     | 15.4G/32.2G [02:38<04:32, 61.5MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  48%|████▊     | 15.4G/32.2G [02:38<04:32, 61.5MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  48%|████▊     | 15.4G/32.2G [02:38<04:28, 62.3MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  49%|████▉     | 15.8G/32.2G [02:44<04:25, 61.8MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  50%|█████     | 16.1G/32.2G [02:44<03:10, 84.2MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  52%|█████▏    | 16.6G/32.2G [02:44<01:58, 132MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  53%|█████▎    | 17.1G/32.2G [02:44<01:16, 198MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  55%|█████▍    | 17.6G/32.2G [02:44<00:50, 290MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  57%|█████▋    | 18.2G/32.2G [02:44<00:30, 458MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  59%|█████▉    | 18.9G/32.2G [02:44<00:18, 700MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  59%|█████▉    | 19.1G/32.2G [03:07<03:37, 60.2MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  59%|█████▉    | 19.1G/32.2G [03:07<03:37, 60.2MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  59%|█████▉    | 19.1G/32.2G [03:07<03:33, 61.1MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  61%|██████    | 19.5G/32.2G [03:17<04:13, 50.2MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  61%|██████▏   | 19.7G/32.2G [03:17<03:07, 66.5MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  62%|██████▏   | 20.1G/32.2G [03:17<02:07, 95.3MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  63%|██████▎   | 20.4G/32.2G [03:17<01:24, 140MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  65%|██████▍   | 20.8G/32.2G [03:17<00:56, 201MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  66%|██████▌   | 21.1G/32.2G [03:17<00:38, 285MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  67%|██████▋   | 21.6G/32.2G [03:18<00:23, 452MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  69%|██████▉   | 22.2G/32.2G [03:18<00:14, 703MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  71%|███████▏  | 23.0G/32.2G [03:18<00:08, 1.12GB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  72%|███████▏  | 23.2G/32.2G [03:41<02:23, 62.7MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  72%|███████▏  | 23.2G/32.2G [03:41<02:23, 62.7MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  72%|███████▏  | 23.2G/32.2G [03:41<02:20, 63.5MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  73%|███████▎  | 23.6G/32.2G [03:51<02:48, 51.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  74%|███████▍  | 23.9G/32.2G [03:51<01:51, 73.8MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  75%|███████▌  | 24.2G/32.2G [03:51<01:20, 99.3MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  77%|███████▋  | 24.7G/32.2G [03:51<00:49, 152MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  78%|███████▊  | 24.9G/32.2G [03:51<00:35, 202MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  79%|███████▉  | 25.6G/32.2G [03:51<00:18, 350MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  81%|████████  | 26.1G/32.2G [03:51<00:11, 527MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  83%|████████▎ | 26.8G/32.2G [03:51<00:06, 818MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  84%|████████▍ | 27.0G/32.2G [04:14<01:26, 59.6MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  84%|████████▍ | 27.0G/32.2G [04:14<01:26, 59.6MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  84%|████████▍ | 27.0G/32.2G [04:15<01:25, 60.4MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  85%|████████▌ | 27.4G/32.2G [04:24<01:33, 51.3MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  86%|████████▌ | 27.6G/32.2G [04:24<01:09, 65.0MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  87%|████████▋ | 28.1G/32.2G [04:25<00:38, 105MB/s] 

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  88%|████████▊ | 28.4G/32.2G [04:25<00:28, 136MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  89%|████████▉ | 28.7G/32.2G [04:25<00:17, 202MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  91%|█████████ | 29.2G/32.2G [04:25<00:09, 315MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  93%|█████████▎| 29.8G/32.2G [04:25<00:04, 512MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  96%|█████████▌| 30.8G/32.2G [04:25<00:01, 934MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  98%|█████████▊| 31.4G/32.2G [04:33<00:03, 217MB/s]

(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf:  99%|█████████▉| 31.9G/32.2G [04:33<00:00, 291MB/s]
(…)3-120B-Instruct-Q6_K-00001-of-00004.gguf: 32.2GB [04:34, 117MB/s]                            

 25%|██▌       | 1/4 [04:35<13:45, 275.04s/it]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:   0%|          | 0.00/32.1G [00:00<?, ?B/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:   0%|          | 32.1M/32.1G [00:33<9:12:39, 967kB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:   1%|          | 257M/32.1G [00:33<50:07, 10.6MB/s]  

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:   3%|▎         | 1.03G/32.1G [00:33<09:01, 57.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:   6%|▌         | 1.83G/32.1G [00:33<04:00, 126MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:   8%|▊         | 2.47G/32.1G [00:33<02:26, 202MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  10%|▉         | 3.18G/32.1G [00:33<01:30, 319MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  12%|█▏        | 3.76G/32.1G [01:04<08:46, 53.8MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  12%|█▏        | 3.76G/32.1G [01:04<08:46, 53.8MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  12%|█▏        | 3.79G/32.1G [01:05<08:46, 53.7MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  13%|█▎        | 4.24G/32.1G [01:06<06:16, 74.0MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  15%|█▌        | 4.85G/32.1G [01:06<03:48, 119MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  17%|█▋        | 5.52G/32.1G [01:06<02:20, 189MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  19%|█▉        | 6.07G/32.1G [01:06<01:37, 268MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  21%|██        | 6.71G/32.1G [01:06<01:04, 396MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  23%|██▎       | 7.25G/32.1G [01:07<00:45, 542MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  24%|██▍       | 7.80G/32.1G [01:09<00:57, 422MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  25%|██▍       | 7.86G/32.1G [01:39<09:59, 40.4MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  25%|██▍       | 7.86G/32.1G [01:39<09:59, 40.4MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  25%|██▌       | 8.02G/32.1G [01:39<08:32, 47.0MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  26%|██▌       | 8.35G/32.1G [01:39<06:00, 65.9MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  28%|██▊       | 8.92G/32.1G [01:40<03:23, 114MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  30%|███       | 9.69G/32.1G [01:40<01:49, 204MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  32%|███▏      | 10.3G/32.1G [01:40<01:13, 297MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  34%|███▎      | 10.8G/32.1G [01:40<00:51, 410MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  35%|███▌      | 11.3G/32.1G [01:40<00:37, 559MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  36%|███▌      | 11.6G/32.1G [02:04<06:01, 56.8MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  36%|███▌      | 11.6G/32.1G [02:04<06:01, 56.8MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  36%|███▌      | 11.6G/32.1G [02:05<05:55, 57.7MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  37%|███▋      | 12.0G/32.1G [02:13<06:24, 52.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  38%|███▊      | 12.2G/32.1G [02:13<04:47, 69.0MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  39%|███▉      | 12.6G/32.1G [02:13<03:12, 102MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  41%|████      | 13.2G/32.1G [02:13<01:44, 181MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  44%|████▎     | 14.0G/32.1G [02:13<00:56, 321MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  45%|████▌     | 14.5G/32.1G [02:13<00:39, 444MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  47%|████▋     | 15.0G/32.1G [02:13<00:28, 610MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  48%|████▊     | 15.5G/32.1G [02:14<00:21, 786MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  49%|████▉     | 15.7G/32.1G [02:38<05:03, 54.0MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  49%|████▉     | 15.7G/32.1G [02:38<05:03, 54.0MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  49%|████▉     | 15.7G/32.1G [02:38<04:58, 54.9MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  50%|█████     | 16.0G/32.1G [02:47<05:29, 48.7MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  51%|█████     | 16.3G/32.1G [02:47<04:09, 63.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  52%|█████▏    | 16.7G/32.1G [02:47<02:35, 99.1MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  54%|█████▍    | 17.3G/32.1G [02:47<01:22, 179MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  56%|█████▌    | 17.8G/32.1G [02:47<00:51, 277MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  58%|█████▊    | 18.5G/32.1G [02:47<00:31, 435MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  59%|█████▉    | 18.9G/32.1G [02:47<00:22, 588MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  60%|██████    | 19.4G/32.1G [02:48<00:19, 662MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  61%|██████    | 19.5G/32.1G [03:12<04:12, 49.7MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  61%|██████    | 19.5G/32.1G [03:12<04:12, 49.7MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  61%|██████    | 19.6G/32.1G [03:12<04:07, 50.6MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  62%|██████▏   | 19.8G/32.1G [03:20<04:42, 43.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  62%|██████▏   | 20.0G/32.1G [03:21<03:36, 55.9MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  63%|██████▎   | 20.3G/32.1G [03:21<02:34, 76.6MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  64%|██████▍   | 20.6G/32.1G [03:21<01:37, 119MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  65%|██████▌   | 21.0G/32.1G [03:21<00:59, 189MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  67%|██████▋   | 21.5G/32.1G [03:21<00:32, 326MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  69%|██████▉   | 22.2G/32.1G [03:21<00:17, 556MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  71%|███████   | 22.7G/32.1G [03:21<00:12, 764MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  72%|███████▏  | 23.1G/32.1G [03:21<00:08, 1.00GB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  73%|███████▎  | 23.6G/32.1G [03:25<00:27, 316MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  74%|███████▎  | 23.7G/32.1G [03:46<02:54, 48.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  74%|███████▎  | 23.7G/32.1G [03:46<02:54, 48.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  74%|███████▍  | 23.7G/32.1G [03:46<02:51, 49.2MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  75%|███████▍  | 23.9G/32.1G [03:54<03:22, 40.5MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  75%|███████▌  | 24.1G/32.1G [03:54<02:36, 51.3MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  76%|███████▌  | 24.3G/32.1G [03:55<01:46, 73.0MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  76%|███████▋  | 24.5G/32.1G [03:55<01:13, 103MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  78%|███████▊  | 25.1G/32.1G [03:55<00:34, 207MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  80%|████████  | 25.7G/32.1G [03:55<00:17, 365MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  82%|████████▏ | 26.4G/32.1G [03:55<00:09, 608MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  84%|████████▍ | 26.9G/32.1G [03:55<00:06, 846MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  85%|████████▌ | 27.4G/32.1G [03:57<00:08, 589MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  86%|████████▌ | 27.5G/32.1G [04:20<01:30, 50.9MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  86%|████████▌ | 27.5G/32.1G [04:20<01:30, 50.9MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  86%|████████▌ | 27.5G/32.1G [04:20<01:28, 51.5MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  87%|████████▋ | 27.8G/32.1G [04:28<01:38, 43.8MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  87%|████████▋ | 28.0G/32.1G [04:28<01:12, 56.4MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  88%|████████▊ | 28.2G/32.1G [04:28<00:50, 77.4MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  89%|████████▊ | 28.4G/32.1G [04:29<00:34, 106MB/s] 

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  90%|█████████ | 28.9G/32.1G [04:29<00:16, 195MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  92%|█████████▏| 29.6G/32.1G [04:29<00:07, 359MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  95%|█████████▌| 30.6G/32.1G [04:29<00:02, 697MB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf:  98%|█████████▊| 31.4G/32.1G [04:29<00:00, 1.05GB/s]

(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 100%|█████████▉| 31.9G/32.1G [04:33<00:00, 375MB/s] 
(…)3-120B-Instruct-Q6_K-00002-of-00004.gguf: 32.1GB [04:33, 117MB/s]                            

 50%|█████     | 2/4 [09:09<09:09, 274.60s/it]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   0%|          | 0.00/32.2G [00:00<?, ?B/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   0%|          | 32.2M/32.2G [00:32<8:54:41, 1.00MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   1%|          | 161M/32.2G [00:32<1:19:42, 6.70MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   1%|          | 386M/32.2G [00:32<25:28, 20.8MB/s]  

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   3%|▎         | 805M/32.2G [00:32<09:02, 57.8MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   5%|▌         | 1.64G/32.2G [00:32<03:08, 162MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   7%|▋         | 2.32G/32.2G [00:32<01:47, 278MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:   9%|▉         | 2.93G/32.2G [00:32<01:09, 420MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  11%|█         | 3.51G/32.2G [01:01<08:30, 56.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  11%|█         | 3.51G/32.2G [01:01<08:30, 56.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  11%|█         | 3.54G/32.2G [01:02<08:38, 55.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  12%|█▏        | 3.93G/32.2G [01:04<06:41, 70.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  13%|█▎        | 4.22G/32.2G [01:04<05:03, 92.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  14%|█▍        | 4.61G/32.2G [01:04<03:26, 134MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  17%|█▋        | 5.35G/32.2G [01:04<01:49, 246MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  19%|█▊        | 5.99G/32.2G [01:05<01:09, 377MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  21%|██        | 6.70G/32.2G [01:05<00:44, 577MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  23%|██▎       | 7.25G/32.2G [01:05<00:32, 774MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  24%|██▎       | 7.63G/32.2G [01:36<07:57, 51.5MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  24%|██▎       | 7.63G/32.2G [01:36<07:57, 51.5MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  24%|██▍       | 7.70G/32.2G [01:37<07:34, 54.0MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  25%|██▌       | 8.08G/32.2G [01:37<05:15, 76.5MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  27%|██▋       | 8.73G/32.2G [01:37<02:59, 131MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  29%|██▉       | 9.28G/32.2G [01:37<01:57, 195MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  30%|███       | 9.73G/32.2G [01:37<01:24, 266MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  32%|███▏      | 10.4G/32.2G [01:37<00:53, 409MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  34%|███▍      | 11.0G/32.2G [01:37<00:36, 582MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  35%|███▍      | 11.2G/32.2G [02:06<07:14, 48.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  35%|███▍      | 11.2G/32.2G [02:06<07:14, 48.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  35%|███▍      | 11.2G/32.2G [02:07<07:00, 49.8MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  36%|███▌      | 11.6G/32.2G [02:09<05:31, 62.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  37%|███▋      | 11.9G/32.2G [02:09<04:09, 81.6MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  38%|███▊      | 12.2G/32.2G [02:09<02:47, 120MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  40%|███▉      | 12.8G/32.2G [02:10<01:33, 207MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  41%|████▏     | 13.3G/32.2G [02:10<01:00, 314MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  43%|████▎     | 13.8G/32.2G [02:10<00:42, 438MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  45%|████▍     | 14.4G/32.2G [02:10<00:26, 669MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  47%|████▋     | 15.0G/32.2G [02:10<00:17, 965MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  48%|████▊     | 15.3G/32.2G [02:42<05:58, 47.1MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  48%|████▊     | 15.3G/32.2G [02:42<05:58, 47.1MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  48%|████▊     | 15.4G/32.2G [02:42<05:39, 49.6MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  49%|████▉     | 15.7G/32.2G [02:42<03:47, 72.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  50%|█████     | 16.2G/32.2G [02:42<02:25, 110MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  53%|█████▎    | 16.9G/32.2G [02:42<01:18, 195MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  54%|█████▍    | 17.4G/32.2G [02:42<00:55, 265MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  56%|█████▌    | 18.0G/32.2G [02:43<00:35, 403MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  58%|█████▊    | 18.6G/32.2G [02:43<00:23, 576MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  59%|█████▊    | 18.8G/32.2G [03:09<04:06, 54.2MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  59%|█████▊    | 18.8G/32.2G [03:09<04:06, 54.2MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  59%|█████▊    | 18.9G/32.2G [03:10<04:15, 52.2MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  60%|█████▉    | 19.2G/32.2G [03:14<03:38, 59.5MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  61%|██████    | 19.5G/32.2G [03:15<02:44, 77.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  62%|██████▏   | 19.9G/32.2G [03:15<01:42, 120MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  64%|██████▎   | 20.5G/32.2G [03:15<00:56, 208MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  65%|██████▍   | 20.9G/32.2G [03:15<00:40, 282MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  66%|██████▋   | 21.4G/32.2G [03:15<00:26, 410MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  68%|██████▊   | 21.8G/32.2G [03:15<00:18, 555MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  70%|██████▉   | 22.4G/32.2G [03:15<00:11, 852MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  71%|███████   | 22.9G/32.2G [03:23<00:52, 176MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  71%|███████▏  | 23.0G/32.2G [03:47<03:54, 39.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  71%|███████▏  | 23.0G/32.2G [03:47<03:54, 39.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  72%|███████▏  | 23.0G/32.2G [03:47<03:37, 42.1MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  72%|███████▏  | 23.3G/32.2G [03:47<02:38, 56.6MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  73%|███████▎  | 23.4G/32.2G [03:47<01:58, 74.0MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  74%|███████▍  | 24.0G/32.2G [03:47<00:58, 141MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  76%|███████▌  | 24.4G/32.2G [03:47<00:36, 216MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  77%|███████▋  | 24.8G/32.2G [03:48<00:24, 309MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  78%|███████▊  | 25.2G/32.2G [03:48<00:15, 445MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  80%|███████▉  | 25.6G/32.2G [03:48<00:10, 636MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  81%|████████  | 26.2G/32.2G [03:48<00:06, 923MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  82%|████████▏ | 26.5G/32.2G [04:12<01:45, 54.1MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  82%|████████▏ | 26.5G/32.2G [04:12<01:45, 54.1MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  82%|████████▏ | 26.5G/32.2G [04:15<01:59, 47.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  83%|████████▎ | 26.8G/32.2G [04:19<01:40, 53.5MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  84%|████████▍ | 27.1G/32.2G [04:20<01:17, 66.4MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  85%|████████▍ | 27.2G/32.2G [04:20<01:01, 81.3MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  86%|████████▌ | 27.6G/32.2G [04:20<00:35, 131MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  87%|████████▋ | 28.1G/32.2G [04:20<00:17, 237MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  89%|████████▊ | 28.5G/32.2G [04:20<00:10, 337MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  90%|█████████ | 29.0G/32.2G [04:21<00:06, 506MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  91%|█████████▏| 29.4G/32.2G [04:21<00:03, 708MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  94%|█████████▍| 30.2G/32.2G [04:21<00:01, 1.16GB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  95%|█████████▌| 30.6G/32.2G [04:33<00:12, 123MB/s] 

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  95%|█████████▌| 30.6G/32.2G [04:33<00:12, 123MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  95%|█████████▌| 30.7G/32.2G [04:33<00:11, 131MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  96%|█████████▋| 31.0G/32.2G [04:34<00:06, 171MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf:  98%|█████████▊| 31.7G/32.2G [04:34<00:01, 290MB/s]

(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 100%|█████████▉| 32.0G/32.2G [04:34<00:00, 330MB/s]
(…)3-120B-Instruct-Q6_K-00003-of-00004.gguf: 32.2GB [04:35, 117MB/s]                            

 75%|███████▌  | 3/4 [13:44<04:34, 274.98s/it]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:   0%|          | 0.00/3.52G [00:00<?, ?B/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:   0%|          | 16.0M/3.52G [00:13<47:34, 1.23MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:   1%|          | 32.0M/3.52G [00:15<25:19, 2.29MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:   2%|▏         | 64.0M/3.52G [00:15<09:28, 6.07MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:   8%|▊         | 272M/3.52G [00:15<01:19, 40.7MB/s] 

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  16%|█▌        | 560M/3.52G [00:16<00:27, 107MB/s] 

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  24%|██▎       | 832M/3.52G [00:16<00:14, 191MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  30%|███       | 1.06G/3.52G [00:16<00:08, 277MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  36%|███▋      | 1.28G/3.52G [00:16<00:05, 391MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  42%|████▏     | 1.49G/3.52G [00:16<00:03, 520MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  49%|████▊     | 1.71G/3.52G [00:16<00:02, 683MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  50%|████▉     | 1.74G/3.52G [00:27<00:39, 45.3MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  50%|████▉     | 1.74G/3.52G [00:27<00:39, 45.3MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  50%|█████     | 1.76G/3.52G [00:28<00:40, 43.1MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  54%|█████▍    | 1.90G/3.52G [00:29<00:30, 52.7MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  60%|█████▉    | 2.10G/3.52G [00:29<00:16, 86.3MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  73%|███████▎  | 2.58G/3.52G [00:30<00:04, 204MB/s] 

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf:  89%|████████▊ | 3.12G/3.52G [00:30<00:01, 385MB/s]

(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 3.52GB [00:30, 551MB/s]                            
(…)3-120B-Instruct-Q6_K-00004-of-00004.gguf: 3.52GB [00:30, 116MB/s]

100%|██████████| 4/4 [14:15<00:00, 178.47s/it]
100%|██████████| 4/4 [14:15<00:00, 213.82s/it]