Hugging Face's logo

brucethemoose
/
CaPlatTessDolXaBoros-34B-200K-exl2-4bpw-fiction

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
Merge
Inference Endpoints
Model card Files Community
2
brucethemoose commited on
Commit
8f89a16
•
1 Parent(s): 284bbd8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -8
README.md CHANGED
@@ -24,23 +24,23 @@ models:
24
  - model: /home/alpha/Storage/Models/Raw/migtissera_Tess-34B-v1.4
25
  parameters:
26
  weight: 0.19
27
- density: 0.44
28
  - model: /home/alpha//Storage/Models/Raw/bhenrym14_airoboros-3_1-yi-34b-200k
29
  parameters:
30
  weight: 0.14
31
- density: 0.34
32
  - model: /home/alpha/Storage/Models/Raw/Nous-Capybara-34B
33
  parameters:
34
  weight: 0.19
35
- density: 0.44
36
  - model: /home/alpha/Storage/Models/Raw/kyujinpy_PlatYi-34B-200K-Q
37
  parameters:
38
  weight: 0.14
39
- density: 0.34
40
  - model: /home/alpha/FastModels/ehartford_dolphin-2.2-yi-34b-200k
41
  parameters:
42
  weight: 0.19
43
- density: 0.44
44
  - model: /home/alpha/FastModels/fblgit_una-xaberius-34b-v1beta
45
  parameters:
46
  weight: 0.15
@@ -48,10 +48,8 @@ models:
48
  merge_method: dare_ties
49
  base_model: /home/alpha/Storage/Models/Raw/chargoddard_Yi-34B-200K-Llama
50
  parameters:
51
-
52
- int8_mask: true
53
  dtype: bfloat16
54
-
55
  ```
56
 
57
  First exllama quantization pass:
 
24
  - model: /home/alpha/Storage/Models/Raw/migtissera_Tess-34B-v1.4
25
  parameters:
26
  weight: 0.19
27
+ density: 0.6
28
  - model: /home/alpha//Storage/Models/Raw/bhenrym14_airoboros-3_1-yi-34b-200k
29
  parameters:
30
  weight: 0.14
31
+ density: 0.5
32
  - model: /home/alpha/Storage/Models/Raw/Nous-Capybara-34B
33
  parameters:
34
  weight: 0.19
35
+ density: 0.6
36
  - model: /home/alpha/Storage/Models/Raw/kyujinpy_PlatYi-34B-200K-Q
37
  parameters:
38
  weight: 0.14
39
+ density: 0.5
40
  - model: /home/alpha/FastModels/ehartford_dolphin-2.2-yi-34b-200k
41
  parameters:
42
  weight: 0.19
43
+ density: 0.6
44
  - model: /home/alpha/FastModels/fblgit_una-xaberius-34b-v1beta
45
  parameters:
46
  weight: 0.15
 
48
  merge_method: dare_ties
49
  base_model: /home/alpha/Storage/Models/Raw/chargoddard_Yi-34B-200K-Llama
50
  parameters:
51
+ int8_mask: true
 
52
  dtype: bfloat16
 
53
  ```
54
 
55
  First exllama quantization pass: