Steelskull commited on
Commit
4b3677f
Β·
verified Β·
1 Parent(s): 9cad315

Update README.md

Browse files

adding new quants found

Files changed (1) hide show
  1. README.md +97 -59
README.md CHANGED
@@ -113,6 +113,7 @@ model-index:
113
  name: Open LLM Leaderboard
114
  ---
115
  <!DOCTYPE html>
 
116
  <style>
117
  ebody {
118
  font-family: 'Quicksand', sans-serif;
@@ -992,35 +993,35 @@ a:hover .link-arrow {
992
  <div>
993
  <div class="review-card">
994
  <div>
995
- <span>@Geechan - Discord</span>
996
  </div>
997
- <p>@Steel Have only briefly tested so far, but you really cooked up an amazing merge with this one, and I mean that wholeheartedly. Insane creativity, perfect character adherence and dialogue, loves to slow burn and take its time, minimal sloppy patterns and writing, and such a breath of fresh air in many ways. I'm enjoying my results with 1 temp and 0.99 TFS (close to something like 0.015 min P). Letting the model be creative and wild is so fun and makes me want to RP more.<br><br>No positivity bias either; violent scenes will result in my death and/or suffering, as they should, and I don't see any soft refusals either. ERP has no skimming of details or refusals like you see on some other L3.3 tunes too</p>
998
  </div>
999
  <div class="review-card">
1000
  <div>
1001
- <span>IGODZOL - Huggingface</span>
1002
  </div>
1003
- <p>I honestly have no idea why (maybe the negative llama is having that great of an influence) but this merge is miles above the individual tunes that went into making it. Good sir, this model has just become my daily driver. Chapeau bas</p>
1004
  </div>
1005
  <div class="review-card">
1006
  <div>
1007
- <span>@thana_alt - Discord</span>
1008
  </div>
1009
- <p>I'm thoroughly impressed by this merge of Llama 3.3. It successfully addresses the positivity bias prevalent in the base Llama model, ensuring a more accurate and balanced response. The adherence to system prompts is also notable, with the model demonstrating a keen understanding of context and instruction.<br><br>The prose generated by this model is truly exceptional - it's almost as if a skilled chef has carefully crafted each sentence to create a rich and immersive experience. I put this to the test in an adventure scenario, where I had about 10,000 tokens of lorebooks and was managing nine characters simultaneously. Despite the complexity, the model performed flawlessly, keeping track of each character's location and activity without any confusion - even when they were in different locations.<br><br>I also experimented with an astral projection type of power, and was impressed to see that the model accurately discerned that I wasn't physically present in a particular location. Another significant advantage of this model is the lack of impersonation issues, allowing for seamless role-playing and storytelling.<br><br>The capacity of this model is equally impressive, as I was able to load up to 110,000 tokens without encountering any issues. In fact, I successfully tested it with up to 70,000 tokens without experiencing any breakdown or degradation in performance.<br><br>When combined with the "The Inception Presets - Methception Llamaception Qwenception" prompt preset from https://huggingface.co/Konnect1221/ , this model truly shines, bringing out the best in the Llama 3.3 architecture. Overall, I'm extremely satisfied with this merge and would highly recommend it to anyone looking to elevate their storytelling and role-playing experiences.</p>
1010
  </div>
1011
  </div>
1012
  </div>
1013
  </details>
1014
  </div>-->
1015
  </div>
1016
- <!-- UGI-Benchmark Results (Temporarily Hidden)
1017
  <h2>UGI-Benchmark Results:</h2>
1018
  <div class="benchmark-container">
1019
  <div class="benchmark-notification">
1020
  <div class="notification-content">
1021
  <span class="notification-icon">πŸ†</span>
1022
  <span class="notification-text">
1023
- Highest ranked 70b as of 01/17/2025.
1024
  <a href="https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard" target="_blank" class="benchmark-link">
1025
  View Full Leaderboard β†’
1026
  </a>
@@ -1032,19 +1033,19 @@ a:hover .link-arrow {
1032
  <div class="core-metrics-grid">
1033
  <div class="metric-box">
1034
  <span class="label">UGI Score</span>
1035
- <span class="value">56.75</span>
1036
  </div>
1037
  <div class="metric-box">
1038
  <span class="label">Willingness Score</span>
1039
- <span class="value">7.5/10</span>
1040
  </div>
1041
  <div class="metric-box">
1042
  <span class="label">Natural Intelligence</span>
1043
- <span class="value">41.09</span>
1044
  </div>
1045
  <div class="metric-box">
1046
  <span class="label">Coding Ability</span>
1047
- <span class="value">20</span>
1048
  </div>
1049
  </div>
1050
  </div>
@@ -1053,7 +1054,7 @@ a:hover .link-arrow {
1053
  <div class="info-grid">
1054
  <div class="metric-box">
1055
  <span class="label">Political Lean</span>
1056
- <span class="value">-8.1%</span>
1057
  </div>
1058
  <div class="metric-box">
1059
  <span class="label">Ideology</span>
@@ -1072,37 +1073,37 @@ a:hover .link-arrow {
1072
  <div class="progress-metric">
1073
  <div class="progress-label">
1074
  <span>Diplomacy</span>
1075
- <span class="progress-value">61.9%</span>
1076
  </div>
1077
  <div class="progress-bar">
1078
- <div class="progress-fill" style="width: 61.9%"></div>
1079
  </div>
1080
  </div>
1081
  <div class="progress-metric">
1082
  <div class="progress-label">
1083
  <span>Government</span>
1084
- <span class="progress-value">45.9%</span>
1085
  </div>
1086
  <div class="progress-bar">
1087
- <div class="progress-fill" style="width: 45.9%"></div>
1088
  </div>
1089
  </div>
1090
  <div class="progress-metric">
1091
  <div class="progress-label">
1092
  <span>Economy</span>
1093
- <span class="progress-value">43.9%</span>
1094
  </div>
1095
  <div class="progress-bar">
1096
- <div class="progress-fill" style="width: 43.9%"></div>
1097
  </div>
1098
  </div>
1099
  <div class="progress-metric">
1100
  <div class="progress-label">
1101
  <span>Society</span>
1102
- <span class="progress-value">60.1%</span>
1103
  </div>
1104
  <div class="progress-bar">
1105
- <div class="progress-fill" style="width: 60.1%"></div>
1106
  </div>
1107
  </div>
1108
  </div>
@@ -1115,140 +1116,139 @@ a:hover .link-arrow {
1115
  <div class="progress-metric split">
1116
  <div class="progress-label">
1117
  <span>Federal</span>
1118
- <span class="progress-value">44.2%</span>
1119
  <span>Unitary</span>
1120
  </div>
1121
  <div class="progress-bar split">
1122
- <div class="progress-fill-left" style="width: 22.1%"></div>
1123
- <div class="progress-fill-right" style="width: 27.9%"></div>
1124
  </div>
1125
  </div>
1126
  <div class="progress-metric split">
1127
  <div class="progress-label">
1128
  <span>Democratic</span>
1129
- <span class="progress-value">66.2%</span>
1130
  <span>Autocratic</span>
1131
  </div>
1132
  <div class="progress-bar split">
1133
- <div class="progress-fill-left" style="width: 33.1%"></div>
1134
- <div class="progress-fill-right" style="width: 16.9%"></div>
1135
  </div>
1136
  </div>
1137
  <div class="progress-metric split">
1138
  <div class="progress-label">
1139
  <span>Security</span>
1140
- <span class="progress-value">48.1%</span>
1141
  <span>Freedom</span>
1142
  </div>
1143
  <div class="progress-bar split">
1144
- <div class="progress-fill-left" style="width: 24.05%"></div>
1145
- <div class="progress-fill-right" style="width: 25.95%"></div>
1146
  </div>
1147
  </div>
1148
  <div class="progress-metric split">
1149
  <div class="progress-label">
1150
  <span>Nationalism</span>
1151
- <span class="progress-value">40.4%</span>
1152
  <span>Int'l</span>
1153
  </div>
1154
  <div class="progress-bar split">
1155
- <div class="progress-fill-left" style="width: 20.2%"></div>
1156
- <div class="progress-fill-right" style="width: 29.8%"></div>
1157
  </div>
1158
  </div>
1159
  <div class="progress-metric split">
1160
  <div class="progress-label">
1161
  <span>Militarist</span>
1162
- <span class="progress-value">30.4%</span>
1163
  <span>Pacifist</span>
1164
  </div>
1165
  <div class="progress-bar split">
1166
- <div class="progress-fill-left" style="width: 15.2%"></div>
1167
- <div class="progress-fill-right" style="width: 34.8%"></div>
1168
  </div>
1169
  </div>
1170
  <div class="progress-metric split">
1171
  <div class="progress-label">
1172
  <span>Assimilationist</span>
1173
- <span class="progress-value">43.3%</span>
1174
  <span>Multiculturalist</span>
1175
  </div>
1176
  <div class="progress-bar split">
1177
- <div class="progress-fill-left" style="width: 21.65%"></div>
1178
- <div class="progress-fill-right" style="width: 28.35%"></div>
1179
  </div>
1180
  </div>
1181
  <div class="progress-metric split">
1182
  <div class="progress-label">
1183
  <span>Collectivize</span>
1184
- <span class="progress-value">43.8%</span>
1185
  <span>Privatize</span>
1186
  </div>
1187
  <div class="progress-bar split">
1188
- <div class="progress-fill-left" style="width: 21.9%"></div>
1189
- <div class="progress-fill-right" style="width: 28.1%"></div>
1190
  </div>
1191
  </div>
1192
  <div class="progress-metric split">
1193
  <div class="progress-label">
1194
  <span>Planned</span>
1195
- <span class="progress-value">43.1%</span>
1196
  <span>LaissezFaire</span>
1197
  </div>
1198
  <div class="progress-bar split">
1199
- <div class="progress-fill-left" style="width: 21.55%"></div>
1200
- <div class="progress-fill-right" style="width: 28.45%"></div>
1201
  </div>
1202
  </div>
1203
  <div class="progress-metric split">
1204
  <div class="progress-label">
1205
  <span>Isolationism</span>
1206
- <span class="progress-value">44.8%</span>
1207
  <span>Globalism</span>
1208
  </div>
1209
  <div class="progress-bar split">
1210
- <div class="progress-fill-left" style="width: 22.4%"></div>
1211
- <div class="progress-fill-right" style="width: 27.6%"></div>
1212
  </div>
1213
  </div>
1214
  <div class="progress-metric split">
1215
  <div class="progress-label">
1216
  <span>Irreligious</span>
1217
- <span class="progress-value">55.4%</span>
1218
  <span>Religious</span>
1219
  </div>
1220
  <div class="progress-bar split">
1221
- <div class="progress-fill-left" style="width: 27.7%"></div>
1222
- <div class="progress-fill-right" style="width: 22.3%"></div>
1223
  </div>
1224
  </div>
1225
  <div class="progress-metric split">
1226
  <div class="progress-label">
1227
  <span>Progressive</span>
1228
- <span class="progress-value">59.6%</span>
1229
  <span>Traditional</span>
1230
  </div>
1231
  <div class="progress-bar split">
1232
- <div class="progress-fill-left" style="width: 29.8%"></div>
1233
- <div class="progress-fill-right" style="width: 20.2%"></div>
1234
  </div>
1235
  </div>
1236
  <div class="progress-metric split">
1237
  <div class="progress-label">
1238
  <span>Acceleration</span>
1239
- <span class="progress-value">65.2%</span>
1240
  <span>Bioconservative</span>
1241
  </div>
1242
  <div class="progress-bar split">
1243
- <div class="progress-fill-left" style="width: 32.6%"></div>
1244
- <div class="progress-fill-right" style="width: 17.4%"></div>
1245
  </div>
1246
  </div>
1247
  </div>
1248
  </details>
1249
  </div>
1250
  </div>
1251
- -->
1252
  <h2>Open LLM-Benchmark Results:</h2>
1253
  <div class="benchmark-container">
1254
  <div class="benchmark-notification">
@@ -1371,6 +1371,44 @@ a:hover .link-arrow {
1371
  <span class="link-arrow">β†’</span>
1372
  </a>
1373
  </div>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1374
  </div>
1375
  </div>
1376
  </div>
@@ -1384,4 +1422,4 @@ a:hover .link-arrow {
1384
  </div>
1385
  </div>
1386
  </body>
1387
- </html>
 
113
  name: Open LLM Leaderboard
114
  ---
115
  <!DOCTYPE html>
116
+
117
  <style>
118
  ebody {
119
  font-family: 'Quicksand', sans-serif;
 
993
  <div>
994
  <div class="review-card">
995
  <div>
996
+ <span>[USERNAME]</span>
997
  </div>
998
+ <p>[REVIEW]</p>
999
  </div>
1000
  <div class="review-card">
1001
  <div>
1002
+ <span>[USERNAME]</span>
1003
  </div>
1004
+ <p>[REVIEW]</p>
1005
  </div>
1006
  <div class="review-card">
1007
  <div>
1008
+ <span>[USERNAME]</span>
1009
  </div>
1010
+ <p>[REVIEW]</p>
1011
  </div>
1012
  </div>
1013
  </div>
1014
  </details>
1015
  </div>-->
1016
  </div>
1017
+ <!-- UGI-Benchmark Results -->
1018
  <h2>UGI-Benchmark Results:</h2>
1019
  <div class="benchmark-container">
1020
  <div class="benchmark-notification">
1021
  <div class="notification-content">
1022
  <span class="notification-icon">πŸ†</span>
1023
  <span class="notification-text">
1024
+ Latest benchmark results as of 01/23/2025.
1025
  <a href="https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard" target="_blank" class="benchmark-link">
1026
  View Full Leaderboard β†’
1027
  </a>
 
1033
  <div class="core-metrics-grid">
1034
  <div class="metric-box">
1035
  <span class="label">UGI Score</span>
1036
+ <span class="value">42.66</span>
1037
  </div>
1038
  <div class="metric-box">
1039
  <span class="label">Willingness Score</span>
1040
+ <span class="value">2.5/10</span>
1041
  </div>
1042
  <div class="metric-box">
1043
  <span class="label">Natural Intelligence</span>
1044
+ <span class="value">40.64</span>
1045
  </div>
1046
  <div class="metric-box">
1047
  <span class="label">Coding Ability</span>
1048
+ <span class="value">22</span>
1049
  </div>
1050
  </div>
1051
  </div>
 
1054
  <div class="info-grid">
1055
  <div class="metric-box">
1056
  <span class="label">Political Lean</span>
1057
+ <span class="value">-11.4%</span>
1058
  </div>
1059
  <div class="metric-box">
1060
  <span class="label">Ideology</span>
 
1073
  <div class="progress-metric">
1074
  <div class="progress-label">
1075
  <span>Diplomacy</span>
1076
+ <span class="progress-value">60.1%</span>
1077
  </div>
1078
  <div class="progress-bar">
1079
+ <div class="progress-fill" style="width: 60.1%"></div>
1080
  </div>
1081
  </div>
1082
  <div class="progress-metric">
1083
  <div class="progress-label">
1084
  <span>Government</span>
1085
+ <span class="progress-value">47.0%</span>
1086
  </div>
1087
  <div class="progress-bar">
1088
+ <div class="progress-fill" style="width: 47.0%"></div>
1089
  </div>
1090
  </div>
1091
  <div class="progress-metric">
1092
  <div class="progress-label">
1093
  <span>Economy</span>
1094
+ <span class="progress-value">45.4%</span>
1095
  </div>
1096
  <div class="progress-bar">
1097
+ <div class="progress-fill" style="width: 45.4%"></div>
1098
  </div>
1099
  </div>
1100
  <div class="progress-metric">
1101
  <div class="progress-label">
1102
  <span>Society</span>
1103
+ <span class="progress-value">62.6%</span>
1104
  </div>
1105
  <div class="progress-bar">
1106
+ <div class="progress-fill" style="width: 62.6%"></div>
1107
  </div>
1108
  </div>
1109
  </div>
 
1116
  <div class="progress-metric split">
1117
  <div class="progress-label">
1118
  <span>Federal</span>
1119
+ <span class="progress-value">43.1%</span>
1120
  <span>Unitary</span>
1121
  </div>
1122
  <div class="progress-bar split">
1123
+ <div class="progress-fill-left" style="width: 21.55%"></div>
1124
+ <div class="progress-fill-right" style="width: 28.45%"></div>
1125
  </div>
1126
  </div>
1127
  <div class="progress-metric split">
1128
  <div class="progress-label">
1129
  <span>Democratic</span>
1130
+ <span class="progress-value">64.2%</span>
1131
  <span>Autocratic</span>
1132
  </div>
1133
  <div class="progress-bar split">
1134
+ <div class="progress-fill-left" style="width: 32.1%"></div>
1135
+ <div class="progress-fill-right" style="width: 17.9%"></div>
1136
  </div>
1137
  </div>
1138
  <div class="progress-metric split">
1139
  <div class="progress-label">
1140
  <span>Security</span>
1141
+ <span class="progress-value">48.3%</span>
1142
  <span>Freedom</span>
1143
  </div>
1144
  <div class="progress-bar split">
1145
+ <div class="progress-fill-left" style="width: 24.15%"></div>
1146
+ <div class="progress-fill-right" style="width: 25.85%"></div>
1147
  </div>
1148
  </div>
1149
  <div class="progress-metric split">
1150
  <div class="progress-label">
1151
  <span>Nationalism</span>
1152
+ <span class="progress-value">42.1%</span>
1153
  <span>Int'l</span>
1154
  </div>
1155
  <div class="progress-bar split">
1156
+ <div class="progress-fill-left" style="width: 21.05%"></div>
1157
+ <div class="progress-fill-right" style="width: 28.95%"></div>
1158
  </div>
1159
  </div>
1160
  <div class="progress-metric split">
1161
  <div class="progress-label">
1162
  <span>Militarist</span>
1163
+ <span class="progress-value">36.7%</span>
1164
  <span>Pacifist</span>
1165
  </div>
1166
  <div class="progress-bar split">
1167
+ <div class="progress-fill-left" style="width: 18.35%"></div>
1168
+ <div class="progress-fill-right" style="width: 31.65%"></div>
1169
  </div>
1170
  </div>
1171
  <div class="progress-metric split">
1172
  <div class="progress-label">
1173
  <span>Assimilationist</span>
1174
+ <span class="progress-value">41.0%</span>
1175
  <span>Multiculturalist</span>
1176
  </div>
1177
  <div class="progress-bar split">
1178
+ <div class="progress-fill-left" style="width: 20.5%"></div>
1179
+ <div class="progress-fill-right" style="width: 29.5%"></div>
1180
  </div>
1181
  </div>
1182
  <div class="progress-metric split">
1183
  <div class="progress-label">
1184
  <span>Collectivize</span>
1185
+ <span class="progress-value">47.9%</span>
1186
  <span>Privatize</span>
1187
  </div>
1188
  <div class="progress-bar split">
1189
+ <div class="progress-fill-left" style="width: 23.95%"></div>
1190
+ <div class="progress-fill-right" style="width: 26.05%"></div>
1191
  </div>
1192
  </div>
1193
  <div class="progress-metric split">
1194
  <div class="progress-label">
1195
  <span>Planned</span>
1196
+ <span class="progress-value">44.4%</span>
1197
  <span>LaissezFaire</span>
1198
  </div>
1199
  <div class="progress-bar split">
1200
+ <div class="progress-fill-left" style="width: 22.2%"></div>
1201
+ <div class="progress-fill-right" style="width: 27.8%"></div>
1202
  </div>
1203
  </div>
1204
  <div class="progress-metric split">
1205
  <div class="progress-label">
1206
  <span>Isolationism</span>
1207
+ <span class="progress-value">43.8%</span>
1208
  <span>Globalism</span>
1209
  </div>
1210
  <div class="progress-bar split">
1211
+ <div class="progress-fill-left" style="width: 21.9%"></div>
1212
+ <div class="progress-fill-right" style="width: 28.1%"></div>
1213
  </div>
1214
  </div>
1215
  <div class="progress-metric split">
1216
  <div class="progress-label">
1217
  <span>Irreligious</span>
1218
+ <span class="progress-value">57.9%</span>
1219
  <span>Religious</span>
1220
  </div>
1221
  <div class="progress-bar split">
1222
+ <div class="progress-fill-left" style="width: 28.95%"></div>
1223
+ <div class="progress-fill-right" style="width: 21.05%"></div>
1224
  </div>
1225
  </div>
1226
  <div class="progress-metric split">
1227
  <div class="progress-label">
1228
  <span>Progressive</span>
1229
+ <span class="progress-value">62.5%</span>
1230
  <span>Traditional</span>
1231
  </div>
1232
  <div class="progress-bar split">
1233
+ <div class="progress-fill-left" style="width: 31.25%"></div>
1234
+ <div class="progress-fill-right" style="width: 18.75%"></div>
1235
  </div>
1236
  </div>
1237
  <div class="progress-metric split">
1238
  <div class="progress-label">
1239
  <span>Acceleration</span>
1240
+ <span class="progress-value">67.3%</span>
1241
  <span>Bioconservative</span>
1242
  </div>
1243
  <div class="progress-bar split">
1244
+ <div class="progress-fill-left" style="width: 33.65%"></div>
1245
+ <div class="progress-fill-right" style="width: 16.35%"></div>
1246
  </div>
1247
  </div>
1248
  </div>
1249
  </details>
1250
  </div>
1251
  </div>
 
1252
  <h2>Open LLM-Benchmark Results:</h2>
1253
  <div class="benchmark-container">
1254
  <div class="benchmark-notification">
 
1371
  <span class="link-arrow">β†’</span>
1372
  </a>
1373
  </div>
1374
+ <div class="quantized-item">
1375
+ <span class="author">ReadyArt</span>
1376
+ <div class="multi-links">
1377
+ <a href="https://huggingface.co/ReadyArt/L3.3-Nevoria-R1-70b_EXL2_5.0bpw_H8" target="_blank">
1378
+ 5.0BPW-EXL2
1379
+ <span class="link-arrow">β†’</span>
1380
+ </a>
1381
+ <span class="separator">//</span>
1382
+ <a href="https://huggingface.co/ReadyArt/L3.3-Nevoria-R1-70b_EXL2_4.0bpw_H8" target="_blank">
1383
+ 4.0BPW-EXL2
1384
+ <span class="link-arrow">β†’</span>
1385
+ </a>
1386
+ <span class="separator">//</span>
1387
+ <a href="https://huggingface.co/ReadyArt/L3.3-Nevoria-R1-70b_EXL2_3.0bpw_H8" target="_blank">
1388
+ 3.0BPW-EXL2
1389
+ <span class="link-arrow">β†’</span>
1390
+ </a>
1391
+ <span class="separator">//</span>
1392
+ <a href="https://huggingface.co/ReadyArt/L3.3-Nevoria-R1-70b_EXL2_2.0bpw_H8" target="_blank">
1393
+ 2.0BPW-EXL2
1394
+ <span class="link-arrow">β†’</span>
1395
+ </a>
1396
+ </div>
1397
+ </div>
1398
+ <div class="quantized-item">
1399
+ <span class="author">PedroPareja</span>
1400
+ <a href="https://huggingface.co/PedroPareja/L3.3-Nevoria-R1-70b-4.5bpw-h6-exl2" target="_blank">
1401
+ 4.5BPW-EXL2
1402
+ <span class="link-arrow">β†’</span>
1403
+ </a>
1404
+ </div>
1405
+ <div class="quantized-item">
1406
+ <span class="author">VoidStare</span>
1407
+ <a href="https://huggingface.co/VoidStare/L3.3-Nevoria-R1-70b-EXL2-6.5bpw-h8" target="_blank">
1408
+ 6.5BPW-EXL2
1409
+ <span class="link-arrow">β†’</span>
1410
+ </a>
1411
+ </div>
1412
  </div>
1413
  </div>
1414
  </div>
 
1422
  </div>
1423
  </div>
1424
  </body>
1425
+ </html>