Hugging Face's logo

Gameselo
/
STS-multilingual-mpnet-base-v2

Sentence Similarity
sentence-transformers
Safetensors
xlm-roberta
mteb
feature-extraction
dataset_size:100K<n<1M
loss:AnglELoss
Eval Results
text-embeddings-inference
Inference Endpoints
Model card Files Community
1
Gameselo commited on
Commit
f2ce457
•
1 Parent(s): 5dc955c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +333 -0
README.md CHANGED
@@ -1,4 +1,337 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  language: []
3
  library_name: sentence-transformers
4
  tags:
 
1
  ---
2
+ model-index:
3
+ - name: Gameselo/STS-multilingual-mpnet-base-v2
4
+ results:
5
+ - dataset:
6
+ config: it
7
+ name: MTEB STS22
8
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
9
+ split: test
10
+ type: mteb/sts22-crosslingual-sts
11
+ metrics:
12
+ - type: cosine_spearman
13
+ value: 0.6847049462613332
14
+ task:
15
+ type: STS
16
+ - dataset:
17
+ config: es
18
+ name: MTEB STS22
19
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
20
+ split: test
21
+ type: mteb/sts22-crosslingual-sts
22
+ metrics:
23
+ - type: cosine_spearman
24
+ value: 0.6620948502618977
25
+ task:
26
+ type: STS
27
+ - dataset:
28
+ config: fr
29
+ name: MTEB STS22
30
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
31
+ split: test
32
+ type: mteb/sts22-crosslingual-sts
33
+ metrics:
34
+ - type: cosine_spearman
35
+ value: 0.7875616631597785
36
+ task:
37
+ type: STS
38
+ - dataset:
39
+ config: pl-en
40
+ name: MTEB STS22
41
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
42
+ split: test
43
+ type: mteb/sts22-crosslingual-sts
44
+ metrics:
45
+ - type: cosine_spearman
46
+ value: 0.7510805416538202
47
+ task:
48
+ type: STS
49
+ - dataset:
50
+ config: ar
51
+ name: MTEB STS22
52
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
53
+ split: test
54
+ type: mteb/sts22-crosslingual-sts
55
+ metrics:
56
+ - type: cosine_spearman
57
+ value: 0.6265329479575293
58
+ task:
59
+ type: STS
60
+ - dataset:
61
+ config: pl
62
+ name: MTEB STS22
63
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
64
+ split: test
65
+ type: mteb/sts22-crosslingual-sts
66
+ metrics:
67
+ - type: cosine_spearman
68
+ value: 0.4335552432730643
69
+ task:
70
+ type: STS
71
+ - dataset:
72
+ config: de
73
+ name: MTEB STS22
74
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
75
+ split: test
76
+ type: mteb/sts22-crosslingual-sts
77
+ metrics:
78
+ - type: cosine_spearman
79
+ value: 0.5774252131250034
80
+ task:
81
+ type: STS
82
+ - dataset:
83
+ config: tr
84
+ name: MTEB STS22
85
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
86
+ split: test
87
+ type: mteb/sts22-crosslingual-sts
88
+ metrics:
89
+ - type: cosine_spearman
90
+ value: 0.6383757017928495
91
+ task:
92
+ type: STS
93
+ - dataset:
94
+ config: es-it
95
+ name: MTEB STS22
96
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
97
+ split: test
98
+ type: mteb/sts22-crosslingual-sts
99
+ metrics:
100
+ - type: cosine_spearman
101
+ value: 0.6624635951676386
102
+ task:
103
+ type: STS
104
+ - dataset:
105
+ config: ru
106
+ name: MTEB STS22
107
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
108
+ split: test
109
+ type: mteb/sts22-crosslingual-sts
110
+ metrics:
111
+ - type: cosine_spearman
112
+ value: 0.5866853707548388
113
+ task:
114
+ type: STS
115
+ - dataset:
116
+ config: en
117
+ name: MTEB STS22
118
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
119
+ split: test
120
+ type: mteb/sts22-crosslingual-sts
121
+ metrics:
122
+ - type: cosine_spearman
123
+ value: 0.6385354535483773
124
+ task:
125
+ type: STS
126
+ - dataset:
127
+ config: zh-en
128
+ name: MTEB STS22
129
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
130
+ split: test
131
+ type: mteb/sts22-crosslingual-sts
132
+ metrics:
133
+ - type: cosine_spearman
134
+ value: 0.6537294853166558
135
+ task:
136
+ type: STS
137
+ - dataset:
138
+ config: zh
139
+ name: MTEB STS22
140
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
141
+ split: test
142
+ type: mteb/sts22-crosslingual-sts
143
+ metrics:
144
+ - type: cosine_spearman
145
+ value: 0.6319430830291571
146
+ task:
147
+ type: STS
148
+ - dataset:
149
+ config: fr-pl
150
+ name: MTEB STS22
151
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
152
+ split: test
153
+ type: mteb/sts22-crosslingual-sts
154
+ metrics:
155
+ - type: cosine_spearman
156
+ value: 0.8451542547285167
157
+ task:
158
+ type: STS
159
+ - dataset:
160
+ config: de-fr
161
+ name: MTEB STS22
162
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
163
+ split: test
164
+ type: mteb/sts22-crosslingual-sts
165
+ metrics:
166
+ - type: cosine_spearman
167
+ value: 0.5798716781400349
168
+ task:
169
+ type: STS
170
+ - dataset:
171
+ config: es-en
172
+ name: MTEB STS22
173
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
174
+ split: test
175
+ type: mteb/sts22-crosslingual-sts
176
+ metrics:
177
+ - type: cosine_spearman
178
+ value: 0.7518021273920814
179
+ task:
180
+ type: STS
181
+ - dataset:
182
+ config: de-en
183
+ name: MTEB STS22
184
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
185
+ split: test
186
+ type: mteb/sts22-crosslingual-sts
187
+ metrics:
188
+ - type: cosine_spearman
189
+ value: 0.5749790581441845
190
+ task:
191
+ type: STS
192
+ - dataset:
193
+ config: de-pl
194
+ name: MTEB STS22
195
+ revision: de9d86b3b84231dc21f76c7b7af1f28e2f57f6e3
196
+ split: test
197
+ type: mteb/sts22-crosslingual-sts
198
+ metrics:
199
+ - type: cosine_spearman
200
+ value: 0.44220332625465214
201
+ task:
202
+ type: STS
203
+ - dataset:
204
+ config: default
205
+ name: MTEB STSBenchmark
206
+ revision: b0fddb56ed78048fa8b90373c8a3cfc37b684831
207
+ split: test
208
+ type: mteb/stsbenchmark-sts
209
+ metrics:
210
+ - type: cosine_spearman
211
+ value: 0.9762486352335524
212
+ task:
213
+ type: STS
214
+ - dataset:
215
+ config: en-tr
216
+ name: MTEB STS17
217
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
218
+ split: test
219
+ type: mteb/sts17-crosslingual-sts
220
+ metrics:
221
+ - type: cosine_spearman
222
+ value: 0.7987027653005363
223
+ task:
224
+ type: STS
225
+ - dataset:
226
+ config: ko-ko
227
+ name: MTEB STS17
228
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
229
+ split: test
230
+ type: mteb/sts17-crosslingual-sts
231
+ metrics:
232
+ - type: cosine_spearman
233
+ value: 0.9766336939338607
234
+ task:
235
+ type: STS
236
+ - dataset:
237
+ config: fr-en
238
+ name: MTEB STS17
239
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
240
+ split: test
241
+ type: mteb/sts17-crosslingual-sts
242
+ metrics:
243
+ - type: cosine_spearman
244
+ value: 0.9067607122592818
245
+ task:
246
+ type: STS
247
+ - dataset:
248
+ config: en-ar
249
+ name: MTEB STS17
250
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
251
+ split: test
252
+ type: mteb/sts17-crosslingual-sts
253
+ metrics:
254
+ - type: cosine_spearman
255
+ value: 0.7703365842088069
256
+ task:
257
+ type: STS
258
+ - dataset:
259
+ config: nl-en
260
+ name: MTEB STS17
261
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
262
+ split: test
263
+ type: mteb/sts17-crosslingual-sts
264
+ metrics:
265
+ - type: cosine_spearman
266
+ value: 0.9114826394926738
267
+ task:
268
+ type: STS
269
+ - dataset:
270
+ config: it-en
271
+ name: MTEB STS17
272
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
273
+ split: test
274
+ type: mteb/sts17-crosslingual-sts
275
+ metrics:
276
+ - type: cosine_spearman
277
+ value: 0.9246785886944904
278
+ task:
279
+ type: STS
280
+ - dataset:
281
+ config: ar-ar
282
+ name: MTEB STS17
283
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
284
+ split: test
285
+ type: mteb/sts17-crosslingual-sts
286
+ metrics:
287
+ - type: cosine_spearman
288
+ value: 0.8124393788492182
289
+ task:
290
+ type: STS
291
+ - dataset:
292
+ config: es-es
293
+ name: MTEB STS17
294
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
295
+ split: test
296
+ type: mteb/sts17-crosslingual-sts
297
+ metrics:
298
+ - type: cosine_spearman
299
+ value: 0.872701191632785
300
+ task:
301
+ type: STS
302
+ - dataset:
303
+ config: en-de
304
+ name: MTEB STS17
305
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
306
+ split: test
307
+ type: mteb/sts17-crosslingual-sts
308
+ metrics:
309
+ - type: cosine_spearman
310
+ value: 0.9109414091487618
311
+ task:
312
+ type: STS
313
+ - dataset:
314
+ config: es-en
315
+ name: MTEB STS17
316
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
317
+ split: test
318
+ type: mteb/sts17-crosslingual-sts
319
+ metrics:
320
+ - type: cosine_spearman
321
+ value: 0.8553203530552356
322
+ task:
323
+ type: STS
324
+ - dataset:
325
+ config: en-en
326
+ name: MTEB STS17
327
+ revision: faeb762787bd10488a50c8b5be4a3b82e411949c
328
+ split: test
329
+ type: mteb/sts17-crosslingual-sts
330
+ metrics:
331
+ - type: cosine_spearman
332
+ value: 0.9378741534997558
333
+ task:
334
+ type: STS
335
  language: []
336
  library_name: sentence-transformers
337
  tags: