Update README.md
Browse files
README.md
CHANGED
@@ -19,6 +19,7 @@ This is an optimized version of [LaBSE (Language-agnostic BERT Sentence Embeddin
|
|
19 |
|
20 |
# Benchmark
|
21 |
|
|
|
22 |
| STSBenchmark | biosses-sts | sickr-sts | sts12-sts | sts13-sts | sts15-sts | sts16-sts | Average Pearson | Model |
|
23 |
|--------------|-------------|-----------|-----------|-----------|-----------|-----------|-----------------|--------------------------------------|
|
24 |
| 0.7363 | 0.8148 | 0.7067 | 0.7050 | 0.6535 | 0.7514 | 0.7070 | 0.7250 | sentence-transformers/LaBSE |
|
@@ -29,15 +30,12 @@ This is an optimized version of [LaBSE (Language-agnostic BERT Sentence Embeddin
|
|
29 |
| 0.6960 | 0.8185 | 0.6950 | 0.6752 | 0.5899 | 0.7186 | 0.6790 | 0.6960 | intfloat/multilingual-e5-base |
|
30 |
| 0.7376 | 0.7917 | 0.7190 | 0.7441 | 0.6286 | 0.7461 | 0.7026 | 0.7242 | intfloat/multilingual-e5-small |
|
31 |
| 0.7927 | 0.6672 | 0.7758 | 0.8122 | 0.7312 | 0.7831 | 0.7416 | 0.7577 | BAAI/bge-m3 |
|
32 |
-
|
33 |
-
[STS-Benchmark](https://github.com/LocalDoc-Azerbaijan/STS-Benchmark)
|
34 |
|
35 |
|
|
|
36 |
|
37 |
-
# Memory Usage Comparison (GPU):
|
38 |
|
39 |
-
Original LaBSE: ~1.89-1.90 GB allocated
|
40 |
-
LaBSE-small-AZ: ~0.58 GB allocated
|
41 |
|
42 |
|
43 |
|
|
|
19 |
|
20 |
# Benchmark
|
21 |
|
22 |
+
```
|
23 |
| STSBenchmark | biosses-sts | sickr-sts | sts12-sts | sts13-sts | sts15-sts | sts16-sts | Average Pearson | Model |
|
24 |
|--------------|-------------|-----------|-----------|-----------|-----------|-----------|-----------------|--------------------------------------|
|
25 |
| 0.7363 | 0.8148 | 0.7067 | 0.7050 | 0.6535 | 0.7514 | 0.7070 | 0.7250 | sentence-transformers/LaBSE |
|
|
|
30 |
| 0.6960 | 0.8185 | 0.6950 | 0.6752 | 0.5899 | 0.7186 | 0.6790 | 0.6960 | intfloat/multilingual-e5-base |
|
31 |
| 0.7376 | 0.7917 | 0.7190 | 0.7441 | 0.6286 | 0.7461 | 0.7026 | 0.7242 | intfloat/multilingual-e5-small |
|
32 |
| 0.7927 | 0.6672 | 0.7758 | 0.8122 | 0.7312 | 0.7831 | 0.7416 | 0.7577 | BAAI/bge-m3 |
|
33 |
+
```
|
|
|
34 |
|
35 |
|
36 |
+
[STS-Benchmark](https://github.com/LocalDoc-Azerbaijan/STS-Benchmark)
|
37 |
|
|
|
38 |
|
|
|
|
|
39 |
|
40 |
|
41 |
|