vrashad commited on
Commit
3026987
·
verified ·
1 Parent(s): 5c3969c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -19,6 +19,7 @@ This is an optimized version of [LaBSE (Language-agnostic BERT Sentence Embeddin
19
 
20
  # Benchmark
21
 
 
22
  | STSBenchmark | biosses-sts | sickr-sts | sts12-sts | sts13-sts | sts15-sts | sts16-sts | Average Pearson | Model |
23
  |--------------|-------------|-----------|-----------|-----------|-----------|-----------|-----------------|--------------------------------------|
24
  | 0.7363 | 0.8148 | 0.7067 | 0.7050 | 0.6535 | 0.7514 | 0.7070 | 0.7250 | sentence-transformers/LaBSE |
@@ -29,15 +30,12 @@ This is an optimized version of [LaBSE (Language-agnostic BERT Sentence Embeddin
29
  | 0.6960 | 0.8185 | 0.6950 | 0.6752 | 0.5899 | 0.7186 | 0.6790 | 0.6960 | intfloat/multilingual-e5-base |
30
  | 0.7376 | 0.7917 | 0.7190 | 0.7441 | 0.6286 | 0.7461 | 0.7026 | 0.7242 | intfloat/multilingual-e5-small |
31
  | 0.7927 | 0.6672 | 0.7758 | 0.8122 | 0.7312 | 0.7831 | 0.7416 | 0.7577 | BAAI/bge-m3 |
32
-
33
- [STS-Benchmark](https://github.com/LocalDoc-Azerbaijan/STS-Benchmark)
34
 
35
 
 
36
 
37
- # Memory Usage Comparison (GPU):
38
 
39
- Original LaBSE: ~1.89-1.90 GB allocated
40
- LaBSE-small-AZ: ~0.58 GB allocated
41
 
42
 
43
 
 
19
 
20
  # Benchmark
21
 
22
+ ```
23
  | STSBenchmark | biosses-sts | sickr-sts | sts12-sts | sts13-sts | sts15-sts | sts16-sts | Average Pearson | Model |
24
  |--------------|-------------|-----------|-----------|-----------|-----------|-----------|-----------------|--------------------------------------|
25
  | 0.7363 | 0.8148 | 0.7067 | 0.7050 | 0.6535 | 0.7514 | 0.7070 | 0.7250 | sentence-transformers/LaBSE |
 
30
  | 0.6960 | 0.8185 | 0.6950 | 0.6752 | 0.5899 | 0.7186 | 0.6790 | 0.6960 | intfloat/multilingual-e5-base |
31
  | 0.7376 | 0.7917 | 0.7190 | 0.7441 | 0.6286 | 0.7461 | 0.7026 | 0.7242 | intfloat/multilingual-e5-small |
32
  | 0.7927 | 0.6672 | 0.7758 | 0.8122 | 0.7312 | 0.7831 | 0.7416 | 0.7577 | BAAI/bge-m3 |
33
+ ```
 
34
 
35
 
36
+ [STS-Benchmark](https://github.com/LocalDoc-Azerbaijan/STS-Benchmark)
37
 
 
38
 
 
 
39
 
40
 
41