dangvantuan
commited on
Commit
•
e5eeec0
1
Parent(s):
a97f1df
Update README.md
Browse files
README.md
CHANGED
@@ -79,7 +79,7 @@ test_evaluator(model, output_path="./")
|
|
79 |
```
|
80 |
|
81 |
**Test Result**:
|
82 |
-
The performance is measured using Pearson and Spearman correlation:
|
83 |
- On dev
|
84 |
|
85 |
|
@@ -94,7 +94,7 @@ The performance is measured using Pearson and Spearman correlation:
|
|
94 |
- On test
|
95 |
|
96 |
**Pearson score**
|
97 |
-
| Model | STS-B | STS12-fr | STS13-fr | STS14-fr | STS15-fr | STS16-fr | SICK-fr | params |
|
98 |
|-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
|
99 |
| [Lajavaness/sentence-camembert-base](https://huggingface.co/Lajavaness/sentence-camembert-base) | 83.46 | 84.49 | 84.61 | 83.94 | 86.94 | 75.20 | 82.86 | 110M |
|
100 |
| [inokufu/flaubert-base-uncased-xnli-sts](https://huggingface.co/inokufu/flaubert-base-uncased-xnli-sts) | 82.82 | 84.79 | 85.76 | 82.81 | 85.38 | 74.05 | 82.23 | 137M |
|
@@ -105,7 +105,7 @@ The performance is measured using Pearson and Spearman correlation:
|
|
105 |
|
106 |
|
107 |
**Spearman score**
|
108 |
-
| Model | STS-B | STS12-fr | STS13-fr | STS14-fr | STS15-fr | STS16-fr | SICK-fr | params |
|
109 |
|-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
|
110 |
| [inokufu/flaubert-base-uncased-xnli-sts](https://huggingface.co/inokufu/flaubert-base-uncased-xnli-sts) | 83.07 | 77.34 | 85.88 | 80.96 | 85.70 | 76.43 | 77.00 | 137M |
|
111 |
| [Lajavaness/sentence-camembert-base](https://huggingface.co/Lajavaness/sentence-camembert-base) | 82.92 | 77.71 | 84.19 | 81.83 | 87.04 | 76.81 | 76.36 | 110M |
|
|
|
79 |
```
|
80 |
|
81 |
**Test Result**:
|
82 |
+
The performance is measured using Pearson and Spearman correlation on many different benchmarks dataset:
|
83 |
- On dev
|
84 |
|
85 |
|
|
|
94 |
- On test
|
95 |
|
96 |
**Pearson score**
|
97 |
+
| Model | [STS-B](https://huggingface.co/datasets/stsb_multi_mt/viewer/fr/train) | [STS12-fr ](https://huggingface.co/datasets/Lajavaness/STS12-fr)| [STS13-fr](https://huggingface.co/datasets/Lajavaness/STS13-fr) | [STS14-fr](https://huggingface.co/datasets/Lajavaness/STS14-fr) | [STS15-fr](https://huggingface.co/datasets/Lajavaness/STS15-fr) | [STS16-fr](https://huggingface.co/datasets/Lajavaness/STS16-fr) | [SICK-fr](https://huggingface.co/datasets/Lajavaness/SICK-fr) | params |
|
98 |
|-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
|
99 |
| [Lajavaness/sentence-camembert-base](https://huggingface.co/Lajavaness/sentence-camembert-base) | 83.46 | 84.49 | 84.61 | 83.94 | 86.94 | 75.20 | 82.86 | 110M |
|
100 |
| [inokufu/flaubert-base-uncased-xnli-sts](https://huggingface.co/inokufu/flaubert-base-uncased-xnli-sts) | 82.82 | 84.79 | 85.76 | 82.81 | 85.38 | 74.05 | 82.23 | 137M |
|
|
|
105 |
|
106 |
|
107 |
**Spearman score**
|
108 |
+
| Model | [STS-B](https://huggingface.co/datasets/stsb_multi_mt/viewer/fr/train) | [STS12-fr ](https://huggingface.co/datasets/Lajavaness/STS12-fr)| [STS13-fr](https://huggingface.co/datasets/Lajavaness/STS13-fr) | [STS14-fr](https://huggingface.co/datasets/Lajavaness/STS14-fr) | [STS15-fr](https://huggingface.co/datasets/Lajavaness/STS15-fr) | [STS16-fr](https://huggingface.co/datasets/Lajavaness/STS16-fr) | [SICK-fr](https://huggingface.co/datasets/Lajavaness/SICK-fr) | params |
|
109 |
|-----------------------------------------------------------|---------|----------|----------|----------|----------|----------|---------|--------|
|
110 |
| [inokufu/flaubert-base-uncased-xnli-sts](https://huggingface.co/inokufu/flaubert-base-uncased-xnli-sts) | 83.07 | 77.34 | 85.88 | 80.96 | 85.70 | 76.43 | 77.00 | 137M |
|
111 |
| [Lajavaness/sentence-camembert-base](https://huggingface.co/Lajavaness/sentence-camembert-base) | 82.92 | 77.71 | 84.19 | 81.83 | 87.04 | 76.81 | 76.36 | 110M |
|