Update README.md
Browse files
README.md
CHANGED
|
@@ -33,8 +33,20 @@ For the MNTP Adapter, please refer to [this link](https://huggingface.co/uzabase
|
|
| 33 |
- Followings are summaries. Details are [here]()
|
| 34 |
## MTEB(Japanese)
|
| 35 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
## MTEB(English)
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
# Training Details
|
| 39 |
|
| 40 |
## Training Data
|
|
|
|
| 33 |
- Followings are summaries. Details are [here]()
|
| 34 |
## MTEB(Japanese)
|
| 35 |
|
| 36 |
+
| | Classification | Clustering | PairClassification | Reranking | BitextMining | Retrieval | Sts | 平均 |
|
| 37 |
+
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
|
| 38 |
+
| Llama2-Llm2vec-eng | 0.527 | 0.258 | 0.501 | 0.217 | 0.275 | 0.296 | 0.765 | 0.408 |
|
| 39 |
+
| Llama2-Llm2vec-jpn | 0.570 | 0.365 | 0.510 | 0.349 | 0.470 | 0.417 | 0.795 | 0.498 |
|
| 40 |
+
| **Swallow-Llm2vec-jpn (This repo)** | 0.621 | 0.391 | 0.510 | 0.475 | 0.475 | 0.491 | 0.832 | 0.523 |
|
| 41 |
+
|
| 42 |
## MTEB(English)
|
| 43 |
|
| 44 |
+
| | Classification | Clustering | Pair_Classification| Reranking | Retrieval | STS | 平均 |
|
| 45 |
+
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
|
| 46 |
+
| Llama2-Llm2vec-eng | 0.709 | 0.386 | 0.780 | 0.588 | 0.329| 0.723 | 0.586 |
|
| 47 |
+
| Llama2-Llm2vec-jpn | 0.722 | 0.428 | 0.785 | 0.594 | 0.371 | 0.717 | 0.603 |
|
| 48 |
+
| **Swallow-Llm2vec-jpn (This repo)** | 0.695 | 0.385 | 0.751 | 0.576 | 0.318 | 0.710 | 0.572 |
|
| 49 |
+
|
| 50 |
# Training Details
|
| 51 |
|
| 52 |
## Training Data
|