wangyuxin
commited on
Commit
•
5c8ab9a
1
Parent(s):
9ab6c4a
添加 openai 评测
Browse files
README.md
CHANGED
|
@@ -65,17 +65,15 @@ M3E 使用 in-batch 负采样的对比学习的方式在句对数据集进行训
|
|
| 65 |
- 评测模型，[text2vec](https://github.com/shibing624/text2vec), m3e-base, m3e-small, openai-ada-002
|
| 66 |
- 评测脚本，具体参考此 [评测脚本](https://github.com/wangyuxinwhy/uniem/blob/main/mteb-zh/tasks.py)
|
| 67 |
|
| 68 |
-
| | text2vec | m3e-small | m3e-base |
|
| 69 |
-
| ----------------- | -------- | --------- | -------- |
|
| 70 |
-
| TNews | 0.43 | 0.4443 | 0.4827 |
|
| 71 |
-
| JDIphone | 0.8214 | 0.8293 | 0.8533 |
|
| 72 |
-
| GubaEastmony | 0.7472 | 0.712 | 0.7621 |
|
| 73 |
-
| TYQSentiment | 0.6099 | 0.6596 | 0.7188 |
|
| 74 |
-
| StockComSentiment | 0.4307 | 0.4291 | 0.4363 |
|
| 75 |
-
| IFlyTek | 0.414 | 0.4263 | 0.4409 |
|
| 76 |
-
| Average | 0.5755 | 0.5834 | 0.6157 |
|
| 77 |
-
|
| 78 |
-
openai-ada-002 模型待评测
|
| 79 |
|
| 80 |
### 检索排序
|
| 81 |
|
|
|
|
| 65 |
- 评测模型，[text2vec](https://github.com/shibing624/text2vec), m3e-base, m3e-small, openai-ada-002
|
| 66 |
- 评测脚本，具体参考此 [评测脚本](https://github.com/wangyuxinwhy/uniem/blob/main/mteb-zh/tasks.py)
|
| 67 |
|
| 68 |
+
| | text2vec | m3e-small | m3e-base | openai |
|
| 69 |
+
| ----------------- | -------- | --------- | -------- | ------ |
|
| 70 |
+
| TNews | 0.43 | 0.4443 | 0.4827 | 0.4594 |
|
| 71 |
+
| JDIphone | 0.8214 | 0.8293 | 0.8533 | 0.746 |
|
| 72 |
+
| GubaEastmony | 0.7472 | 0.712 | 0.7621 | 0.7574 |
|
| 73 |
+
| TYQSentiment | 0.6099 | 0.6596 | 0.7188 | 0.68 |
|
| 74 |
+
| StockComSentiment | 0.4307 | 0.4291 | 0.4363 | 0.4819 |
|
| 75 |
+
| IFlyTek | 0.414 | 0.4263 | 0.4409 | 0.4486 |
|
| 76 |
+
| Average | 0.5755 | 0.5834 | 0.6157 | 0.5956 |
|
|
|
|
|
|
|
| 77 |
|
| 78 |
### 检索排序
|
| 79 |
|