Update README.md
Browse files
README.md
CHANGED
|
@@ -62,6 +62,40 @@ print(cos_sim(text_embeddings[0], image_embeddings[0])) # text-image cross-modal
|
|
| 62 |
|
| 63 |
## Performance
|
| 64 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
## Contact
|
| 66 |
|
| 67 |
Join our [Discord community](https://discord.jina.ai) and chat with other community members about ideas.
|
|
|
|
| 62 |
|
| 63 |
## Performance
|
| 64 |
|
| 65 |
+
### Text-Image Retrieval
|
| 66 |
+
|
| 67 |
+
#### Flickr
|
| 68 |
+
|
| 69 |
+
| Name | Flickr Image Retr. R@1 | Flickr Image Retr. R@5 | Flickr Text Retr. R@1 | Flickr Text Retr. R@5 |
|
| 70 |
+
|------------------|-------------------------|-------------------------|-----------------------|-----------------------|
|
| 71 |
+
| ViT-B-32 | 0.597 | 0.8398 | 0.781 | 0.938 |
|
| 72 |
+
| ViT-B-16 | 0.6216 | 0.8572 | 0.822 | 0.966 |
|
| 73 |
+
| jina-clip | 0.6748 | 0.8902 | 0.811 | 0.965 |
|
| 74 |
+
|
| 75 |
+
#### MSCOCO
|
| 76 |
+
|
| 77 |
+
| Name | MSCOCO Image Retr. R@1 | MSCOCO Image Retr. R@5 | MSCOCO Text Retr. R@1 | MSCOCO Text Retr. R@5 |
|
| 78 |
+
|------------------|-------------------------|-------------------------|-----------------------|-----------------------|
|
| 79 |
+
| ViT-B-32 | 0.342 | 0.6001 | 0.5234 | 0.7634 |
|
| 80 |
+
| ViT-B-16 | 0.3309 | 0.5842 | 0.5242 | 0.767 |
|
| 81 |
+
| jina-clip | 0.4111 | 0.6644 | 0.5544 | 0.7904 |
|
| 82 |
+
|
| 83 |
+
### Text-Text Retrieval
|
| 84 |
+
|
| 85 |
+
#### STS
|
| 86 |
+
|
| 87 |
+
| Name | STS12 | STS15 | STS17 | STS13 | STS14 | STS16 | STS22 | STSBenchmark | SummEval |
|
| 88 |
+
|-----------------------|--------|--------|--------|--------|--------|--------|--------|--------------|----------|
|
| 89 |
+
| jina-embeddings-v2 | 0.7427 | 0.8755 | 0.8888 | 0.833 | 0.7917 | 0.836 | 0.6346 | 0.8404 | 0.3056 |
|
| 90 |
+
| jina-clip | 0.7352 | 0.8746 | 0.8976 | 0.8323 | 0.7868 | 0.8377 | 0.6583 | 0.8493 | 0.3048 |
|
| 91 |
+
|
| 92 |
+
#### BEIR
|
| 93 |
+
|
| 94 |
+
| Name | ArguAna | FiQA2018 | NFCorpus | Quora | SCIDOCS | SciFact | TRECCOVID |
|
| 95 |
+
|--------------------|---------|----------|----------|-------|---------|---------|-----------|
|
| 96 |
+
| jina-embeddings-v2 | 0.4418 | 0.4158 | 0.3245 | 0.882 | 0.1986 | 0.6668 | 0.6591 |
|
| 97 |
+
| jina-clip | 0.4933 | 0.3827 | 0.3352 | 0.8789| 0.2024 | 0.6734 | 0.7161 |
|
| 98 |
+
|
| 99 |
## Contact
|
| 100 |
|
| 101 |
Join our [Discord community](https://discord.jina.ai) and chat with other community members about ideas.
|