ClayAtlas commited on
Commit
1e0a464
1 Parent(s): aa8a738

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1326 -0
README.md CHANGED
@@ -590,6 +590,1332 @@ model-index:
590
  value: 75.45100000000001
591
  - type: recall_at_5
592
  value: 81.02000000000001
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
593
  - task:
594
  type: Retrieval
595
  dataset:
 
590
  value: 75.45100000000001
591
  - type: recall_at_5
592
  value: 81.02000000000001
593
+ - task:
594
+ type: Classification
595
+ dataset:
596
+ type: mteb/amazon_massive_intent
597
+ name: MTEB MassiveIntentClassification (af)
598
+ config: af
599
+ split: test
600
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
601
+ metrics:
602
+ - type: accuracy
603
+ value: 28.813046402151986
604
+ - type: f1
605
+ value: 26.66771458648628
606
+ - task:
607
+ type: Classification
608
+ dataset:
609
+ type: mteb/amazon_massive_intent
610
+ name: MTEB MassiveIntentClassification (am)
611
+ config: am
612
+ split: test
613
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
614
+ metrics:
615
+ - type: accuracy
616
+ value: 3.0363147276395432
617
+ - type: f1
618
+ value: 2.1282632958878023
619
+ - task:
620
+ type: Classification
621
+ dataset:
622
+ type: mteb/amazon_massive_intent
623
+ name: MTEB MassiveIntentClassification (ar)
624
+ config: ar
625
+ split: test
626
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
627
+ metrics:
628
+ - type: accuracy
629
+ value: 6.745124411566914
630
+ - type: f1
631
+ value: 4.64897627862169
632
+ - task:
633
+ type: Classification
634
+ dataset:
635
+ type: mteb/amazon_massive_intent
636
+ name: MTEB MassiveIntentClassification (az)
637
+ config: az
638
+ split: test
639
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
640
+ metrics:
641
+ - type: accuracy
642
+ value: 27.004034969737727
643
+ - type: f1
644
+ value: 24.50373453583708
645
+ - task:
646
+ type: Classification
647
+ dataset:
648
+ type: mteb/amazon_massive_intent
649
+ name: MTEB MassiveIntentClassification (bn)
650
+ config: bn
651
+ split: test
652
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
653
+ metrics:
654
+ - type: accuracy
655
+ value: 3.24142568930733
656
+ - type: f1
657
+ value: 1.4440829714459096
658
+ - task:
659
+ type: Classification
660
+ dataset:
661
+ type: mteb/amazon_massive_intent
662
+ name: MTEB MassiveIntentClassification (cy)
663
+ config: cy
664
+ split: test
665
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
666
+ metrics:
667
+ - type: accuracy
668
+ value: 31.176866173503697
669
+ - type: f1
670
+ value: 27.449943893371536
671
+ - task:
672
+ type: Classification
673
+ dataset:
674
+ type: mteb/amazon_massive_intent
675
+ name: MTEB MassiveIntentClassification (da)
676
+ config: da
677
+ split: test
678
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
679
+ metrics:
680
+ - type: accuracy
681
+ value: 35.52790854068594
682
+ - type: f1
683
+ value: 32.284095877219734
684
+ - task:
685
+ type: Classification
686
+ dataset:
687
+ type: mteb/amazon_massive_intent
688
+ name: MTEB MassiveIntentClassification (de)
689
+ config: de
690
+ split: test
691
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
692
+ metrics:
693
+ - type: accuracy
694
+ value: 30.64895763281775
695
+ - type: f1
696
+ value: 27.273098137670022
697
+ - task:
698
+ type: Classification
699
+ dataset:
700
+ type: mteb/amazon_massive_intent
701
+ name: MTEB MassiveIntentClassification (el)
702
+ config: el
703
+ split: test
704
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
705
+ metrics:
706
+ - type: accuracy
707
+ value: 18.167451244115668
708
+ - type: f1
709
+ value: 14.717271932824833
710
+ - task:
711
+ type: Classification
712
+ dataset:
713
+ type: mteb/amazon_massive_intent
714
+ name: MTEB MassiveIntentClassification (en)
715
+ config: en
716
+ split: test
717
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
718
+ metrics:
719
+ - type: accuracy
720
+ value: 54.76126429051782
721
+ - type: f1
722
+ value: 50.43678929170829
723
+ - task:
724
+ type: Classification
725
+ dataset:
726
+ type: mteb/amazon_massive_intent
727
+ name: MTEB MassiveIntentClassification (es)
728
+ config: es
729
+ split: test
730
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
731
+ metrics:
732
+ - type: accuracy
733
+ value: 32.53194351042367
734
+ - type: f1
735
+ value: 30.922864615091562
736
+ - task:
737
+ type: Classification
738
+ dataset:
739
+ type: mteb/amazon_massive_intent
740
+ name: MTEB MassiveIntentClassification (fa)
741
+ config: fa
742
+ split: test
743
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
744
+ metrics:
745
+ - type: accuracy
746
+ value: 8.715534633490249
747
+ - type: f1
748
+ value: 5.943557212598054
749
+ - task:
750
+ type: Classification
751
+ dataset:
752
+ type: mteb/amazon_massive_intent
753
+ name: MTEB MassiveIntentClassification (fi)
754
+ config: fi
755
+ split: test
756
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
757
+ metrics:
758
+ - type: accuracy
759
+ value: 31.785474108944182
760
+ - type: f1
761
+ value: 28.416607289904295
762
+ - task:
763
+ type: Classification
764
+ dataset:
765
+ type: mteb/amazon_massive_intent
766
+ name: MTEB MassiveIntentClassification (fr)
767
+ config: fr
768
+ split: test
769
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
770
+ metrics:
771
+ - type: accuracy
772
+ value: 33.16072629455279
773
+ - type: f1
774
+ value: 31.78249030156056
775
+ - task:
776
+ type: Classification
777
+ dataset:
778
+ type: mteb/amazon_massive_intent
779
+ name: MTEB MassiveIntentClassification (he)
780
+ config: he
781
+ split: test
782
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
783
+ metrics:
784
+ - type: accuracy
785
+ value: 3.026227303295226
786
+ - type: f1
787
+ value: 1.0249360076972784
788
+ - task:
789
+ type: Classification
790
+ dataset:
791
+ type: mteb/amazon_massive_intent
792
+ name: MTEB MassiveIntentClassification (hi)
793
+ config: hi
794
+ split: test
795
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
796
+ metrics:
797
+ - type: accuracy
798
+ value: 3.611297915265635
799
+ - type: f1
800
+ value: 1.8805751299306375
801
+ - task:
802
+ type: Classification
803
+ dataset:
804
+ type: mteb/amazon_massive_intent
805
+ name: MTEB MassiveIntentClassification (hu)
806
+ config: hu
807
+ split: test
808
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
809
+ metrics:
810
+ - type: accuracy
811
+ value: 30.470746469401476
812
+ - type: f1
813
+ value: 27.326274554457026
814
+ - task:
815
+ type: Classification
816
+ dataset:
817
+ type: mteb/amazon_massive_intent
818
+ name: MTEB MassiveIntentClassification (hy)
819
+ config: hy
820
+ split: test
821
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
822
+ metrics:
823
+ - type: accuracy
824
+ value: 5.346334902488231
825
+ - type: f1
826
+ value: 2.0115115171706197
827
+ - task:
828
+ type: Classification
829
+ dataset:
830
+ type: mteb/amazon_massive_intent
831
+ name: MTEB MassiveIntentClassification (id)
832
+ config: id
833
+ split: test
834
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
835
+ metrics:
836
+ - type: accuracy
837
+ value: 32.454606590450574
838
+ - type: f1
839
+ value: 31.8382002228813
840
+ - task:
841
+ type: Classification
842
+ dataset:
843
+ type: mteb/amazon_massive_intent
844
+ name: MTEB MassiveIntentClassification (is)
845
+ config: is
846
+ split: test
847
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
848
+ metrics:
849
+ - type: accuracy
850
+ value: 30.11768661735037
851
+ - type: f1
852
+ value: 27.934697686003663
853
+ - task:
854
+ type: Classification
855
+ dataset:
856
+ type: mteb/amazon_massive_intent
857
+ name: MTEB MassiveIntentClassification (it)
858
+ config: it
859
+ split: test
860
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
861
+ metrics:
862
+ - type: accuracy
863
+ value: 36.32145258910558
864
+ - type: f1
865
+ value: 34.47615722242413
866
+ - task:
867
+ type: Classification
868
+ dataset:
869
+ type: mteb/amazon_massive_intent
870
+ name: MTEB MassiveIntentClassification (ja)
871
+ config: ja
872
+ split: test
873
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
874
+ metrics:
875
+ - type: accuracy
876
+ value: 41.08944182918628
877
+ - type: f1
878
+ value: 39.27783199703022
879
+ - task:
880
+ type: Classification
881
+ dataset:
882
+ type: mteb/amazon_massive_intent
883
+ name: MTEB MassiveIntentClassification (jv)
884
+ config: jv
885
+ split: test
886
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
887
+ metrics:
888
+ - type: accuracy
889
+ value: 30.423671822461333
890
+ - type: f1
891
+ value: 28.09995717285775
892
+ - task:
893
+ type: Classification
894
+ dataset:
895
+ type: mteb/amazon_massive_intent
896
+ name: MTEB MassiveIntentClassification (ka)
897
+ config: ka
898
+ split: test
899
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
900
+ metrics:
901
+ - type: accuracy
902
+ value: 3.789509078681909
903
+ - type: f1
904
+ value: 2.3697617052406272
905
+ - task:
906
+ type: Classification
907
+ dataset:
908
+ type: mteb/amazon_massive_intent
909
+ name: MTEB MassiveIntentClassification (km)
910
+ config: km
911
+ split: test
912
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
913
+ metrics:
914
+ - type: accuracy
915
+ value: 6.785474108944182
916
+ - type: f1
917
+ value: 2.8990913772357447
918
+ - task:
919
+ type: Classification
920
+ dataset:
921
+ type: mteb/amazon_massive_intent
922
+ name: MTEB MassiveIntentClassification (kn)
923
+ config: kn
924
+ split: test
925
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
926
+ metrics:
927
+ - type: accuracy
928
+ value: 3.8567585743106925
929
+ - type: f1
930
+ value: 2.0161963929375477
931
+ - task:
932
+ type: Classification
933
+ dataset:
934
+ type: mteb/amazon_massive_intent
935
+ name: MTEB MassiveIntentClassification (ko)
936
+ config: ko
937
+ split: test
938
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
939
+ metrics:
940
+ - type: accuracy
941
+ value: 8.823133826496301
942
+ - type: f1
943
+ value: 7.858046825547553
944
+ - task:
945
+ type: Classification
946
+ dataset:
947
+ type: mteb/amazon_massive_intent
948
+ name: MTEB MassiveIntentClassification (lv)
949
+ config: lv
950
+ split: test
951
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
952
+ metrics:
953
+ - type: accuracy
954
+ value: 30.232010759919298
955
+ - type: f1
956
+ value: 28.881628667244787
957
+ - task:
958
+ type: Classification
959
+ dataset:
960
+ type: mteb/amazon_massive_intent
961
+ name: MTEB MassiveIntentClassification (ml)
962
+ config: ml
963
+ split: test
964
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
965
+ metrics:
966
+ - type: accuracy
967
+ value: 2.9287155346334903
968
+ - type: f1
969
+ value: 1.2010642206520263
970
+ - task:
971
+ type: Classification
972
+ dataset:
973
+ type: mteb/amazon_massive_intent
974
+ name: MTEB MassiveIntentClassification (mn)
975
+ config: mn
976
+ split: test
977
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
978
+ metrics:
979
+ - type: accuracy
980
+ value: 12.609280430396769
981
+ - type: f1
982
+ value: 11.505263544077053
983
+ - task:
984
+ type: Classification
985
+ dataset:
986
+ type: mteb/amazon_massive_intent
987
+ name: MTEB MassiveIntentClassification (ms)
988
+ config: ms
989
+ split: test
990
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
991
+ metrics:
992
+ - type: accuracy
993
+ value: 30.655682582380628
994
+ - type: f1
995
+ value: 27.59065107222783
996
+ - task:
997
+ type: Classification
998
+ dataset:
999
+ type: mteb/amazon_massive_intent
1000
+ name: MTEB MassiveIntentClassification (my)
1001
+ config: my
1002
+ split: test
1003
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1004
+ metrics:
1005
+ - type: accuracy
1006
+ value: 5.847343644922662
1007
+ - type: f1
1008
+ value: 3.3114858432654826
1009
+ - task:
1010
+ type: Classification
1011
+ dataset:
1012
+ type: mteb/amazon_massive_intent
1013
+ name: MTEB MassiveIntentClassification (nb)
1014
+ config: nb
1015
+ split: test
1016
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1017
+ metrics:
1018
+ - type: accuracy
1019
+ value: 31.07262945527909
1020
+ - type: f1
1021
+ value: 29.317858835895027
1022
+ - task:
1023
+ type: Classification
1024
+ dataset:
1025
+ type: mteb/amazon_massive_intent
1026
+ name: MTEB MassiveIntentClassification (nl)
1027
+ config: nl
1028
+ split: test
1029
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1030
+ metrics:
1031
+ - type: accuracy
1032
+ value: 34.095494283792874
1033
+ - type: f1
1034
+ value: 30.319492995092318
1035
+ - task:
1036
+ type: Classification
1037
+ dataset:
1038
+ type: mteb/amazon_massive_intent
1039
+ name: MTEB MassiveIntentClassification (pl)
1040
+ config: pl
1041
+ split: test
1042
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1043
+ metrics:
1044
+ - type: accuracy
1045
+ value: 33.170813718897115
1046
+ - type: f1
1047
+ value: 28.978304060463582
1048
+ - task:
1049
+ type: Classification
1050
+ dataset:
1051
+ type: mteb/amazon_massive_intent
1052
+ name: MTEB MassiveIntentClassification (pt)
1053
+ config: pt
1054
+ split: test
1055
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1056
+ metrics:
1057
+ - type: accuracy
1058
+ value: 36.91661062542031
1059
+ - type: f1
1060
+ value: 34.591929627017805
1061
+ - task:
1062
+ type: Classification
1063
+ dataset:
1064
+ type: mteb/amazon_massive_intent
1065
+ name: MTEB MassiveIntentClassification (ro)
1066
+ config: ro
1067
+ split: test
1068
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1069
+ metrics:
1070
+ - type: accuracy
1071
+ value: 33.006052454606596
1072
+ - type: f1
1073
+ value: 30.91144759622849
1074
+ - task:
1075
+ type: Classification
1076
+ dataset:
1077
+ type: mteb/amazon_massive_intent
1078
+ name: MTEB MassiveIntentClassification (ru)
1079
+ config: ru
1080
+ split: test
1081
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1082
+ metrics:
1083
+ - type: accuracy
1084
+ value: 10.403496973772697
1085
+ - type: f1
1086
+ value: 10.071257139055659
1087
+ - task:
1088
+ type: Classification
1089
+ dataset:
1090
+ type: mteb/amazon_massive_intent
1091
+ name: MTEB MassiveIntentClassification (sl)
1092
+ config: sl
1093
+ split: test
1094
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1095
+ metrics:
1096
+ - type: accuracy
1097
+ value: 30.729657027572298
1098
+ - type: f1
1099
+ value: 28.973650264516444
1100
+ - task:
1101
+ type: Classification
1102
+ dataset:
1103
+ type: mteb/amazon_massive_intent
1104
+ name: MTEB MassiveIntentClassification (sq)
1105
+ config: sq
1106
+ split: test
1107
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1108
+ metrics:
1109
+ - type: accuracy
1110
+ value: 36.98386012104909
1111
+ - type: f1
1112
+ value: 33.55308140748509
1113
+ - task:
1114
+ type: Classification
1115
+ dataset:
1116
+ type: mteb/amazon_massive_intent
1117
+ name: MTEB MassiveIntentClassification (sv)
1118
+ config: sv
1119
+ split: test
1120
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1121
+ metrics:
1122
+ - type: accuracy
1123
+ value: 33.01613987895091
1124
+ - type: f1
1125
+ value: 30.764827155309348
1126
+ - task:
1127
+ type: Classification
1128
+ dataset:
1129
+ type: mteb/amazon_massive_intent
1130
+ name: MTEB MassiveIntentClassification (sw)
1131
+ config: sw
1132
+ split: test
1133
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1134
+ metrics:
1135
+ - type: accuracy
1136
+ value: 31.62071284465367
1137
+ - type: f1
1138
+ value: 29.79828395194018
1139
+ - task:
1140
+ type: Classification
1141
+ dataset:
1142
+ type: mteb/amazon_massive_intent
1143
+ name: MTEB MassiveIntentClassification (ta)
1144
+ config: ta
1145
+ split: test
1146
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1147
+ metrics:
1148
+ - type: accuracy
1149
+ value: 3.194351042367182
1150
+ - type: f1
1151
+ value: 1.2345975087085737
1152
+ - task:
1153
+ type: Classification
1154
+ dataset:
1155
+ type: mteb/amazon_massive_intent
1156
+ name: MTEB MassiveIntentClassification (te)
1157
+ config: te
1158
+ split: test
1159
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1160
+ metrics:
1161
+ - type: accuracy
1162
+ value: 2.5924680564895763
1163
+ - type: f1
1164
+ value: 1.3765731931999778
1165
+ - task:
1166
+ type: Classification
1167
+ dataset:
1168
+ type: mteb/amazon_massive_intent
1169
+ name: MTEB MassiveIntentClassification (th)
1170
+ config: th
1171
+ split: test
1172
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1173
+ metrics:
1174
+ - type: accuracy
1175
+ value: 4.613315400134499
1176
+ - type: f1
1177
+ value: 3.315370311126649
1178
+ - task:
1179
+ type: Classification
1180
+ dataset:
1181
+ type: mteb/amazon_massive_intent
1182
+ name: MTEB MassiveIntentClassification (tl)
1183
+ config: tl
1184
+ split: test
1185
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1186
+ metrics:
1187
+ - type: accuracy
1188
+ value: 32.548755884330866
1189
+ - type: f1
1190
+ value: 28.72005484752792
1191
+ - task:
1192
+ type: Classification
1193
+ dataset:
1194
+ type: mteb/amazon_massive_intent
1195
+ name: MTEB MassiveIntentClassification (tr)
1196
+ config: tr
1197
+ split: test
1198
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1199
+ metrics:
1200
+ - type: accuracy
1201
+ value: 26.86617350369872
1202
+ - type: f1
1203
+ value: 25.04984155580145
1204
+ - task:
1205
+ type: Classification
1206
+ dataset:
1207
+ type: mteb/amazon_massive_intent
1208
+ name: MTEB MassiveIntentClassification (ur)
1209
+ config: ur
1210
+ split: test
1211
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1212
+ metrics:
1213
+ - type: accuracy
1214
+ value: 4.229993275050437
1215
+ - type: f1
1216
+ value: 2.6738110863892466
1217
+ - task:
1218
+ type: Classification
1219
+ dataset:
1220
+ type: mteb/amazon_massive_intent
1221
+ name: MTEB MassiveIntentClassification (vi)
1222
+ config: vi
1223
+ split: test
1224
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1225
+ metrics:
1226
+ - type: accuracy
1227
+ value: 29.243443174176193
1228
+ - type: f1
1229
+ value: 26.632983928112132
1230
+ - task:
1231
+ type: Classification
1232
+ dataset:
1233
+ type: mteb/amazon_massive_intent
1234
+ name: MTEB MassiveIntentClassification (zh-CN)
1235
+ config: zh-CN
1236
+ split: test
1237
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1238
+ metrics:
1239
+ - type: accuracy
1240
+ value: 70.91123066576999
1241
+ - type: f1
1242
+ value: 68.65382422288536
1243
+ - task:
1244
+ type: Classification
1245
+ dataset:
1246
+ type: mteb/amazon_massive_intent
1247
+ name: MTEB MassiveIntentClassification (zh-TW)
1248
+ config: zh-TW
1249
+ split: test
1250
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1251
+ metrics:
1252
+ - type: accuracy
1253
+ value: 65.49092131809012
1254
+ - type: f1
1255
+ value: 64.63433166397587
1256
+ - task:
1257
+ type: Classification
1258
+ dataset:
1259
+ type: mteb/amazon_massive_scenario
1260
+ name: MTEB MassiveScenarioClassification (af)
1261
+ config: af
1262
+ split: test
1263
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1264
+ metrics:
1265
+ - type: accuracy
1266
+ value: 35.41022192333557
1267
+ - type: f1
1268
+ value: 32.043773998696864
1269
+ - task:
1270
+ type: Classification
1271
+ dataset:
1272
+ type: mteb/amazon_massive_scenario
1273
+ name: MTEB MassiveScenarioClassification (am)
1274
+ config: am
1275
+ split: test
1276
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1277
+ metrics:
1278
+ - type: accuracy
1279
+ value: 9.045057162071284
1280
+ - type: f1
1281
+ value: 5.989702120693128
1282
+ - task:
1283
+ type: Classification
1284
+ dataset:
1285
+ type: mteb/amazon_massive_scenario
1286
+ name: MTEB MassiveScenarioClassification (ar)
1287
+ config: ar
1288
+ split: test
1289
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1290
+ metrics:
1291
+ - type: accuracy
1292
+ value: 14.91593813046402
1293
+ - type: f1
1294
+ value: 10.836622322362432
1295
+ - task:
1296
+ type: Classification
1297
+ dataset:
1298
+ type: mteb/amazon_massive_scenario
1299
+ name: MTEB MassiveScenarioClassification (az)
1300
+ config: az
1301
+ split: test
1302
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1303
+ metrics:
1304
+ - type: accuracy
1305
+ value: 31.9670477471419
1306
+ - type: f1
1307
+ value: 29.560759362481413
1308
+ - task:
1309
+ type: Classification
1310
+ dataset:
1311
+ type: mteb/amazon_massive_scenario
1312
+ name: MTEB MassiveScenarioClassification (bn)
1313
+ config: bn
1314
+ split: test
1315
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1316
+ metrics:
1317
+ - type: accuracy
1318
+ value: 9.14593140551446
1319
+ - type: f1
1320
+ value: 4.755013470168768
1321
+ - task:
1322
+ type: Classification
1323
+ dataset:
1324
+ type: mteb/amazon_massive_scenario
1325
+ name: MTEB MassiveScenarioClassification (cy)
1326
+ config: cy
1327
+ split: test
1328
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1329
+ metrics:
1330
+ - type: accuracy
1331
+ value: 37.451244115669134
1332
+ - type: f1
1333
+ value: 32.72149678893314
1334
+ - task:
1335
+ type: Classification
1336
+ dataset:
1337
+ type: mteb/amazon_massive_scenario
1338
+ name: MTEB MassiveScenarioClassification (da)
1339
+ config: da
1340
+ split: test
1341
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1342
+ metrics:
1343
+ - type: accuracy
1344
+ value: 42.65299260255547
1345
+ - type: f1
1346
+ value: 38.54490018628139
1347
+ - task:
1348
+ type: Classification
1349
+ dataset:
1350
+ type: mteb/amazon_massive_scenario
1351
+ name: MTEB MassiveScenarioClassification (de)
1352
+ config: de
1353
+ split: test
1354
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1355
+ metrics:
1356
+ - type: accuracy
1357
+ value: 38.325487558843314
1358
+ - type: f1
1359
+ value: 34.01573345578629
1360
+ - task:
1361
+ type: Classification
1362
+ dataset:
1363
+ type: mteb/amazon_massive_scenario
1364
+ name: MTEB MassiveScenarioClassification (el)
1365
+ config: el
1366
+ split: test
1367
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1368
+ metrics:
1369
+ - type: accuracy
1370
+ value: 24.451916610625418
1371
+ - type: f1
1372
+ value: 21.268458069782508
1373
+ - task:
1374
+ type: Classification
1375
+ dataset:
1376
+ type: mteb/amazon_massive_scenario
1377
+ name: MTEB MassiveScenarioClassification (en)
1378
+ config: en
1379
+ split: test
1380
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1381
+ metrics:
1382
+ - type: accuracy
1383
+ value: 63.42299932750504
1384
+ - type: f1
1385
+ value: 60.31829616506453
1386
+ - task:
1387
+ type: Classification
1388
+ dataset:
1389
+ type: mteb/amazon_massive_scenario
1390
+ name: MTEB MassiveScenarioClassification (es)
1391
+ config: es
1392
+ split: test
1393
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1394
+ metrics:
1395
+ - type: accuracy
1396
+ value: 37.730329522528585
1397
+ - type: f1
1398
+ value: 34.47682087542897
1399
+ - task:
1400
+ type: Classification
1401
+ dataset:
1402
+ type: mteb/amazon_massive_scenario
1403
+ name: MTEB MassiveScenarioClassification (fa)
1404
+ config: fa
1405
+ split: test
1406
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1407
+ metrics:
1408
+ - type: accuracy
1409
+ value: 11.842636180228647
1410
+ - type: f1
1411
+ value: 9.103915091369243
1412
+ - task:
1413
+ type: Classification
1414
+ dataset:
1415
+ type: mteb/amazon_massive_scenario
1416
+ name: MTEB MassiveScenarioClassification (fi)
1417
+ config: fi
1418
+ split: test
1419
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1420
+ metrics:
1421
+ - type: accuracy
1422
+ value: 34.48554135843981
1423
+ - type: f1
1424
+ value: 30.544187613857655
1425
+ - task:
1426
+ type: Classification
1427
+ dataset:
1428
+ type: mteb/amazon_massive_scenario
1429
+ name: MTEB MassiveScenarioClassification (fr)
1430
+ config: fr
1431
+ split: test
1432
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1433
+ metrics:
1434
+ - type: accuracy
1435
+ value: 40.917955615332886
1436
+ - type: f1
1437
+ value: 38.272473597242005
1438
+ - task:
1439
+ type: Classification
1440
+ dataset:
1441
+ type: mteb/amazon_massive_scenario
1442
+ name: MTEB MassiveScenarioClassification (he)
1443
+ config: he
1444
+ split: test
1445
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1446
+ metrics:
1447
+ - type: accuracy
1448
+ value: 7.642905178211164
1449
+ - type: f1
1450
+ value: 3.5932317435422974
1451
+ - task:
1452
+ type: Classification
1453
+ dataset:
1454
+ type: mteb/amazon_massive_scenario
1455
+ name: MTEB MassiveScenarioClassification (hi)
1456
+ config: hi
1457
+ split: test
1458
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1459
+ metrics:
1460
+ - type: accuracy
1461
+ value: 8.63819771351715
1462
+ - type: f1
1463
+ value: 5.367937513295658
1464
+ - task:
1465
+ type: Classification
1466
+ dataset:
1467
+ type: mteb/amazon_massive_scenario
1468
+ name: MTEB MassiveScenarioClassification (hu)
1469
+ config: hu
1470
+ split: test
1471
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1472
+ metrics:
1473
+ - type: accuracy
1474
+ value: 37.24949562878279
1475
+ - type: f1
1476
+ value: 33.56542557269889
1477
+ - task:
1478
+ type: Classification
1479
+ dataset:
1480
+ type: mteb/amazon_massive_scenario
1481
+ name: MTEB MassiveScenarioClassification (hy)
1482
+ config: hy
1483
+ split: test
1484
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1485
+ metrics:
1486
+ - type: accuracy
1487
+ value: 10.907868190988568
1488
+ - type: f1
1489
+ value: 6.164592664350547
1490
+ - task:
1491
+ type: Classification
1492
+ dataset:
1493
+ type: mteb/amazon_massive_scenario
1494
+ name: MTEB MassiveScenarioClassification (id)
1495
+ config: id
1496
+ split: test
1497
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1498
+ metrics:
1499
+ - type: accuracy
1500
+ value: 36.109616677874925
1501
+ - type: f1
1502
+ value: 33.60549268558145
1503
+ - task:
1504
+ type: Classification
1505
+ dataset:
1506
+ type: mteb/amazon_massive_scenario
1507
+ name: MTEB MassiveScenarioClassification (is)
1508
+ config: is
1509
+ split: test
1510
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1511
+ metrics:
1512
+ - type: accuracy
1513
+ value: 37.804303967720244
1514
+ - type: f1
1515
+ value: 33.702687457766196
1516
+ - task:
1517
+ type: Classification
1518
+ dataset:
1519
+ type: mteb/amazon_massive_scenario
1520
+ name: MTEB MassiveScenarioClassification (it)
1521
+ config: it
1522
+ split: test
1523
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1524
+ metrics:
1525
+ - type: accuracy
1526
+ value: 41.684599865501006
1527
+ - type: f1
1528
+ value: 37.827678631817356
1529
+ - task:
1530
+ type: Classification
1531
+ dataset:
1532
+ type: mteb/amazon_massive_scenario
1533
+ name: MTEB MassiveScenarioClassification (ja)
1534
+ config: ja
1535
+ split: test
1536
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1537
+ metrics:
1538
+ - type: accuracy
1539
+ value: 48.379287155346326
1540
+ - type: f1
1541
+ value: 47.42916530771652
1542
+ - task:
1543
+ type: Classification
1544
+ dataset:
1545
+ type: mteb/amazon_massive_scenario
1546
+ name: MTEB MassiveScenarioClassification (jv)
1547
+ config: jv
1548
+ split: test
1549
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1550
+ metrics:
1551
+ - type: accuracy
1552
+ value: 35.19502353732348
1553
+ - type: f1
1554
+ value: 32.346531581560086
1555
+ - task:
1556
+ type: Classification
1557
+ dataset:
1558
+ type: mteb/amazon_massive_scenario
1559
+ name: MTEB MassiveScenarioClassification (ka)
1560
+ config: ka
1561
+ split: test
1562
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1563
+ metrics:
1564
+ - type: accuracy
1565
+ value: 9.902488231338264
1566
+ - type: f1
1567
+ value: 6.949726319598101
1568
+ - task:
1569
+ type: Classification
1570
+ dataset:
1571
+ type: mteb/amazon_massive_scenario
1572
+ name: MTEB MassiveScenarioClassification (km)
1573
+ config: km
1574
+ split: test
1575
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1576
+ metrics:
1577
+ - type: accuracy
1578
+ value: 12.750504371217216
1579
+ - type: f1
1580
+ value: 6.484683676180122
1581
+ - task:
1582
+ type: Classification
1583
+ dataset:
1584
+ type: mteb/amazon_massive_scenario
1585
+ name: MTEB MassiveScenarioClassification (kn)
1586
+ config: kn
1587
+ split: test
1588
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1589
+ metrics:
1590
+ - type: accuracy
1591
+ value: 10.309347679892403
1592
+ - type: f1
1593
+ value: 6.303469804836742
1594
+ - task:
1595
+ type: Classification
1596
+ dataset:
1597
+ type: mteb/amazon_massive_scenario
1598
+ name: MTEB MassiveScenarioClassification (ko)
1599
+ config: ko
1600
+ split: test
1601
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1602
+ metrics:
1603
+ - type: accuracy
1604
+ value: 14.515803631472762
1605
+ - type: f1
1606
+ value: 11.448228509062176
1607
+ - task:
1608
+ type: Classification
1609
+ dataset:
1610
+ type: mteb/amazon_massive_scenario
1611
+ name: MTEB MassiveScenarioClassification (lv)
1612
+ config: lv
1613
+ split: test
1614
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1615
+ metrics:
1616
+ - type: accuracy
1617
+ value: 33.076664425016816
1618
+ - type: f1
1619
+ value: 29.62119483929902
1620
+ - task:
1621
+ type: Classification
1622
+ dataset:
1623
+ type: mteb/amazon_massive_scenario
1624
+ name: MTEB MassiveScenarioClassification (ml)
1625
+ config: ml
1626
+ split: test
1627
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1628
+ metrics:
1629
+ - type: accuracy
1630
+ value: 7.4411566913248155
1631
+ - type: f1
1632
+ value: 3.9500853520943777
1633
+ - task:
1634
+ type: Classification
1635
+ dataset:
1636
+ type: mteb/amazon_massive_scenario
1637
+ name: MTEB MassiveScenarioClassification (mn)
1638
+ config: mn
1639
+ split: test
1640
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1641
+ metrics:
1642
+ - type: accuracy
1643
+ value: 17.982515131136516
1644
+ - type: f1
1645
+ value: 16.21370873212602
1646
+ - task:
1647
+ type: Classification
1648
+ dataset:
1649
+ type: mteb/amazon_massive_scenario
1650
+ name: MTEB MassiveScenarioClassification (ms)
1651
+ config: ms
1652
+ split: test
1653
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1654
+ metrics:
1655
+ - type: accuracy
1656
+ value: 37.92871553463349
1657
+ - type: f1
1658
+ value: 33.45105376049966
1659
+ - task:
1660
+ type: Classification
1661
+ dataset:
1662
+ type: mteb/amazon_massive_scenario
1663
+ name: MTEB MassiveScenarioClassification (my)
1664
+ config: my
1665
+ split: test
1666
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1667
+ metrics:
1668
+ - type: accuracy
1669
+ value: 11.72831203765972
1670
+ - type: f1
1671
+ value: 8.44884960923806
1672
+ - task:
1673
+ type: Classification
1674
+ dataset:
1675
+ type: mteb/amazon_massive_scenario
1676
+ name: MTEB MassiveScenarioClassification (nb)
1677
+ config: nb
1678
+ split: test
1679
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1680
+ metrics:
1681
+ - type: accuracy
1682
+ value: 38.02286482851379
1683
+ - type: f1
1684
+ value: 34.67204151455546
1685
+ - task:
1686
+ type: Classification
1687
+ dataset:
1688
+ type: mteb/amazon_massive_scenario
1689
+ name: MTEB MassiveScenarioClassification (nl)
1690
+ config: nl
1691
+ split: test
1692
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1693
+ metrics:
1694
+ - type: accuracy
1695
+ value: 40.373234700739744
1696
+ - type: f1
1697
+ value: 35.65457711900268
1698
+ - task:
1699
+ type: Classification
1700
+ dataset:
1701
+ type: mteb/amazon_massive_scenario
1702
+ name: MTEB MassiveScenarioClassification (pl)
1703
+ config: pl
1704
+ split: test
1705
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1706
+ metrics:
1707
+ - type: accuracy
1708
+ value: 36.344989912575656
1709
+ - type: f1
1710
+ value: 32.79620374350878
1711
+ - task:
1712
+ type: Classification
1713
+ dataset:
1714
+ type: mteb/amazon_massive_scenario
1715
+ name: MTEB MassiveScenarioClassification (pt)
1716
+ config: pt
1717
+ split: test
1718
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1719
+ metrics:
1720
+ - type: accuracy
1721
+ value: 41.82918628110289
1722
+ - type: f1
1723
+ value: 38.67744252721392
1724
+ - task:
1725
+ type: Classification
1726
+ dataset:
1727
+ type: mteb/amazon_massive_scenario
1728
+ name: MTEB MassiveScenarioClassification (ro)
1729
+ config: ro
1730
+ split: test
1731
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1732
+ metrics:
1733
+ - type: accuracy
1734
+ value: 40.62542030934767
1735
+ - type: f1
1736
+ value: 36.98261635854706
1737
+ - task:
1738
+ type: Classification
1739
+ dataset:
1740
+ type: mteb/amazon_massive_scenario
1741
+ name: MTEB MassiveScenarioClassification (ru)
1742
+ config: ru
1743
+ split: test
1744
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1745
+ metrics:
1746
+ - type: accuracy
1747
+ value: 18.95763281775387
1748
+ - type: f1
1749
+ value: 16.30423107207311
1750
+ - task:
1751
+ type: Classification
1752
+ dataset:
1753
+ type: mteb/amazon_massive_scenario
1754
+ name: MTEB MassiveScenarioClassification (sl)
1755
+ config: sl
1756
+ split: test
1757
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1758
+ metrics:
1759
+ - type: accuracy
1760
+ value: 35.299260255548084
1761
+ - type: f1
1762
+ value: 31.765574086767216
1763
+ - task:
1764
+ type: Classification
1765
+ dataset:
1766
+ type: mteb/amazon_massive_scenario
1767
+ name: MTEB MassiveScenarioClassification (sq)
1768
+ config: sq
1769
+ split: test
1770
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1771
+ metrics:
1772
+ - type: accuracy
1773
+ value: 41.956960322797585
1774
+ - type: f1
1775
+ value: 38.574130779247525
1776
+ - task:
1777
+ type: Classification
1778
+ dataset:
1779
+ type: mteb/amazon_massive_scenario
1780
+ name: MTEB MassiveScenarioClassification (sv)
1781
+ config: sv
1782
+ split: test
1783
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1784
+ metrics:
1785
+ - type: accuracy
1786
+ value: 37.19233355749832
1787
+ - type: f1
1788
+ value: 33.81282301018017
1789
+ - task:
1790
+ type: Classification
1791
+ dataset:
1792
+ type: mteb/amazon_massive_scenario
1793
+ name: MTEB MassiveScenarioClassification (sw)
1794
+ config: sw
1795
+ split: test
1796
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1797
+ metrics:
1798
+ - type: accuracy
1799
+ value: 38.87693342299933
1800
+ - type: f1
1801
+ value: 36.374284150293924
1802
+ - task:
1803
+ type: Classification
1804
+ dataset:
1805
+ type: mteb/amazon_massive_scenario
1806
+ name: MTEB MassiveScenarioClassification (ta)
1807
+ config: ta
1808
+ split: test
1809
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1810
+ metrics:
1811
+ - type: accuracy
1812
+ value: 8.5137861466039
1813
+ - type: f1
1814
+ value: 3.77604514028691
1815
+ - task:
1816
+ type: Classification
1817
+ dataset:
1818
+ type: mteb/amazon_massive_scenario
1819
+ name: MTEB MassiveScenarioClassification (te)
1820
+ config: te
1821
+ split: test
1822
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1823
+ metrics:
1824
+ - type: accuracy
1825
+ value: 7.347007397444519
1826
+ - type: f1
1827
+ value: 4.316679614648472
1828
+ - task:
1829
+ type: Classification
1830
+ dataset:
1831
+ type: mteb/amazon_massive_scenario
1832
+ name: MTEB MassiveScenarioClassification (th)
1833
+ config: th
1834
+ split: test
1835
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1836
+ metrics:
1837
+ - type: accuracy
1838
+ value: 10.104236718224612
1839
+ - type: f1
1840
+ value: 7.587154404252399
1841
+ - task:
1842
+ type: Classification
1843
+ dataset:
1844
+ type: mteb/amazon_massive_scenario
1845
+ name: MTEB MassiveScenarioClassification (tl)
1846
+ config: tl
1847
+ split: test
1848
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1849
+ metrics:
1850
+ - type: accuracy
1851
+ value: 35.907868190988566
1852
+ - type: f1
1853
+ value: 32.42532534803655
1854
+ - task:
1855
+ type: Classification
1856
+ dataset:
1857
+ type: mteb/amazon_massive_scenario
1858
+ name: MTEB MassiveScenarioClassification (tr)
1859
+ config: tr
1860
+ split: test
1861
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1862
+ metrics:
1863
+ - type: accuracy
1864
+ value: 32.07800941492939
1865
+ - type: f1
1866
+ value: 31.072741162550983
1867
+ - task:
1868
+ type: Classification
1869
+ dataset:
1870
+ type: mteb/amazon_massive_scenario
1871
+ name: MTEB MassiveScenarioClassification (ur)
1872
+ config: ur
1873
+ split: test
1874
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1875
+ metrics:
1876
+ - type: accuracy
1877
+ value: 10.373234700739745
1878
+ - type: f1
1879
+ value: 7.124408430261137
1880
+ - task:
1881
+ type: Classification
1882
+ dataset:
1883
+ type: mteb/amazon_massive_scenario
1884
+ name: MTEB MassiveScenarioClassification (vi)
1885
+ config: vi
1886
+ split: test
1887
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1888
+ metrics:
1889
+ - type: accuracy
1890
+ value: 33.91055817081373
1891
+ - type: f1
1892
+ value: 31.82496122405504
1893
+ - task:
1894
+ type: Classification
1895
+ dataset:
1896
+ type: mteb/amazon_massive_scenario
1897
+ name: MTEB MassiveScenarioClassification (zh-CN)
1898
+ config: zh-CN
1899
+ split: test
1900
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1901
+ metrics:
1902
+ - type: accuracy
1903
+ value: 74.94283792871552
1904
+ - type: f1
1905
+ value: 74.29520816825985
1906
+ - task:
1907
+ type: Classification
1908
+ dataset:
1909
+ type: mteb/amazon_massive_scenario
1910
+ name: MTEB MassiveScenarioClassification (zh-TW)
1911
+ config: zh-TW
1912
+ split: test
1913
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1914
+ metrics:
1915
+ - type: accuracy
1916
+ value: 70.99529253530599
1917
+ - type: f1
1918
+ value: 70.48943927686703
1919
  - task:
1920
  type: Retrieval
1921
  dataset: