twitter-roberta-base-emotion-multilabel-latest

This model is a fine-tuned version of cardiffnlp/twitter-roberta-base-2022-154m on the SemEval 2018 - Task 1 Affect in Tweets (subtask: E-c / multilabel classification).

Performance

Following metrics are achieved on the test split:

• F1 (micro): 0.7169
• F1 (macro): 0.5464
• Jaccard Index (samples): 0.5970:

Usage

1. tweetnlp

Install tweetnlp via pip.

pip install tweetnlp

Load the model in python.

import tweetnlp

model = tweetnlp.load_model('topic_classification', model_name='cardiffnlp/twitter-roberta-base-emotion-multilabel-latest')

model.predict("I bet everything will work out in the end :)")

>> {'label': ['joy', 'optimism']}

2. pipeline

pip install -U tensorflow==2.10

from transformers import pipeline

pipe = pipeline("text-classification", model="cardiffnlp/twitter-roberta-base-emotion-multilabel-latest", return_all_scores=True)

pipe("I bet everything will work out in the end :)")

>> [[{'label': 'anger', 'score': 0.018903767690062523},
  {'label': 'anticipation', 'score': 0.28172484040260315},
  {'label': 'disgust', 'score': 0.011607927270233631},
  {'label': 'fear', 'score': 0.036411102861166},
  {'label': 'joy', 'score': 0.8812029361724854},
  {'label': 'love', 'score': 0.09591569006443024},
  {'label': 'optimism', 'score': 0.9810988306999207},
  {'label': 'pessimism', 'score': 0.016823478043079376},
  {'label': 'sadness', 'score': 0.01889917254447937},
  {'label': 'surprise', 'score': 0.02702752873301506},
  {'label': 'trust', 'score': 0.4155798852443695}]]

Reference

@inproceedings{camacho-collados-etal-2022-tweetnlp,
    title={{T}weet{NLP}: {C}utting-{E}dge {N}atural {L}anguage {P}rocessing for {S}ocial {M}edia},
    author={Camacho-Collados, Jose and Rezaee, Kiamehr and Riahi, Talayeh and Ushio, Asahi and Loureiro, Daniel and Antypas, Dimosthenis and Boisson, Joanne and Espinosa-Anke, Luis and Liu, Fangyu and Mart{\'\i}nez-C{\'a}mara, Eugenio and others},
    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations",
    month = nov,
    year = "2022",
    address = "Abu Dhabi, U.A.E.",
    publisher = "Association for Computational Linguistics",
}