--- library_name: transformers tags: [] --- # Model Card for Model ID ## Model Details - eval_loss : 0.03441721946001053, - eval_accuracy: 0.991941391941392, - eval_f1-score: 0.9919413227394245, - epoch : 2.0 ``` Classification Report: precision recall f1-score support 0 1.00 0.99 0.99 1365 1 0.99 1.00 0.99 1365 accuracy 0.99 2730 macro avg 0.99 0.99 0.99 2730 weighted avg 0.99 0.99 0.99 2730 ```` #### Clean Function - I used it when I tested the model and it gave good results when cleaning. ```python import re import html def clean_text(text): # Remove HTML tags clean = re.compile('<.*?>') text = re.sub(clean, '', text) # Replace HTML entities with their corresponding characters text = html.unescape(text) # Remove extra whitespace and normalize spaces text = re.sub(r'\s+', ' ', text).strip() text = re.sub(r'[^a-zA-Z0-9\s]', '', text) return re.sub("\s\s+", " ", text) ```