NorahAlshahrani commited on
Commit
55cb8c8
1 Parent(s): e92bcd8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -9
README.md CHANGED
@@ -20,24 +20,29 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  # BERThard
22
 
23
- This model is a fine-tuned version of [aubmindlab/bert-base-arabertv2](https://huggingface.co/aubmindlab/bert-base-arabertv2) on an unknown dataset.
24
  It achieves the following results on the evaluation set:
25
  - Loss: 0.4141
26
  - Accuracy: 0.8311
27
 
28
  ## Model description
29
 
30
- More information needed
 
 
 
 
 
 
 
 
 
 
 
31
 
32
- ## Intended uses & limitations
33
-
34
- More information needed
35
-
36
- ## Training and evaluation data
37
-
38
- More information needed
39
 
40
  ## Training procedure
 
41
 
42
  ### Training hyperparameters
43
 
 
20
 
21
  # BERThard
22
 
23
+ This model is a fine-tuned version of [aubmindlab/bert-base-arabertv2](https://huggingface.co/aubmindlab/bert-base-arabertv2) on Hotel Arabic Reviews Dataset (HARD) dataset.
24
  It achieves the following results on the evaluation set:
25
  - Loss: 0.4141
26
  - Accuracy: 0.8311
27
 
28
  ## Model description
29
 
30
+ ```bash
31
+ @inproceedings{alshahrani-etal-2024-bert-synonym-attack,
32
+ title = "{Arabic Synonym BERT-based Adversarial Examples for Text Classification}",
33
+ author = "Alshahrani, Norah and Alshahrani, Saied and Wali, Esma and Matthews, Jeanna ",
34
+ booktitle = "Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop",
35
+ month = March,
36
+ year = "2024",
37
+ address = "Malta",
38
+ publisher = "Association for Computational Linguistics",
39
+ abstract = "Text classification systems have been proven vulnerable to adversarial text examples, modified versions of the original text examples that are often unnoticed by human eyes, yet can force text classification models to alter their classification. Often, research works quantifying the impact of adversarial text attacks have been applied only to models trained in English. In this paper, we introduce the first word-level study of adversarial attacks in Arabic. Specifically, we use a synonym (word-level) attack using a Masked Language Modeling (MLM) task with a BERT model in a black-box setting to assess the robustness of the state-of-the-art text classification models to adversarial attacks in Arabic. To evaluate the grammatical and semantic similarities of the newly produced adversarial examples using our synonym BERT-based attack, we invite four human evaluators to assess and compare the produced adversarial examples with their original examples. We also study the transferability of these newly produced Arabic adversarial examples to various models and investigate the effectiveness of defense mechanisms against these adversarial examples on the BERT models. We find that fine-tuned BERT models were more susceptible to our synonym attacks than the other Deep Neural Networks (DNN) models like WordCNN and WordLSTM we trained. We also find that fine-tuned BERT models were more susceptible to transferred attacks. We, lastly, find that fine-tuned BERT models successfully regain at least 2% in accuracy after applying adversarial training as an initial defense mechanism.",
40
+ }
41
+ ```
42
 
 
 
 
 
 
 
 
43
 
44
  ## Training procedure
45
+ We have trained this model using the Paperspace GPU-Cloud service. We used a machine with 8 CPUs, 45GB RAM, and A6000 GPU with 48GB RAM.
46
 
47
  ### Training hyperparameters
48