README.md

metadata

language: ar
license: apache-2.0
datasets:
  - AQMAR
  - ANERcorp
thumbnail: >-
  https://raw.githubusercontent.com/JetRunner/BERT-of-Theseus/master/bert-of-theseus.png
embeddings:
  - GloVe
  - Flair
tags:
  - Text Classification
metrics:
  - f1

Arabic NER Model using Flair Embeddings

Training was conducted over 94 epochs, using a linear decaying learning rate of 2e-05, starting from 0.225 and a batch size of 32 with GloVe and Flair forward and backward embeddings.

Results:

• F1-score (micro) 0.8666
• F1-score (macro) 0.8488

	tp	fp	fn	precision	recall	class-F1
LOC	539	51	68	0.9136	0.8880	0.9006
MISC	408	57	89	0.8774	0.8209	0.8482
ORG	167	43	64	0.7952	0.7229	0.7574
PER	501	65	60	0.8852	0.8930	0.8891

---

2020-10-27 12:05:47,801 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('glove')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(7125, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=7125, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(7125, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=7125, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4196, out_features=4196, bias=True)
  (rnn): LSTM(4196, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=15, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None