Commit
路
2a0a3a4
1
Parent(s):
648c7e2
Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,6 @@
|
|
1 |
---
|
2 |
datasets:
|
3 |
-
-
|
4 |
-
- squad-v1
|
5 |
|
6 |
language:
|
7 |
- English
|
@@ -11,9 +10,48 @@ thumbnail:
|
|
11 |
tags:
|
12 |
- roberta
|
13 |
- roberta-base
|
14 |
-
-
|
15 |
-
-
|
|
|
|
|
16 |
|
17 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
datasets:
|
3 |
+
- SQuAD
|
|
|
4 |
|
5 |
language:
|
6 |
- English
|
|
|
10 |
tags:
|
11 |
- roberta
|
12 |
- roberta-base
|
13 |
+
- question-answering
|
14 |
+
- qa
|
15 |
+
|
16 |
+
license: cc-by-4.0
|
17 |
|
18 |
---
|
19 |
+
# roberta-base + SQuAD QA
|
20 |
+
|
21 |
+
Objective:
|
22 |
+
This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
|
23 |
+
|
24 |
+
```
|
25 |
+
model_name = "thatdramebaazguy/roberta-base-squad"
|
26 |
+
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")
|
27 |
+
```
|
28 |
+
|
29 |
+
## Overview
|
30 |
+
**Language model:** roberta-base
|
31 |
+
**Language:** English
|
32 |
+
**Downstream-task:** QA
|
33 |
+
**Training data:** SQuADv1
|
34 |
+
**Eval data:** SQuAD
|
35 |
+
**Infrastructure**: 2x Tesla v100
|
36 |
+
**Code:** See [example](https://github.com/adityaarunsinghal/Domain-Adaptation/blob/master/scripts/shell_scripts/train_movieR_just_squadv1.sh)
|
37 |
+
|
38 |
+
## Hyperparameters
|
39 |
+
```
|
40 |
+
Num examples = 88567
|
41 |
+
Num Epochs = 10
|
42 |
+
Instantaneous batch size per device = 32
|
43 |
+
Total train batch size (w. parallel, distributed & accumulation) = 64
|
44 |
|
45 |
+
```
|
46 |
+
## Performance
|
47 |
+
|
48 |
+
### Eval on MoviesQA
|
49 |
+
- epoch = 10.0
|
50 |
+
- eval_samples = 10790
|
51 |
+
- exact_match = 83.6045
|
52 |
+
- f1 = 91.1709
|
53 |
+
|
54 |
+
Github Repo:
|
55 |
+
- [Domain-Adaptation Project](https://github.com/adityaarunsinghal/Domain-Adaptation/)
|
56 |
+
|
57 |
+
---
|