Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ datasets:
|
|
| 7 |
- rams
|
| 8 |
- tacred
|
| 9 |
- fewrel
|
| 10 |
-
-
|
| 11 |
language:
|
| 12 |
- en
|
| 13 |
metrics:
|
|
@@ -34,6 +34,27 @@ We introduce <b>ADELIE</b> (<b>A</b>ligning large language mo<b>DEL</b>s on <b>I
|
|
| 34 |
</p>
|
| 35 |
- 🐧 Github: [THU/ADELIE](https://github.com/THU-KEG/ADELIE/tree/main)
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
### Model Description
|
| 38 |
|
| 39 |
<!-- Provide a longer summary of what this model is. -->
|
|
@@ -44,5 +65,5 @@ We introduce <b>ADELIE</b> (<b>A</b>ligning large language mo<b>DEL</b>s on <b>I
|
|
| 44 |
- **Model type:** Text Generation
|
| 45 |
- **Language(s) (NLP):** English
|
| 46 |
- **License:** LLaMA2 License for the base model.
|
| 47 |
-
- **Finetuned from model [optional]:**
|
| 48 |
|
|
|
|
| 7 |
- rams
|
| 8 |
- tacred
|
| 9 |
- fewrel
|
| 10 |
+
- maven
|
| 11 |
language:
|
| 12 |
- en
|
| 13 |
metrics:
|
|
|
|
| 34 |
</p>
|
| 35 |
- 🐧 Github: [THU/ADELIE](https://github.com/THU-KEG/ADELIE/tree/main)
|
| 36 |
|
| 37 |
+
|
| 38 |
+
# Model Performance
|
| 39 |
+
|
| 40 |
+
The table below presents the average F1 scores (%) of the ADELIE model across closed IE, open IE, and on-demand IE tasks, as well as its overall performance (%) on general benchmarks. For dataset details, please refer to the paper.
|
| 41 |
+
|
| 42 |
+
| Model | Closed IE | Open IE | On-demand IE | General Average Score |
|
| 43 |
+
|-----------------|-----------|---------|--------------|-----------------------|
|
| 44 |
+
| Llama2 7B | 5.7 | 5.6 | 22.4 | 52.2 |
|
| 45 |
+
| ADELIE-SFT | 42.6 | 46.9 | 60.4 | 53.5 |
|
| 46 |
+
| ADELIE-DPO | **42.7** | **47.6** | **60.5** | **53.8** |
|
| 47 |
+
|-----------------|-----------|---------|--------------|-----------------------|
|
| 48 |
+
| Llama3.2 3B | 19.1 | 18.5 | 20.8 | 55.5 |
|
| 49 |
+
| ADELIE-SFT-3B | **41.8** | 47.6 | **60.8** | **55.6** |
|
| 50 |
+
| ADELIE-DPO-3B | 39.2 | **47.8** | 60.7 | **55.6** |
|
| 51 |
+
|-----------------|-----------|---------|--------------|-----------------------|
|
| 52 |
+
| Qwen2.5 1.5B | 16.5 | 14.2 | 20.5 | 54.6 |
|
| 53 |
+
| ADELIE-SFT-1.5B | 37.7 | 44.6 | 58.9 | 55.0 |
|
| 54 |
+
| ADELIE-DPO-1.5B | **38.5** | **45.6** | **59.2** | **55.1** |
|
| 55 |
+
|
| 56 |
+
|
| 57 |
+
|
| 58 |
### Model Description
|
| 59 |
|
| 60 |
<!-- Provide a longer summary of what this model is. -->
|
|
|
|
| 65 |
- **Model type:** Text Generation
|
| 66 |
- **Language(s) (NLP):** English
|
| 67 |
- **License:** LLaMA2 License for the base model.
|
| 68 |
+
- **Finetuned from model [optional]:** LLaMA2-7B
|
| 69 |
|