Update README.md
Browse files
README.md
CHANGED
@@ -8,9 +8,30 @@ datasets:
|
|
8 |
- totto
|
9 |
---
|
10 |
|
11 |
-
# BLOOM (0.56B) fine-tuned on
|
12 |
|
13 |
-
This model is a fine-tuned version of [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) on the **
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
|
15 |
|
16 |
## Usage
|
@@ -45,21 +66,10 @@ example = valid_dataset[1]
|
|
45 |
print(explain_hl_cells(example['linearized_table'])
|
46 |
```
|
47 |
|
48 |
-
### Evaluation results
|
49 |
-
|
50 |
-
| Metric | Value |
|
51 |
-
|:-------:|:-----:|
|
52 |
-
| rouge1 | 0.56 |
|
53 |
-
| rouge2 | 0.33 |
|
54 |
-
| rougeL | 0.48 |
|
55 |
-
| rougeLsum | 0.48 |
|
56 |
-
|
57 |
-
|
58 |
-
|
59 |
|
60 |
### Framework versions
|
61 |
|
62 |
- Transformers 4.21.2
|
63 |
- Pytorch 1.12.1+cu113
|
64 |
- Datasets 2.4.0
|
65 |
-
- Tokenizers 0.12.1
|
|
|
8 |
- totto
|
9 |
---
|
10 |
|
11 |
+
# BLOOM (0.56B) fine-tuned on ToTTo for Table-to-text
|
12 |
|
13 |
+
This model is a fine-tuned version of [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) on the **ToTTo** [dataset](https://huggingface.co/datasets/totto).
|
14 |
+
|
15 |
+
|
16 |
+
## The model
|
17 |
+
|
18 |
+
It is a 560M params version of [**BLOOM**](https://bigscience.huggingface.co/blog/bloom)
|
19 |
+
|
20 |
+
## The dataset
|
21 |
+
|
22 |
+
**ToTTo** is an open-domain English table-to-text dataset with over 120,000 training examples that proposes a controlled generation task: given a Wikipedia table and a set of highlighted table cells, produce a one-sentence description.
|
23 |
+
|
24 |
+
During the dataset creation process, tables from English Wikipedia are matched with (noisy) descriptions. Each table cell mentioned in the description is highlighted and the descriptions are iteratively cleaned and corrected to faithfully reflect the content of the highlighted cells.
|
25 |
+
|
26 |
+
|
27 |
+
### Evaluation results
|
28 |
+
|
29 |
+
| Metric | Value |
|
30 |
+
|:-------:|:-----:|
|
31 |
+
| rouge1 | 0.56 |
|
32 |
+
| rouge2 | 0.33 |
|
33 |
+
| rougeL | 0.48 |
|
34 |
+
| rougeLsum | 0.48 |
|
35 |
|
36 |
|
37 |
## Usage
|
|
|
66 |
print(explain_hl_cells(example['linearized_table'])
|
67 |
```
|
68 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
69 |
|
70 |
### Framework versions
|
71 |
|
72 |
- Transformers 4.21.2
|
73 |
- Pytorch 1.12.1+cu113
|
74 |
- Datasets 2.4.0
|
75 |
+
- Tokenizers 0.12.1
|