|
|
 |
|
Lundi 28 Mars
| Heure: |
13:00 - 14:30 |
| Lieu: |
Salle B107, bâtiment B, Université de Villetaneuse |
| Résumé: |
Abstractive Summarization Evaluation: Overview and Reflections |
| Description: |
Yanzhu Guo The topic of summarization evaluation has recently received a surge of attention due to the rapid development of abstractive summarization systems. We conduct a survey of the state-of-the-art evaluation metrics along with relevant datasets and visualization systems. We also touch upon the statistical deficiencies in current meta-evaluation approaches such as the problematic choice of scoring range, the lack of paired evaluation as well as the prevalence of underpowered tests. Finally, we show experimental results proving the unreliability of human-annotated ground-truth reference summaries and thus argue for reference-free metrics as a more promising future direction. |
|
|
