Ask a Question

Prefer a chat interface with context about you and your work?

Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary

Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary

Abstract A desirable property of a reference-based evaluation metric that measures the content quality of a summary is that it should estimate how much information that summary has in common with a reference. Traditional text overlap based metrics such as ROUGE fail to achieve this because they are limited to …