What is the reference summary of a new summary created by the system for Rouge to compare with.
Answers
Explanation:
ROUGE stands for Recall-Oriented Understudy for Gisting Evaluation. It is essentially a set of metrics for evaluating automatic summarization of texts as well as machine translations.
It works by comparing an automatically produced summary or translation against a set of reference summaries (typically human-produced). Let’s say that we have the following system and reference summaries:
System Summary (what the machine produced):
the cat was found under the bed
Reference Summary (gold standard — usually by humans):
the cat was under the bed
If we consider just the individual words, the number of overlapping words between the system summary and reference summary is 6. This, however, does not tell you much as a metric. To get a good quantitative value, we can actually compute the precision and recall using the overlap.
the system summary is recovering or capturing. If we are just considering the individual words, it can be computed as:
no.of overlapping words/total no.in reference summary.
how much of the system summary was in fact relevant or needed? Precision is measured as:
no.of overlapping words/total no.in system summary.
hope the answer is helpful
kindly mark me as a brainliest