.svg)
What is Summarization Metric?
The Summarization Metric evaluates the quality of summaries by assessing their factual alignment with the original text and their inclusion of important information. This process combines scores of factual accuracy and comprehensiveness.
Effective summaries should:
- Be factually aligned with the original text
- Include essential information from the original text
Using advanced techniques, we can calculate both factual alignment and inclusion scores to determine a final summarization score. The minimum of these intermediary scores is considered as the final score.
