Papers by Ramya Akula
Sentence Pair Embeddings Based Evaluation Metric for Abstractive and Extractive Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics, such as ROUGE and BLEU, rely on exact word matching and fail to capture semantic similarity. |
| Approach: | They propose to use contextualized word or sentence embeddings to capture semantic similarity between sentences to evaluate text summarization methods. |
| Outcome: | The proposed evaluation metric shows that it performs faster than the current state-of-the-art on the SummEval dataset. |