Papers with richness
Evaluating Diversity of Multiword Expressions in Annotated Text (2022.coling-1)
Copied to clipboard
| Challenge: | Using the extensive formalization and measures of diversity developed in ecology, we evaluate the variety and balance of multiword expression annotation produced by automatic annotation systems. |
| Approach: | They propose to use the formalization and measures of diversity developed in ecology to evaluate the variety and balance of multiword expression annotation produced by automatic annotation systems. |
| Outcome: | The proposed measures validate or invalidate their pertinence for multiword expressions in annotated texts. |
Diverse dialogue generation with context dependent dynamic loss function (2020.coling-main)
Copied to clipboard
| Challenge: | Dialogue systems using deep learning have achieved generation of fluent response sentences to user utterances, but they tend to produce responses that are not diverse and less context-dependent. |
| Approach: | They propose an Inverse N-gram loss function which incorporates contextual fluency and diversity at the same time by a simple formula. |
| Outcome: | The proposed loss function outperforms baseline models in automatic evaluations such as DIST-N and ROUGE and achieves higher scores on human evaluations of coherence and richness. |