Papers by Whanhee Cho
Bidirectional Masked Self-attention and N-gram Span Attention for Constituency Parsing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attention mechanisms for constituency parsing lack directional information needed to form sentence spans. |
| Approach: | They propose a bidirectional masked and N-gram span Attention model which captures the explicit dependencies between each word and enhances the representation of the output span vectors. |
| Outcome: | The proposed model achieves state-of-the-art performance on the Penn Treebank and Chinese Penn TreeBank datasets with F1 scores of 96.47 and 94.15 respectively. |