Improve Discourse Dependency Parsing with Contextualized Representations (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies show that discourse dependency analysis is easier when describing text units in a context-dependent way. |
| Approach: | They propose to use transformers to encode contextualized representations of units of different levels to capture information needed for discourse dependency analysis. |
| Outcome: | The proposed model outperforms traditional direct classification methods on English and Chinese datasets. |
Similar Papers
Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT (2020.emnlp-main)
Copied to clipboard
| Challenge: | a new method of analysis based on semantic tags demonstrates that character-level representations improve performance across a subset of selected semantic phenomena. |
| Approach: | They combine character-level and contextual language model representations to improve performance on Discourse Representation Structure parsing. |
| Outcome: | The proposed model improves performance on a subset of selected semantic phenomena. |
Label-Enhanced Hierarchical Contextualized Representation for Sequential Metaphor Identification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent approaches to identify metaphors ignore extra information from data, such as contextual information and broader discourse information. |
| Approach: | They propose a model augmented with hierarchical contextualized representation to extract more information from both sentence-level and discourse-level. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two tasks using a VUA dataset. |
Improving the Transformer Translation Model with Document-Level Context (D18-1)
Copied to clipboard
| Challenge: | Existing models for document-level context translation ignore documentlevel context. |
| Approach: | They propose a document-level context encoder to represent document- level context and integrate it into the Transformer model. |
| Outcome: | Experiments on NIST Chinese-English and IWSLT French-English datasets show that the proposed translation model outperforms the Transformer model significantly. |
Top-down Discourse Parsing via Sequence Labelling (2021.eacl-main)
Copied to clipboard
| Challenge: | Discourse analysis is a systematic way to understand how texts are segmented hierarchically into discourse units. |
| Approach: | They propose a top-down approach to discourse parsing that is conceptually simpler than its predecessors. |
| Outcome: | The proposed model eliminates the decoder and reduces the search space for splitting points. |
Picking BERT’s Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis (2020.coling-main)
Copied to clipboard
| Challenge: | Contextualized word embeddings can incorporate contextual information, whereas other embeddables cannot. |
| Approach: | They propose an approach to address this question using Representational Similarity Analysis (RSA) they investigate whether verb embeddings encode verb’s subject, pronoun embedds antecedent and full-sentence representations encode sentence’s head word . |
| Outcome: | The proposed approach can adjudicate between hypotheses about which aspects of context are encoded in representations of language. |
Discourse Representation Parsing for Sentences and Documents (P19-1)
Copied to clipboard
| Challenge: | Experimental results show that our model outperforms competitive baselines by a wide margin. |
| Approach: | They propose a neural model which parses discourse structures of arbitrary length and granularity. |
| Outcome: | The proposed model outperforms baseline models on sentence- and document-level benchmarks. |
Pretrained Language Models for Sequential Sentence Classification (D19-1)
Copied to clipboard
| Challenge: | Recent successful models for document-level understanding have used hierarchical encoding and CRFs to capture dependencies between subsequent labels. |
| Approach: | They propose a pretrained language model that captures contextual dependencies without hierarchical encoding nor a CRF. |
| Outcome: | The proposed model captures contextual dependencies without hierarchical encoding nor a CRF on four datasets, including a new dataset of structured scientific abstracts. |
Diverse Pretrained Context Encodings Improve Document Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for sentence-level sequence-to-sequence translations do not use extra-sentential information. |
| Approach: | They propose a sentence-level sequence-to-sequence transformer with multiple pre-trained context signals. |
| Outcome: | The proposed model outperforms existing models on Chinese-English and English-German tasks. |
Hierarchical Bracketing Encodings Work for Dependency Graphs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Sequence labeling (SL) is a simple yet effective paradigm for a wide range of natural language problems. |
| Approach: | They propose a new bracketing approach for dependency graph parsing that encodes graphs as sequences and n tagging actions. |
| Outcome: | The proposed approach significantly reduces label space while preserving structural information. |
Enhancing Discourse Dependency Parsing with Sentence Dependency Parsing: A Unified Generative Method Based on Code Representation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing annotation resources for Discourse Dependency Parsing tasks are limited due to their complexity and annotation schema differences. |
| Approach: | They propose a code-based unified dependency parsing method that uses code to model dependency parses under different annotation schemas. |
| Outcome: | The proposed method improves on two Chinese DDP tasks. |