Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsing (2024.lrec-main)
Copied to clipboard
| Challenge: | Discourse Representation Structure (DRS) parsers are constrained when trained exclusively on monolingual data. |
| Approach: | They propose a cross-lingual training strategy that leverages cross-linguistic training data to train models in multiple languages. |
| Outcome: | The proposed method improves clause and graph parsing in English, German, Italian and Dutch. |
Similar Papers
Pre-Trained Language-Meaning Models for Multilingual Parsing and Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have been used for tasks in computational semantics but meaning representations are not included in PLMs. |
| Approach: | They propose to include meaning representations besides natural language texts in the same model . they propose to use DRSs to improve performance of non-English tasks . |
| Outcome: | The proposed approach achieves the best performance on multilingual parsing and DRS-to-text generation tasks. |
Discourse Representation Structure Parsing (P18-1)
Copied to clipboard
| Challenge: | Existing semantic parsers are data-driven using annotated examples consisting of utterances and their meaning representations. |
| Approach: | They propose a method which transforms Discourse Representation Structures (DRSs) to trees and develop a structure-aware model which decomposes the decoding process into three stages. |
| Outcome: | The proposed model outperforms baseline models on the Groningen Meaning Bank (GMB) by a wide margin. |
Discourse Representation Parsing for Sentences and Documents (P19-1)
Copied to clipboard
| Challenge: | Experimental results show that our model outperforms competitive baselines by a wide margin. |
| Approach: | They propose a neural model which parses discourse structures of arbitrary length and granularity. |
| Outcome: | The proposed model outperforms baseline models on sentence- and document-level benchmarks. |
Mixed-Lingual Pre-training for Cross-lingual Summarization (2020.aacl-main)
Copied to clipboard
| Challenge: | Cross-lingual summarization (CLS) aims at producing a summary in the target language for an article in the source language. |
| Approach: | They propose a mixed-lingual pre-training scheme that leverages both cross-lingual tasks such as translation and monolingual tasks like masked language models. |
| Outcome: | The proposed model improves on the translation and masked language models with no task-specific components and saves memory. |
Frustratingly Simple but Surprisingly Strong: Using Language-Independent Features for Zero-shot Cross-lingual Semantic Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing training data is limited for languages other than English, so is the performance of the developed parsers. |
| Approach: | They propose to apply a pre-trained multilingual model to Italian, German and Dutch parsers where only a small number of manually annotated parses are available. |
| Outcome: | The proposed model improves on six parsers in English and Italian, German and Dutch, with the addition of universal dependency relations and universal POS tags as model-agnostic features. |
Multilingual Neural RST Discourse Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies on text discourse parsing for English are limited due to the lack of annotated data. |
| Approach: | They propose to use multilingual vector representations and segment-level translation to establish a neural, cross-lingual discourse parser. |
| Outcome: | The proposed model achieves state-of-the-art on cross-lingual, document-level discourse parsing on all sub-tasks. |
Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT (2020.emnlp-main)
Copied to clipboard
| Challenge: | a new method of analysis based on semantic tags demonstrates that character-level representations improve performance across a subset of selected semantic phenomena. |
| Approach: | They combine character-level and contextual language model representations to improve performance on Discourse Representation Structure parsing. |
| Outcome: | The proposed model improves performance on a subset of selected semantic phenomena. |
Text Generation from Discourse Representation Structures (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing models to generate text from formal meaning representations based on Discourse Representation Structures (DRSs) . |
| Approach: | They propose neural models to generate text from formal meaning representations based on Discourse Representation Structures (DRSs). |
| Outcome: | The proposed model achieves competitive performance on the GMB benchmark against several strong baselines. |
Input Representations for Parsing Discourse Representation Structures: Comparing English with Chinese (2021.acl-short)
Copied to clipboard
| Challenge: | Neural semantic parsers have obtained acceptable results in parsing DRSs . previous studies have focused on parse of DRS in English, but have focused only on a few languages . |
| Approach: | They propose to use character sequences as input to map meaning representations to string format. |
| Outcome: | The proposed models learn the meaning of a series of semantic phenomena by taking sentences as input and outputting the corresponding DRSs, without the aid of any extra linguistic information. |
Emerging Cross-lingual Structure in Pretrained Language Models (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work has shown that multilingual pretraining works, but is unable to measure these effects. |
| Approach: | They propose to use multilingual masked language modeling to train a model on concatenated text from multiple languages to find universal latent symmetries in embedding spaces. |
| Outcome: | The proposed models can be trained on concatenated text from multiple languages without shared vocabulary or domain similarity. |