Can we obtain significant success in RST discourse parsing by using Large Language Models? (2024.eacl-long)
Copied to clipboard
| Challenge: | Experimental results show that LLMs with tens of billion parameters can perform discourse parsing tasks. |
| Approach: | They employ Llama 2 and fine-tune it with QLoRA to achieve similar results . they show that LLMs with tens of billion parameters can perform a wide range of NLP tasks . |
| Outcome: | The proposed model performs better than existing models on three benchmark datasets. |
Similar Papers
Unleashing the Power of Neural Discourse Parsers - A Context and Structure Aware Approach Using Large Scale Pretraining (2020.coling-main)
Copied to clipboard
| Challenge: | Discourse parsing is an important upstream task within the area of Natural Language Processing (NLP) . |
| Approach: | They propose a discourse parser that incorporates recent contextual language models to improve the performance of RST-based discourse parses. |
| Outcome: | The proposed parser outperforms existing models on two key RST datasets and on large-scale "silver-standard" discourse treebank MEGA-DT. |
A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing discourse parsing methods need a strong baseline for reporting reliable experimental results. |
| Approach: | They integrate existing parsing strategies with transformer-based pre-trained language models to provide a strong baseline for reporting reliable experimental results. |
| Outcome: | The proposed model outperforms the current best model using DeBERTa. |
Enhancing Discourse Parsing for Local Structures from Social Media with LLM-Generated Data (2025.coling-main)
Copied to clipboard
| Challenge: | Existing discourse parsers do not generalize well across genres and text types. |
| Approach: | They propose to integrate large language models into RST discourse parsers to improve parser performance in a social media context. |
| Outcome: | The proposed model improves parser performance in a social media context without pre-identified discourse units. |
Large Language Models Are No Longer Shallow Parsers (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have reshaped the field of natural language processing (NLP) however, fundamental NLP tasks that involve linguistic analysis still play essential roles in the field. |
| Approach: | They propose to use constituency parsing to improve performance of LLMs on deep syntactic parse trees to prompt LLM chunking, filter out low-quality chunks and add remaining chunks to prompts to instruct LLM for parser. |
| Outcome: | The proposed approach improves LLMs' performance on constituency parsing on English and Chinese benchmark datasets. |
Are LLMs Good Annotators for Discourse-level Event Relation Extraction? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated proficiency in a wide array of natural language processing tasks, but their effectiveness over discourse-level event relation extraction tasks remains unexplored. |
| Approach: | They evaluate LLMs' ability to address discourse-level event relation extraction tasks using an open-source model and a commercial model. |
| Outcome: | The proposed model performs poorly on discourse-level event relation extraction tasks. |
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation (2025.findings-acl)
Copied to clipboard
Yingfeng Luo, Tong Zheng, Yongyu Mu, Bei Li, Qinghong Zhang, Yongqi Gao, Ziqiang Xu, Peinan Feng, Xiaoqian Liu, Tong Xiao, JingBo Zhu
| Challenge: | Recent advances in machine translation have focused on a single pre-trained decoder . encoder-decoder architectures have received relatively little attention in NMT . |
| Approach: | They propose a method that leverages LLMs as MT encoders and pairs them with lightweight decoders to develop universal translation models. |
| Outcome: | The proposed method matches or surpasses baselines in terms of translation quality but achieves 75% reduction in memory footprint of the KV cache. |
RST Discourse Parsing with Second-Stage EDU-Level Pre-training (2022.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models (PLMs) are based on sentence-level pre-training, which is different from the basic processing unit, i.e. element discourse unit (EDU). |
| Approach: | They propose a second-stage EDU-level pre-training approach to learn effective EDU representations continually based on well pre-trained language models. |
| Outcome: | The proposed method improves F1 score by 2.1 points on a benckmark dataset. |
Discourse Representation Parsing for Sentences and Documents (P19-1)
Copied to clipboard
| Challenge: | Experimental results show that our model outperforms competitive baselines by a wide margin. |
| Approach: | They propose a neural model which parses discourse structures of arbitrary length and granularity. |
| Outcome: | The proposed model outperforms baseline models on sentence- and document-level benchmarks. |
Top-down Discourse Parsing via Sequence Labelling (2021.eacl-main)
Copied to clipboard
| Challenge: | Discourse analysis is a systematic way to understand how texts are segmented hierarchically into discourse units. |
| Approach: | They propose a top-down approach to discourse parsing that is conceptually simpler than its predecessors. |
| Outcome: | The proposed model eliminates the decoder and reduces the search space for splitting points. |
Llamipa: An Incremental Discourse Parser (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Discourse parsing is a task of predicting relationships between utterances and their semantic content . lack of surface cues in discourse graphs forces parsers to rely on deep, semantic information . a large language model (LLM) can significantly improve discourse parser performance . |
| Approach: | They propose a large language model (LLM) that leverages discourse context to parse a discourse . this model provides local, context-sensitive representations of discourse units . |
| Outcome: | The proposed model can provide local, context-sensitive representations of discourse units . it can process discourse data incrementally, which is essential for later use of discourse information . |