Challenge: Existing discourse parsers do not generalize well across genres and text types.
Approach: They propose to integrate large language models into RST discourse parsers to improve parser performance in a social media context.
Outcome: The proposed model improves parser performance in a social media context without pre-identified discourse units.

Similar Papers

Unleashing the Power of Neural Discourse Parsers - A Context and Structure Aware Approach Using Large Scale Pretraining (2020.coling-main)

Copied to clipboard

Challenge: Discourse parsing is an important upstream task within the area of Natural Language Processing (NLP) .
Approach: They propose a discourse parser that incorporates recent contextual language models to improve the performance of RST-based discourse parses.
Outcome: The proposed parser outperforms existing models on two key RST datasets and on large-scale "silver-standard" discourse treebank MEGA-DT.
Can we obtain significant success in RST discourse parsing by using Large Language Models? (2024.eacl-long)

Copied to clipboard

Challenge: Experimental results show that LLMs with tens of billion parameters can perform discourse parsing tasks.
Approach: They employ Llama 2 and fine-tune it with QLoRA to achieve similar results . they show that LLMs with tens of billion parameters can perform a wide range of NLP tasks .
Outcome: The proposed model performs better than existing models on three benchmark datasets.
A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing discourse parsing methods need a strong baseline for reporting reliable experimental results.
Approach: They integrate existing parsing strategies with transformer-based pre-trained language models to provide a strong baseline for reporting reliable experimental results.
Outcome: The proposed model outperforms the current best model using DeBERTa.
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance .
Approach: They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy.
Outcome: The proposed model will be able to detect human-written content in real time.
Discourse Representation Parsing for Sentences and Documents (P19-1)

Copied to clipboard

Challenge: Experimental results show that our model outperforms competitive baselines by a wide margin.
Approach: They propose a neural model which parses discourse structures of arbitrary length and granularity.
Outcome: The proposed model outperforms baseline models on sentence- and document-level benchmarks.
Video Discourse Parsing and Its Application to Multimodal Summarization: A Dataset and Baseline Approaches (2024.findings-emnlp)

Copied to clipboard

Challenge: Fig. 1 shows the video's story structure and event relationships in discourse parsing.
Approach: They propose to construct an RST tree for a video to represent its storyline and illustrate the event relationships between events.
Outcome: The proposed model outperforms two existing approaches to video RST parsing: the ‘parsing after captioning’ framework and parser using visual features.
Llamipa: An Incremental Discourse Parser (2024.findings-emnlp)

Copied to clipboard

Challenge: Discourse parsing is a task of predicting relationships between utterances and their semantic content . lack of surface cues in discourse graphs forces parsers to rely on deep, semantic information . a large language model (LLM) can significantly improve discourse parser performance .
Approach: They propose a large language model (LLM) that leverages discourse context to parse a discourse . this model provides local, context-sensitive representations of discourse units .
Outcome: The proposed model can provide local, context-sensitive representations of discourse units . it can process discourse data incrementally, which is essential for later use of discourse information .
Multilingual Neural RST Discourse Parsing (2020.coling-main)

Copied to clipboard

Challenge: Existing studies on text discourse parsing for English are limited due to the lack of annotated data.
Approach: They propose to use multilingual vector representations and segment-level translation to establish a neural, cross-lingual discourse parser.
Outcome: The proposed model achieves state-of-the-art on cross-lingual, document-level discourse parsing on all sub-tasks.
Are LLMs Good Annotators for Discourse-level Event Relation Extraction? (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated proficiency in a wide array of natural language processing tasks, but their effectiveness over discourse-level event relation extraction tasks remains unexplored.
Approach: They evaluate LLMs' ability to address discourse-level event relation extraction tasks using an open-source model and a commercial model.
Outcome: The proposed model performs poorly on discourse-level event relation extraction tasks.
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology (2024.findings-eacl)

Copied to clipboard

Challenge: Scholarly communication in the digital age is facing significant challenges due to the overwhelming volume of publications.
Approach: They propose to use Wikipedia infoboxes and structured Amazon product descriptions to create structured scholarly contribution summaries using text generation capabilities of LLMs.
Outcome: The proposed model can be applied to complex IE tasks within terse domains like Science with 1000x fewer parameters than the state-of-the-art GPT-davinci.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations