Challenge: Recent development of large language models (LLMs) have boosted interest on dialogue agents . however, research on these tasks is limited by the insufficiency of public datasets . stance detection and debate summarization are key for engaging argumentative dialogues - but are not available for non-English languages.
Approach: They propose to use ORCHID to benchmark stance detection and debate summarization in Chinese debates.
Outcome: The proposed task is based on 1,218 real-world debates conducted in Chinese on 476 unique topics.

Similar Papers

IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks (2022.acl-long)

Copied to clipboard

Challenge: Argument mining (AM) is a computational process that is used to analyze information in a debating system.
Approach: They propose to use a large dataset to automate the manual process of debating . they propose to integrate claim extraction, stance classification and evidence extraction tasks .
Outcome: The proposed tasks can extract claims, stances, evidence and more from a large dataset . the proposed tasks are highly efficient and can be applied to argument mining tasks .
-Stance: A Large-Scale Real World Dataset of Stances in Legal Argumentation (2025.acl-long)

Copied to clipboard

Challenge: Current tools for legal argument reasoning do not support this task.
Approach: They propose to use a large-scale dataset to facilitate work on the legal argument stance classification task by evaluating whether a case summary strengthens or weakens a legal argument.
Outcome: The proposed dataset is used to facilitate work on the legal argument stance classification task, which involves assessing whether a case summary strengthens or weakens a legal argument (polarity) and to what extent (intensity).
Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have made it difficult to build an automated debate system that helps people to synthesise persuasive arguments.
Approach: They propose to use an argument mining dataset to capture the end-to-end process of preparing an argumentative essay for a debate.
Outcome: The proposed dataset shows that it performs better on individual tasks than on human-centred evaluations.
A Dataset of Argumentative Dialogues on Scientific Papers (2023.acl-long)

Copied to clipboard

Challenge: Recent advances in question-answering models have made them a great asset in accessing the content of scientific papers.
Approach: They propose to use a dataset of 41 argumentative dialogues between scientists on 20 NLP papers to improve and evaluate their question-answering models.
Outcome: The proposed dataset includes both exploratory and argumentative questions and answers in a dialogue discourse on a scientific paper.
Can We Identify Stance without Target Arguments? A Study for Rumour Stance Classification (2024.lrec-main)

Copied to clipboard

Challenge: Existing target-aware models underperform in cases where the context of the target is crucial.
Approach: They propose a framework to enhance reasoning with the targets and propose 'target-aware' models without awareness of the target.
Outcome: The proposed framework achieves state-of-the-art on two benchmark datasets.
CEDAR: A Chinese Evaluation Dataset for Computational Argumentation (2026.acl-long)

Copied to clipboard

Challenge: Existing debate datasets neglect important labels for argument mining, generation, and evaluation.
Approach: They propose a Chinese Evaluation Dataset for Computational Argumentation that includes key arguments and key rhetorical figures, debater roles, modal words, debate results and transcripts.
Outcome: The proposed dataset covers 600 debates about 318 topics from Chinese debate competitions.
Exploiting contextual information to improve stance detection in informal political discourse with LLMs (2025.acl-srw)

Copied to clipboard

Challenge: Political stance detection is an increasingly relevant part of analyzing the flow of ideas in online environments where discourse is informal and implicitly expressed.
Approach: They evaluate large language models for political stance detection in informal online discourse by analyzing user profiles derived from historical posts.
Outcome: The proposed model improves accuracy by up to 74% on a political forum dataset.
Target-Aware Data Augmentation for Stance Detection (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods for stance detection are not diversified or inconsistent with the given target and label information.
Approach: They propose to augment a text with a conditional masked word prediction task . they propose to replace a target mention with 'target-aware' sentences by replacing a reference word with .
Outcome: The proposed method outperforms existing methods on 11 targets.
A Challenge Dataset and Effective Models for Conversational Stance Detection (2024.lrec-main)

Copied to clipboard

Challenge: stance detection studies focus on evaluating stances within individual instances, hindering progress of conversational stance analysis.
Approach: They propose a multi-turn conversation stance detection dataset that encompasses multiple targets for conversational stance detector.
Outcome: The proposed dataset encompasses multiple targets for conversational stance detection.
Arg-LLaDA: Argument Summarization via Large Language Diffusion Models and Sufficiency-Aware Refinement (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to argument summarization rely on single-pass generation, offering limited support for factual correction or structural refinement.
Approach: They propose a large language diffusion framework that iteratively improves argument summarization by sufficiency-guided remasking and regeneration.
Outcome: Empirical results show that Arg-LLaDA surpasses state-of-the-art baselines in 7 out of 10 evaluation metrics.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations