Papers by Benjamin Schiller
Classification and Clustering of Arguments with Contextualized Word Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing methods for argument mining focus on analyzing local argumentation structures, but information-seeking approaches need to be able to deal with heterogeneous sources and topics. |
| Approach: | They propose to use contextualized word embeddings to classify and cluster topic-dependent arguments using a UKP Sentential Argument Mining Corpus and IBM Debater - Evidence Sentences datasets. |
| Outcome: | The proposed method improves state-of-the-art on argument classification and clustering tasks and across multiple datasets. |
A Retrospective Analysis of the Fake News Challenge Stance-Detection Task (C18-1)
Copied to clipboard
Andreas Hanselowski, Avinesh PVS, Benjamin Schiller, Felix Caspelherr, Debanjan Chaudhuri, Christian M. Meyer, Iryna Gurevych
| Challenge: | 2017 Fake News Challenge Stage 1 (FNC-1) shared task addressed a stance classification task as a crucial first step towards detecting fake news. |
| Approach: | They propose a new evaluation metric favoring the majority class, which can be easily classified, and propose stacked LSTM models that perform on par with the best systems, but is superior in predicting minority classes. |
| Outcome: | The proposed evaluation metric favors the majority class, which can be easily classified, and overestimates the true discriminative power of the methods. |
ArgumenText: Searching for Arguments in Heterogeneous Sources (N18-5)
Copied to clipboard
Christian Stab, Johannes Daxenberger, Chris Stahlhut, Tristan Miller, Benjamin Schiller, Christopher Tauchmann, Steffen Eger, Iryna Gurevych
| Challenge: | Argument mining is a core technology for enabling argument search in large corpora . but current methods fail when applied to heterogeneous texts . despite its obvious applications, argument search has attracted relatively little attention . |
| Approach: | They propose a system that searches sentential arguments for any given topic . ArgumenText automatically identifies and classifies arguments by relevance . |
| Outcome: | The proposed system covers 89% of arguments found in expert-curated lists . it also identifies additional valid arguments omitted or overlooked by human curators . |
Aspect-Controlled Neural Argument Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Current argument generation models produce lengthy texts and allow the user little control over the aspect the argument should address. |
| Approach: | They propose a language model that can be controlled to generate sentence-level arguments for a given topic, stance, and aspect. |
| Outcome: | The proposed model generates high-quality arguments for argumentation and counter-arguments. |
Diversity Over Size: On the Effect of Sample and Topic Sizes for Topic-Dependent Argument Mining Datasets (2024.emnlp-main)
Copied to clipboard
| Challenge: | Topic-dependent argument mining is a task that requires expert knowledge to recognize retrieved arguments. |
| Approach: | They investigate the effect of TDAM dataset composition on model performance by using carefully composed training samples and reducing the training sample size by almost 90%. |
| Outcome: | The proposed model can achieve 95% of the maximum performance on three different datasets. |
Cross-topic Argument Mining from Heterogeneous Sources (D18-1)
Copied to clipboard
| Challenge: | Argument mining is a core technology for automating argument search in document collections. |
| Approach: | They propose a new sentential annotation scheme that is reliably applicable by crowd workers to arbitrary Web texts. |
| Outcome: | The proposed scheme outperforms vanilla BiLSTMs in two- and three-label cross-topic settings and can be further improved by leveraging additional data for topic relevance using multi-task learning. |
Argument Summarization and its Evaluation in the Era of Large Language Models (2025.emnlp-main)
Copied to clipboard
Moritz Altemeyer, Steffen Eger, Johannes Daxenberger, Yanran Chen, Tim Altendorf, Philipp Cimiano, Benjamin Schiller
| Challenge: | Large Language Models (LLMs) have revolutionized various Natural Language Generation tasks, including Argument Summarization (ArgSum). |
| Approach: | They propose a prompt-based evaluation scheme and validate it through a human benchmark dataset. |
| Outcome: | The proposed evaluation scheme outperforms existing methods and is validated by a human benchmark dataset. |