Papers by Andreas Rücklé
AdapterHub: A Framework for Adapting Transformers (2020.emnlp-demos)
Copied to clipboard
Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, Aishwarya Kamath, Ivan Vulić, Sebastian Ruder, Kyunghyun Cho, Iryna Gurevych
| Challenge: | AdapterHub framework enables dynamic “stiching-in” of pre-trained adapters for different tasks and languages. |
| Approach: | They propose a framework that allows dynamic "stiching-in" of pre-trained adapters for different tasks and languages. |
| Outcome: | The proposed framework allows dynamic “stiching-in” of pre-trained adapters for different tasks and languages. |
Evaluation Pitfalls and Sparsity Limitations in LLM-based Confidence Estimates for Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Xuan et al., 2023) show that verbalization produces extremely sparse outputs for confidence estimation. |
| Approach: | They propose to standardize stepwise interpolation for a fairer comparison . they advocate standardizing stepwise intercepts for AUARC evaluation . |
| Outcome: | The proposed method achieves the best AUARC score (+2.3 points over vanilla verbalization) while requiring less inference cost. |
What to Pre-Train on? Efficient Intermediate Task Selection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning intermediate tasks are inefficient and expensive. |
| Approach: | They propose to use a set of 42 intermediate and 11 target English classification, multiple choice, question answering, and sequence tagging tasks to identify the best settings for intermediate transfer learning. |
| Outcome: | The proposed methods achieve an average Regret@3 of 1% across all target tasks. |
Neural Duplicate Question Detection without Labeled Training Data (D19-1)
Copied to clipboard
| Challenge: | Recent studies have used alternative methods to train neural models to duplicate question detection in community Question Answering forums. |
| Approach: | They propose two new methods for supervised question detection in community Question Answering forums . they propose weak supervision using title and body of question and automatic generation of duplicate questions . |
| Outcome: | The proposed methods can achieve better performance even without labeled data. |
AdapterDrop: On the Efficiency of Adapters in Transformers (2021.emnlp-main)
Copied to clipboard
Andreas Rücklé, Gregor Geigle, Max Glockner, Tilman Beck, Jonas Pfeiffer, Nils Reimers, Iryna Gurevych
| Challenge: | Recent approaches to transformer models are expensive to fine-tune, slow for inference, and have large storage requirements. |
| Approach: | They propose a method to remove adapters from transformer layers during training and inference . they show that AdapterDrop can dynamically reduce computational overhead . |
| Outcome: | The proposed approach reduces computational overhead while maintaining performance over multiple tasks with minimal loss of performance. |
MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale (2020.emnlp-main)
Copied to clipboard
| Challenge: | a new study examines the zero-shot transfer capabilities of text matching models on a massive scale. |
| Approach: | They propose to integrate self-supervised with supervised multi-task learning on all available source domains to study the zero-shot transfer capabilities of text matching models on a massive scale. |
| Outcome: | The proposed model outperforms in-domain BERT and the previous state of the art on six benchmarks. |
AdapterFusion: Non-Destructive Task Composition for Transfer Learning (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for incorporating knowledge from multiple tasks suffer from catastrophic forgetting and difficulties in dataset balancing. |
| Approach: | They propose an algorithm that extracts and combine adapters in a knowledge composition step. |
| Outcome: | The proposed class outperforms traditional methods such as full fine-tuning and multi-task learning on 16 diverse NLU tasks. |
Improving QA Generalization by Concurrent Modeling of Multiple Biases (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for debiasing datasets are weaker than current approaches for generalization. |
| Approach: | They propose a framework for analyzing multiple biases in training data to reduce bias weighting. |
| Outcome: | The proposed framework improves generalization on in-domain and out-of-domain datasets by weighting examples based on their strengths and bias strengths. |
Text Processing Like Humans Do: Visually Attacking and Shielding NLP Systems (N19-1)
Copied to clipboard
Steffen Eger, Gözde Gül Şahin, Andreas Rücklé, Ji-Ung Lee, Claudia Schulz, Mohsen Mesgar, Krishnkant Swarnkar, Edwin Simpson, Iryna Gurevych
| Challenge: | Recent studies show that visual similarity can play a decisive role in assessing the meaning of characters. |
| Approach: | They investigate the impact of visual adversarial attacks on current NLP systems . they explore three shielding methods that significantly improve the robustness of the models . |
| Outcome: | The proposed methods improve performance but still fall behind non-attack scenarios. |