Zero-Shot Rationalization by Multi-Task Transfer Learning from Question Answering (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to extract rationales from input text are difficult and impractical. |
| Approach: | They propose a method that leverages multi-task learning and transfer learning to generate rationales through question answering in a zero-shot fashion. |
| Outcome: | The proposed method achieves comparable or even better performance without supervised signal for two benchmark rationalization datasets. |
Similar Papers
Unsupervised Selective Rationalization with Noise Injection (2023.acl-long)
Copied to clipboard
| Challenge: | Unsupervised selective rationalization produces rationales alongside predictions, but does not ensure that the rationale contains a plausible explanation for the prediction. |
| Approach: | They propose a technique that injects noise between a rationale generator and a predictor to limit generation of implausible rationales. |
| Outcome: | The proposed method achieves significant improvements in plausibility and task accuracy over the state-of-the-art models while maintaining or improving model faithfulness. |
Self-training with Few-shot Rationalization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work focused on training largescale and complex neural network models, but they are opaque in terms of their decision-making process. |
| Approach: | They propose a multi-task teacher-student framework for self-training pre-trained language models with limited task-specific labels and annotated rationales. |
| Outcome: | The proposed model improves performance in low-resource settings by making it aware of its rationalized predictions. |
ZARA: Improving Few-Shot Self-Rationalization for Small Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies demonstrate great performance gain for self-rationalization by few-shot prompting LMs with rationale-augmented exemplars. |
| Approach: | They propose to leverage explanations for small LMs to improve few-shot self-rationalization by reducing the problem of plausibility judgement to natural language inference. |
| Outcome: | The proposed approach achieves SOTA performance on the FEB benchmark, for both the task accuracy and the explanation metric. |
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective (2022.emnlp-main)
Copied to clipboard
Ping Yang, Junjie Wang, Ruyi Gan, Xinyu Zhu, Lin Zhang, Ziwei Wu, Xinyu Gao, Jiaxing Zhang, Tetsuya Sakai
| Challenge: | Existing approaches to zero-shot learning are format-agnostic and can address new learning tasks without additional training. |
| Approach: | They propose a new paradigm for zero-shot learning that is format agnostic and compatible with any format and applicable to a list of language tasks. |
| Outcome: | The proposed model shows state-of-the-art performance on several benchmarks and produces satisfactory results on tasks such as text classification and commonsense reasoning. |
Toward Zero-Shot Instruction Following (2024.eacl-srw)
Copied to clipboard
| Challenge: | a novel approach to zero-shot cross-task generalization is proposed . prior work relied on demonstrations, but this approach could be overestimated . |
| Approach: | They propose a "demonstration-driven instruction following" setting for zero-shot cross-task generalization . they propose to automatically find out critical sentences in a paragraph-style task definition . |
| Outcome: | The proposed approach yields state-of-the-art performance on the Super-NaturalInstructions. |
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models (2022.acl-long)
Copied to clipboard
| Challenge: | Massively Multilingual Transformer based Language Models have been shown to be effective on zero-shot transfer across languages, though performance varies from language to language depending on pivot language(s) used for fine-tuning. |
| Approach: | They propose to combine multi-task learning problems with multi-lingual Transformers to model zero-shot transfer across languages. |
| Outcome: | The proposed model can predict zero-shot transfer across languages with a multi-task learning problem with pretraining data in very few languages. |
Zero-shot Event Extraction via Transfer Learning: Challenges and Insights (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for event extraction require expensive annotation and are not extensible to new event ontologies. |
| Approach: | They propose to use textual entailment and/or question answering queries to extract a zero-shot event from a set of TE and/ or QA queries. |
| Outcome: | The proposed method achieves acceptable results on ACE-2005 and ERE, but there is still a large gap from supervised approaches. |
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing language models can be refined for zero-shot commonsense reasoning . however, commons sense reasoning is still an unsolved problem . |
| Approach: | They propose a self-supervised learning approach that refines a pre-trained language model to boost conceptualization. |
| Outcome: | The proposed approach boosts conceptualization by utilizing loss landscape refinement. |
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | a number of information extraction tasks require task-specific training. |
| Approach: | They propose a text-to-triple translation framework for information extraction tasks . they propose enabling task-agnostic translation by leveraging latent knowledge of a pre-trained language model . |
| Outcome: | The proposed framework outperforms the existing methods on open information extraction tasks. |
Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations in a Label-Abundant Setup (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to train models to provide natural language explanations (NLEs) require acquisition of task-specific NLEs, which is time- and resource-consuming. |
| Approach: | They propose a few-shot out-of-domain transfer of NLEs from a parent task to a child task . they propose four methods that cover possible fine-tuning combinations of NLESs and labels . |
| Outcome: | The proposed methods cover the possible fine-tuning combinations of labels and NLEs for the parent and child tasks. |