Papers by Adam Fisch
Consistent Accelerated Inference via Confident Adaptive Transformers (2021.emnlp-main)
Copied to clipboard
| Challenge: | Amortized or approximate computational methods increase efficiency, but can result in unpredictable performance costs. |
| Approach: | They propose a method that increases computational efficiency while guaranteeing a specifiable degree of consistency with the original model with high confidence. |
| Outcome: | The proposed method improves on four classification and regression tasks and can be used to predict the performance of the proposed model. |
CapWAP: Image Captioning with a Purpose (2020.emnlp-main)
Copied to clipboard
| Challenge: | a traditional image captioning task uses generic reference captions to provide textual information about images. |
| Approach: | They propose a task that uses question-answer pairs to provide visual information instead of generic reference captions. |
| Outcome: | The proposed captioning with a purpose task can be tailored to meet user needs . question-answer pairs are used as a source of supervision for learning visual information needs a new task is proposed . |
MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehension (D19-58)
Copied to clipboard
| Challenge: | MRQA datasets have been used to benchmark progress in general-purpose language understanding. |
| Approach: | They propose to combine 18 question answering datasets into one shared task to evaluate their generalization capabilities. |
| Outcome: | The best system achieved an average F1 score of 72.5 on the 12 held-out datasets, 10.7 absolute points higher than baseline based on BERT. |
Get Your Vitamin C! Robust Fact Verification with Contrastive Evidence (2021.naacl-main)
Copied to clipboard
| Challenge: | Typical fact verification models use retrieved written evidence to verify claims . evidence sources change over time as more information is gathered and revised . a new benchmark for fact verification is VitaminC, which is contrastive in nature . |
| Approach: | They propose a benchmark that uses Wikipedia revisions to train models to discern and adjust to slight factual changes. |
| Outcome: | The proposed model improves accuracy by 10% on adversarial fact verification and 6% on adversary natural language inference. |
Making Pre-trained Language Models Better Few-shot Learners (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that the GPT-3 model can perform few-shots on language understanding tasks with a natural-language prompt and a few task demonstrations. |
| Approach: | They propose a technique for fine-tuning language models using a few examples . they propose LM-BFF, which uses prompt-based fine-uning and a pipeline for automating prompt generation . |
| Outcome: | The proposed approach outperforms standard fine-tuning procedures on a range of NLP tasks. |
Working Hard or Hardly Working: Challenges of Integrating Typology into Neural Dependency Parsers (D19-1)
Copied to clipboard
| Challenge: | linguistic typology has shown great promise in pre-neural parsing, but results for neural architectures have been mixed. |
| Approach: | They explore the task of leveraging typology in the context of cross-lingual dependency parsing. |
| Outcome: | The proposed approach improves performance in the context of cross-lingual dependency parsing. |