Papers by Xinyan Yu
CREPE: Open-Domain Question Answering with False Presuppositions (2023.acl-long)
Copied to clipboard
| Challenge: | Existing question answering datasets assume all questions have well defined answers. |
| Approach: | They propose a QA dataset containing a distribution of false presuppositions . they find that 25% of questions contain false presumptions . |
| Outcome: | The proposed model finds that 25% of questions contain false presuppositions . the model can find presuffpositions moderately well, but struggle when predicting correctness . |
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer (2024.naacl-long)
Copied to clipboard
Akari Asai, Sneha Kudugunta, Xinyan Yu, Terra Blevins, Hila Gonen, Machel Reid, Yulia Tsvetkov, Sebastian Ruder, Hannaneh Hajishirzi
| Challenge: | Recent advances in few-shot generalization in natural language processing focus on English. |
| Approach: | They propose a benchmark that unifies 15 diverse tasks across 54 languages in a sequence-to-sequence format and provides a fixed set of few-shot examples and instructions. |
| Outcome: | The proposed framework unifies 15 diverse tasks across 54 languages in a sequence-to-sequence format and provides a fixed set of few-shot examples and instructions. |
Diversified Multiple Instance Learning for Document-Level Multi-Aspect Sentiment Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that D-MILN outperforms recent weakly-supervised baselines . document-level multi-aspect sentiment classification requires a lot of manual aspect-level annotations - which is time-consuming and laborious . |
| Approach: | They propose a novel Diversified Multiple Instance Learning Network to achieve DMSC with only document-level weak supervision. |
| Outcome: | The proposed method outperforms weakly-supervised baselines on TripAdvisor and BeerAdvocate datasets. |
On Retrieval Augmentation and the Limitations of Language Model Training (2024.naacl-short)
Copied to clipboard
| Challenge: | Recent efforts to improve the performance of language models (LMs) have focused on scaling up model and training data size, though with steep accompanying energy and compute resource costs. |
| Approach: | They propose to augment a language model with k-nearest neighbors retrieval on its training data to reduce its perplexity. |
| Outcome: | The proposed model reduces storage costs by over 25x compared to traditional retrieval methods for GPT-2 and Mistral 7B . |
Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resources (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have examined the quality of labeled data in non-English languages. |
| Approach: | They annotate how datasets are created, input text and label sources, tools used to build them and what they study. |
| Outcome: | The results show that language-proficient NLP researchers' estimated availability correlates with dataset availability. |
MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | MURMUR generates highly faithful and correct reasoning paths that lead to 26% more logically consistent summaries on LogicNLG compared to direct prompting. |
| Approach: | They propose a neuro-symbolic modular approach to text generation from semi-structured data with multi-step reasoning that generates reasoning paths using neural and symbolic modules with specific linguistic and logical skills. |
| Outcome: | The proposed method improves on two data-to-text generation tasks, while achieving comparable performance to fine-tuned GPT-2 on out-of-domain data. |