Papers by Nan Shao
Aggregating Bidirectional Encoder Representations Using MatchLSTM for Sequence Matching (D19-1)
Copied to clipboard
| Challenge: | Recent work on text sequence matching tasks uses task specific supervised datasets, which are always limited to the amount due to the cost of annotation. |
| Approach: | They propose an aggregation method to combine Bidirectional Encoder Representations from Transformer (BERT) with a MatchLSTM layer for Sequence Matching. |
| Outcome: | The proposed model improves on two publicly available datasets, WikiQA and SNLI. |
Multi-level Alignment Pretraining for Multi-lingual Semantic Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for multilingual semantic parsing only handle monolingual parsers, while in real world applications such as Chatbot and search engine, we generally need to handle multi-lingual semanticparsing. |
| Approach: | They propose a multi-level alignment pretraining method in a unified architecture for multi-lingual semantic parsing. |
| Outcome: | The proposed method outperforms state-of-the-art methods on a publicly avail-able multi-lingual semantic parsing dataset and a newly constructed dataset. |
Spotlighter: Revisiting Prompt Tuning from a Representative Mining View (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Spotlighter is a lightweight token-selection framework that enhances accuracy and efficiency in prompt tuning. |
| Approach: | They propose a token-selection framework that enhances accuracy and efficiency in prompt tuning by preserving only the top-scoring tokens for downstream prediction. |
| Outcome: | The proposed framework outperforms CLIP by up to 11.19% in harmonic mean accuracy and achieves 0.8K additional FPS, with only 21 extra parameters. |
Is Graph Structure Necessary for Multi-hop Question Answering? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on multi-hop question answering across multiple documents or paragraphs. |
| Approach: | They propose a graph neural network to deal with graph structure in textual multi-hop reasoning . they propose 'self-attention' and propose removing entire graph structure may not hurt the final results . |
| Outcome: | The proposed model shows that graph-attention or the entire graph structure can be replaced by self-attention . hotpotQA is a widely used benchmark for multi-hop question answering . |
Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work has proposed to improve relevance modeling by having large language models actively involved in retrieval, i.e., to guide retrieval with generation. |
| Approach: | They propose to have large language models actively involved in retrieval to guide retrieval with generation. |
| Outcome: | The proposed method synergizes retrieval and generation in an iterative manner, and can generate better results in subsequent iterations. |
GPS: Genetic Prompt Search for Efficient Few-Shot Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models are often finetuned for downstream tasks, which has been shown to improve performance over non-pretrained models. |
| Approach: | They propose a genetic algorithm to automatically search for the best prompt for few-shot learning with pretrained language models by gradient-free algorithm. |
| Outcome: | Experiments on diverse datasets show that the proposed method outperforms manual prompts by 2.6 points. |
Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for news headline generation focus on producing a single short sentence . et al., 2017; Gehrmann e.t., 2018; Zhong ee., 2019) focus on single-headline generation. |
| Approach: | They propose a method to generate multiple headlines with keyphrases of user interests . they propose generating multiple keyphrase-relevant headlines using a transformer decoder . |
| Outcome: | The proposed method achieves state-of-the-art in terms of quality and diversity. |
ZeroPrompt: Scaling Prompt-Based Pretraining to 1,000 Tasks Improves Zero-Shot Generalization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that task scaling can be an efficient alternative to model scaling. |
| Approach: | They propose a multitask pretraining approach ZeroPrompt for zero-shot generalization . they focus on task scaling and zero-shooting to improve model performance . |
| Outcome: | The proposed approach improves zero-shot generalization efficiency by 30 times with task scaling. |