Papers by Hanjun Dai
SQLPrompt: In-Context Text-to-SQL with Minimal Labeled Data (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-SQL aims to automate the process of generating SQL queries on a database from natural language text. |
| Approach: | They propose a method to improve few-shot prompting capabilities of Text-to-SQL for Large Language Models (LLMs) they propose 'SQlPrompt' which aims to diversify the SQL proposals during consistency selection with different prompt designs and foundation models. |
| Outcome: | The proposed method outperforms previous approaches for in-context learning with zero labeled data by a large margin, closing the gap with finetuning state-of-the-art with thousands of labeles. |
DocumentNet: Bridging the Data Gap in Document Pre-training (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Document understanding tasks are a tedious task that requires extensive training and privacy constraints. |
| Approach: | They propose a method to collect weakly labeled data from the web to benefit VDER training . the collected dataset does not depend on specific document types or entity sets . |
| Outcome: | The proposed method does not depend on specific document types or entity sets, making it universally applicable to all VDER tasks. |
Universal Self-Adaptive Prompting (2023.emnlp-main)
Copied to clipboard
| Challenge: | a hallmark of modern large language models is their impressive general zero-shot and few-shot abilities . however, zero- shot performances are weaker due to the lack of guidance and the difficulty of applying existing automatic prompt design methods in general tasks. |
| Approach: | They propose an automatic prompt design approach specifically tailored for zero-shot learning that categorizes a possible NLP task into one of three possible task types and then uses a selector to select the most suitable queries and zero- shot model-generated responses as pseudo-demonstrations. |
| Outcome: | The proposed approach is able to generalize ICL to zero-shot learning tasks while also allowing for a more efficient and efficient prompt design. |
Better Zero-Shot Reasoning with Self-Adaptive Prompting (2023.findings-acl)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) have demonstrated impressive capabilities at sophisticated tasks, often through step-by-step reasoning similar to humans. |
| Approach: | They propose a new method that uses a set of examples from the LLM zero-shot outputs to improve performance. |
| Outcome: | The proposed method improves performance up to 15% compared to baselines and matches or exceeds few-shot baselines at a range of reasoning tasks. |
On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Visually-rich document entity retrieval (VDER) is an important topic in industrial NLP applications. |
| Approach: | They propose a task-aware meta-learning framework to tackle the problem of visually-rich document entity retrieval (VDER) they adopt a hierarchical decoder and employ contrastive learning to achieve this goal. |
| Outcome: | The proposed framework significantly improves the robustness of popular meta-learning baselines. |