Learning Web-based Procedures by Reasoning over Explanations and Demonstrations in Context (2020.acl-main)
Copied to clipboard
| Challenge: | a new direction for semantic parsing that models explanations to demonstrations is proposed . bottom-up approach to generating logical forms is complicated in domains with rich composition . |
| Approach: | They propose a new direction for semantic parsing that models explanations in a context . they use inverse semantics to reason backwards from observed demonstrations . |
| Outcome: | The proposed approach shows better task completion rates than a baseline method . it is competitive with exploration-and-demonstration based methods, but requires no exploration of environment . |
Similar Papers
Learning API Functionality from In-Context Demonstrations for Tool-based Agents (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Documentation is often missing, outdated, privatized, or inconsistent in tool-based agents. |
| Approach: | They propose a task that allows agents to learn API functionality directly from in-context demonstrations. |
| Outcome: | The proposed model improves the task success rate of an API-based agent by providing explicit function calls and natural language critiques. |
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis (2024.findings-acl)
Copied to clipboard
Miaoran Zhang, Vagrant Gautam, Mingyang Wang, Jesujoba Alabi, Xiaoyu Shen, Dietrich Klakow, Marius Mosbach
| Challenge: | In-context learning is a popular inference strategy where large language models solve a task using only a few labeled demonstrations without updating the model parameters. |
| Approach: | They conduct multidimensional analysis of multilingual in-context learning using 5 models from different model families and 9 datasets covering classification and generation tasks. |
| Outcome: | The results show that demonstrations vary significantly across models, tasks, and languages. |
LLMs Learn Task Heuristics from Demonstrations: A Heuristic-Driven Prompting Strategy for Document-Level Event Argument Extraction (2024.acl-long)
Copied to clipboard
| Challenge: | In-context learning (ICL) is an emerging ability of large-scale labeled data for document-level event argument extraction (EAE). |
| Approach: | They propose an explicit heuristic-driven demonstration construction approach that emphasizes task heurs in document-level event argument extraction tasks. |
| Outcome: | The proposed method outperforms existing prompting methods and few-shot supervised learning methods on document-level EAE datasets. |
Commonsense Reasoning for Natural Language Processing (2020.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will outline the various types of commonsense knowledge and discuss techniques to gather and represent commonsence knowledge. |
| Approach: | This tutorial will provide researchers with the critical foundations and recent advances in commonsense representation and reasoning. |
| Outcome: | This tutorial will outline the various types of commonsense and discuss techniques to gather and represent commonsence knowledge while highlighting the challenges specific to this type of knowledge (e.g., reporting bias). |
Prompting Contrastive Explanations for Commonsense Reasoning Tasks (2021.findings-acl)
Copied to clipboard
| Challenge: | Large pretrained language models (PLMs) can achieve near-human performance on commonsense reasoning tasks, but provide little human-interpretable evidence of the underlying reasoning they use. |
| Approach: | They propose to use large pretrained language models to generate evidence for commonsense reasoning NLP tasks . they use models to contrast alternative explanations based on key attribute(s) required to justify the correct answer . |
| Outcome: | The proposed model improves performance on two commonsense reasoning benchmarks compared to previous non-contrastive alternatives. |
CLIX: Cross-Lingual Explanations of Idiomatic Expressions (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing definition generation systems are difficult to use in second language learning due to the presence of unfamiliar words and grammar. |
| Approach: | They propose to use cross-lingual explanations of idiomatic expressions to support vocabulary expansion for language learners. |
| Outcome: | The proposed system is able to explain idiomatic expressions in non-standard language. |
An Imitation Game for Learning Semantic Parsers from User Interaction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for learning semantic parsers are expensive and tedious . despite the widespread applications, bootstrapping and fine-tuning is tedious a task . |
| Approach: | They propose an alternative method for learning semantic parsers directly from users . they propose an annotation-efficient imitation learning algorithm that iteratively collects new datasets . |
| Outcome: | The proposed method is cost-effective and shows promising performance on the text-to-SQL problem. |
Negation, Coordination, and Quantifiers in Contextualized Language Models (2022.coling-1)
Copied to clipboard
| Challenge: | Recent work has focused on specific tasks and on the learning outcome. |
| Approach: | They propose to decouple the weaknesses from specific tasks and focus on the embeddings per se and their mode of learning. |
| Outcome: | The proposed model can learn semantic constraints and how the context impacts their embeddings. |
Counterfactual Explanations for Natural Language Interfaces (2022.acl-short)
Copied to clipboard
| Challenge: | Semantic parsing is a promising technique for enabling natural language interfaces, but human language can encode concepts that do not exist in the underlying system or are encoded using different language. |
| Approach: | They propose a novel approach for generating explanations of a natural language interface based on semantic parsing by providing a user with an utterance and a demonstration of their desired goal. |
| Outcome: | The proposed approach significantly improves user performance and generates explanations that more closely match the user’s intent compared to two ablations. |
Let Me Check the Examples: Enhancing Demonstration Learning via Explicit Imitation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing work only concatenates answered examples as demonstrations to prompt template without any additional operation, neglecting the prompt-demonstration dependencies. |
| Approach: | They propose to concatenate answered examples as demonstrations to prompt template without any additional operation, neglecting the prompt-demonstration dependencies. |
| Outcome: | Experiments show that the proposed method achieves state-of-the-art performance on 5 out of 14 classification corpus. |