Compositional generalization with a broad-coverage semantic parser (2022.starsem-1)
Copied to clipboard
| Challenge: | Recent work has shown that compositional generalization on COGS is difficult and complex. |
| Approach: | They propose a compositional semantic parser that solves compositional generalization on COGS dataset. |
| Outcome: | The AM parser solves compositional generalization on the COGS dataset. |
Similar Papers
One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasets (2021.starsem-1)
Copied to clipboard
| Challenge: | Existing semantic parsing datasets lack a single standard for meaning representations . lack of a standard led to the creation of plethora of datasets requiring expert annotators . |
| Approach: | They propose to use multi-task learning to unify different datasets and train a single model for them. |
| Outcome: | The proposed architectures yield better parsing accuracies and composition generalization than single-task models. |
Measuring Alignment Bias in Neural Seq2seq Semantic Parsers (2022.starsem-1)
Copied to clipboard
| Challenge: | Sequence-to-sequence semantic parsers with attention mechanisms have changed the research landscape . emergence of seq2seq models have led to questions about alignments . |
| Approach: | They investigate whether seq2seq models can handle both simple and complex alignments. |
| Outcome: | The proposed model performs better on monotonic and complex alignments compared to monotonic models . |
Functional Distributional Semantics at Scale (2023.starsem-1)
Copied to clipboard
| Challenge: | Functional Distributional Semantics is a linguistically motivated framework for modelling lexical and sentence-level semantics with truth-conditional functions using distributional information. |
| Approach: | They propose a more expressive lexical model that works over a continuous semantic space. |
| Outcome: | The proposed model improves performance and flexibility and is compatible with present-day machine learning frameworks. |
Semantic Structural Decomposition for Neural Machine Translation (2020.starsem-1)
Copied to clipboard
| Challenge: | Existing methods for translation of long sentences are limited by the translation of single sentences to single sentences. |
| Approach: | They propose to use semantic splitting of the source sentence as preprocessing for machine translation. |
| Outcome: | The proposed approach tackles two main limitations of state-of-the-art machine translation. |
Compositional Structured Explanation Generation with Dynamic Modularized Reasoning (2024.starsem-1)
Copied to clipboard
| Challenge: | Large-scale language models have shown remarkable performance on reasoning tasks such as reading comprehension, natural language inference, story generation, etc. |
| Approach: | They propose a compositional structured explanation generation task to test a model's ability to generalize from generating entailment trees to more steps, focusing on the length and shapes of engorgement trees. |
| Outcome: | The proposed model shows competitive compositional generalization abilities in a generation setting. |
When Truth Matters - Addressing Pragmatic Categories in Natural Language Inference (NLI) by Large Language Models (LLMs) (2023.starsem-1)
Copied to clipboard
| Challenge: | In this paper, we examine the ability of large language models (LLMs) to accommodate different pragmatic sentence types, such as questions, commands, and sentence fragments for natural language inference (NLI). |
| Approach: | They propose to fine-tune large language models to accommodate different sentence types for natural language inference (NLI) they also explore ChatGPT's concept of entailment by using a symbolic semantic parser. |
| Outcome: | The proposed models can accommodate different sentence types without losing too much accuracy on MNLI-matched models. |
Syntax and Semantics Meet in the “Middle”: Probing the Syntax-Semantics Interface of LMs Through Agentivity (2023.starsem-1)
Copied to clipboard
| Challenge: | a recent study examined how large language models handle interactions in meaning across words and larger syntactic forms. |
| Approach: | They propose to use a dataset to examine the linguistic properties of optionally transitive English verbs to examine their agentivity. |
| Outcome: | The proposed model outperforms all other models in the evaluation dataset . the results are better correlated with human judgements than syntactic and semantic corpus statistics . |
Dependency Patterns of Complex Sentences and Semantic Disambiguation for Abstract Meaning Representation Parsing (2021.starsem-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a sentence-level meaning representation based on predicate argument structure. |
| Approach: | They propose to use a dictionary to capture the structure of complex sentences . they train models on data derived from AMR and Wikipedia corpus . |
| Outcome: | The proposed model will be made public and the proposed patterns will be validated. |
DRS Parsing as Sequence Labeling (2022.starsem-1)
Copied to clipboard
| Challenge: | a new semantic parser for English, German, Italian, and Dutch discourse representation structures is developed . we present a system that maps tokens to finite set of meaning fragments and is more transparent . a comprehensive error analysis highlights areas for future work on semantic parses . |
| Approach: | They propose a fully trainable semantic parser for English, German, Italian, and Dutch discourse representation structures that maps each token to one of a finite set of meaning fragments. |
| Outcome: | The proposed system is more transparent and useful for human-in-the-loop annotations. |
PropBank Comes of Age—Larger, Smarter, and more Diverse (2022.starsem-1)
Copied to clipboard
Sameer Pradhan, Julia Bonn, Skatje Myers, Kathryn Conger, Tim O’gorman, James Gung, Kristin Wright-bettner, Martha Palmer
| Challenge: | The PropBank has been used for semantic role labeling for over 20 years . it includes non-verbal predicates, adjectives, prepositions and multi-word expressions . |
| Approach: | They describe the evolution of the PropBank approach to semantic role labeling over the last 20 years . they describe the substantial effort that has gone into ensuring consistency and reliability of the various annotated datasets and resources . |
| Outcome: | The PropBank has been used for more than 20 years to test semantic role labeling systems. |