The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing (2023.findings-acl)
Copied to clipboard
| Challenge: | Using a knowledge graph question answering task, we replace the entire SPARQL vocabulary with alternate vocabularies. |
| Approach: | They replace the entire SPARQL vocabulary with alternate vocabularies . they find absolute gains in the range of 17% on the GrailQA dataset . |
| Outcome: | The proposed substitutions show that the model performance improves on the GrailQA dataset. |
Similar Papers
Semantic Parsing for Conversational Question Answering over Knowledge Graphs (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent years have seen an increasing number of applications aiming to build conversational interfaces based on information retrieval and user recommendation. |
| Approach: | They develop a dataset where user questions are annotated with Sparql parses and system answers correspond to execution results thereof. |
| Outcome: | The proposed parsers can be used to ground questions into queries over definitions in a knowledge graph with large vocabularies. |
Rethinking Semantic Parsing for Large Language Models: Enhancing LLM Performance with Semantic Hints (2025.acl-short)
Copied to clipboard
| Challenge: | Semantic Parsing improves performance of smaller models, but it is unclear whether it extends similarly to large language models. |
| Approach: | They propose a prompting approach that embeds semantic hints within the prompt to improve LLM performance. |
| Outcome: | The proposed approach improves LLMs’ performance across various tasks, highlighting the potential of integrating semantic information to improve LLM capabilities. |
Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks (2026.acl-short)
Copied to clipboard
| Challenge: | Language models (LMs) are pre-trained on raw text datasets to generate text sequences token-by-token. |
| Approach: | They propose a framework that integrates Language Learning Tasks alongside standard next-token prediction to stimulate the acquisition of morphological, syntactic, and semantic knowledge. |
| Outcome: | The proposed framework improves performance on linguistic competence benchmarks while maintaining competitive performance on reasoning tasks. |
Improving Generalization in Language Model-based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-based Techniques (2023.acl-short)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs)2 have been adopted for semantic parsing due to their promising performance and straightforward architectures. |
| Approach: | They propose to use token preprocessing to preserve semantic boundaries of tokens produced by LM tokenizers and special tokens to mark the boundaries of aligned components. |
| Outcome: | The proposed techniques improve the performance of pre-trained language models on two text-to-SQL semantic parsing datasets. |
Analyzing the Role of Semantic Representations in the Era of Large Language Models (2024.naacl-long)
Copied to clipboard
Zhijing Jin, Yuen Chen, Fernando Gonzalez Adauto, Jiarui Liu, Jiayi Zhang, Julian Michael, Bernhard Schölkopf, Mona Diab
| Challenge: | Existing studies show the benefits of semantic representations in NLP tasks . Existing work using AMR is concerned with trainable models . |
| Approach: | They propose an AMR-driven chain-of-thought prompting method that uses AMR . they propose to use it to predict which input examples AMR may help or hurt on . |
| Outcome: | The proposed method hurts performance more than it helps on five different tasks. |
Constrained Language Models Yield Few-Shot Semantic Parsers (2021.emnlp-main)
Copied to clipboard
Richard Shin, Christopher Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Benjamin Van Durme
| Challenge: | Large pretrained language models excel at generating natural language, but they are not efficient for task specific semantic parsing. |
| Approach: | They propose to use large pretrained language models as few-shot semantic parsers . they paraphrase inputs into a controlled sublanguage resembling English . |
| Outcome: | The proposed model can generate surprisingly accurate models on multiple tasks with minimal code and data. |
Input Representations for Parsing Discourse Representation Structures: Comparing English with Chinese (2021.acl-short)
Copied to clipboard
| Challenge: | Neural semantic parsers have obtained acceptable results in parsing DRSs . previous studies have focused on parse of DRS in English, but have focused only on a few languages . |
| Approach: | They propose to use character sequences as input to map meaning representations to string format. |
| Outcome: | The proposed models learn the meaning of a series of semantic phenomena by taking sentences as input and outputting the corresponding DRSs, without the aid of any extra linguistic information. |
The impact of lexical and grammatical processing on generating code from natural language (2022.findings-acl)
Copied to clipboard
| Challenge: | Yin and Neubig (2018) identify four key components of importance for natural language to code translation. |
| Approach: | They propose a seq2seq-based architecture that relies on a grammar-based decoder and a lexical substitution component for natural language to code translation. |
| Outcome: | The proposed architecture relies on a grammar-based decoder and a BERT encoder . the proposed architecture is based on lexical substitutions in natural language to code translation . |
Exploiting Abstract Meaning Representation for Open-Domain Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work attempts to address these challenges using Pretrained Language Models (PLMs) but the diversity of surface form expressions can hinder the model’s ability to capture accurate correlations, especially when the context is lengthy and complex. |
| Approach: | They propose a method known as Graph-as-Token (GST) to incorporate AMRs into PLMs to assist the model in understanding complex semantic information. |
| Outcome: | The proposed method outperforms existing methods and significantly improves performance on both Natural Questions and TriviaQA. |
Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queries (2021.eacl-main)
Copied to clipboard
| Challenge: | Pretrained language models have been suggested as an alternative or complement to structured knowledge bases . however, this paradigm has only been considered in a very limited setting . |
| Approach: | They propose a paradigm that allows LMs to store a large number of entities . they propose LM-as-KB paradigm which allows querying stored facts . |
| Outcome: | The proposed paradigm allows handling 21k entities whose name is found in common LM vocabularies . the proposed paradigm has only been considered in a very limited setting . |