Benchmarking Meaning Representations in Neural Semantic Parsing (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on meaning representations is not comprehensively evaluated due to the lack of readily-available execution engines. |
| Approach: | They propose a unified benchmark on meaning representations by integrating existing semantic parsing datasets, completing the missing logical forms, and implementing the missing execution engines. |
| Outcome: | The proposed benchmark combines existing parsing datasets, completes missing logical forms, and implements missing execution engines. |
Similar Papers
Exploring the Secrets Behind the Learning Difficulty of Meaning Representations for Semantic Parsing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that the design of Meaning Representation (MR) greatly influences the final model performance of a neural semantic parser. |
| Approach: | They propose a data-aware metric called ISS to measure the final performance of MRs. |
| Outcome: | The proposed metric denoting incremental structural stability (ISS) of MRs can be used as an indicator for MR design to avoid the costly training-testing process. |
Meaning Representations for Natural Languages: Design, Models and Applications (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | a tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation. |
| Approach: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation. authors propose a cutting-edge, full-day tutorial for all stakeholders in the AI community. |
| Outcome: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models . it also reviews the applications of meaning representation in downstream NLP tasks and real-world applications . |
Meaning Representations for Natural Languages: Design, Models and Applications (2022.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models. |
| Approach: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models. |
| Outcome: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models . it also reviews the applications of meaning representation in downstream NLP tasks and real-world applications . |
Neural Semantic Parsing (P18-5)
Copied to clipboard
| Challenge: | Semantic parsing is the study of translating natural language utterances into machine-executable programs. |
| Approach: | They will describe the various approaches researchers have taken to translate natural language into a formal language . they will also discuss why much recent work has chosen to use standard programming languages instead of more linguistically-motivated representations. |
| Outcome: | This paper will describe the various approaches researchers have taken to translate natural language into a formal language. |
Reranking for Neural Semantic Parsing (P19-1)
Copied to clipboard
| Challenge: | Semantic parsing is the task of transducing natural language utterances into machine executable meaning representations (e.g., Python code). |
| Approach: | They propose to rerank an n-best list of predicted MRs and use features to fix observed problems with baseline models to improve parser performance. |
| Outcome: | The proposed method outperforms the best published neural parser on four datasets and improves the baseline parsing performance by 5.7% and 2.9%. |
A Survey of Meaning Representations – From Theory to Practical Utility (2024.naacl-long)
Copied to clipboard
| Challenge: | Symbolic meaning representations of natural language text have been studied since at least the 1960s . with the availability of large annotated corpora, the field has recently seen several new developments . |
| Approach: | They propose a framework for expressing meaning in natural language text using annotated corpora and a set of tools for machine learning. |
| Outcome: | The frameworks are based on a set of theoretical and practical problems and their applications. |
A Survey of AMR Applications (2024.emnlp-main)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation that takes the form of a rooted, directed graph. |
| Approach: | They analyze more than 100 papers which use Abstract Meaning Representation (AMR) they highlight the range of applications for which AMR has been harnessed and techniques for incorporating it . they also highlight broader AMR engineering patterns and outline areas of future work that seem ripe for AMR incorporation. |
| Outcome: | The results highlight the range of applications for which AMR has been harnessed and the techniques for incorporating it into those applications. |
Analyzing the Role of Semantic Representations in the Era of Large Language Models (2024.naacl-long)
Copied to clipboard
Zhijing Jin, Yuen Chen, Fernando Gonzalez Adauto, Jiarui Liu, Jiayi Zhang, Julian Michael, Bernhard Schölkopf, Mona Diab
| Challenge: | Existing studies show the benefits of semantic representations in NLP tasks . Existing work using AMR is concerned with trainable models . |
| Approach: | They propose an AMR-driven chain-of-thought prompting method that uses AMR . they propose to use it to predict which input examples AMR may help or hurt on . |
| Outcome: | The proposed method hurts performance more than it helps on five different tasks. |
Coarse-to-Fine Decoding for Neural Semantic Parsing (P18-1)
Copied to clipboard
| Challenge: | Experimental results show that semantic parsing is more efficient than using simple decoders. |
| Approach: | They propose a structure-aware neural architecture which decomposes the semantic parsing process into two stages. |
| Outcome: | The proposed architecture consistently improves performance on four datasets characteristic of different domains and meaning representations. |
Pushing the Limits of AMR Parsing with Self-Learning (2020.findings-emnlp)
Copied to clipboard
Young-Suk Lee, Ramón Fernandez Astudillo, Tahira Naseem, Revanth Gangi Reddy, Radu Florian, Salim Roukos
| Challenge: | Abstract Meaning Representation (AMR) parsing has experienced a notable growth in performance in the last two years due to the impact of transfer learning and the development of novel architectures specific to AMR. |
| Approach: | They propose to use AMR annotations to generate synthetic text and refine actions oracle without additional human annotations for AMR parsing. |
| Outcome: | The proposed models improve on AMR 1.0 and 2.0 without human annotations. |