Learning Semantic Structure through First-Order-Logic Translation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that transformer-based language models can confuse which predicates apply to which objects . a this is a crucial building block of semantic structure, but if an LM mixes up which objects have which property, it makes errors in reasoning . |
| Approach: | They propose to use transformer-based language models to learn predicate argument structure from simple sentences. |
| Outcome: | The proposed model can learn predicate argument structure from simple sentences. |
Similar Papers
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models (2023.findings-acl)
Copied to clipboard
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron Halfaker, Liqun Shao, Daniel McDuff, Ahmed Hassan Awadallah, Dragomir Radev, Jianfeng Gao
| Challenge: | Existing pre-trained language models that ignore the logical structures underlying natural language text often lack the ability to capture and encode key logical information in the input sequences. |
| Approach: | They propose to construct logic-aware input embeddings for transformer language models through logic detection, logic mapping and hierarchical logical projections and then develop a new modeling paradigm that can upgrade existing transformer language model into logical transformers to boost their performance. |
| Outcome: | The proposed model can achieve superior performance on four important and challenging tasks. |
Can Language Models Learn Embeddings of Propositional Logic Assertions? (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for automating reasoning can no longer be used for natural language tasks. |
| Approach: | They propose to use transformer-based language models to reason about knowledge expressed in natural language rather than using LMs to perform reasoning directly. |
| Outcome: | The proposed approach is feasible to some extent, but lacks robustness. |
Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Logic-based approaches to reasoning have lost popularity due to limited scalability and coverage. |
| Approach: | They present a dataset of 28K sentence-level NL-FOL pairs from GPT4 and a LogicLLaMA2-7B/13B fine-tuned on MALLS for NL translation. |
| Outcome: | The proposed model can be used standalone or to correct previously generated rules by GPT3.5. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
Probing for Predicate Argument Structures in Pretrained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Recent proposed approaches have achieved impressive results in dependency- and span-based, multilingual and cross-lingual Semantic Role Labeling (SRL) |
| Approach: | They propose to probe for predicate argument structures in pretrained language models . they show that PLMs encode semantic structures directly into contextualized representations . |
| Outcome: | The proposed models have achieved impressive results in dependency- and span-based, multilingual and cross-lingual Semantic Role Labeling (SRL) |
Leveraging pre-trained language models for linguistic analysis: A case of argument structure constructions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Argument structure constructions (ASCs) are lexicogrammatical patterns at the clausal level. |
| Approach: | They evaluate the effectiveness of pre-trained language models in identifying argument structure constructions . they use supervised training with RoBERTa and prompt-guided annotation with GPT-4 . |
| Outcome: | The proposed model outperforms the gold-standard model on three methods . the results show that the model performs better on gold-standardized data . |
Complex Reasoning in Natural Language (2023.acl-tutorials)
Copied to clipboard
| Challenge: | Recent research shows that pretrained language models are often brittle for complex reasoning tasks. |
| Approach: | They propose to use pre-trained language models to teach machines to reason over texts . they will review recent promising approaches to tackling complex reasoning tasks . |
| Outcome: | This tutorial reviews promising approaches to complex reasoning tasks . it reviews the methods that can be used to augment models with robustness . |
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-based Question Answering (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to embedding in multiparty dialogues are poor for span-based question answering (QA) |
| Approach: | They propose a novel approach to transformers that learns hierarchical representations in multiparty dialogue. |
| Outcome: | The proposed model improves on the FriendsQA dataset by 3.8% and 1.4% over the two state-of-the-art models. |
STL-CQA: Structure-based Transformers with Localization and Encoding for Chart Question Answering (2020.emnlp-main)
Copied to clipboard
| Challenge: | Chart Question Answering (CQA) is a task of answering natural language questions about visualisations in the chart image. |
| Approach: | They propose a method for Chart Question Answering which improves the question/answering through sequential elements localization, question encoding and then, a structural transformer-based learning approach. |
| Outcome: | The proposed method outperforms state-of-the-art methods on various chart Q/A datasets while outperforming even human baseline. |
Asking and Answering Questions to Extract Event-Argument Structures (2024.lrec-main)
Copied to clipboard
| Challenge: | Traditionally, corpora are limited to arguments within the same sentence, and inter-sentential arguments are more challenging and have received less attention. |
| Approach: | They propose a question-answering approach to extract document-level event-argument structures by automating questions for each argument type an event may have. |
| Outcome: | The proposed model outperforms previous models and is especially beneficial to extract arguments that appear in different sentences than the event trigger. |