Learning as Abduction: Trainable Natural Logic Theorem Prover for Natural Language Inference (2020.starsem-1)
Copied to clipboard
| Challenge: | a logic-based approach to Natural Language Inference is becoming less and less common . a new method uses semantic relations to abduct sentences from data . |
| Approach: | They propose a method to reverse a theorem-proving procedure to abduct semantic relations from data. |
| Outcome: | The proposed method improves the performance of the theorem prover on the SICK dataset by 1.4% while maintaining high precision (>94%) |
Similar Papers
AnaLog: Testing Analytical and Deductive Logic Learnability in Language Models (2022.starsem-1)
Copied to clipboard
| Challenge: | Existing approaches to NLP tasks rely on pre-trained language models, but some do not. |
| Approach: | They propose a natural language inference task to test pre-trained language models for logical reasoning capabilities. |
| Outcome: | The proposed language model performs better than other models across logical connectives and reasoning domains, but is sensitive to lexical and syntactic variations in the realisation of logical statements. |
Teach the Rules, Provide the Facts: Targeted Relational-knowledge Enhancement for Textual Inference (2021.starsem-1)
Copied to clipboard
| Challenge: | InferBERT is a method to enhance transformer-based inference models with relevant relational knowledge. |
| Approach: | They propose to enhance transformer-based inference models with relevant relational knowledge by injecting relevant facts at test time into the model. |
| Outcome: | The proposed method outperforms existing models on the challenge datasets while outperforming existing models. |
When Truth Matters - Addressing Pragmatic Categories in Natural Language Inference (NLI) by Large Language Models (LLMs) (2023.starsem-1)
Copied to clipboard
| Challenge: | In this paper, we examine the ability of large language models (LLMs) to accommodate different pragmatic sentence types, such as questions, commands, and sentence fragments for natural language inference (NLI). |
| Approach: | They propose to fine-tune large language models to accommodate different sentence types for natural language inference (NLI) they also explore ChatGPT's concept of entailment by using a symbolic semantic parser. |
| Outcome: | The proposed models can accommodate different sentence types without losing too much accuracy on MNLI-matched models. |
Exploring Factual Entailment with NLI: A News Media Study (2024.starsem-1)
Copied to clipboard
| Challenge: | Recent studies have focused on the relationship between factuality and Natural Language Inference (NLI). |
| Approach: | They propose a novel annotation scheme that models factual rather than textual entailment and use it to annotate a dataset of naturally occurring sentences from news articles. |
| Outcome: | The proposed annotation scheme can be used to model factual relationships on a dataset of naturally occurring sentences from news articles. |
Generating Hypothetical Events for Abductive Inference (2021.starsem-1)
Copied to clipboard
| Challenge: | Abductive reasoning is inference to the best explanation given an incomplete set of observations about everyday situations. |
| Approach: | They propose a model that generates what could happen next from a hypothetical scenario and then proposes the most plausible explanation from varying hypothetical scenarios. |
| Outcome: | The proposed model improves over previous vanilla pre-trained models fine-tuned on Abductive NLI. |
Is Shortest Always Best? The Role of Brevity in Logic-to-Text Generation (2023.starsem-1)
Copied to clipboard
| Challenge: | Logical formulae are essential for scholars in many fields, including linguistics and artificial intelligence. |
| Approach: | They propose to use a Quantified Boolean Formulae (QBFs) problem to find the shortest formulae as input for a "logic-to-text" generation system. |
| Outcome: | The proposed approach improves the comprehensibility and fluency of the generated texts. |
NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoning (2021.starsem-1)
Copied to clipboard
| Challenge: | Currently, symbolic and deep learning approaches to NLI are receiving less attention. |
| Approach: | They propose a symbolic-based inference framework that integrates symbolic reasoning and semantic formalism to solve NLI tasks. |
| Outcome: | The proposed framework improves accuracy on the NLI task and on the SICK and MED datasets. |
Limits for learning with language models (2023.starsem-1)
Copied to clipboard
| Challenge: | Recent studies show that large language models fail to capture important aspects of linguistic meaning . authors argue that LLMs cannot learn fundamental semantic properties defined in formal semantics . |
| Approach: | They propose a theoretical explanation for some of the observed failings of large language models . they show that LLMs cannot learn certain fundamental semantic properties . |
| Outcome: | The proposed model fails to learn semantic entailment and consistency as defined in formal semantics, the authors argue . their model fails on tasks that require engorgements and deep linguistic understanding, they argue - but not on universal quantification. |
PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs (2024.starsem-1)
Copied to clipboard
| Challenge: | Existing approaches to utilizing explicit knowledge graphs (KGs) are limited by the number of nodes in the subgraph. |
| Approach: | They propose a grounding-pruning-reasoning pipeline to prune noisy nodes in subgraphs to improve the efficiency of graph reasoning with KG. |
| Outcome: | The proposed method reduces computation cost and memory usage while obtaining decent representation of pruned subgraphs. |
ParsFEVER: a Dataset for Farsi Fact Extraction and Verification (2021.starsem-1)
Copied to clipboard
Majid Zarharan, Mahsa Ghaderan, Amin Pourdabiri, Zahra Sayedi, Behrouz Minaei-Bidgoli, Sauleh Eetemadi, Mohammad Taher Pilehvar
| Challenge: | Existing methods for fact-checking and verification require large amounts of annotated data, but this is limited to low-resource languages. |
| Approach: | They present a first publicly available Farsi dataset for fact extraction and verification . they use the construction procedure of the standard English dataset for the task . |
| Outcome: | The proposed dataset improves on the standard English dataset and is available on github. |