Papers with ProofWriter
Towards General Natural Language Understanding with Probabilistic Worldbuilding (2022.tacl-1)
Copied to clipboard
| Challenge: | Probabilistic worldbuilding model is a Bayesian model of semantic parsing and reasoning . large-scale language models are domain-general, despite training on text from virtually every domain . |
| Approach: | They propose a Bayesian probabilistic worldbuilding model that parses and abduces sentences . they use a dataset to test their method against heuristics and to generate a probability model . |
| Outcome: | The proposed model outperforms baselines on two out-of-domain question-answering datasets. |
Concise and Organized Perception Facilitates Reasoning in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Extensive experimental results on several popular logical benchmarks (ProofWriter, PrOntoQA, PrONtoQA-OOD, and FOLIO) and mathematical benchmark (DI-GSM) show that COP significantly outperforms previous state-of-the-art methods. |
| Approach: | They propose a reasoning approach called Concise and Organized Perception (COP) that carefully analyzes the given statements to identify the most pertinent information while eliminating redundancy efficiently. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on several popular logical benchmarks and mathematical benchmarks. |
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers (2023.emnlp-main)
Copied to clipboard
Theo Olausson, Alex Gu, Ben Lipkin, Cedegao Zhang, Armando Solar-Lezama, Joshua Tenenbaum, Roger Levy
| Challenge: | Logical reasoning is an important task for artificial intelligence, says a new study . many prompting-based strategies to enable large language models fail in subtle and unpredictable ways. |
| Approach: | They propose to reformulate logical reasoning tasks by leveraging large language models . they use a modular neurosymbolic programming approach to translate premises and conclusions from natural language to logic . |
| Outcome: | The proposed approach outperforms open-source models on FOLIO and ProofWriter while showing distinct failure modes. |
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work shows that transformers can generate both implications of a theory and the natural language proofs that support them. |
| Approach: | They propose a generative model that generates both implications of a theory and natural language proofs that support them. |
| Outcome: | The proposed model generates both implications of a theory and the natural language proofs that support them. |
LeanReasoner: Boosting Complex Logical Reasoning with Lean (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) often struggle with complex logical reasoning due to logical inconsistencies and the inherent difficulty of such reasoning. |
| Approach: | They propose a method that formalizes logical reasoning problems into theorems within Lean and then proves or disproving the corresponding theorels. |
| Outcome: | The proposed method achieves state-of-the-art performance on the FOLIO dataset and near this level on ProofWriter. |
DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have revolutionized the landscape of reasoning tasks. |
| Approach: | They propose a new approach that rethinks the reasoning process as an evolution from indeterminacy to determinacy. |
| Outcome: | The proposed model surpasses all baselines on various logical reasoning benchmarks. |