Challenge: Legal texts contain computational legal clauses that exceed the semantic complexity of the realworld activities they govern.
Approach: They propose a neuro-symbolic approach to legal adjudication using an LLM . they use a typed graph intermediate representation to translate a legal text into a deterministic contract language .
Outcome: The proposed system reduces compute costs by over 90% in high-volume workflows while satisfying auditability requirements.

Similar Papers

LePREC: Reasoning as Classification over Structured Factors for Assessing Relevance of Legal Issues (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive reasoning capabilities, but their precision remains inadequate.
Approach: They propose a framework that integrates neural generation with statistical reasoning to improve the accuracy of large language models.
Outcome: The proposed framework achieves interpretability through transparent feature weighting while maintaining data efficiency through correlation-based statistical classification.
Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have found that when LLMs are given criminal facts and legal rules, then asked whether cases constitute a certain charge, they struggle to understand legal theories and perform basic legal reasoning tasks.
Approach: They propose a task to assess LLMs' understanding of legal theories and reasoning capabilities by using a novel framework: Multi-Agent framework for improving complex legal reasoning capability.
Outcome: The proposed framework improves LLMs' understanding of legal theories and reasoning abilities in real-world scenarios.
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation (2025.acl-long)

Copied to clipboard

Challenge: a novel framework for automated legal interpretation is proposed to alleviate the burden on legal experts.
Approach: They propose a framework for automated legal interpretation that uses large language models to extract concept-related information and interpret legal concepts.
Outcome: The proposed framework eliminates the need for legal experts to interpret legal concepts . it uses large language models to extract concept-related information and interpret legal concept interpretations .
Better Call CLAUSE: A Discrepancy Benchmark for Auditing LLMs Legal Reasoning Capabilities (2026.findings-eacl)

Copied to clipboard

Challenge: Existing evaluation methods fail to probe fragile reasoning capabilities of large language models (LLMs) a single undetected defect can have catastrophic consequences, highlighting the need for a new class of benchmarks to stress-test their reliability against nuanced contractual flaws.
Approach: They propose a benchmark to evaluate the fragility of an LLM’s legal reasoning by producing over 7500 real-world perturbed contracts from foundational datasets like CUAD and ContractNLI.
Outcome: The proposed benchmark evaluates LLMs' ability to detect and reason about fine-grained discrepancies from over 7500 real-world perturbed contracts from foundational datasets like CUAD and ContractNLI.
PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement (2025.acl-demo)

Copied to clipboard

Challenge: Large Language Models (LLMs) are capable of material inference but lack formal rigour and verifiability.
Approach: They propose a framework to unify material and formal inference through an iterative conjecture–criticism process.
Outcome: The proposed framework unifies material and formal inference through an iterative conjecture–criticism process.
ReEfBench: Quantifying the Reasoning Efficiency of LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for Chain-of-Thought evaluations do not distinguish between genuine reasoning and mere verbosity.
Approach: They propose a framework for the non-intrusive, comprehensive process-centric evaluation of reasoning grounded in First-Order Logic.
Outcome: The proposed framework identifies four distinct behavioral prototypes and diagnoses the failure modes.
The Lawyer That Never Thinks: Consistency and Fairness as Keys to Reliable AI (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly used in high-stakes domains like law and research.
Approach: They evaluate six leading Large Language Models on rationality, stability, and ethical fairness through reasoning tests, legal challenges, and bias-sensitive scenarios.
Outcome: The models perform well on reasoning tests, legal challenges, and bias-sensitive scenarios.
TrustTable: A Neuro-Symbolic Auditing Framework for Faithful Table QA (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs)-based TableQA models exhibit unfaithful behavior where correct answers are derived through erroneous reasoning paths.
Approach: They propose a neuro-symbolic framework to audit LLM reasoning processes . it enforces factual grounding and ensures logical soundness by verifying reasoning chains .
Outcome: The proposed framework outperforms LLM judges in majority voting and rejection sampling with process supervision.
Law in Silico: Simulating Legal Society with LLM-Based Agents (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are powerful tools for legal simulation, but their application remains underexplored.
Approach: They propose a unified LLM-based agent framework for simulating legal scenarios . they calibrate agent behaviors against real-world crime data .
Outcome: The proposed framework calibrates agent behaviors against real-world crime data.
Adaptive LLM-Symbolic Reasoning via Dynamic Logical Solver Composition (2026.eacl-long)

Copied to clipboard

Challenge: Existing approaches to NLP are static and require manual formalization.
Approach: They propose an adaptive, multi-paradigm, neuro-symbolic inference framework that automatically identifies formal reasoning strategies from problems expressed in natural language and dynamically selects and applies specialized formal logical solvers.
Outcome: The proposed framework outperforms baselines on individual and multi-paradigm reasoning tasks by 17% and 6%.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations