Papers by Adithya Chandramouli
Better Call CLAUSE: A Discrepancy Benchmark for Auditing LLMs Legal Reasoning Capabilities (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing evaluation methods fail to probe fragile reasoning capabilities of large language models (LLMs) a single undetected defect can have catastrophic consequences, highlighting the need for a new class of benchmarks to stress-test their reliability against nuanced contractual flaws. |
| Approach: | They propose a benchmark to evaluate the fragility of an LLM’s legal reasoning by producing over 7500 real-world perturbed contracts from foundational datasets like CUAD and ContractNLI. |
| Outcome: | The proposed benchmark evaluates LLMs' ability to detect and reason about fine-grained discrepancies from over 7500 real-world perturbed contracts from foundational datasets like CUAD and ContractNLI. |