Papers by Janderson Santos
Monotonic Scaffolding as a Diagnostic Lens for Legal Reasoning in LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Modern evaluation of Legal QA systems is shifting from terminal accuracy toward process-aware analyses of model reasoning. |
| Approach: | They propose a diagnostic framework grounded in monotonic scaffolding where language models receive gold-standard, case-relevant information across stages aligned with the canonical legal framework FIRAC. |
| Outcome: | The proposed framework evaluates 3,123 Brazilian Bar Exam questions . it shows that terminal accuracy overestimates legal reasoning competence . |