Papers by Brandon Smock
On Finding Inconsistencies in Documents (2026.findings-acl)
Copied to clipboard
Charles Lovering, Seth Ebner, Brandon Smock, Michael Krumdick, Muhammad Saad Rabbani, Ahmed Muhammad, Varshini Reddy, Chris Tanner
| Challenge: | Language models can be used to quickly and easily detect inconsistencies in documents . |
| Approach: | They propose a benchmark to measure language models' ability to detect inconsistencies in documents . they use a document with an inconsistent inserted manually by a domain expert . |
| Outcome: | The best-performing model recovered 64% of the inserted inconsistencies on 50 arXiv papers and found that the original authors had already found inconsistent inconsistances. |