Papers by Keerakiat Pratai
NitiBench: Benchmarking LLM Frameworks on Thai Legal Question Answering Capabilities (2025.emnlp-main)
Copied to clipboard
Pawitsapak Akarajaradwong, Pirat Pothavorn, Chompakorn Chaksangchaichot, Panuthep Tasawong, Thitiwat Nopparatbundit, Keerakiat Pratai, Sarana Nutanong
| Challenge: | Large language models (LLMs) show promise in legal question answering (QA), yet Thai legal QA systems face challenges due to limited data and complex legal structures. |
| Approach: | They propose a benchmark which uses Thai financial laws and tax rulings to evaluate Thai legal QA systems. |
| Outcome: | The proposed benchmark compared retrieval-augmented generation and long-context LLM approaches across three key dimensions and found that they improve over naive methods. |