Papers by Terry Zhuo
Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have attracted a lot of attention in the legal domain due to their ability to tackle a variety of legal tasks. |
| Approach: | They constructed a corpus consisting of two legal scenarios using the IRAC method and used it to perform analysis on the corpus. |
| Outcome: | The proposed model can analyze a contract act in Malaysia and the Australian Social Act for Dependent Child using the IRAC method. |
DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Text (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models generate huge amounts of text, making it impractical to manually distinguish whether a text is machine-generated. |
| Approach: | They propose two methods to detect machine-generated text by leveraging Log-Rank information and propose a faster method that uses less perturbations to achieve the same level of performance. |
| Outcome: | The proposed methods improve over the state of the art by 3.9 and 1.75 AUROC points absolute and require less perturbations to achieve the same level of performance. |