Papers by Theodore Zhao
Pareto Optimal Learning for Estimating Large Language Model Errors (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches for improving the correctness of LLMs include prompt engineering, retrieval methods, and a generative model. |
| Approach: | They propose a method that generates a risk score to estimate the probability of error in an LLM by integrating multiple sources of information. |
| Outcome: | The proposed method is well correlated with the true LLM error rate, thus facilitating error correction. |