Papers by Sai Rajan
Knowledge-based Consistency Testing of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are being increasingly utilized in real-world applications. |
| Approach: | They propose an automated testing framework which leverages a knowledge graph to construct test cases. |
| Outcome: | The proposed framework generates 19.2% error inducing inputs and reveals 16.5% knowledge gap across all tested LLMs. |