Papers by Robert Friel
Luna: A Lightweight Evaluation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost (2025.coling-industry)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) systems are crucial for enhancing the capabilities of large language models (LLMs) in industry applications. |
| Approach: | They propose a DeBERTA-large encoder for hallucination detection in RAG settings that is fine-tuned for halluination detection. |
| Outcome: | The proposed model outperforms GPT-3.5 and commercial evaluation frameworks on the hallucination detection task, with 97% and 91% reduction in cost and latency, respectively. |