Papers by Marco Bonizzato
Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on identifying and addressing hallucinations in large language models (LLMs), but the impact of the training process on hallucinosity remains underexplored. |
| Approach: | They propose a training protocol to reduce hallucination variance by dropping embedding indices with significant variability and an unsupervised halluciation detection metric, Efficient EigenScore. |
| Outcome: | The proposed training protocol reduces hallucination variance during training by dropping embedding indices with significant variability. |