Papers by Javier Carnerero-Cano
Comprehensiveness Metrics for Automatic Evaluation of Factual Recall in Text Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) produce incomplete or selectively omit key information . omissions of key information or misrepresentation of conflicting evidence can cause harm . |
| Approach: | They propose a method that decomposes texts into atomic statements and uses natural language inference to identify missing facts and a Q A-based metric that extracts question-answer pairs and compares responses across sources. |
| Outcome: | The proposed evaluation metrics show they perform better than more complex metrics, but at a cost. |
FactCorrector: A Graph-Inspired Approach to Long-Form Factuality Correction of Large Language Models (2026.acl-long)
Copied to clipboard
Javier Carnerero-Cano, Massimiliano Pronesti, Radu Marinescu, Tigran T. Tchrakian, James Barry, Jasmina Gajcin, Yufang Hou, Alessandra Pascale, Elizabeth M. Daly
| Challenge: | Large language models (LLMs) often produce factually incorrect responses. |
| Approach: | They propose a new method that adapts across domains without retraining and leverages structured feedback to generate a correction. |
| Outcome: | The proposed method outperforms baseline methods on a VELI5 dataset and several popular long-form factuality datasets. |
FactReasoner: A Probabilistic Approach to Long-Form Factuality Assessment for Large Language Models (2025.findings-emnlp)
Copied to clipboard
Radu Marinescu, Debarun Bhattacharjya, Junkyu Lee, Tigran T. Tchrakian, Javier Carnerero-Cano, Yufang Hou, Elizabeth M. Daly, Alessandra Pascale
| Challenge: | Large language models often fail to ensure factual accuracy of outputs thus limiting reliability in real-world applications. |
| Approach: | They propose a neuro-symbolic based factuality assessment framework that employs probabilistic reasoning to evaluate the truthfulness of long-form generated responses. |
| Outcome: | The proposed framework outperforms state-of-the-art prompt-based methods in factual accuracy and recall. |