Papers by Xinnuo Li
ExAnte: A Benchmark for Ex-Ante Inference in Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) struggle with ex-ante reasoning—making inferences or predictions without access to future information. |
| Approach: | They propose a benchmark that assesses LLMs’ ex-ante inference ability across four tasks: stock prediction, question answering, Wikipedia event generation, and scientific publication generation. |
| Outcome: | The proposed benchmark assesses LLMs’ ex-ante inference ability across four tasks. |
Fact-based Content Weighting for Evaluating Abstractive Summarisation (2020.acl-main)
Copied to clipboard
| Challenge: | Abstractive summarisation is notoriously hard to evaluate since word-overlap-based metrics are insufficient. |
| Approach: | They propose a new evaluation metric which is based on fact-level content weighting, relating the facts of the document to the facts in the summary. |
| Outcome: | The proposed evaluation metric is highly correlated to human perception and compares favourably to the recent manual highlight-based metric of Hardy et al. |