Papers by Gili Lior
Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Document collections of various domains share some underlying collection-wide structure . structure can be useful in various use cases across different domains, such as legal, medical, or financial . |
| Approach: | They propose to identify the typical structure of document within a collection by using header paraphrases to ground topics to respective document locations. |
| Outcome: | The proposed method extracts meaningful collection-wide structure from documents in three domains in English and Hebrew. |
ReliableEval: A Recipe for Stochastic LLM Evaluation via Method of Moments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LLMs are highly sensitive to prompt phrasing, yet standard benchmarks typically report performance using a single prompt, raising concerns about the reliability of such evaluations. |
| Approach: | They propose a stochastic method of moments evaluation over the space of meaning-preserving prompt perturbations and propose resamplings to estimate the number of prompt re-sampleds needed to obtain meaningful results. |
| Outcome: | The proposed method is model-, task-, and metric-agnostic, offering a recipe for meaningful and robust evaluation. |
PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that LLMs are highly sensitive to small, meaning-preserving variations in task formulation. |
| Approach: | They propose a framework that enables the automatic generation of various prompts. |
| Outcome: | The proposed framework provides meaningful variations to support strong evaluation practices. |