Papers with Messi
The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces (2025.naacl-short)
Copied to clipboard
| Challenge: | Existing studies have focused on simple factual recall, but we have not explored how this is used in more complex queries. |
| Approach: | They propose to identify low-dimensional subspaces which encode numerical attributes associated with entities in comparison prompts. |
| Outcome: | The proposed model can answer numeric comparison questions using a low-dimensional subspace of theembedding space. |
DUnE: Dataset for Unified Editing (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models are susceptible to errors necessitating a comprehensive retraining process. |
| Approach: | They propose to define an edit as any natural language expression that solicits a change in the model’s outputs. |
| Outcome: | The proposed editing benchmarks show that retrieval-augmented language modeling outperforms specialized editing techniques and neither set of approaches has fully solved the generalized editing problem covered by the proposed benchmark. |