| Challenge: | Numeracy is an essential skill for language understanding since numbers are often interspersed in text. |
| Approach: | They propose a comprehensive taxonomy of tasks and methods to represent numbers in text . they synthesize best practices for representing numbers in texts and articulate a vision for holistic numeracy . |
| Outcome: | The proposed model synthesizes best practices for representing numbers in text . it argues that the model is more effective than other approaches . |
Similar Papers
Exploring Numeracy in Word Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing word embeddings are inadequate at capturing numerical properties of numbers. |
| Approach: | They propose to use word embeddings to capture numerical properties of numbers . they hope to develop methods which better capture numeric properties . |
| Outcome: | The proposed models lack the ability to capture numeric properties of numbers, the authors show . their findings provide a starting point for the development of better models . |
Numeracy for Language Models: Evaluating and Improving their Ability to Predict Numbers (P18-1)
Copied to clipboard
| Challenge: | Numeracy is the ability to understand and work with numbers. |
| Approach: | They propose a neural architecture that uses a continuous probability density function to model numerals from an open vocabulary using hierarchical models. |
| Outcome: | The proposed model reduces errors by 18% and 54% on clinical and scientific datasets compared to the second best model for each dataset . |
Do NLP Models Know Numbers? Probing Numeracy in Embeddings (D19-1)
Copied to clipboard
| Challenge: | Existing models cannot capture numeracy, but they can be useful for complex reasoning tasks. |
| Approach: | They investigate numerical reasoning capabilities of a question-answering model . they probe token embedding methods on synthetic list maximum, number decoding, and addition tasks. |
| Outcome: | The proposed model excels on questions that require numerical reasoning, i.e., it already captures numeracy. |
Revealing the Numeracy Gap: An Empirical Investigation of Text Embedding Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Text embedding models are widely used in natural language processing but are often benchmarked on tasks that do not require understanding nuanced numerical information in text. |
| Approach: | They evaluate 13 widely used text embedding models and find they struggle to capture numerical details accurately. |
| Outcome: | The proposed models struggle to capture nuanced numerical details accurately, despite being benchmarked on tasks that do not require understanding nuance. |
Laying Anchors: Semantically Priming Numerals in Language Modeling (2024.findings-naacl)
Copied to clipboard
| Challenge: | Numeracy is the comprehension of numbers, and numerals are important for comprehension. |
| Approach: | They propose methods to semantically prime numerals by generating anchors governed by the distribution of numeral in any corpus. |
| Outcome: | The proposed methods perform better on numeracy tasks for both in-domain and out-domain numerals. |
Meaning Representations for Natural Languages: Design, Models and Applications (2022.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models. |
| Approach: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models. |
| Outcome: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models . it also reviews the applications of meaning representation in downstream NLP tasks and real-world applications . |
Learning Numeracy: A Simple Yet Effective Number Embedding Approach Using Knowledge Graph (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for numeracy-intensive applications fail to learn numerability . existing models fail to handle numbers, resulting in performance problems . |
| Approach: | They propose a number embedding approach that embeds numbers into dimensional space . they construct a knowledge graph consisting of number entities and magnitude relations . |
| Outcome: | The proposed method is easy to implement and shows that it performs well on numeracy-related tasks. |
Meaning Representations for Natural Languages: Design, Models and Applications (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | a tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation. |
| Approach: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation. authors propose a cutting-edge, full-day tutorial for all stakeholders in the AI community. |
| Outcome: | This tutorial reviews the design of common meaning representations and SoTA models for predicting meaning representation models . it also reviews the applications of meaning representation in downstream NLP tasks and real-world applications . |
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges (2025.acl-long)
Copied to clipboard
Bolei Ma, Yuting Li, Wei Zhou, Ziwei Gong, Yang Janet Liu, Katja Jasinskaja, Annemarie Friedrich, Julia Hirschberg, Frauke Kreuter, Barbara Plank
| Challenge: | linguistics studies how context influences meaning of language and how people use it to convey implied meanings, emotions, and intentions. |
| Approach: | They analyze task designs, data collection methods, evaluation approaches and their relevance to real-world applications. |
| Outcome: | The findings highlight emerging trends, challenges, and gaps in existing benchmarks . the findings will contribute to more nuanced and context-aware NLP models . |
Numeracy enhances the Literacy of Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Specialized number representations have shown improvements on numerical reasoning tasks like arithmetic word problems and masked number prediction. |
| Approach: | They propose to use six different number encoders to improve masked word prediction by avoiding conflating nominal and ordinal number occurrences. |
| Outcome: | The proposed representations improve masked word prediction accuracy and generalize to contexts without annotated numbers. |