Recursive numeral systems are highly regular and easy to process (2026.eacl-long)
Copied to clipboard
Ponrawee Prasertsom, Andrea Silvi, Jennifer Culbertson, Devdatt Dubhashi, Moa Johansson, Kenny Smith
| Challenge: | Existing studies on linguistic efficiency have focused on the systematicity of forms, a key property of natural language. |
| Approach: | They propose to incorporate regularity across sets of forms in studies of efficiency in language . they use the Minimum Description Length approach to measure regularity and processing complexity . |
| Outcome: | The proposed method shows that recursive numeral systems are more efficient with respect to regularity and processing complexity. |
Similar Papers
Systematicity between Forms and Meanings across Languages Supports Efficient Communication (2026.acl-long)
Copied to clipboard
| Challenge: | Languages vary in how meanings map to word forms, but this theory does not account for systematic relations within word forms. |
| Approach: | They propose a model that measures the learnability of meaning-to-form mappings by inverse of simplicity. |
| Outcome: | The proposed model captures fine-grained regularities in linguistic form, allowing better discrimination between attested and unattested systems. |
High Performance Natural Language Processing (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | a tutorial on scaling natural language processing will recapitulate the state-of-the-art in the field . |
| Approach: | This cutting-edge tutorial recapitulates the state-of-the-art in natural language processing with scale in perspective. |
| Outcome: | This cutting-edge tutorial recapitulates the state-of-the-art in natural language processing with scale in perspective. |
On Efficiently Representing Regular Languages as RNNs (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent work by Hewitt et al. (2020) provides an interpretation of the empirical success of recurrent neural networks (RNNs) as language models (LMs). |
| Approach: | They generalize their construction and show that RNNs can efficiently represent a larger class of LMs than previously claimed. |
| Outcome: | The results suggest that RNNs can represent a larger class of LMs than previously claimed . |
NUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs are not able to handle numerals and units of measurement, but they can be improved by introducing perturbations. |
| Approach: | They propose to analyze existing LLMs on processing numerals and units of measurement by perturbing their datasets. |
| Outcome: | The proposed model improves on ancient Chinese arithmetic problems and can handle numeral and measurement conversions. |
Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles (2025.emnlp-main)
Copied to clipboard
| Challenge: | Across languages, numeral systems vary widely in how they construct and combine numbers. |
| Approach: | They conduct experiments to examine the linguistic and mathematical aspects of numbers in language. |
| Outcome: | The models can't solve linguistic-mathematical puzzles involving cross-linguistic numeral systems, the authors found . they lack the ability to flexibly infer compositional rules from implicit patterns in human-scale data. |
Re-Tuning: Overcoming the Compositionality Limits of Large Language Models with Recursive Tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to solve compositional tasks are limited by complexity and complexity. |
| Approach: | They propose a method that tunes large language models to break down a problem into subproblems, solve those subproblem, and combine the results. |
| Outcome: | The proposed method significantly improves model performance on three representative compositional tasks: integer addition, dynamic programming, and parity. |
Efficient Methods for Natural Language Processing: A Survey (2023.tacl-1)
Copied to clipboard
Marcos Treviso, Ji-Ung Lee, Tianchu Ji, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Colin Raffel, Pedro H. Martins, André F. T. Martins, Jessica Zosa Forde, Peter Milder, Edwin Simpson, Noam Slonim, Jesse Dodge, Emma Strubell, Niranjan Balasubramanian, Leon Derczynski, Iryna Gurevych, Roy Schwartz
| Challenge: | Recent work in natural language processing (NLP) has yielded appealing results from scaling model parameters and training data, but using only scale to improve performance means resource consumption also grows. |
| Approach: | They propose to use data, time, storage, or energy to improve model performance. |
| Outcome: | The proposed methods and findings provide guidance for conducting NLP under limited resources and point towards promising research directions for developing more efficient methods. |
Incremental Natural Language Processing: Challenges, Strategies, and Evaluation (C18-1)
Copied to clipboard
| Challenge: | In this survey, I consolidate and categorize the approaches, identifying similarities and differences in computation and data, and show trade-offs that have to be considered. |
| Approach: | They consolidate and categorize approaches to incremental processing and show trade-offs that have to be considered. |
| Outcome: | The proposed approaches show that they have similarities and differences in computation and data and that they are not trivial. |
Frequency & Compositionality in Emergent Communication (2025.emnlp-main)
Copied to clipboard
| Challenge: | Natural languages exhibit a universal tendency to resist regular patterns, developing idiosyncratic forms. |
| Approach: | They investigate the relationship between frequency and compositionality in emergent languages . they use a referential game setting to manipulate input frequency through Zipfian distributions . |
| Outcome: | The proposed method shows that the frequency distributions of the most frequent words resist regular patterns, resulting in less compositional structure. |
Representing Numbers in NLP: a Survey and a Vision (2021.naacl-main)
Copied to clipboard
| Challenge: | Numeracy is an essential skill for language understanding since numbers are often interspersed in text. |
| Approach: | They propose a comprehensive taxonomy of tasks and methods to represent numbers in text . they synthesize best practices for representing numbers in texts and articulate a vision for holistic numeracy . |
| Outcome: | The proposed model synthesizes best practices for representing numbers in text . it argues that the model is more effective than other approaches . |