| Challenge: | a limited amount of annotated data is available for mathematical language processing . mathematics is a highly specialized domain with its own unique set of challenges . |
| Approach: | They provide annotated corpora that can be used to study the language of mathematics . they provide part-of-speech tags, lemmas, and dependency trees . |
| Outcome: | The proposed corpora provide part-of-speech tags, lemmas, and dependency trees . the learning assistant grants access to the content of the corporata in a context-sensitive manner . |
Similar Papers
Introduction to Mathematical Language Processing: Informal Proofs, Word Problems, and Supporting Tasks (2023.tacl-1)
Copied to clipboard
| Challenge: | Using mathematical language processing methods, we analyze prevailing methods, existing limitations, and promising avenues for future research. |
| Approach: | They analyze mathematical language processing methods from recent years and highlight prevailing methodologies, existing limitations and promising avenues for future research. |
| Outcome: | The proposed methods highlight prevailing methods, existing limitations and promising avenues for future research. |
A Repository of Corpora for Summarization (L18-1)
Copied to clipboard
| Challenge: | Summarization corpora are numerous but fragmented, making it difficult to pinpoint corporata best suited for a given summarization task. |
| Approach: | They propose a repository containing corpora available to train and evaluate automatic summarization systems. |
| Outcome: | The proposed system is based on a repository of corpora available for summarization tasks. |
Natural Language Premise Selection: Finding Supporting Statements for Mathematical Text (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to understand mathematical discourse are limited by the complexity of word and symbol interactions. |
| Approach: | They propose a task to retrieve supporting definitions and supporting propositions from a dataset that can be used to evaluate different approaches for the task. |
| Outcome: | The proposed task is based on a dataset that can be used to evaluate different approaches for the natural premise selection task. |
MathAlign: Linking Formula Identifiers to their Contextual Natural Language Descriptions (2020.lrec-1)
Copied to clipboard
Maria Alexeeva, Rebecca Sharp, Marco A. Valenzuela-Escárcega, Jennifer Kadowaki, Adarsh Pyarelal, Clayton Morrison
| Challenge: | Existing approaches to extract mathematical concepts and their descriptions are useful for a variety of tasks, including math information retrieval and accessibility efforts to make scientific documents available to the visually impaired. |
| Approach: | They propose a rule-based approach which extracts LaTeX representations of formula identifiers and links them to their in-text descriptions, given only the original PDF and the location of the formula of interest. |
| Outcome: | The proposed approach extracts LaTeX representations of formula identifiers and links them to their in-text descriptions, given only the original PDF and the location of the formula of interest. |
Tree-Based Representation and Generation of Natural and Mathematical Language (2023.acl-long)
Copied to clipboard
| Challenge: | Existing models for generating and modeling mathematical language are limited . existing models for modeling and generating mathematical language simply treat mathematical expressions as text . |
| Approach: | They propose to combine mathematical expressions and text-based models to generate mathematically valid expressions. |
| Outcome: | The proposed model outperforms baselines on mathematical expression generation tasks. |
Neural Machine Translation for Mathematical Formulae (2023.acl-long)
Copied to clipboard
| Challenge: | a recent paper examines the problem of neural machine translation of mathematical formulae between ambiguous presentation languages and unambiguous content languages. |
| Approach: | They perform translation tasks from LaTeX to Mathematica and from La TeX into semantic LaTaX using convolutional sequence-to-sequence networks. |
| Outcome: | The proposed translations achieve 95.1% and 90.7% exact matches between the two languages. |
Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Models (2025.findings-acl)
Copied to clipboard
Haoyang Li, Xuejia Chen, Zhanchao Xu, Darian Li, Nicole Hu, Fei Teng, Yiming Li, Luyu Qiu, Chen Jason Zhang, Li Qing, Lei Chen
| Challenge: | Existing benchmarks focus on linguistic competence or structured mathematical problem-solving, neglecting fundamental numerical reasoning required in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate numerical capabilities for large language models . they use a dataset to assess number recognition, arithmetic operations, contextual retrieval, comparison, summary, and multi-step reasoning. |
| Outcome: | The proposed benchmark evaluates six fundamental numerical capabilities: number recognition, arithmetic operations, contextual retrieval, comparison, summary, and multi-step reasoning. |
STEM-POM: Evaluating Language Models Math-Symbol Reasoning in Document Parsing (2025.findings-acl)
Copied to clipboard
| Challenge: | Advances in large language models have spurred research into enhancing their reasoning capabilities, particularly in math-rich STEM documents. |
| Approach: | They propose a benchmark dataset to evaluate LLMs’ reasoning abilities on math symbols within contextual scientific text. |
| Outcome: | The proposed dataset demonstrates that state-of-the-art LLMs achieve an average accuracy of 20-60% under in-context learning and 50-60% with fine-tuning, highlighting a substantial gap in their ability to classify mathematical symbols. |
SciNLP: A Domain-Specific Benchmark for Full-Text Scientific Entity and Relation Extraction in NLP (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets for structured information extraction focus on specific publication sections due to domain complexity and high cost of annotating scientific texts. |
| Approach: | They propose a specialized benchmark for full-text entity and relation extraction in the natural language processing domain. |
| Outcome: | The proposed dataset comprises 60 manually annotated full-text NLP publications covering 7,072 entities and 1,826 relations. |
Autoformalization in the Wild: Assessing LLMs on Real-World Mathematical Definitions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable potential in assisting with mathematical reasoning on different downstream tasks. |
| Approach: | They propose two new tools for autoformalizing real-world mathematical definitions from Wikipedia and arXiv papers. |
| Outcome: | The proposed methods improve definitions by up to 16% and undefined errors by 43%. |