Best-of-L: Cross-Lingual Reward Modeling for Mathematical Reasoning (2026.findings-eacl)
Copied to clipboard
| Challenge: | Recent studies have focused on improving reasoning ability in English models, with multilingual models receiving comparatively little attention. |
| Approach: | They propose a framework that ranks candidate reasoning traces across languages rather than within a single language. |
| Outcome: | The proposed framework improves accuracy by up to 10 points in English compared to using reward modeling within a single language. |
Similar Papers
Demystifying Multilingual Reasoning in Process Reward Modeling (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study focuses on the use of large language models to solve multi-step reasoning tasks. |
| Approach: | They propose to extend large language models to multilingual settings by extending process reward models to English . they train multilingual PRMs on a dataset spanning seven languages, which is translated from english . |
| Outcome: | The proposed model improves accuracy and reduces early-stage reasoning errors. |
A Survey of Multilingual Reasoning in Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | This survey provides the first in-depth review of multilingual reasoning in Language Models. |
| Approach: | This survey provides the first in-depth review of multilingual reasoning in LMs. |
| Outcome: | The present study provides the first in-depth review of multilingual reasoning in LMs. |
LLM Parameters for Math Across Languages: Shared or Separate? (2026.acl-srw)
Copied to clipboard
Behzad Shomali, Luisa Victor, Tim Selbach, Ali Hamza Bashir, David Berghaus, Joachim Koehler, Mehdi Ali, Markus Frey
| Challenge: | Existing research on large language models (LLMs) has focused on performance or representational properties, but it remains unclear whether these differences reflect language-specific parameters or a shared mechanism. |
| Approach: | They propose to localize and compare model parameters that support mathematical reasoning across languages. |
| Outcome: | The proposed analysis shows that the model parameters in English and lower-resource languages exhibit partial cross-lingual overlap with systematic language-dependent differences. |
The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AI (2026.eacl-short)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) are highly effective on mathematical, scientific, and other question-answering tasks. |
| Approach: | They compare an LRM's reasoning in English to that of a multilingual question . they find that English reasoning traces exhibit a substantially higher presence of cognitive behaviors . |
| Outcome: | The LRMs generate reasoning sequences in English, but the language of the question is not. |
Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research focuses on developing powerful large language models for mathematical reasoning within monolingual languages. |
| Approach: | They propose to use translation to build powerful multilingual math reasoning models . they propose different training strategies to build xMR LLMs that outperform open-source LLM . |
| Outcome: | The proposed model outperforms open-source LLMs and surpasses ChatGPT in few-shot scenarios. |
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) demonstrate impressive multilingual capability, but their performance varies substantially across different languages. |
| Approach: | They propose a generic template prompt that stimulates cross-lingual and logical reasoning skills to enhance task performance across languages. |
| Outcome: | The proposed method improves multilingual capability across languages and covers high-resource and low-resourced languages. |
Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning (2026.acl-long)
Copied to clipboard
Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Kaiyu Huang, Yufeng Chen, Xu Jinan, Jie Zhou
| Challenge: | Current Large Reasoning Models exhibit two critical limitations when processing non-English languages: (1) They struggle to maintain input-output language consistency; (2) They generally perform poorly with wrong reasoning paths and lower answer accuracy compared to English. |
| Approach: | They propose a language-consistency reward and a cross-lingual thinking alignment reward to improve the model's interpretability and accuracy. |
| Outcome: | The proposed model achieves nearly 100% language consistency and superior performance on two multilingual benchmarks (MMATH and PolyMath). |
From Representation to Choice: Tracing Decision Emergence Across Languages in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models have made them highly multilingual, but how they internally reason remains unexplored. |
| Approach: | They propose to model multilingual reasoning through a decision-making perspective using aligned multiple-choice questions from the mMMLU benchmark. |
| Outcome: | The proposed model shows that languages share similar activation spaces, but subtle divergences emerge as decisions propagate through transformer layers. |
When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. |
| Approach: | They evaluate two leading LRMs with thinking traces on established benchmark XReasoning and propose directions for future research. |
| Outcome: | The proposed models often revert to English or produce fragmented reasoning in other languages, revealing a substantial gap in the capability of thinking in non-English languages. |
Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering (2026.acl-long)
Copied to clipboard
Qiming Li, Xiaocheng Feng, Yixuan Ma, Ruihan Chen, Zihe Tong, Zekai Ye, Xiachong Feng, Libo Qin, Haoyu Ren, Kun Chen, Yunfei Lu, Dandan Tu, Bing Qin
| Challenge: | Existing approaches to enhance multilingual reasoning capabilities rely on costly multilingual training or employ prompting with external translation tools. |
| Approach: | They propose a training-free inference-time method to enhance multilingual reasoning capabilities via Representation Engineering without additional training data or tools. |
| Outcome: | The proposed method outperforms existing methods on four reasoning benchmarks in English and Thai and Swahili. |