Papers by Ruixin Yu
CLOMO: Counterfactual Logical Modification with Large Language Models (2024.acl-long)
Copied to clipboard
Yinya Huang, Ruixin Hong, Hongming Zhang, Wei Shao, Zhicheng Yang, Dong Yu, Changshui Zhang, Xiaodan Liang, Linqi Song
| Challenge: | Existing studies on evaluating model reasoning are limited in both form and content. |
| Approach: | They propose a task to cultivate counterfactual thought processes within large language models and an evaluation metric to evaluate their natural language output instead of modeling the task as a multiple-choice problem. |
| Outcome: | The proposed evaluation metric aligns well with human preference. |
Faithful Question Answering with Monte-Carlo Planning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to answer questions using large language models lack the ability to faithfully follow the intermediate reasoning steps from the known premises to the answer. |
| Approach: | They propose a faithful question-answering task that uses a Monte-Carlo planning algorithm to produce faithful reasoning steps from the known premises to the answer. |
| Outcome: | The proposed task can produce valid and faithful reasoning steps compared with large language models with a much smaller model size. |
A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models of large language models struggle with complex logical reasoning problems. |
| Approach: | They propose to use large language models to identify their own errors to improve their models' performance. |
| Outcome: | The proposed models can identify logical fallacies accurately and improve by themselves. |
ManCC: A Task-Anchored Benchmark for Manchu–Classical Chinese Cross-Lingual Modeling (2026.findings-acl)
Copied to clipboard
Meiqi Wang, Xiaoxin Sun, Dongjie Wang, Ruixin Yu, Xiantao Heng, Shuo Wang, Zhen Huang, Peng Zhao, Suhua Wang, Minghao Yin
| Challenge: | Mainstream research in natural language processing has focused on high-resource and modern languages. |
| Approach: | They propose a task-anchored benchmark for Manchu–Classical Chinese translation . they use a parallel corpus of 16,627 sentence pairs to evaluate the model . |
| Outcome: | The proposed benchmarks show that linguistic differences influence performance and broader language coverage facilitate low-resource transfer. |
METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing work on QA explanation proposes to explain the answers with entailment trees composed of multiple enlargement steps. |
| Approach: | They propose a Module-based Entailment Tree GENeration framework that has multiple modules and a reasoning controller. |
| Outcome: | The proposed framework outperforms state-of-the-art models on the standard benchmark with only 9% of the parameters. |
Abstraction-of-Thought Makes Language Models Better Reasoners (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstract reasoning is a key to generalization in human reasoning, but eliciting language models to perform reasoning with abstraction remains unexplored. |
| Approach: | They propose a new structured reasoning format called Abstraction-of-Thought (AoT) this approach elicits language models to first contemplate on the abstract level before incorporating concrete details . |
| Outcome: | The proposed model outperforms the prevailing Chain-of-Thought (CoT) reasoning on 23 unseen tasks. |
MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current explanation datasets often employ synthetic data with simple reasoning structures. |
| Approach: | They propose a comprehensive logical reasoning explanation form that incorporates three main components to better fit the human cognitive process. |
| Outcome: | The proposed model performs better than existing models on real-life scenarios, but is more challenging for the current models. |