Papers by Jian Guo

APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning (2024.lrec-main)

Challenge:	Existing studies focus on language-agnostic settings, neglecting the inherently multilingual nature of modern software development.
Approach:	They propose a proportion-dependent scaling law that prioritizes high-utility languages . they propose PLs to have varying effects during pre-training that affect model performance .
Outcome:	The proposed scaling law is based on 1000+ experiments across multiple languages and models.

Copied to clipboard

Jiashuo Sun, Hang Zhang, Chen Lin, Xiangdong Su, Yeyun Gong, Jian Guo

Programming Languages in NLP

Challenge:	Existing methods to generate reasoning programs that ignore the differences between facts treated all facts equally, leading to wrong punishment of programs that differed from the ground truth.
Approach:	They propose an optimized training framework for long-form numerical reasoning that incorporates a number-aware negative sampling strategy and consistency-based reinforcement learning to increase execution accuracy.
Outcome:	The proposed method improves the performance of long-form numerical reasoning on the FinQA and ConvFinQA leaderboards.

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation (2022.findings-emnlp)

Copied to clipboard

Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei

Multilinguality

Challenge:	Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data.
Approach:	They propose a cross-lingual entity projection framework to enable zero-shot cross-linguistic NER with the help of a multilingual labeled sequence translation model.
Outcome:	The proposed method outperforms the baseline method on two benchmarks by a large margin of +3 7 F1 scores and achieves state-of-the-art performance.

Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder (2020.acl-main)

Copied to clipboard

Daya Guo, Duyu Tang, Nan Duan, Jian Yin, Daxin Jiang, Ming Zhou

Temporal Token Matters: Investigating and Interpreting the Consistency of Temporal Ordering in Large Language Models (2026.findings-acl)

Challenge:	Existing approaches for inferential text generation ignore context that is not explicitly provided . Existing models ignore background knowledge that provides crucial evidence to generate inferences .
Approach:	They propose an approach that automatically finds evidence for an event from a large text corpus and leverages it to guide the generation of inferential texts.
Outcome:	The proposed model generates inferential texts from a large text corpus and uses evidence to guide it.

Copied to clipboard

Zhen Yang, Xinyue Zhang, Ping Jian, Chengzhi Li, Zhongbin Guo, Jiaping Feng, Wenpeng Lu

Noisy Pair Corrector for Dense Retrieval (2023.findings-emnlp)

Challenge:	Large Language Models (LLMs) exhibit notable deficiencies in temporal reasoning . phrasing changes can lead LLMs to produce inconsistent outputs .
Approach:	They investigate the mechanistic interpretability of temporal ordering within event temporal reasoning . they identify a sparse subset of attention heads that are causally responsible for reasoning outcomes .
Outcome:	The proposed model outperforms other models in a variety of tasks and is validated by intervention-based experiments.

Copied to clipboard

Hang Zhang, Yeyun Gong, Xingwei He, Dayiheng Liu, Daya Guo, Jiancheng Lv, Jian Guo

Information Retrieval

Challenge:	Existing dense retrieval models assume that query-document pairs are exactly matched, resulting in mismatched-pair noise.
Approach:	They propose a novel approach to train an effective model with mismatched-pair noise.
Outcome:	The proposed model performs well on natural question and triviaQA, code-search benchmarks and SO-DS.

IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web (2025.findings-acl)

Copied to clipboard

Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Shaosheng Cao, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou, Zhoujun Li

LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)

Challenge:	Existing models have been introduced to improve image comprehension, but there is no robust benchmark for imagetoweb conversion.
Approach:	They propose a benchmark to assess imagetoweb conversion proficiency of large multimodal models . they propose to measure layout information of web pages by parsing the Document Object Model tree .
Outcome:	The proposed benchmark measures the layout information of web pages—i.e., the positional relationships between elements—which has been overlooked by prior work.

Copied to clipboard

Jian Yang, Wei Zhang, Shuyue Guo, Yizhi LI, Linzheng Chai, Zhengmao Ye, Shukai Liu, Yuyang Song, Jiajun Wu, Che Liu, Tianyu Zheng, Siwei Wu, Leo L, Xudong Ma, Chuan Hao, Ran Tao, Yan Xing, Jianzhou Wang, Mingjie Tang, Aishan Liu, Zhoujun Li, Xianglong Liu, Weifeng Lv, Bryan Dai

VLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training (2025.findings-emnlp)

Challenge:	Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge.
Approach:	They propose a recurrent inductive bias that aligns with the recursive nature of programming logic.
Outcome:	The proposed model achieves comparable performance to standard dense models with more parameters.

Copied to clipboard

Zhanpeng Chen, Chengjin Xu, Yiyan Qi, Xuhui Jiang, Jian Guo

Question Generation from SQL Queries Improves Neural Semantic Parsing (D18-1)

Challenge:	a significant drawback of Vision-language Models is their reliance on static training data, leading to outdated information and limited contextual awareness.
Approach:	They propose a framework with knowledge-enhanced reranking and noise-injected training to improve the VLM's ranking ability.
Outcome:	The proposed framework is based on a simple yet effective instruction template and is able to induce its ranking ability and serve it as a reranker to precisely filter the top-k retrieved images.

Copied to clipboard

Daya Guo, Yibo Sun, Duyu Tang, Nan Duan, Jian Yin, Hong Chi, James Cao, Peng Chen, Ming Zhou

Text Generation

Challenge:	Using question generation, we learn a semantic parser with 30% of the supervised training data.
Approach:	They propose to use question generation to learn a semantic parser with less supervised training data.
Outcome:	The proposed method improves the state-of-the-art model with less training data.

Context as a Tool: Context Management for Long-Horizon SWE-Agents (2026.findings-acl)

Copied to clipboard

Shukai Liu, Bo Jiang, Jian Yang, Yizhi LI, Jinyang Guo, Xianglong Liu, Bryan Dai

TransS-Driven Joint Learning Architecture for Implicit Discourse Relation Recognition (2020.acl-main)

Challenge:	Existing large language models rely on append-only context maintenance or passively triggered compression heuristics, leading to context explosion, semantic drift, and degraded reasoning in long-running interactions.
Approach:	They propose a new context management paradigm that elevates context maintenance to a callable tool . they propose 'cat' framework that injects context-management actions into complete interaction trajectories .
Outcome:	The proposed model outperforms ReAct-based agents and static compression baselines on SWE-Verified tests.

Copied to clipboard

Ruifang He, Jian Wang, Fengyu Guo, Yugui Han

Challenge:	Existing approaches to implicit discourse relation recognition lack connectives as strong linguistic clues.
Approach:	They propose a transS-driven joint learning architecture to translate discourse relations in low-dimensional embedding space and exploit the semantic features of arguments to assist discourse understanding.
Outcome:	The proposed model outperforms existing systems on the Penn Discourse TreeBank.

LLM-Driven Completeness and Consistency Evaluation for Cultural Heritage Data Augmentation in Cross-Modal Retrieval (2025.emnlp-main)

Copied to clipboard

Jian Zhang, Junyi Guo, Junyi Yuan, Huanda Lu, Yanlin Zhou, Fangyu Wu, Qiufeng Wang, Dongming Lu

Continual Pretraining on Encrypted Synthetic Data for Privacy-Preserving LLMs (2026.findings-eacl)

Challenge:	Cross-modal retrieval is essential for interpreting cultural heritage data, but its effectiveness is limited by incomplete or inconsistent textual descriptions.
Approach:	They propose a data augmentation framework that enhances cross-modal retrieval performance by improving the completeness and consistency of LLM-generated descriptions.
Outcome:	The proposed framework improves cross-modal retrieval performance by improving completeness and consistency of LLM-generated descriptions.

Copied to clipboard

Honghao Liu, Xuhui Jiang, Chengjin Xu, Cehao Yang, Yiran Cheng, Lionel Ni, Jian Guo

LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Data (2025.findings-acl)

Challenge:	Existing methods to protect PII from training on small corpora are difficult to implement in real-world applications.
Approach:	They propose an entity-based framework that synthesizes encrypted training data to protect PII.
Outcome:	The proposed framework outperforms base models and ensures PII security on limited-scale datasets while exhibiting a modest performance gap compared to models trained on unencrypted synthetic data.

Copied to clipboard

Cehao Yang, Xueyuan Lin, Chengjin Xu, Xuhui Jiang, Shengjie Ma, Aofan Liu, Hui Xiong, Jian Guo

CROP: Contextual Region-Oriented Visual Token Pruning (2025.emnlp-main)

Challenge:	Long-context processing ability has emerged as a significant challenge for large language models.
Approach:	They propose a pipeline for synthesizing faithful long-context reasoning instruction datasets . they integrate ground truth and citation-based reasoning prompts integrating them .
Outcome:	The proposed pipeline eliminates distractions and improves reasoning chains.

Copied to clipboard

Jiawei Guo, Feifei Zhai, Pu Jian, Qianrun Wei, Yu Zhou

Visual Data in NLP

Challenge:	Existing VLMs process entire images, leading to excessive visual tokens . redundant image information also introduces a large number of visual token, requiring much higher memory and computation in VLM.
Approach:	They propose a framework to prune visual tokens using localization and pruning . they propose CROP to locate local image regions relevant to the query .
Outcome:	The proposed framework outperforms existing visual token pruning methods on a wide range of tasks.

M2C: Towards Automatic Multimodal Manga Complement (2023.findings-emnlp)

Copied to clipboard

Hongcheng Guo, Boyang Wang, Jiaqi Bai, Jiaheng Liu, Jian Yang, Zhoujun Li

UniXcoder: Unified Cross-Modal Pre-training for Code Representation (2022.acl-long)

Challenge:	Multimodal manga analysis focuses on enhancing manga understanding with visual and textual features.
Approach:	They propose a task to enhance manga understanding with visual and textual features by providing a shared semantic space for vision and language understanding.
Outcome:	The proposed task provides a shared semantic space for vision and language understanding.

Copied to clipboard

Daya Guo, Shuai Lu, Nan Duan, Yanlin Wang, Ming Zhou, Jian Yin

Conflicts Make Large Reasoning Models Vulnerable to Attacks (2026.findings-acl)

Challenge:	Pre-trained models for programming languages have demonstrated great success on code intelligence . however, such pre-tried models are sub-optimal for auto-regressive tasks .
Approach:	They propose a unified cross-modal pre-trained model for programming language that leverages cross-module contents like AST and code comment to enhance code representation.
Outcome:	The proposed model achieves state-of-the-art on most code-related tasks and compares with existing models on zero-shot code-to-code search.

Copied to clipboard

Honghao Liu, Chengjin Xu, Xuhui Jiang, Cehao Yang, Shengming Yin, Zhengwu Ma, Lionel Ni, Jian Guo

Rethinking Multiple-Choice Questions for RLVR: Unlocking Potential via Distractor Design (2026.findings-acl)

Challenge:	Large Reasoning Models have demonstrated outstanding capabilities in solving complex reasoning tasks by incorporating step-by-step chain-of-thought (CoT) reasoning.
Approach:	They evaluate three large reasoning models that perform explicit and coherent reasoning under conflicting objectives and use them to evaluate their performance.
Outcome:	The proposed models perform explicit and coherent reasoning before producing their outputs, improving problem-solving and multi-step decision making.

Copied to clipboard

Xu Guo, Qiming Ge, Jian Tong, Kedi Chen, Jin Zhang, Xiaogui Yang, Xuan Gao, Haijun Lv, Zhihui Lu, Yicheng Zou, Qipeng Guo

MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Challenge:	Existing approaches to RLVR use multiple-choice questions as verifiable rewards . however, not all tasks provide reliable verification .
Approach:	They propose a framework that actively constructs high-quality distractors to block elimination shortcuts and promote deep reasoning.
Outcome:	The proposed method significantly improves reasoning capabilities of Large Language Models.

Copied to clipboard

Shukai Liu, Linzheng Chai, Jian Yang, Jiajun Shi, He Zhu, Liran Wang, Jin Ke, Wei Zhang, Hualei Zhu, Shuyue Guo, Tao Sun, Jiaheng Liu, Yunlong Duan, Yu Hao, Liqun Yang, Guanglin Niu, Ge Zhang, Zhoujun Li

Select2Reason: Efficient Instruction-Tuning Data Selection for Long-CoT Reasoning (2026.findings-acl)

Challenge:	Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach:	They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome:	The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.

Copied to clipboard

Cehao Yang, Xueyuan Lin, Xiaojun Wu, Chengjin Xu, Xuhui Jiang, Honghao Liu, Hui Xiong, Jian Guo

From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base (2023.emnlp-main)

Challenge:	Large reasoning models exhibit human-like behaviors such as exploration, verification, reflection, and correction.
Approach:	They propose a supervised fine-tuning framework for long chain-of-thoughts reasoning . they leverage a difficulty-aware reward model to estimate the learning value of questions .
Outcome:	The proposed framework performs fine-tuning on large reasoning models on 10% of the data selected.

Copied to clipboard

Wangzhen Guo, Linyin Luo, Hanjiang Lai, Jian Yin

V-GameGym: Visual Game Generation for Code Large Language Models (2026.findings-acl)

Challenge:	Existing methods for parsing knowledge-base questions into executable logical forms have not been successful on complex KBQA.
Approach:	They propose a new semantic parser called KoPL to model the reasoning processes . they propose 'parse-execute-refine' paradigm to unlock reasoning ability .
Outcome:	The proposed parser performs better than the state-of-the-art on complex KBQA . the proposed parsed-execute-refine paradigm can model complex reasoning steps .

Copied to clipboard

Wei Zhang, Jian Yang, Renshuai Tao, Linzheng Chai, Shuyue Guo, Jiajun Wu, Xiaoming Chen, Ganqu Cui, Ning Ding, Xander Xu, HU Wei, Bowen Zhou

LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation (2022.emnlp-main)

Challenge:	Existing code-related benchmarks focus on single modality rather than visual game development.
Approach:	They propose a multimodal benchmark for evaluating code large language models in visual game generation that integrates a clustering-based curation methodology and a pipeline for visual code synthesis.
Outcome:	The proposed framework assesses code generation and visual game generation using a sandbox environment.

Copied to clipboard

Hongcheng Guo, Jiaheng Liu, Haoyang Huang, Jian Yang, Zhoujun Li, Dongdong Zhang, Zheng Cui

Multilinguality

Challenge:	Recent advances struggle to train a separate model for each language pair, which is costly and unaffordable when the number of languages increases in the real world.
Approach:	They propose to train different MMT models to support translations between different languages.
Outcome:	The proposed model is able to handle the above issues by providing a shared semantic space for multiple languages.

Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment (2025.emnlp-demos)

Copied to clipboard

Saizhuo Wang, Hang Yuan, Leon Zhou, Lionel Ni, Heung-Yeung Shum, Jian Guo

Retrieval, Reasoning, Re-ranking: A Context-Enriched Framework for Knowledge Graph Completion (2025.naacl-long)

Challenge:	Traditional methods of alpha mining have inherent limitations, especially in implementing the ideas of quant researchers.
Approach:	They propose a new alpha mining paradigm by introducing human-AI interaction and a prompt engineering algorithmic framework to implement this paradigm by using large language models.
Outcome:	The proposed framework is based on human-AI interaction and large language models and is comparable to human participants in the WorldQuant International Quant Championship.

Copied to clipboard

Muzhi Li, Cehao Yang, Chengjin Xu, Xuhui Jiang, Yiyan Qi, Jian Guo, Ho-fung Leung, Irwin King

Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment (2026.acl-long)

Challenge:	Existing embedding-based methods rely on triples in the KG, which is vulnerable to specious relation patterns and long-tail entities.
Approach:	They propose a context-enriched framework for KGC that uses a large language model to generate potential answers for each query triple.
Outcome:	The proposed framework improves on FB15k237 and WN18RR datasets.

Copied to clipboard

Yuming Yang, Mingyoung Lai, Wanxu Zhao, Xiaoran Fan, Zhiheng Xi, Mingqi Wu, Chiyue Huang, Jun Zhao, Haijun Lv, Jian Tong, Yunhua Zhou, Yicheng Zou, Qipeng Guo, Tao Gui, Qi Zhang, Xuanjing Huang

Knowledge Enhanced Pre-training for Cross-lingual Dense Retrieval (2024.lrec-main)

Challenge:	Existing methods assess suitability primarily through student likelihood, favoring trajectories that align closely with the student model’s current behavior but overlooking more informative ones.
Approach:	They propose a Rank–Surprisal Ratio metric that captures both alignment and informativeness to assess the suitability of a reasoning trajectory.
Outcome:	The proposed metric captures both alignment and informativeness to assess the suitability of a reasoning trajectory.

Copied to clipboard

Hang Zhang, Yeyun Gong, Dayiheng Liu, Shunyu Zhang, Xingwei He, Jiancheng Lv, Jian Guo

How Do LLMs and VLMs Understand Viewpoint Rotation Without Vision? An Interpretability Study (2026.acl-long)

Challenge:	Existing mPLMs neglect the importance of knowledge in cross-lingual dense retrieval.
Approach:	They propose a novel mPLM that leverages knowledge to learn language-agnostic semantic representations from a multilingual knowledge base and an annotation of Wiki.
Outcome:	The proposed model achieves strong multilingual and cross-lingual retrieval performance with significant improvements over existing mPLMs.

Copied to clipboard

Zhen Yang, Ping Jian, Zhongbin Guo, Zuming Zhang, Chengzhi Li, Yonghong Deng, Xinyue Zhang, Wenpeng Lu

Explainability & Interpretability in NLP

Challenge:	Existing studies on spatial intelligence from the perspective of visual-spatial intelligence have not explored whether visual intelligence alone is sufficient to endow models with spatial intelligence.
Approach:	They propose to use a linguistic perspective to investigate spatial intelligence from a theoretical perspective.
Outcome:	The proposed model performs poorly on the proposed dataset while human can easily achieve 100% accuracy.

Unlocking the Power of Large Language Models for Entity Alignment (2024.acl-long)

Copied to clipboard

Xuhui Jiang, Yinghan Shen, Zhichao Shi, Chengjin Xu, Wei Li, Zixuan Li, Jian Guo, Huawei Shen, Yuanzhuo Wang

m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt (2024.lrec-main)

Challenge:	Entity Alignment (EA) is a crucial step in unifying data from heterogeneous sources and plays a critical role in data-driven AI applications.
Approach:	They propose a framework that incorporates large language models to improve EA.
Outcome:	The proposed framework incorporates large language models (LLMs) to improve EA accuracy while preserving efficiency.

Copied to clipboard

Jian Yang, Hongcheng Guo, Yuwei Yin, Jiaqi Bai, Bing Wang, Jiaheng Liu, Xinnian Liang, LinZheng Chai, Liqun Yang, Zhoujun Li

Multilinguality

Challenge:	Existing multimodal neural machine translation models focus on bilingual translation, but experimental results show that they outperform the text-only baselines and multilingual multimodal methods by a large margin.
Approach:	They propose a framework to leverage the multimodal prompt to guide the Multimodal Multilingual Neural Machine Translation (m3P) this framework aligns the representations of different languages with the same meaning and generates the conditional vision-language memory for translation.
Outcome:	The proposed framework outperforms previous text-only baselines and multilingual multimodal methods by a large margin.

Enhancing Multilingual Reasoning via Steerable Model Merging (2026.findings-acl)

Copied to clipboard

Zhuoran Li, Rui Xu, Jian Yang, Junnan Liu, Zhijun Chen, Qianren Mao, Hongcheng Guo, Jiaheng Liu, Likang Xiao, Ming LI, Xiaojie Wang

COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Challenge:	Model merging is an effective technique for composing the capabilities of a multilingual model and a reasoning model.
Approach:	They propose a model merging framework that modulates the contribution of each source model.
Outcome:	Experiments show that the proposed model merging framework outperforms strong baselines on multilingual reasoning benchmarks across 21 different languages.

Copied to clipboard

Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin

UniCoder: Scaling Code Large Language Model via Universal Code (2024.acl-long)

Challenge:	Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach:	They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome:	The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.

Copied to clipboard

Tao Sun, Linzheng Chai, Jian Yang, Yuwei Yin, Hongcheng Guo, Jiaheng Liu, Bing Wang, Liqun Yang, Zhoujun Li

Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing (P19-1)

Challenge:	Experimental results show that UniCoder with the universal code significantly outperforms the previous prompting methods by a large margin.
Approach:	They introduce the universal code (UniCode) as the intermediate representation of algorithm steps using conventions of programming languages.
Outcome:	The proposed model outperforms previous prompting methods by a large margin . the proposed model is based on a dataset of natural-language questions and code solutions .

Copied to clipboard

Daya Guo, Duyu Tang, Nan Duan, Ming Zhou, Jian Yin

Analytical Reasoning of Text (2022.findings-naacl)

Challenge:	a context-aware retrieval model and a meta-learning paradigm are used for context-dependent semantic parsing .
Approach:	They propose a retrieval model and a meta-learner to incorporate retrieved datapoints as context-dependent semantic parsing evidence.
Outcome:	The proposed approach performs better than retrieve-and-edit baselines on CONCODE and CSQA datasets.

Copied to clipboard

Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Yining Chen, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models (2024.findings-acl)

Challenge:	Existing models with implicit reasoning ability struggle to solve analytical reasoning of text.
Approach:	They propose an approach to analyze text and use it to perform reasoning over it.
Outcome:	The proposed approach outperforms pre-trained models on an analysis of the Law School Admission Test dataset.

Copied to clipboard

Noah Wang, Z.y. Peng, Haoran Que, Jiaheng Liu, Wangchunshu Zhou, Yuhan Wu, Hongcheng Guo, Ruitong Gan, Zehao Ni, Jian Yang, Man Zhang, Zhaoxiang Zhang, Wanli Ouyang, Ke Xu, Wenhao Huang, Jie Fu, Junran Peng

Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models (2024.findings-naacl)

Challenge:	Large Language Models (LLMs) have paved the way for complex tasks such as role-playing.
Approach:	They propose a framework to benchmark, elicit, and enhance role-playing abilities in Large Language Models.
Outcome:	The proposed framework improves role-playing abilities with 168,093 samples.

Copied to clipboard

Jiashuo Sun, Yi Luo, Yeyun Gong, Chen Lin, Yelong Shen, Jian Guo, Nan Duan

Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding (2021.emnlp-main)

Challenge:	Chain-of-thought (CoT) prompting is a technique to enhance the reasoning abilities of Large language models (LLMs) however, the reasoning chains of demonstrations are observed to be prone to errors, which can lead to incorrect reasoning during inference.
Approach:	They propose an iterative bootstrapping technique to enhance the reasoning abilities of Large language models (LLMs) by generating a series of reasoning steps to obtain the answer, and using the reasoning chains as exemplars to demonstrate the task.
Outcome:	The proposed method improves the performance of Large language models (LLMs) on three reasoning tasks on ten datasets.

Copied to clipboard

Yingmei Guo, Linjun Shou, Jian Pei, Ming Gong, Mingxing Xu, Zhiyong Wu, Daxin Jiang

Understanding and Mitigating Spurious Signal Amplification in Test-Time Reinforcement Learning for Math Reasoning (2026.findings-acl)

Challenge:	Existing approaches to scale out spoken language understanding to low-resource languages are noisy.
Approach:	They propose a method for mitigating noise in augmented data by training models with augmented datasets.
Outcome:	The proposed method outperforms state-of-the-art methods on two benchmark datasets.

Copied to clipboard

Yongcan Yu, Lingxiao He, Jian Liang, Kuangpu Guo, Meng Wang, Qianlong Xie, Xingxing Wang, Ran He

mABC: Multi-Agent Blockchain-inspired Collaboration for Root Cause Analysis in Micro-Services Architecture (2024.findings-emnlp)

Challenge:	a framework to mitigate spurious optimization signals is proposed for test-time reinforcement learning (TTRL) Reinforcement learning with verifiable rewards (RLVR) is an effective paradigm for improving large language models on structured challenging reasoning tasks.
Approach:	They propose a framework to mitigate spurious optimization signals from label noise . they propose to use a frequency-based sampling strategy to exclude ambiguous samples .
Outcome:	The proposed framework outperforms existing TTRL baselines on three large language models across multiple mathematical reasoning benchmarks.

Copied to clipboard

Wei Zhang, Hongcheng Guo, Jian Yang, Zhoujin Tian, Yi Zhang, Yan Chaoran, Zhoujun Li, Tongliang Li, Xu Shi, Liangfan Zheng, Bo Zhang

SemRegex: A Semantics-Based Approach for Generating Regular Expressions from Natural Language Specifications (D18-1)

Challenge:	Root cause analysis (RCA) in Micro-services architectures with escalating complexity is challenging due to fault propagation and circular dependencies among nodes.
Approach:	They propose a framework where multiple agents follow Agent Workflow and collaborate in blockchain-inspired voting to ensure the reliability of root cause analysis.
Outcome:	The proposed framework reduces the number of steps and standardizes task processing through Agent Workflow.

Copied to clipboard

Zexuan Zhong, Jiaqi Guo, Wei Yang, Jian Peng, Tao Xie, Jian-Guang Lou, Ting Liu, Dongmei Zhang

JudgeAgent: Beyond Static Benchmarks for Knowledge-Driven and Dynamic LLM Evaluation (2026.findings-acl)

Challenge:	Existing approaches to generate programs from natural language do not address program aliasing . semantically equivalent programs may have many syntactically different forms .
Approach:	They propose a semantics-based approach to generate regular expressions from natural language.
Outcome:	The proposed approach improves on three public datasets.

Copied to clipboard

Zhichao Shi, Xuhui Jiang, Chengjin Xu, Cangli Yao, Shengjie Ma, Yinghan Shen, Zixuan Li, Jian Guo, Yuanzhuo Wang

Challenge:	Current evaluation methods for large language models rely on static benchmarks . limited knowledge coverage and fixed difficulties hinder the targeted optimizations resulting in superficial evaluations of LLMs - a problem that has been addressed by JudgeAgent .
Approach:	They propose a knowledge-driven and dynamic evaluation framework for large language models . judgeAgent leverages LLM agents equipped with context graphs to traverse knowledge structures .
Outcome:	The proposed framework can achieve comprehensive evaluations and facilitate effective model iterations.

MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment (2024.findings-emnlp)

Copied to clipboard

Xuhui Jiang, Yinghan Shen, Zhichao Shi, Chengjin Xu, Wei Li, Huang Zihe, Jian Guo, Yuanzhuo Wang

Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models (2025.findings-emnlp)

Challenge:	Existing MMEA methods rely on knowledge representation learning (KRL) to measure the similarity of entity embeddings.
Approach:	They propose a framework that utilizes the visual reasoning abilities of MLLMs for multimodal entity alignment.
Outcome:	The proposed framework integrates the visual reasoning abilities of MLLMs for multimodal entity alignment.

Copied to clipboard

Xiaojun Wu, Junxi Liu, Huan-Yi Su, Zhouchi Lin, Yiyan Qi, Chengjin Xu, Jiajun Su, Jiajie Zhong, Fuwei Wang, Saizhuo Wang, Fengrui Hua, Jia Li, Jian Guo

LIME: Less Is More for MLLM Evaluation (2025.findings-acl)

Challenge:	Existing financial benchmarks suffer from limited language and task coverage, low-quality datasets, and inadequate adaptability for LLM evaluation.
Approach:	They propose a bilingual benchmark for financial LLMs that assesses models’ language understanding and generation capabilities.
Outcome:	The proposed bilingual benchmark assesses models’ language understanding and generation capabilities.

Copied to clipboard

King Zhu, Qianbo Zang, Shian Jia, Siwei Wu, Feiteng Fang, Yizhi Li, Shuyue Guo, Tianyu Zheng, Jiawei Guo, Bo Li, Haoning Wu, Xingwei Qu, Jian Yang, Ruibo Liu, Xiang Yue, Jiaheng Liu, Chenghua Lin, Hamid Alinejad-Rokny, Min Yang, Shiwen Ni, Wenhao Huang, Ge Zhang

DataArc-SynData-Toolkit: A Unified Closed-Loop Framework for Multi-Path, Multimodal, and Multilingual Data Synthesis (2026.acl-demo)

Challenge:	Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs.
Approach:	They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding.
Outcome:	The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities.

Copied to clipboard

Zhichao Shi, Cehao Yang, Hao Zhou, Xiaojun Wu, Huajie Li, Xuhui Jiang, Chengjin Xu, Yuanzhuo Wang, Jian Guo

Can LLMs See Without Pixels? Benchmarking Spatial Intelligence from Textual Descriptions (2026.findings-acl)

Challenge:	Existing synthetic data tools are limited by convoluted workflows, fragmented data standards, and limited scalability across modalities.
Approach:	They develop an open-source framework that aims to reduce the technical barrier to synthetic data generation and subsequent model training.
Outcome:	The proposed framework achieves an optimal balance between generation efficiency and data quality.

Copied to clipboard

Zhongbin Guo, Zhen Yang, Yushan Li, Xinyue Zhang, Wenyu Gao, Jiacheng Wang, Chengzhi Li, Xiangrui Liu, Ping Jian

HumanLLM: Benchmarking and Improving LLM Anthropomorphism via Human Cognitive Patterns (2026.acl-long)

Challenge:	Existing advances in Spatial Intelligence rely on vision-Language Models . however, a critical question remains: does spatial understanding originate from visual encoders?
Approach:	They propose to evaluate the SI performance of Large Language Models without pixel-level input.
Outcome:	The proposed benchmark challenges large language models to perform symbolic reasoning rather than visual pattern matching.

Copied to clipboard

Xintao Wang, Jian Yang, Weiyuan Li, Rui Xie, Jen-tse Huang, Jun Gao, Shuai Huang, Yueping Kang, Yuanli Guo, Hongwei Feng, Yanghua Xiao

Linguistics & Cognitive NLP

Challenge:	Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs).
Approach:	They propose a framework that treats psychological patterns as interacting causal forces and synthesizes 113 scenarios where 2-5 patterns reinforce, conflict, or modulate each other.
Outcome:	The proposed framework outperforms Qwen3-32B on multi-pattern dynamics despite 4 fewer parameters.

Efficient Universal Goal Hijacking with Semantics-guided Prompt Organization (2025.acl-long)

Copied to clipboard

Yihao Huang, Chong Wang, Xiaojun Jia, Qing Guo, Felix Juefei-Xu, Jian Zhang, Yang Liu, Geguang Pu

Ensuring Safe and High-Quality Outputs: A Guideline Library Approach for Language Models (2024.naacl-long)

Challenge:	Existing methods for prompt injection have focused on optimizing the suffix, overlooking the role of the prompt.
Approach:	They propose a method that incorporates an efficient optimization algorithm and two semantics-guided prompt organization strategies to optimize the suffix sequence for universal goal hijacking.
Outcome:	The proposed method can generate a fixed suffix that can concatenate to arbitrary user prompts for universal goal hijacking.

Copied to clipboard

Yi Luo, Zhenghao Lin, YuHao Zhang, Jiashuo Sun, Chen Lin, Chengjin Xu, Xiangdong Su, Yelong Shen, Jian Guo, Yeyun Gong