Papers by Cheng Ma
Emotion–Cause Pair Extraction in Conversations via Semantic Decoupling and Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Emotion-Cause Pair Extraction in Conversations (ECPEC) aims to identify the set of causal relations between emotion utterances and their triggering causes within a dialogue. |
| Approach: | They propose a framework for Emotion-Cause Pair Extraction in Conversations that decouples emotion-oriented semantics from cause-oriented ones and employs optimal transport to enable many-to-many and globally consistent emotion-cause matching. |
| Outcome: | The proposed framework achieves state-of-the-art on several benchmark datasets. |
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)
Copied to clipboard
Sashuai Zhou, Qiang Zhou, Jijin Hu, Hanqing Yang, Yue Cao, Junpeng Ma, Yinchao Ma, Jun Song, Tiezheng Ge, Cheng Yu, Bo Zheng, Zhou Zhao
| Challenge: | generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap. |
| Approach: | They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback . |
| Outcome: | The proposed system significantly improves image reasoning and generation quality. |
Before Generation, Align it! A Novel and Effective Strategy for Mitigating Hallucinations in Text-to-SQL Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) driven by In-Context Learning (ICL) have improved performance of text-to-SQL. |
| Approach: | They propose a strategy to mitigate hallucinations in large language models driven by In-Context Learning (ICL) they propose TA-SQL, a text-to-Sql framework that encourages LLMs to take advantage of similar tasks rather than starting from scratch. |
| Outcome: | The proposed framework improves the performance of the GPT-4 model by 21.23% on BIRD dev. |
Neo-Classic: A Benchmark for Evaluating Linguistic-Aesthetic Reasoning in Classical Chinese Poetry (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) achieve high accuracy on established Classical Chinese Poetry benchmarks, but it remains challenging to distinguish transferable Linguistic-Aesthetic Reasoning from reliance on familiar pre-training patterns. |
| Approach: | They propose a benchmark that combines a constructionist Out-of-Sample dataset with reverse understanding probes to evaluate large-scale large-format models. |
| Outcome: | The proposed model performs well on classical Chinese poetry benchmarks, but a performance gap persists . the model can complete famous couplets and can be used to understand a variety of texts. |
CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Models (2024.acl-long)
Copied to clipboard
| Challenge: | Current methods for multimodal sarcasm target identification focus on superficial indicators in an end-to-end manner, overlooking the nuanced understanding of multimodal content. |
| Approach: | They propose a multimodal sarcasm target identification framework with a coarse-to-fine paradigm by augmenting sarcasm explainability with reasoning and pre-training knowledge. |
| Outcome: | The proposed framework outperforms state-of-the-art methods and exhibits explainability in deciphering sarcasm as well. |
GLAF: Global-to-Local Aggregation and Fission Network for Semantic Level Fact Verification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing fact verification models lack fine-grained reasoning over key entities . GLAF uses local fission reasoning to capture latent logical relations between clues . |
| Approach: | They propose a global-to-local fission and fissional network to capture latent logical relations hidden in multiple evidence clues. |
| Outcome: | The proposed network achieves state-of-the-art on a FEVER dataset with a 77.62% FEVER score. |
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions (2026.acl-long)
Copied to clipboard
Chunyu Qiang, Xiaopeng Wang, Kang Yin, Yuzhe Liang, Yuxin Guo, Teng Ma, Ziyu Zhang, Tianrui Wang, Cheng Gong, Yushen Chen, Ruibo Fu, Longbiao Wang, Jianwu Dang
| Challenge: | Generative audio modeling has been fragmented into specialized tasks such as text-to-speech (TTS), text- to-music (TTM), and text-ta (TTA) specialized models require reference audio for timbre cloning and strict phoneme alignment, whereas TTA models generate unstructured textures from open-ended captions. |
| Approach: | They propose a unified flow-matching framework capable of synthesizing speech, music, sound effects . they propose 'token injection mechanism' that projects unstructured environmental sounds into structured temporal latent space . |
| Outcome: | The proposed framework achieves state-of-the-art performance in instruction-based TTS and TTM while maintaining competitive fidelity in TTA. |
The Mirage of Model Editing: Revisiting Evaluation in the Wild (2025.acl-long)
Copied to clipboard
| Challenge: | despite near-perfect results, effectiveness of model editing in real-world applications remains unclear. |
| Approach: | They propose QAEdit and WILD to better reflect real-world use of model editing . they propose a benchmark aligned with widely used question answering datasets and a task-agnostic evaluation framework . |
| Outcome: | The proposed QAEdit benchmark and WILD evaluation framework show that current models perform worse than previously reported. |
From Word to World: Can Large Language Models be Implicit Text-based World Models? (2026.acl-long)
Copied to clipboard
Yixia Li, Hongru Wang, Jiahao Qiu, Zhenfei Yin, Dongdong Zhang, Cheng Qian, Zeping Li, Xiaoteng Ma, Guanhua Chen, Heng Ji
| Challenge: | Agentic learning increasingly hinges on interaction, yet real-world experience is expensive, limited, and often irreversible at inference time. |
| Approach: | They propose a framework that reframes language modeling as next-state prediction under interaction. |
| Outcome: | The proposed framework evaluates world models in text-based environments . it shows that sufficiently trained models capture coherent environment dynamics . |
From Model-centered to Human-Centered: Revision Distance as a Metric for Text Evaluation in LLMs-based Applications (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation metrics for large language models yield numerical scores that ignore user experience. |
| Approach: | They propose a metric that suggests revision edits that mimic the human writing process . their results show that the metric offers more insightful feedback and distinguishes between texts . |
| Outcome: | The proposed metric can provide a self-explained text evaluation result in a human-understandable manner beyond the context-independent score. |
CAVA: A Tool for Cultural Alignment Visualization & Analysis (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Using CAVA, researchers can analyze country-specific biases encoded in large language models. |
| Approach: | They propose a visualization tool that allows users to identify biases in language models by adding country-based questions and models. |
| Outcome: | The proposed tool can be used to analyze the cultural competencies of large language models across the dimension of geographic locales. |
Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to learn new relations with limited labeled data are prone to catastrophic forgetting and overfitting. |
| Approach: | They propose a framework that uses prompts to acquire more generalized knowledge . they propose CFRE to continuously learn new relations while retaining knowledge of old ones . |
| Outcome: | The proposed method outperforms state-of-the-art methods by a large margin and significantly mitigates catastrophic forgetting and overfitting in low-resource scenarios. |
S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to incentivize LLMs’ deep thinking abilities require large-scale data or significant training efforts. |
| Approach: | They introduce an efficient framework that enhances LLM reasoning by teaching models to self-verify and self-correct during inference. |
| Outcome: | The proposed framework outperforms models trained on long-CoT distilled data with 3.1k initialization samples and achieves an accuracy improvement of 51.0% to 81.6%. |
VideoQA-TA: Temporal-Aware Multi-Modal Video Question Answering (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for video question answering align visual or textual features directly with large language models, limiting the deep semantic association between modalities and hindering a comprehensive understanding of interactions within spatial and temporal contexts. |
| Approach: | They propose a temporal-aware framework for multi-modal video question answering that aligns videos and questions at fine-grained levels. |
| Outcome: | The proposed framework improves reasoning ability and accuracy of videoQA by aligning videos and questions at fine-grained levels. |
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning (2025.acl-long)
Copied to clipboard
Fangzhi Xu, Hang Yan, Chang Ma, Haiteng Zhao, Qiushi Sun, Kanzhi Cheng, Junxian He, Jun Liu, Zhiyong Wu
| Challenge: | Existing methods for enhancing LLM reasoning rely on supervisory signals . current methods rely heavily on outcome supervision and auxiliary reward models . |
| Approach: | They propose a gen-eralizable and purely unsupervised self-training framework to enhance LLM reasoning without supervision. |
| Outcome: | The proposed framework improves LLM reasoning without supervision without external supervision. |
DR-HM: Distill-then-Reinforce Training with Cognition-Aware Data Synthesis for Harmful Meme Detection (2026.findings-acl)
Copied to clipboard
Zihan Cheng, Jianxiang Ma, Xiaocui Yang, Peidong Wang, Wen Zhang, Shi Feng, Daling Wang, Yifei Zhang, Mingfu Zhang
| Challenge: | Current methods for harmful meme detection lack the knowledge required to identify such hate . current methods lack the ability to identify cultural stereotypes and visual metaphors . |
| Approach: | They propose a framework that decomposes meme analysis into a human-inspired reasoning process . they propose DR-HM to transfer knowledge from closed-source models while mitigating biases . |
| Outcome: | The proposed framework outperforms existing methods on three benchmark datasets. |
Natural-Language Policies to Executable Decisions: An Interpretable Large Language Model Framework (2026.acl-industry)
Copied to clipboard
Ziqiang Zhang, Jing Ma, Zilong Wang, Jiayuan Chen, Yi Qiao, Yu He, Wei Zhang, Dai Cheng, Xiaoyu Shen
| Challenge: | a production-grade pricing system for tourism is challenging due to unstructured nature of travel orders and ever-evolving pricing policies. |
| Approach: | They propose a production-grade pricing system with a strict decision boundary . they propose to combine structured extraction and bounded policy/path selection with interpretable condition trees . |
| Outcome: | The proposed system processed 3,960 orders in six months and reduced the order management team from 15-20 to 3 . the system reduced the per-order handling time from 10 minutes to 2 minutes. |
A Generalizable Rhetorical Strategy Annotation Model Using LLM-based Debate Simulation and Labelling (2025.findings-emnlp)
Copied to clipboard
Shiyu Ji, Farnoosh Hashemi, Joice Chen, Juanwen Pan, Weicheng Ma, Hefan Zhang, Sophia Pan, Ming Cheng, Shubham Mohole, Saeed Hassanpour, Soroush Vosoughi, Michael Macy
| Challenge: | Rhetorical strategies are important to persuasive communication, but their analysis relies on human annotation, which is costly, inconsistent and difficult to scale. |
| Approach: | They propose a framework that leverages large language models to generate and label debate data . they fine-tune transformer-based classifiers on this dataset and validate it against human data a . |
| Outcome: | The proposed model achieves high performance and strong generalization across topical domains. |
AgentGC: Evolutionary Learning-based Lossless Compression for Genomics Data with LLM-driven Multiple Agent (2026.findings-acl)
Copied to clipboard
Sun Hui, Ding Yanfeng, Huidong Ma, Chang Xu, Keyan Jin, Lizheng Zu, Cheng Zhong, Xiaoguang Liu, Gang Wang, Wentong Cai
| Challenge: | Lossless compression has made significant advancements in Genomics Data storage, sharing and management. |
| Approach: | They propose a novel agent-based GD Compressor with 3 layers with a multi-agent named Leader and Worker. |
| Outcome: | The proposed method improves on existing methods with low-level modeling and limited adaptability and user-unfriendly interface. |
Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating complex semantics and diverse equations are limited by a fixed view. |
| Approach: | They propose a multi-view consistent contrastive learning approach that decouples human reasoning into two independent but consistent views. |
| Outcome: | The proposed approach significantly outperforms existing baselines on complex problems on multiple languages. |
CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era (2025.findings-acl)
Copied to clipboard
Kanzhi Cheng, Wenpo Song, Jiaxin Fan, Zheng Ma, Qiushi Sun, Fangzhi Xu, Chenyang Yan, Nuo Chen, Jianbing Zhang, Jiajun Chen
| Challenge: | Image captioning has been a challenge for vision-language researchers for decades . current VLMs focus on tasks like visual question answering (YA) but image captioning is not as advanced as expected. |
| Approach: | They evaluate VLMs' performance on image captioning using human annotations . they find that some metrics show high caption-level agreement with humans . |
| Outcome: | The proposed model outperforms open-source models on image captioning . it achieves 93.4% correlation with human rankings at $4 per test . |
Safety in Large Reasoning Models: A Survey (2025.findings-emnlp)
Copied to clipboard
Cheng Wang, Yue Liu, Baolong Bi, Duzhen Zhang, Zhong-Zhi Li, Yingwei Ma, Yufei He, Shengju Yu, Xinfeng Li, Junfeng Fang, Jiaheng Zhang, Bryan Hooi
| Challenge: | Large Reasoning Models (LRMs) have a high level of advanced reasoning capabilities, but they are vulnerable and vulnerable. |
| Approach: | This paper presents the first comprehensive survey of Large Reasoning Models . it explores the new safety risks, attacks, and defense strategies specific to LRMs based on reasoning . |
| Outcome: | The proposed study examines the safety and security risks of large reasoning models. |
Chain-of-Skills: A Configurable Model for Open-Domain Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Using customized retrieval models, model transferability and scalability are limited. |
| Approach: | They propose a modular retrieval model where individual modules correspond to key skills that can be reused across datasets. |
| Outcome: | The proposed model outperforms self-supervised retrievers in zero-shot evaluations and achieves state-of-the-art fine-tuned retrieval performance on NQ, HotpotQA and OTT-QA. |
Plug-in Language Model: Controlling Text Generation with a Simple Regression Model (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models have demonstrated unrivaled capacity in generating text that closely resembles human-written content. |
| Approach: | They propose a plug-in language model that leverages reinforcement learning to adjust latent states to control text generation. |
| Outcome: | The proposed model outperforms existing methods that rely on gradient-based, weighted decoding, or prompt-based methods. |
Music Audio-Visual Question Answering Requires Specialized Multimodal Designs (2026.findings-acl)
Copied to clipboard
Wenhao You, Xingjian Diao, Wenjun Huang, Chunhui Zhang, Keyi Kong, Weiyi Wu, Chiyu Ma, Zhongyu Ouyang, Tingxuan Wu, Ming Cheng, Soroush Vosoughi, Jiang Gui
| Challenge: | Music audio-visual question answering presents unique challenges with dense audio-visual content, intricate temporal dynamics, and the need for domain-specific knowledge. |
| Approach: | They analyze Music AVQA datasets and analyze their results to identify key design patterns . they propose concrete future directions for incorporating musical priors . |
| Outcome: | The proposed architectures are critical for success in Music AVQA, the authors argue . they suggest concrete future directions for incorporating musical priors . |
Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation (2026.acl-long)
Copied to clipboard
Zihao Cheng, Zeming Liu, Yingyu Shan, Xinyi Wang, Xiangrong Zhu, Yunpu Ma, Hongru Wang, Yuhang Guo, Wei Lin, Yunhong Wang
| Challenge: | Existing frameworks that focus on static tools and static assets are ineffective for self-evolving agents. |
| Approach: | They propose a paradigm of co-evolutionary Capability Expansion and Experience Distillation that leverages accumulated experience to guide dynamic creation of assets. |
| Outcome: | The proposed framework improves performance in single-task and cross-task settings by 18.53% over standard LLMs, 11.80% over agents evolving solely through experience, and 6.46% over those evolving solelly through asset creation. |
Rumor Detection on Twitter with Claim-Guided Hierarchical Graph Attention Networks (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for rumor detection are limited to the strict relation of user responses or oversimplify the conversation structure. |
| Approach: | They propose a method that reinforces interaction of user opinions while reducing negative impact imposed by irrelevant posts. |
| Outcome: | The proposed method improves performance on three Twitter datasets and can detect rumors at early stages. |
The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapse (2024.findings-acl)
Copied to clipboard
| Challenge: | Even a single edit can trigger model collapse, manifesting as significant performance degradation in various benchmark tasks. |
| Approach: | They propose to use perplexity as a surrogate metric to determine whether an edited model's performance is affected by a single edit. |
| Outcome: | The proposed method shows that even a single edit can cause model collapse, manifesting as significant performance degradation in various benchmark tasks. |
Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing open-domain question answering methods rely on the retriever to gather all evidence in isolation, but our approach uses an intermediary module to perform a chain of reasoning over the retrieved set. |
| Approach: | They propose a new open-domain question answering framework that integrates an intermediary module into the current retriever-reader pipeline and integrates it into the model. |
| Outcome: | The proposed framework outperforms the state-of-the-art on two OTT-QA datasets with an exact match score of 47.3 (45% relative gain). |
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)
Copied to clipboard
Haoyu Huang, Yongfeng Huang, Yang Junjie, Zhenyu Pan, Yongqiang Chen, Kaili Ma, Hongzhi Chen, James Cheng
| Challenge: | Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems. |
| Approach: | They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems. |
| Outcome: | The proposed approach achieves significant performance improvements over the state-of-the-art methods. |
Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition (2025.acl-long)
Copied to clipboard
Kehua Feng, Keyan Ding, Tan Hongzhi, Kede Ma, Zhihua Wang, Shuangquan Guo, Cheng Yuzhou, Ge Sun, Guozhou Zheng, Qiang Zhang, Huajun Chen
| Challenge: | Existing methods for evaluation of large language models are inefficient and inefficient due to inaccuracy of standard metrics in human perception of text quality and inefficiency in sampling informative test examples. |
| Approach: | They propose a sample-efficient human evaluation method for large language models based on the principle of MAximum Discrepancy (MAD) competition. |
| Outcome: | The proposed method achieves the “golden” ranking of LLMs with a minimum set of input instructions, which in turn reveal their relative strengths and weaknesses. |
UniTranSeR: A Unified Transformer Semantic Representation Framework for Multimodal Task-Oriented Dialog System (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on multimodal task-oriented dialog systems follow the pipeline to learn intra-modal features separately and then conduct simple feature concatenation or attention-based feature fusion to generate responses. |
| Approach: | They propose a Unified Transformer Semantic Representation framework with feature alignment and intention reasoning for multimodal dialog systems that embed multimodal features into a unified Transformer semantic space to prompt inter-modal interactions. |
| Outcome: | The proposed framework significantly outperforms state-of-the-art approaches on the representative MMD dataset. |
SHARE: An SLM-based Hierarchical Action CorREction Assistant for Text-to-SQL (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to self-correct text-to-SQL fail to demonstrate underlying reasoning path . authors propose **SHARE**, a self-revolution assistant for text-based error correction . |
| Approach: | They propose a "SHARE" assistant that enables LLMs to perform more precise error localization and efficient correction. |
| Outcome: | The proposed assistant performs more precise error localization and efficient correction for monolithic SQL queries. |
Beyond Binary Preferences: Semi-Online Label-Free GRACE-KTO with Group-Wise Adaptive Calibration for High-Quality Long-Text Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Generating high-quality long-text remains challenging for Large Language Models (LLMs), as conventional supervised fine-tuning fails to ensure overall quality due to its teacher-forcing nature. |
| Approach: | They propose a semi-online framework that transforms KTO’s binary signals into dynamically calibrated intra-group rewards. |
| Outcome: | The proposed framework transforms binary signals into dynamically calibrated intra-group rewards. |
E-ABSA20K: A Dataset and Propose-and-Verify for Aspect-Based Sentiment Analysis in Long E-commerce Reviews (2026.findings-acl)
Copied to clipboard
| Challenge: | Aspect-based Sentiment Analysis (ABSA) is critical for extracting actionable product insights from e-commerce reviews. |
| Approach: | They propose a framework that decomposes ABSA into two stages to extract review-level quadruple reviews from 20K reviews from four product categories. |
| Outcome: | The proposed framework outperforms existing benchmarks and single-stage prompting and competitive ABSA extraction baselines. |
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)
Copied to clipboard
Tianrui Wang, Ziyang Ma, Yizhou Peng, Haoyu Wang, Zhikang Niu, Zikang Huang, Yihao Wu, Yi-Wen Chao, Yu Jiang, Yuheng Lu, Guanrou Yang, Xuanchen Li, Hexin Liu, Chunyu Qiang, Cheng Gong, Yifan Yang, Tianchi Liu, Junyu Wang, Nana Hou, Meng Ge, Fuming You, Yang Wei, Zhongqian Sun, Hu Haifeng, Xiaobao Wang, Eng Siong Chng, Xie Chen, Longbiao Wang, Jianwu Dang
| Challenge: | Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level. |
| Approach: | They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context. |
| Outcome: | The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set. |
TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization (2026.findings-acl)
Copied to clipboard
Shichao Ma, Zhiyuan Ma, Ming Yang, Xiaofan Li, Xing Wu, Jintao Du, Yu Cheng, Weiqiang Wang, Qiliang Liu, Zhengyang Zhou, Yang Wang
| Challenge: | Large Language Models (LLMs) can solve complex tasks through iterative information retrieval. |
| Approach: | They propose a turn-level stage-aware policy optimization approach to solve this problem . they introduce a first-occurrence latent reward mechanism to allocate partial rewards . |
| Outcome: | Experiments show that TSPO outperforms state-of-the-art models on Qwen2.5-3B and 7B models. |
PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation (2022.emnlp-industry)
Copied to clipboard
Lianshang Cai, Linhao Zhang, Dehong Ma, Jun Fan, Daiting Shi, Yi Wu, Zhicong Cheng, Simiu Gu, Dawei Yin
| Challenge: | Pre-trained language models have been a key part of ranking systems . knowledge distillation is widely used to maintain high performance while keeping efficient computations. |
| Approach: | They propose an algorithm to combine knowledge from multi-teachers and label information to achieve competitive performance in offline and online experiments. |
| Outcome: | The proposed method has been deployed in a real-world commercial search system. |
Copyright Detective: A Forensic System to Evidence LLMs Flickering Copyright Leakage Risks (2026.acl-demo)
Copied to clipboard
Guangwei Zhang, Jianing Zhu, Cheng Qian, Neil Zhenqiang Gong, Rada Mihalcea, Zhaozhuo Xu, Jingrui He, Jiaqi W. Ma, Chaowei Xiao, Bo Li, Ahmed Abbasi, Dongwon Lee, Heng Ji, Denghui Zhang
| Challenge: | **Copyright Detective** is the first interactive forensic system for detecting, analyzing, and visualizing potential copyright risks in LLM outputs. |
| Approach: | They propose a system that detects copyright infringements and visualizes them . they use content recall testing, paraphrase-level similarity analysis and persuasive jailbreak probing . |
| Outcome: | The proposed system detects, analyzes, and visualizes potential copyright risks in LLM outputs. |
Intention Reasoning Network for Multi-Domain End-to-end Task-Oriented Dialogue (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent years has witnessed the remarkable success in end-to-end task-oriented dialog system, especially when incorporating external knowledge information. |
| Approach: | They propose a mechanism to model deterministic entity knowledge by using an intention reasoning network to obtain intention-aware representations of conceptual tokens. |
| Outcome: | The proposed mechanism captures concept shifts and generates accurate responses on two representative multi-domain dialog datasets. |
UEGP: Unified Expert-Guided Pre-training for Knowledge Rekindle (2024.findings-naacl)
Copied to clipboard
Yutao Mou, Kexiang Wang, Jianhe Lin, Dehong Ma, Jun Fan, Daiting Shi, Zhicong Cheng, Gu Simiu, Dawei Yin, Weiran Xu
| Challenge: | Existing paradigms for pre-training and fine-tuning have limitations . knowledge rekindle aims to break through performance upper bounds of experts without introducing additional annotated data. |
| Approach: | They propose a new paradigm for pre-training and fine-tuning that aims to re-incorporate the fine- tuned expert model into the training cycle and break through performance upper bounds of experts. |
| Outcome: | The proposed model breaks through performance upper bounds of experts without additional annotated data. |
MessToClean: Evidence-Grounded Structure-Preserving Reconstruction for Real-World Degraded Exam Paper Images (2026.acl-long)
Copied to clipboard
Jiayi Tuo, Cheng Tang, Zihan Wang, Chenyue Zhou, Yao Li, Yanbiao Ma, Chao Wang, Wei Dai, Mingxuan Wang, Shitong Qin, Ziwei Zhao
| Challenge: | Existing Multimodal Large Language Models (MLLMs) fail under RDEI, leading to disrupted structure and evidence-unsupported hallucinations. |
| Approach: | They propose a backbone-agnostic, evidence-driven pipeline that treats off-the-shelf MLLMs as interchangeable components to improve stem consistency and figure consistency. |
| Outcome: | The proposed pipeline improves stem consistency by 1.01-3.18%, figure consistency by 0.50-49.16%, and refusal F1 by 1.06-10.88% across question types. |
From Informal to Formal – Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs (2025.acl-long)
Copied to clipboard
Jialun Cao, Yaojie Lu, Meiziniu Li, Haoyang Ma, Haokun Li, Mengda He, Cheng Wen, Le Sun, Hongyu Zhang, Shengchao Qin, Shing-Chi Cheung, Cong Tian
| Challenge: | Recent studies in formal mathematical reasoning have shown an unstoppable growth trend. |
| Approach: | They constructed 18k high-quality instruction-response pairs across five mainstream formal specification languages and evaluated them against ten open-sourced LLMs. |
| Outcome: | The proposed model compared instruction-response pairs across five formal specification languages and found that the LLMs were good at writing proof segments when given either the code, or the detailed description of proof steps. |
TKGT: Redefinition and A New Way of Text-to-Table Tasks Based on Real World Demands and Knowledge Graphs Augmented LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on text-to-table tasks that ignore domain structures and use simple datasets to extract structured information from unstructured text. |
| Approach: | They propose a new text-to-table task that generates domain knowledge graphs from raw text using a mixed-IE method and a hybrid retrieval augmented generation method. |
| Outcome: | The proposed dataset improves compatibility with long text-processing tasks by incorporating domain knowledge graphs (KGs) classes into tables. |
Beyond A Fixed Seal: Adaptive Stealing Watermark in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing detection methods for large language models rely on fixed strategies to steal watermarks. |
| Approach: | They propose a novel steal-based watermark algorithm that derives watermark information from watermarked texts to craft highly targeted adversarial attacks. |
| Outcome: | The proposed system significantly increases steal efficiency against target watermarks under identical conditions. |
Open Domain Question Answering with A Unified Knowledge Interface (2022.acl-long)
Copied to clipboard
| Challenge: | a retriever-reader framework is popular for open domain question answering . however, accessing heterogeneous knowledge sources through a unified interface remains unknown . |
| Approach: | They propose a retriever-reader framework that uses explicit knowledge to access heterogeneous knowledge sources through a unified interface. |
| Outcome: | The proposed framework can benefit from the expanded knowledge index, the authors show . their approach sets the single-model state-of-the-art on Natural Questions . |
Micro-Act: Mitigate Knowledge Conflict in Question Answering via Actionable Self-Reasoning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to mitigate knowledge conflict by comparing two knowledge sources can overwhelm LLMs with extraneous or lengthy contexts. |
| Approach: | They propose a framework that decomposes knowledge into fine-grained comparisons . they propose 'Micro-Act' framework that allows for reasoning beyond the superficial context . |
| Outcome: | The proposed framework achieves significant increase in QA accuracy over state-of-the-art baselines on five benchmark datasets. |
Detect Rumors in Microblog Posts for Low-Resource Domains via Adversarial Contrastive Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing rumor detection methods are poor at detecting false rumors about breaking news or trending topics due to the lack of training data and prior knowledge. |
| Approach: | They propose an adversarial contrastive learning framework to detect false rumors by adapting features learned from well-resourced rumor data to that of the low-resource. |
| Outcome: | The proposed framework improves on two low-resource datasets and shows superior performance . it overcomes restriction of domain and/or language usage and improves robustness . |
Generative Prompt Tuning for Relation Classification (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing prompt tuning methods for RC are limited by label spaces and rigid prompt restrictions. |
| Approach: | They propose a generative prompt tuning method to reformulate relation classification as an infilling problem by adding cloze-style phrases to masked language modeling problems. |
| Outcome: | The proposed method exploits rich semantics of entity and relation types and can predict label verbalizations with varying lengths at multiple predicted positions. |
Case2Code: Scalable Synthetic Data for Code Generation (2025.coling-main)
Copied to clipboard
Yunfan Shao, Linyang Li, Yichuan Ma, Peiji Li, Demin Song, Qinyuan Cheng, Shimin Li, Xiaonan Li, Pengyu Wang, Qipeng Guo, Hang Yan, Xipeng Qiu, Xuanjing Huang, Dahua Lin
| Challenge: | Large Language Models (LLMs) have shown outstanding breakthroughs in code generation. |
| Approach: | They propose a case-to-code induction task that exploits the expressiveness and correctness of programs by incorporating LLMs into their training. |
| Outcome: | The proposed task improves distribution case-to-code induction and various coding generation tasks. |
TST: A Schema-Based Top-Down and Dynamic-Aware Agent of Text-to-Table Tasks (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to extract text content based on static table structures neglect to deal with precise inner-document evidence extraction and dynamic information such as multiple entities and events. |
| Approach: | They propose a dynamic content extraction agent framework that uses type recognition to extract context evidences with the conduction of domain schema sequentially. |
| Outcome: | The proposed framework exhibits state-of-the-art (SOTA) performance on a large dataset. |
Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Early approaches focus on text-based reasoning, but they often follow a single task-specific reasoning pattern. |
| Approach: | They propose a generative multimodal reasoning paradigm that unifies diverse reasoning skills by generating intermediate images during the reasoning process. |
| Outcome: | The proposed model unifies diverse multimodal reasoning skills by generating intermediate images during the reasoning process. |
Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model (2024.emnlp-main)
Copied to clipboard
Wenqi Zhang, Zhenglin Cheng, Yuanyu He, Mengna Wang, Yongliang Shen, Zeqi Tan, Guiyang Hou, Mingqian He, Yanna Ma, Weiming Lu, Yueting Zhuang
| Challenge: | Using large language models, large multimodal models struggle with basic tasks like reading time from a clock and planning a route using a road map. |
| Approach: | They propose a multimodal self-instruct that synthesizes massive abstract images and visual reasoning instructions. |
| Outcome: | The proposed model synthesizes 11,193 abstract images and reasoning instructions across eight visual scenarios. |