Papers by Min Yang
OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction (2025.acl-long)
Copied to clipboard
Haonan Zhang, Run Luo, Xiong Liu, Yuchuan Wu, Ting-En Lin, Pengpeng Zeng, Qiang Qu, Feiteng Fang, Min Yang, Lianli Gao, Jingkuan Song, Fei Huang, Yongbin Li
| Challenge: | Existing methods focus on replicating dialogues in textual form, neglecting the role’s voice traits as a crucial effect in interaction, which tends to be more immersive experiences in realistic scenarios. |
| Approach: | They propose a first seamless speech-language personality interaction model to achieve immersive RPAs with low latency. |
| Outcome: | The proposed model exhibits role-specific personality traits and vocal traits throughout the interaction, enabling a mixture of speech and language responses. |
Improving In-Context Learning with Prediction Feedback for Sentiment Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning paradigm. |
| Approach: | They propose a framework that incorporates prior predictions and feedback to improve sentiment understanding by incorporating prior feedback and leveraging a feedback-driven prompt. |
| Outcome: | The proposed framework improves on nine sentiment analysis datasets with an average improvement of 5.95% over conventional methods. |
A Multi-sentiment-resource Enhanced Attention Network for Sentiment Classification (P18-2)
Copied to clipboard
| Challenge: | Existing sentiment classification approaches do not fully exploit sentiment linguistic knowledge. |
| Approach: | They propose a Multi-sentiment-resource Enhanced Attention Network to integrate sentiment linguistic knowledge into the deep neural network via attention mechanisms. |
| Outcome: | The proposed network captures sentiments from different representation sub-spaces, and is superior to strong competitors. |
LLM-based Translation Inference with Iterative Bilingual Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that the ability of large language models to generate contextual understanding of the sentence can degrade translation quality. |
| Approach: | They propose a method that generates contextual understanding for both source and target languages separately. |
| Outcome: | The proposed method outperforms strong comparison methods in multiple domains. |
JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods achieve promising performance in in-target stance detection when trained and tested on the same datasets. |
| Approach: | They propose a joint contrastive learning framework to generalize stance features for unseen targets. |
| Outcome: | The proposed framework achieves state-of-the-art on three benchmark datasets. |
Exploring the Impact of Personality Traits on LLM Toxicity and Bias (2025.emnlp-main)
Copied to clipboard
| Challenge: | anthropomorphic LLMs are being developed to serve diversified roles, but content safety concerns remain regarding their toxicity and toxicity. |
| Approach: | They propose to assign personality traits to large language models (LLMs) to reduce toxic language and social biases in their outputs by using the widely accepted HEXACO personality framework developed in social psychology. |
| Outcome: | The proposed model is able to perform on three toxic and bias benchmarks and shows that assigning personality traits reduces bias and toxicity similar to humans’ correlations between personality traits and toxic behaviors. |
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks . |
| Approach: | They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token . |
| Outcome: | The proposed approach allows for more efficient and better performed NLG models. |
Multi-modal Stance Detection: New Datasets and Model (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for stance detection for pure texts have limited results to multi-modal content. |
| Approach: | They propose a multi-modal stance detection framework that leverages target information to learn multi-modal stance features from textual and visual modalities. |
| Outcome: | The proposed framework achieves state-of-the-art in multi-modal stance detection on five datasets based on Twitter . |
CLHA: A Simple Yet Effective Contrastive Learning Framework for Human Alignment (2024.lrec-main)
Copied to clipboard
Feiteng Fang, Liang Zhu, Xi Feng, Jinchang Hou, Qixuan Zhao, Chengming Li, Xiping Hu, Ruifeng Xu, Min Yang
| Challenge: | Large language models (LLMs) have attracted considerable attention from academic and industrial communities due to their outstanding performance in various natural language processing tasks. |
| Approach: | They propose a Contrastive Learning Framework for Human Alignment to evaluate the noise within the data and dynamically adjust the training process. |
| Outcome: | The proposed framework surpasses other algorithms in terms of reward model scores, automatic evaluations, and human assessments on the widely used dataset "Helpful and Harmless" |
Reducing Spurious Correlations in Aspect-based Sentiment Analysis with Explanation from Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis models are susceptible to learning spurious correlations between words . a recent study shows that feature engineering is time-consuming and costly . |
| Approach: | They propose to use a template to prompt LLMs to generate an appropriate explanation for the sentiment polarity of each aspect to reduce spurious correlations. |
| Outcome: | The proposed methods improve ABSA models and their generalization ability. |
From Charts to Code: A Hierarchical Benchmark for Multimodal Models (2026.acl-long)
Copied to clipboard
Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu, Zijian Zhang, Yifei Tao, Dongxing Mao, Yang Wan, Jingru Tan, Min Zeng, Min Li, Alex Jinpeng Wang
| Challenge: | Chart2Code is a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models. |
| Approach: | They introduce Chart2Code, a new benchmark for evaluating the natural language to chart code generation capabilities of large multimodal models. |
| Outcome: | The proposed benchmark is the first to scale task complexity while capturing diverse scenarios. |
An Empirical Study of Frame Selection for Text-to-Video Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text-to-video retrieval select a subset of frames to represent video content . current methods only explore video contents while ignoring relevancy to texts . |
| Approach: | They propose to use a subset of frames to represent video content for TVR . they analyze six different frame selection methods to determine their effectiveness . |
| Outcome: | The proposed method improves retrieval efficiency without sacrificing visual details . the proposed method explores the video contents while ignoring relevancy to texts . |
Reducing Spurious Correlations for Answer Selection by Feature Decorrelation and Language Debiasing (2022.coling-1)
Copied to clipboard
| Challenge: | Existing deep neural models rely on spurious correlations between prediction labels and input features, which in general suffer from robustness and generalization. |
| Approach: | They propose a feature decorrelation module to remove feature dependencies and reduce spurious correlations by learning a weight for each instance at the training phase. |
| Outcome: | The proposed method improves the robustness of the neural ANswer selection models from the sample and feature perspectives. |
Prediction Difference Regularization against Perturbation for Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for regularizing input perturbation are limited by under-fitting of training data. |
| Approach: | They propose a method that can reduce over-fitting and under-fitting at the same time. |
| Outcome: | The proposed method can reduce over-fitting and under-fitturing while making the model less sensitive to small input changes and more robust to under-perturbed training data. |
BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover’s Distance (2020.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models have been proposed and applied to many NLP tasks, yielding state-of-the-art performance, but high storage and computational costs obstruct them to be effectively deployed on resource-constrained devices and real-time applications. |
| Approach: | They propose a BERT distillation method which allows each intermediate student layer to learn from any intermediate teacher layers. |
| Outcome: | The proposed method can learn from different teacher layers adaptively for different NLP tasks. |
Make Imagination Clearer! Stable Diffusion-based Visual Imagination for Multimodal Machine Translation (2025.acl-long)
Copied to clipboard
Andong Chen, Yuchen Song, Kehai Chen, Xuefeng Bai, Muyun Yang, Liqiang Nie, Jie Liu, Tiejun Zhao, Min Zhang
| Challenge: | Experimental results show that our model significantly outperforms existing multimodal MT and text-only MT. |
| Approach: | They propose a stable diffusion-based imagination network into a multimodal large language model to generate an image for each source sentence. |
| Outcome: | The proposed model outperforms existing multimodal and text-only MT and achieves an average improvement of 14 BLEU points on Multi30K and MSCOCO multimodal MT benchmarks. |
Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit substantial capabilities yet face challenges such as hallucination, outdated knowledge, and untraceable reasoning processes. |
| Approach: | They propose a retrieval-augmented generation approach that leverages adaptive adversarial training to dynamically adjust the model’s training process in response to retrieval noises. |
| Outcome: | The proposed approach improves the performance of the LLaMA-2 7B model under diverse noise conditions. |
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval (2024.emnlp-industry)
Copied to clipboard
Xin Zhang, Yanzhao Zhang, Dingkun Long, Wen Xie, Ziqi Dai, Jialong Tang, Huan Lin, Baosong Yang, Pengjun Xie, Fei Huang, Meishan Zhang, Wenjie Li, Min Zhang
| Challenge: | Existing models for text retrieval are based on a multi-stage process that involves retrieving documents from a large corpus. |
| Approach: | They propose to build a multilingual text representation model and a cross-encoder reranker from scratch for text retrieval. |
| Outcome: | The proposed models outperform the state-of-the-art models on long-context retrieval benchmarks. |
Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations models struggle due to lack of Common Sense Knowledge (CSK). |
| Approach: | They propose a multimodal approach to integrate multiple knowledge into the edge representations by integrating textual and visual CSK. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two popular datasets. |
Forget for Get: A Lightweight Two-phase Gradient Method for Knowledge Editing in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge editing methodologies often encounter parameter conflict during knowledge overwriting and excessive computational overhead. |
| Approach: | They propose a method that erases outdated knowledge and inserts new knowledge at the location that corresponds to the target knowledge. |
| Outcome: | The proposed method achieves more effective knowledge editing at a lower cost compared to previous methods across various base models. |
AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents (2025.findings-acl)
Copied to clipboard
Guhong Chen, Liyang Fan, Zihan Gong, Nan Xie, Zixuan Li, Ziqiang Liu, Chengming Li, Qiang Qu, Hamid Alinejad-Rokny, Shiwen Ni, Min Yang
| Challenge: | Existing legal language models struggle with dynamic courtroom interactions, resulting in overfitting to standardized legal tasks. |
| Approach: | They propose a new adversarial evolutionary approach for agents that performs dynamic knowledge learning and evolution through structured adversarials in a simulated courtroom program. |
| Outcome: | The proposed approach outperforms existing LLM-based models in three critical dimensions: cognitive agility, professional knowledge, and logical rigor. |
ToolRM: Towards Agentic Tool-Use Reward Modeling (2026.findings-acl)
Copied to clipboard
Renhao Li, Jianhong Tu, Yang Su, Yantao Liu, Fei Huang, Hamid Alinejad-Rokny, Derek F. Wong, Junyang Lin, Min Yang
| Challenge: | lack of reliable reward models for tool-use tasks has limited progress toward agentic AI . recent advances in agentic artificial intelligence are driven by tool-using capabilities of large language models. |
| Approach: | They propose a pipeline that constructs pairwise preference data using rule-based scoring and multidimensional sampling to build lightweight reward models. |
| Outcome: | The proposed model outperforms existing models on tool calling tasks with higher accuracy. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for aspect category sentiment analysis do not necessarily occur in a sentence. |
| Approach: | They propose a Beta Distribution-guided aspect-aware graph construction based on external knowledge . they use aspect-related words as the pivots to derive aspect-relevant weights . |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on 6 benchmark datasets. |
Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition (NER) in Chinese are limited by the lack of annotated data. |
| Approach: | They propose a method which can automatically populate annotated training data without humancost by using distant supervision. |
| Outcome: | The proposed method performs better than comparison systems on two datasets. |
MMA: Cross-Domain Knowledge Integration via Mixture of Multi-Domain Agents (2025.findings-emnlp)
Copied to clipboard
| Challenge: | achieving synergistic improvements between generalization and domain specialization remains a challenge in pre-training and post-training. |
| Approach: | They propose a test-time cross-domain knowledge integration method that integrates general-purpose and domain-specific models to enhance their performance on complex, domainspecific tasks. |
| Outcome: | The proposed method combines the outputs of general-purpose and domain-specific models to improve their performance on complex, domainspecific tasks. |
An Evaluation Resource for Grounding Translation Errors (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current fine-grained error analyses do not ground the errors to the reasons why the annotated text spans are erroneous. |
| Approach: | They use a bi-directional grounding scheme to ground erroneous text in two directions . if the error spans of both directions are consistent, the explanation is valid . |
| Outcome: | The proposed grounding process improves translation error detection significantly. |
Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing understanding and reasoning abilities in graphbased tasks focus on specific graph types or tasks, posing challenges in designing versatile systems suitable for various tasks and graphs across diverse domains. |
| Approach: | They propose a structure-aware fine-tuning framework to enhance LVLMs with structure learning abilities through three self-supervised learning tasks. |
| Outcome: | Extensive evaluations on 14 LVLMs reveal that LVLs are weak in basic graph understanding and reasoning tasks, particularly those concerning relational or structurally complex information. |
CB-Whisper: Contextual Biasing Whisper Using Open-Vocabulary Keyword-Spotting (2024.lrec-main)
Copied to clipboard
Yuang Li, Yinglu Li, Min Zhang, Chang Su, Jiawei Yu, Mengyao Piao, Xiaosong Qiao, Miaomiao Ma, Yanqing Zhao, Hao Yang
| Challenge: | End-to-end automatic speech recognition systems struggle to recognize rare name entities such as personal names, organizations and terminologies that are not frequently encountered in the training data. |
| Approach: | They propose a convolutional neural network-based ASR system that performs open-vocabulary keyword-spotting before the decoder to match the features between the entities and the utterances. |
| Outcome: | The proposed system significantly improves mixed-error-rate (MER) and entity recall compared to the original Whisper model on three internal datasets and two publicly available datasets. |
Sentence-Level Agreement for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Empirical results show that a sentence-level agreement module can significantly improve the performance of neural machine translation (NMT) |
| Approach: | They propose a sentence-level agreement module to minimize the difference between the representation of source and target sentences. |
| Outcome: | Empirical results show the proposed agreement module significantly improves translation performance. |
A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing ABSA methods only use one aspect or multiple aspects with the same sentiment polarity . recent studies show that neural network methods can be trained end-to-end and automatically learn important features. |
| Approach: | They propose a large-scale multi-aspect multi-sentiment dataset with two different aspects with different sentiment polarities. |
| Outcome: | The proposed model outperforms the state-of-the-art models on the large-scale dataset . it is based on a novel neural network approach that can be trained end-to-end . |
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders (2025.emnlp-main)
Copied to clipboard
Weiqiao Shan, Yuang Li, Yuhao Zhang, Yingfeng Luo, Chen Xu, Xiaofeng Zhao, Long Meng, Yunfei Lu, Min Zhang, Hao Yang, Tong Xiao, JingBo Zhu
| Challenge: | Existing work on integrating audio encoders with large language models (LLMs) has focused on semantic understanding tasks, but different tasks may require distinct features that emphasize either semantic or acoustic aspects. |
| Approach: | They propose to use a prompt-aware mixture to enhance the Speech LLM that uses multiple audio encoders to extract different features based on the prompt. |
| Outcome: | The proposed approach outperforms all single-encoder Speech LLMs on ASR, speaker number verification, and AC tasks. |
Using active learning to expand training data for implicit discourse relation recognition (D18-1)
Copied to clipboard
| Challenge: | Existing methods to determine semantic relations between text spans are limited in the field of discourse-level relation recognition. |
| Approach: | They propose to expand the training data set using the corpus of explicitly-related arguments by arbitrarily dropping the overtly presented discourse connectives. |
| Outcome: | The proposed model expands the training data set using the corpus of explicitly-related arguments, by arbitrarily dropping the overtly presented discourse connectives. |
Just Like a Human Would, Direct Access to Sarcasm Augmented with Potential Result and Reaction (2023.acl-long)
Copied to clipboard
| Challenge: | sarcasm is a form of irony conveying mockery and contempt . social media has become increasingly popular for identifying sarcasm . |
| Approach: | They develop a method to detect sarcasm from social media using augmented potentials. |
| Outcome: | The proposed method outperforms baselines on benchmark datasets. |
MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct (2025.findings-acl)
Copied to clipboard
Run Luo, Haonan Zhang, Longze Chen, Ting-En Lin, Xiong Liu, Yuchuan Wu, Min Yang, Yongbin Li, Minzheng Wang, Pengpeng Zeng, Lianli Gao, Heng Tao Shen, Yunshui Li, Hamid Alinejad-Rokny, Xiaobo Xia, Jingkuan Song, Fei Huang
| Challenge: | a new framework for image-text instruction data evolution improves MLLM performance . lack of high-quality instruction data remains a major bottleneck in ML modeling . |
| Approach: | They propose a multimodal instruction data evolution framework that iteratively enhances data quality through fine-grained perception, cognitive reasoning, and interaction evolution. |
| Outcome: | The proposed approach improves MLLM performance in nine vision-language tasks while using significantly less data. |
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to generalize deep neural networks are datahungry and generalize poorly from small datasets. |
| Approach: | They propose an agreement score to evaluate routing processes at instance-level and an adaptive optimizer to enhance routing. |
| Outcome: | The proposed approach improves on two NLP tasks and in low-resource settings with few training instances. |
Beyond Chunking: Discourse-Aware Hierarchical Retrieval for Long Document Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing long document question answering systems process texts as flat sequences or use heuristic chunking, which overlooks the discourse structures that guide human comprehension. |
| Approach: | They propose a discourse-aware hierarchical framework that leverages rhetorical structure theory for long document question answering. |
| Outcome: | The proposed framework exhibits strong robustness across diverse document types and linguistic settings. |
Amalgamating Knowledge from Two Teachers for Task-oriented Dialogue System with Adversarial Training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to task-oriented dialogue systems require a large number of handcrafted features and labels. |
| Approach: | They propose a "Two-Teacher One-Student" learning framework for task-oriented dialogue . the framework amalgamates knowledge from two teacher networks and provides guidance . |
| Outcome: | The proposed framework outperforms baseline methods on two benchmark datasets . it can retrieve accurate KB entities and generate human-like responses simultaneously . |
Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to extract emotions and causes from unannotated text are pipelined, causing error propagation. |
| Approach: | They propose to transform a task into a procedure of parsing-like directed graph construction . they propose to generate a directed graph with labeled edges based on a sequence of actions . |
| Outcome: | The proposed method outperforms the state-of-the-art methods by 6.71% (p0.01) in F1 measure. |
Dependency-aware Prototype Learning for Few-shot Relation Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for few-shot relation classification fail to distinguish multiple relations that co-exist in one sentence. |
| Approach: | They propose a dependency-aware prototype learning method for few-shot relation classification . they utilize dependency trees and shortest dependency paths as structural information . |
| Outcome: | The proposed method achieves better performance than baselines on the FewRel dataset. |
On the Hallucination in Simultaneous Machine Translation (2024.acl-short)
Copied to clipboard
| Challenge: | Currently, there are no studies which systematically analyze hallucination in SiMT. |
| Approach: | They conduct a comprehensive analysis of hallucination in simultaneous machine translation (SiMT) they find that halluciation is extremely severe, especially as latency increases . |
| Outcome: | The results show that it is possible to alleviate hallucination by decreasing the over usage of target-side information for SiMT. |
CTC-based Non-autoregressive Textless Speech-to-Speech Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing direct speech-to-speech translation models require text supervision during training, which is not feasible for numerous unwritten languages. |
| Approach: | They propose a non-autoregressive (NAR) model that generates discrete units from the source speech and employs a unit-based vocoder to synthesize the target. |
| Outcome: | The proposed model achieves translation quality comparable to the autoregressive model while preserving up to 26.81 decoding speedup. |
PanicToCalm: A Proactive Counseling Agent for Panic Attacks (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for training such models are limited due to ethical and logistical issues. |
| Approach: | They propose a dataset that includes high-distress episodes constructed from first-person narratives and structured around the principles of Psychological First Aid. |
| Outcome: | The proposed model outperforms baseline models in counselor-side metrics and client affect improvement. |
Expanding before Inferring: Enhancing Factuality in Large Language Models through Premature Layers Interpolation (2025.emnlp-main)
Copied to clipboard
Dingwei Chen, Ziqiang Liu, Feiteng Fang, Chak Tou Leong, Shiwen Ni, Ahmadreza Argha, Hamid Alinejad-Rokny, Min Yang, Chengming Li
| Challenge: | Existing approaches to generating factually inconsistent outputs are resource-intensive. |
| Approach: | They propose a plug-and-play intervention designed to enhance factuality by inserting premature layers formed through mathematical interpolation with adjacent layers. |
| Outcome: | The proposed intervention reduces hallucinations while outperforming baselines on four datasets. |
PITA: Prompting Task Interaction for Argumentation Mining (2024.acl-long)
Copied to clipboard
| Challenge: | Argumentation mining (AM) aims to detect arguments and their inherent relations from textual compositions. |
| Approach: | They propose a method to model the inter-relationships among three subtasks within a generative framework. |
| Outcome: | The proposed method achieves state-of-the-art performance on two AM benchmarks. |
Improving Automatic Grammatical Error Annotation for Chinese Through Linguistically-Informed Error Typology (2025.coling-main)
Copied to clipboard
| Challenge: | In educational settings, GEC systems provide immediate and consistent feedback to both native (L1) and non-native (L2) language learners. |
| Approach: | They propose a framework that provides detailed feedback on 12-16% of all errors by identifying them under a new error typology, specific enough to uncover subtle differences in error patterns between L1 and L2 writings. |
| Outcome: | The proposed framework can provide detailed feedback on 12-16% of all errors, revealing subtle differences in error patterns between L1 and L2 writings. |
MCS: An In-battle Commentary System for MOBA Games (2022.coling-1)
Copied to clipboard
Xiaofeng Qi, Chao Li, Zhongping Liang, Jigang Liu, Cheng Zhang, Yuanxin Wei, Lin Yuan, Guang Yang, Lanxiao Huang, Min Li
| Challenge: | In-battle commentary is an important component of live streaming of e-sports competitions and is applicable to a wide range of scenarios like combat information analysis and live streaming. |
| Approach: | They propose a generative system for in-battle real-time commentary in mobile MOBA games and propose 'transform' method to convert match statistics and utterances into consistent encoding space. |
| Outcome: | The proposed system is based on real-time match statistics and events and can be used for live streaming, e-sports commentary and combat information analysis. |
SmartSpanNER: Making SpanNER Robust in Low Resource Scenarios (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is one of the most fundamental tasks in natural language processing. |
| Approach: | They propose a method which introduces a Named Entity Head (NEH) prediction task to SpanNER and performs multi-task learning together with task of span classification. |
| Outcome: | The proposed method improves the robustness of SpanNER in low resource scenarios on the CoNLL03, Few-NERD, GENIA and ACE05 benchmark datasets. |
STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing (2022.findings-emnlp)
Copied to clipboard
Zefeng Cai, Xiangyu Li, Binyuan Hui, Min Yang, Bowen Li, Binhua Li, Zheng Cao, Weijie Li, Fei Huang, Luo Si, Yongbin Li
| Challenge: | Extensive experiments show that STAR outperforms previous pre-training methods and ranks first on the leaderboard . text-to-SQL parsing aims to translate natural language (NL) questions into executable SQL queries . |
| Approach: | They propose a SQL guided pre-training framework STAR for context-dependent text-to-SQL parsing . they propose two objectives that explore context-dependence of NL utterances and SQL queries . |
| Outcome: | The proposed framework outperforms existing methods on two downstream benchmarks and ranks first on the leaderboard. |
SEMGraph: Incorporating Sentiment Knowledge and Eye Movement into Graph Model for Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on sentiment analysis based on eye movement signals has been attributed importance. |
| Approach: | They propose a linguistic probing eye movement paradigm to extract eye movement features based on the relationship between linguistic features and human reading behavior. |
| Outcome: | The proposed graph architecture achieves state-of-the-art performance on two sentiment analysis datasets with eye movement signals and three sentiment analysis data without eye movement signal. |
ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha Moments (2026.acl-long)
Copied to clipboard
| Challenge: | Existing defenses for Large Reasoning Models (LRMs) depend on costly fine-tuning and additional expert knowledge, which limits their scalability. |
| Approach: | They propose an inference-time safeguard for Large Reasoning Models that injects safety aha moments into the reasoning process to guide the model towards harmless yet helpful reasoning. |
| Outcome: | The proposed safeguard outperforms nine existing safeguards while avoiding common exaggerated safety issues. |
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document . |
| Approach: | They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document. |
| Outcome: | The proposed model over-estimates tokens and makes it well-calibrated on common datasets. |
Layer-wise Regularized Dropout for Neural Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to regularize dropout are consistency training and dropout is a problem in many pre-trained neural language models. |
| Approach: | They propose a layer-wise regularized dropout technique which regularizes dropout at the output layer using consistency training. |
| Outcome: | The proposed model can be regarded as a "self-distillation" framework, in which each sub-model generated by dropout is the other's "teacher" model and "student" model. |
Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity (2026.acl-long)
Copied to clipboard
Feiteng Fang, Dingwei Chen, Xiang Huang, Ting-En Lin, Yuchuan Wu, Xiong Liu, Jing Ye, Ziqiang Liu, Haonan Zhang, Liang Zhu, Hamid Alinejad-Rokny, Min Yang, Yongbin Li
| Challenge: | Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences. |
| Approach: | They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks. |
| Outcome: | The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge. |
Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation frameworks often rely on single-frame assessments, which can lead to outcome-hacking. |
| Approach: | They propose a process-aware evaluation paradigm that uses a hierarchical rubric to evaluate the validity of the intermediate steps and the final result. |
| Outcome: | The proposed model achieves POC@1.0 only about 20% and exhibits significant outcome-hacking. |
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)
Copied to clipboard
Shuaimin Li, Liyang Fan, Zeyang li, Zhuoyue Wan, Yufang Lin, Shiwen Ni, Feiteng Fang, Hamid Alinejad-Rokny, Yuanfeng Song, Kun Jing, Chen Jason Zhang, Min Yang
| Challenge: | Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds. |
| Approach: | They propose a framework for self-referential leakage detection for gray-box and black-box settings. |
| Outcome: | The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines. |
Topic-Guided Self-Introduction Generation for Social Media Users (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on social media use tags to profile users, but we have found that sentence-level self-introductions are more natural and engaging. |
| Approach: | They propose a novel topic-guided encoder-decoder framework that uses a user's tweeting history to generate a short sentence outlining their personal interests. |
| Outcome: | The proposed framework outperforms existing encoder-decoder models on a large-scale Twitter dataset and shows that it is more natural and engaging than previous approaches. |
A Generative Model for End-to-End Argument Mining with Reconstructed Positional Encoding and Constrained Pointer Mechanism (2022.emnlp-main)
Copied to clipboard
| Challenge: | Argument mining (AM) is a challenging task as it requires recognizing complex argumentation structures involving multiple subtasks. |
| Approach: | They propose a generative framework where expected outputs of AM are framed as a simple target sequence. |
| Outcome: | The proposed framework achieves state-of-the-art on two AM benchmarks. |
Argument Pair Extraction with Mutual Guidance and Inter-sentence Relation Graph (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on argumentation mining focus on monological argumentation and dialogical argumentation. |
| Approach: | They propose a mutual guidance framework that could guide arguments in one passage . they propose an inter-sentence relation graph to effectively model the inter-relations between two sentences . |
| Outcome: | The proposed method outperforms the current state-of-the-art model. |
Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization (2024.findings-emnlp)
Copied to clipboard
Yixin Ji, Yang Xiang, Juntao Li, Qingrong Xia, Zi Ye, Xinyu Duan, Zhefeng Wang, Kehai Chen, Min Zhang
| Challenge: | Large language models require a balance between efficiency and performance. |
| Approach: | They propose a low-rank compression technique that reduces non-essential parameters by decomposing weight matrices into products of two low-ranked matrici. |
| Outcome: | The proposed method outperforms existing pruning and low-rank compression techniques in maintaining model performance at the same compression ratio. |
When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to early exit reasoning often rely on handcrafted or empirical indicators that are unreliable and impractical. |
| Approach: | They propose a framework that allows LRMs to assess the sufficiency of its chain-of-thought and determine the optimal point for early exit. |
| Outcome: | The proposed framework reduces reasoning length by 28.9%–34.9% with minimal performance loss, effectively mitigating overthinking. |
Task-wrapped Continual Learning in Task-Oriented Dialogue Systems (2025.findings-naacl)
Copied to clipboard
| Challenge: | Continual learning is vital for task-oriented dialogue systems (ToDs), but its performance is limited by training separate adapters for each task, preventing global knowledge sharing. |
| Approach: | They propose a framework that employs task-wrapped Adapters to learn global and task-specific information through parameter sharing. |
| Outcome: | The proposed framework outperforms AdapterCL in 37 domains while using only 46% of the parameters. |
Covariance Matrix-Driven Image Channel Allocation for Multimodal Fake News Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods focus on designing efficient multimodal fusion frameworks to bridge the semantic gap between images and texts. |
| Approach: | They propose a covariance matrix-driven image channel allocation method that expands the number of original channel maps and assigns importance scores to the expanded channel maps. |
| Outcome: | The proposed method achieves state-of-the-art on three public multimodal fake news detection benchmark datasets. |
UNComp: Can Matrix Entropy Uncover Sparsity? — A Compressor Design from an Uncertainty-Aware Perspective (2025.emnlp-main)
Copied to clipboard
Jing Xiong, Jianghan Shen, Fanghua Ye, Chaofan Tao, Zhongwei Wan, Jianqiao Lu, Xun Wu, Chuanyang Zheng, Zhijiang Guo, Min Yang, Lingpeng Kong, Ngai Wong
| Challenge: | Deploying large language models (LLMs) for long-context inference remains challenging due to their substantial memory and computational demands. |
| Approach: | They propose an uncertainty-aware framework that leverages truncated matrix entropy to identify areas of low information content. |
| Outcome: | The proposed framework reduces the KV cache size to 4.74% of the original and achieves a 6% speedup. |
Multimodal Invariant Sentiment Representation Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal sensing ignore significant sentiment distribution imbalances and cross-modal sentiment conflicts, hindering performance improvement. |
| Approach: | They propose a method to learn stable multimodal invariant sentiment representations by incorporating distributional discrepancies and sentiment conflicts into the model training. |
| Outcome: | The proposed method improves MSA performance and achieves new state-of-the-art. |
CINO: A Chinese Minority Pre-trained Language Model (2022.coling-1)
Copied to clipboard
| Challenge: | Existing multilingual pre-trained language models do not perform well on some low-resource languages. |
| Approach: | They propose a multilingual pre-trained language model for Chinese minority languages . they collect documents from Wikipedia and construct two classification datasets . |
| Outcome: | The proposed model outperforms baseline models on various classification tasks. |
CPsyExam: A Chinese Benchmark for Evaluating Psychology using Examinations (2025.coling-main)
Copied to clipboard
Jiahao Zhao, Jingwei Zhu, Minghuan Tan, Min Yang, Renhao Li, Yang Di, Chenhao Zhang, Guancheng Ye, Chengming Li, Xiping Hu, Derek F. Wong
| Challenge: | CPsyExam prioritizes psychological knowledge and case analysis separately, recognizing the significance of applying psychological knowledge to real-world scenarios. |
| Approach: | They propose a psychological benchmark, CPsyExam, constructed from questions from Chinese examination systems. |
| Outcome: | The proposed benchmark prioritizes psychological knowledge and case analysis separately, recognizing the significance of applying psychological knowledge to real-world scenarios. |
HiMATE: A Hierarchical Multi-Agent Framework for Machine Translation Evaluation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLM-based evaluation methods fail to accurately identify error spans and assess their severity. |
| Approach: | They propose a Hierarchical Multi-Agent Framework for Machine Translation Evaluation based on the MQM error typology and a hierarchical multi-agent system enabling granular evaluation of subtype errors. |
| Outcome: | The proposed framework outperforms baselines in error span detection and severity assessment. |
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)
Copied to clipboard
Guhong Chen, Chenghao Sun, Cheng Fu, Qiyao Wang, Zhihong Huang, ChaoPeng Wei, Guangxu Chen, Feiteng Fang, Ahmadreza Argha, Bing Zhao, Xander Xu, Qi Han, Hamid Alinejad-Rokny, Qiang Qu, Binhua Li, Shiwen Ni, Min Yang, HU Wei, Yongbin Li
| Challenge: | Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization . |
| Approach: | They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. |
| Outcome: | Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency. |
CLaSp: In-Context Layer Skip for Self-Speculative Decoding (2025.acl-long)
Copied to clipboard
Longze Chen, Renke Shan, Huiming Wang, Lu Wang, Ziqiang Liu, Run Luo, Jiawei Wang, Hamid Alinejad-Rokny, Min Yang
| Challenge: | Existing methods for drafting Large Language Models require additional modules to be trained, which can be challenging to implement and ensure compatibility across various LLMs. |
| Approach: | They propose an in-context layer-skipping strategy for self-speculative decoding that uses a plug-and-play mechanism to skip intermediate layers of the verify model to construct a compressed draft model. |
| Outcome: | The proposed method achieves a speedup of 1.3 1.7 on LLaMA3 series models without altering the original distribution of the generated text. |
Forgetting before Learning: Utilizing Parametric Arithmetic for Knowledge Updating in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods of model editing and knowledge updating add additional network parameters, knowledge bases, knowledge base, and model parameters. |
| Approach: | They propose a new paradigm for fine-tuning called F-Learning that employs parametric arithmetic to facilitate the forgetting of old knowledge and learning of new knowledge. |
| Outcome: | The proposed model outperforms existing models on two datasets and is comparable to full fine-tuning and LoRA fine-uning. |
Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScore (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for detecting LLM-generated text require no training data. |
| Approach: | They propose a black-box zero-shot detection approach that calculates the Grammar Error Correction Score for a given text to differentiate between human-written and LLM-generated texts. |
| Outcome: | The proposed method outperforms current state-of-the-art zero-shot and supervised methods, achieving an average AUROC of 98.62% across XSum and Writing Prompts datasets. |
PEToolLLM: Towards Personalized Tool Learning in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing tool learning studies focus on general-purpose tool-use capability, but ignore the importance of personalized tool-user preferences. |
| Approach: | They propose a framework to adapt Large Language Models to personalized tool learning task, which is trained through supervised fine-tuning and direct preference optimization. |
| Outcome: | Extensive experiments on PEToolBench show that the proposed framework outperforms existing LLMs in the personalized tool learning task. |
Sparse Adapter Fusion for Continual Learning in NLP (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods for learning continuously face challenges such as inefficient parameter reuse across tasks and catastrophic forgetting when tasks are dissimilar. |
| Approach: | They propose a Sparse Adapter Fusion Method which dynamically fuses old and new adapters to address these challenges. |
| Outcome: | The proposed method outperforms state-of-the-art methods while utilizing less than 60% of the parameters. |
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)
Copied to clipboard
Qiyao Wang, Guhong Chen, Hongbo Wang, Huaren Liu, Minghui Zhu, Zhifei Qin, Li Linwei, Yilin Yue, Shiqiang Wang, Jiayan Li, Wu Yihang, Ziqiang Liu, Longze Chen, Run Luo, Liyang Fan, Jiaming Li, Lei Zhang, Kan Xu, Hamid Alinejad-Rokny, Chengming Li, Shiwen Ni, Yuan Lin, Min Yang
| Challenge: | Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios. |
| Approach: | They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice. |
| Outcome: | The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models . |
Cross-Domain Audio Deepfake Detection: Dataset and Analysis (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing audio deepfake detection datasets are outdated and lack generalization capabilities. |
| Approach: | They construct a new cross-domain audio deepfake detection dataset comprising over 300 hours of speech data that is generated by five advanced zero-shot TTS models. |
| Outcome: | The proposed models achieve 4.1% and 6.5% error rates in the cross-domain ADD dataset generated by five advanced zero-shot TTS models. |
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference (2022.findings-acl)
Copied to clipboard
| Challenge: | Previously, it's common to disregard it as noise or as a sign of poor-quality data, as their annotations are heavily based on personal experience and opinions. |
| Approach: | They propose to capture the human disagreement distribution from the perspective of model calibration. |
| Outcome: | The proposed model can achieve competitive performance when well-calibrated, on divergence scores between predictive probability and the true human opinion distribution, and the accuracy. |
Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment (2023.acl-long)
Copied to clipboard
Tianshu Yu, Haoyu Gao, Ting-En Lin, Min Yang, Yuchuan Wu, Wentao Ma, Chao Wang, Fei Huang, Yongbin Li
| Challenge: | Existing speech-text pre-training methods are limited to one or two specific tasks, despite their success in speech-language processing tasks. |
| Approach: | They propose a temporal position prediction task to capture the speech-text alignment . they use a textual dialog pre-training task to generalize a response selection task . |
| Outcome: | The proposed model is superior in learning speech-text alignment and multi-turn dialog context. |
Interactive Key-Value Memory-augmented Attention for Image Paragraph Captioning (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to image paragraph captioning ignore the past alignment information, resulting in repetitive captioning and incomplete captioning. |
| Approach: | They propose an Interactive key-value Memory-augmented Attention model for image paragraph captioning to keep track of attention history along with update-chain of decoder state. |
| Outcome: | Extensive experiments on a benchmark dataset demonstrate the effectiveness of the proposed model. |
Improving Low-resource Question Answering by Augmenting Question Information (2023.findings-emnlp)
Copied to clipboard
Andong Chen, Yuan Sun, Xiaobing Zhao, Rosella Galindo Esparza, Kehai Chen, Yang Xiang, Tiejun Zhao, Min Zhang
| Challenge: | Low-resource questions pose a significant challenge within the field of Question-Answering (QA) tasks. |
| Approach: | They propose a method that leverages large models' internal knowledge to enhance the quality of augmented data by Prompt Answer, Question Generation, and Question Filter. |
| Outcome: | The proposed method outperforms existing augmentation strategies on high-resource QA tasks like SQUAD1.1 and TriviaQA. |
Focal Training and Tagger Decouple for Grammatical Error Correction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Grammatical Error Correction (GEC) are categorized into sequence-to-sequence approaches, tagging-based approaches, and hybrid approaches. |
| Approach: | They propose to decouple error detection layer from label tagging layer and to down-weight label imbalance and tabbing entanglement loss using Focal Loss. |
| Outcome: | The proposed methods are effective over three latest Chinese Grammatical Error Correction datasets. |
Boundary-Driven Table-Filling for Aspect Sentiment Triplet Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work focuses on extracting aspect terms and opinion terms without considering the relations between aspect terms . |
| Approach: | They propose a task to extract aspect terms, opinion terms, and expressed sentiments from a two-dimensional (2D) table. |
| Outcome: | The proposed method achieves state-of-the-art on several public benchmarks and is well-suited to the ASTE task. |
An Empirical Study on Multiple Information Sources for Zero-Shot Fine-Grained Entity Typing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Auxiliary information from multiple sources has been demonstrated to be effective in zero-shot fine-grained entity typing (ZFET) however, there is no comprehensive understanding of how to make better use of the existing information sources and how they affect the performance of ZFET. |
| Approach: | They propose a multi-source fusion model targeting auxiliary information from multiple sources to improve zero-shot fine-grained entity typing (ZFET) |
| Outcome: | The proposed model achieves 11.42% and 22.84% gains over state-of-the-art baselines on BBN and Wiki respectively with regard to macro F1 scores. |
A Training-Free Debiasing Framework with Counterfactual Reasoning for Conversational Emotion Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies in Emotion Recognition in Conversations (ERC) focus on capturing context-sensitive and speaker-sensitive dependencies, ignoring the unintended dataset biases of data. |
| Approach: | They propose a training-free debiasing framework that extracts biases from the model by generating counterfactual utterances and contexts and mitigates them using simple yet empirically robust element-wise subtraction operations. |
| Outcome: | Experiments on three public datasets show that the proposed framework improves generalization ability and fairness across different ERC models. |
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Existing simultaneous translation methods focus on text-to-text and speech-totext translation. |
| Approach: | They propose a Simul-S2ST model that jointly learns translation and simultaneous policy in a unified framework of multi-task learning. |
| Outcome: | The proposed model can perform offline and simultaneous speech recognition, speech translation and speech synthesis via an "All-in-One" seamless model. |
SUN: Exploring Intrinsic Uncertainties in Text-to-SQL Parsers (2022.coling-1)
Copied to clipboard
Bowen Qin, Lihan Wang, Binyuan Hui, Bowen Li, Xiangpeng Wei, Binhua Li, Fei Huang, Luo Si, Min Yang, Yongbin Li
| Challenge: | Existing methods that learn from multiple semantically-equivalent questions are limited to one-to-one mapping . |
| Approach: | They propose a constraint to explore the underlying complementary semantic information among multiple semantically-equivalent questions and learn robust feature representations with reduced spurious associations. |
| Outcome: | The proposed method outperforms strong competitors and achieves state-of-the-art results on five benchmark datasets. |
PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts (2023.acl-long)
Copied to clipboard
| Challenge: | Existing research on multi-modal dialogue pre-training is limited due to limited availability of multi-dimensional data . a recent emergence of chatGPT 1 has increased confidence in the potential for this goal . |
| Approach: | They propose a framework for multi-modal dialogue pre-training that integrates experts to accommodate multi-faceted tasks. |
| Outcome: | The proposed framework achieves state-of-the-art on eight multi-modal dialog benchmarks. |
Paying More Attention to Source Context: Mitigating Unfaithful Translations from Large Language Model (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models lack explicit alignment between source and target contexts, leading to unfaithful translations. |
| Approach: | They propose three learning strategies to encourage LLMs to pay more attention to source context . they use a dataset to test the effectiveness of their model across multiple language pairs . |
| Outcome: | The proposed model reduces hallucinatory translation and improves fidelity across multiple languages. |
Self-Distillation with Meta Learning for Knowledge Graph Completion (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge graph completion frameworks for knowledge graphs are far from complete and require missing triples to be added to them. |
| Approach: | They propose a dynamic pruning technique to obtain a pruned model from a large source model, where the pruning mask of the pruned models could be updated adaptively per epoch after the model weights are updated. |
| Outcome: | The proposed framework achieves competitive performance compared to strong baselines, while being 10x smaller than baselines. |
Diagnosing and Remedying Representation Deficiencies for Deterministic Reasoning in KGQA (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to solve non-deterministic reasoning problems in large language models are limited by their complexity and lack of a clear understanding of the problem. |
| Approach: | They propose a method to diagnose and correct non-deterministic reasoning behaviors in large language models. |
| Outcome: | The proposed method outperforms baselines and WebQSP benchmarks on the widely used WebQ SP and CWQ benchmarks. |
Concise and Precise Context Compression for Tool-Using Language Models (2024.findings-acl)
Copied to clipboard
Yang Xu, Yunlong Feng, Honglin Mu, Yutai Hou, Yitong Li, Xinghao Wang, Wanjun Zhong, Zhongyang Li, Dandan Tu, Qingfu Zhu, Min Zhang, Wanxiang Che
| Challenge: | Existing methods suffer from key information loss and difficulty in adjusting the length of compressed sequences based on documentation lengths. |
| Approach: | They propose two strategies for compressing tool documentation into concise and precise summary sequences for tool-using language models. |
| Outcome: | The proposed approach achieves comparable performance to the upper-bound baseline under 16x compression ratio. |
PiKGL: Leveraging Pruned Knowledge Graphs for Explainable Stance Detection (2026.tacl-1)
Copied to clipboard
Bingbing Wang, Jingjie Lin, Zhixin Bai, Xintong Song, Qianlong Wang, Min Yang, Xi Zeng, Jing Li, Ruifeng Xu
| Challenge: | Experimental results demonstrate that a Pruned interpretable knowledge Graph Learning framework for explainable stance detection is state-of-the-art for social media stance prediction. |
| Approach: | They propose a Pruned interpretable knowledge Graph Learning framework for explainable stance detection that incorporates commonsense knowledge and prunes redundant information to ensure precision and minimize noise. |
| Outcome: | The proposed framework achieves state-of-the-art on three public datasets. |
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding (2021.acl-long)
Copied to clipboard
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
| Challenge: | Existing pre-training tasks for text and layout are effective in visually-rich document understanding tasks. |
| Approach: | They propose to combine pre-training tasks with a multi-modal model to model interaction between text, layout and image in a single multi-module framework. |
| Outcome: | The proposed model outperforms LayoutLM by a large margin on visual-rich document understanding tasks. |
SlowBERT: Slow-down Attacks on Input-adaptive Multi-exit BERT (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models such as Google’s BERT have been gaining significant improvements to various down-stream applications, but the enormous training and inference cost severely hinders its practice on real-time applications and hardwareconstrained edge devices. |
| Approach: | They propose a slow-down attack on input-adaptive multi-exit BERT where the adversary imperceptibly modifies the input texts to drastically increase the inference cost. |
| Outcome: | The proposed attack on input-adaptive multi-exit BERT dramatically increases the average inference cost by 4.57, which would hurt the service quality of multi-extit BRT in practice, e.g., increasing the real-time cloud services’ response times for online users. |
CoEvol: Constructing Better Responses for Instruction Finetuning through Multi-Agent Cooperation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on constructing substantial quantities of IFT data with minimal human effort. |
| Approach: | They propose a multi-agent cooperation framework for the improvement of IFT responses for large language models using a debate-advise-edit-judge paradigm. |
| Outcome: | The proposed framework outperforms baseline models on unseen tasks and shows that it can improve instruction-following capabilities on large language models. |
DoCIA: An Online Document-Level Context Incorporation Agent for Speech Translation (2025.findings-acl)
Copied to clipboard
Xinglin Lyu, Wei Tang, Yuang Li, Xiaofeng Zhao, Ming Zhu, Junhui Li, Yunfei Lu, Min Zhang, Daimeng Wei, Hao Yang, Min Zhang
| Challenge: | Document-level context is crucial for speech translation due to noise from ASR . incorporating document-level contextual information into ST remains a challenge . |
| Approach: | They develop an online framework that integrates document-level context into machine translation . they use document-based modules to integrate document- level context into ST . |
| Outcome: | The proposed framework outperforms baselines in sentence and discourse metrics . it can correct ASR transcription errors and improve translation performance . |
Reliability-Aware Adaptive Self-Consistency for Efficient Sampling in LLM Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Self-consistency improves reasoning reliability but incurs substantial inference cost . Adaptive self-consistent methods rely on count-based stopping rules that treat all responses equally . |
| Approach: | They propose a method that reframs adaptive sampling from response counting to evidence sufficiency by leveraging response-level confidence. |
| Outcome: | The proposed method reduces inference cost by up to 70% while preserving accuracy on GSM8K. |
CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling (2024.findings-acl)
Copied to clipboard
Chenhao Zhang, Renhao Li, Minghuan Tan, Min Yang, Jingwei Zhu, Di Yang, Jiahao Zhao, Guancheng Ye, Chengming Li, Xiping Hu
| Challenge: | Existing datasets lack consulting knowledge, resulting in LLMs lacking professional consulting competence. |
| Approach: | They propose a report-based multi-turn dialogue reconstruction framework for Chinese psychological counseling that uses large language models to assist counseling. |
| Outcome: | The proposed framework is open-source and can be used in future research. |
Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theory (2024.findings-emnlp)
Copied to clipboard
Suyeon Lee, Sunghwan Kim, Minju Kim, Dongjin Kang, Dongil Yang, Harim Kim, Minseok Kang, Dayi Jung, Min Kim, Seungbeen Lee, Kyong-Mee Chung, Youngjae Yu, Dongha Lee, Jinyoung Yeo
| Challenge: | Existing models that use large language models are not available due to ethical concerns, and data privacy concerns are a concern. |
| Approach: | They propose a multi-turn dialogue dataset that emulates real-life counseling interactions using the goal-oriented approach of Cognitive Behavioral Therapy (CBT). |
| Outcome: | The proposed model outperforms other models in counseling skills, highlighting its effectiveness and potential as a counseling agent. |
Investigating Capsule Networks with Dynamic Routing for Text Classification (D18-1)
Copied to clipboard
| Challenge: | Earlier efforts in text modeling have achieved limited success on word meanings . convolutional neural networks (CNNs) are used to model higher level concepts and facts in texts . |
| Approach: | They propose three strategies to stabilize dynamic routing process to alleviate disturbance of noise capsules. |
| Outcome: | The proposed methods achieve state-of-the-art on 4 out of 6 datasets . they show that capsule networks exhibit significant improvement over baseline methods . |
Learning First-Order Logic Rules for Argumentation Mining (2025.acl-long)
Copied to clipboard
Yang Sun, Guanrong Chen, Hamid Alinejad-Rokny, Jianzhu Bao, Yuqi Huang, Bin Liang, Kam-Fai Wong, Min Yang, Ruifeng Xu
| Challenge: | Argumentation Mining (AM) aims to extract argumentative structures from texts by identifying argumentation components (ACs) and their argumentative relations (ARs). |
| Approach: | They propose a First- Order Logic reasoning framework for AM to capture logical reasoning paths within argumentative texts. |
| Outcome: | The proposed framework outperforms strong baselines while significantly improving explainability. |
Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods to learn consecutive tasks without forgetting how to perform previously trained problems are lacking. |
| Approach: | They propose a continual learning method which preserves performance on previously encountered tasks while accelerating learning progress on subsequent tasks. |
| Outcome: | The proposed method preserves performance on previously encountered tasks while accelerating learning progress on subsequent tasks. |
One-Shot Learning as Instruction Data Prospector for Large Language Models (2024.acl-long)
Copied to clipboard
Yunshui Li, Binyuan Hui, Xiaobo Xia, Jiaxi Yang, Min Yang, Lei Zhang, Shuzheng Si, Ling-Hao Chen, Junhao Liu, Tongliang Liu, Fei Huang, Yongbin Li
| Challenge: | Contemporary practices in instruction tuning often hinge on enlarging data scaling without a clear strategy for ensuring data quality. |
| Approach: | They propose a method that leverages one-shot learning to discern and select high-quality instruction data from extensive datasets. |
| Outcome: | Nuggets outperforms existing methods on MT-Bench and Alpaca-Eval benchmarks. |
Decomposing Argumentative Essay Generation via Dialectical Planning of Complex Reasoning (2024.findings-acl)
Copied to clipboard
| Challenge: | Argumentative Essay Generation (AEG) is a challenging task in computational argumentation, where detailed logical reasoning and effective rhetorical skills are essential. |
| Approach: | They propose an argumentative planning strategy for prompting large language models to generate high-quality essays by sketch planning and dialectical planning. |
| Outcome: | The proposed method generates more dialectical and persuasive essays with higher diversity compared to baselines. |
Synthesizing Text-to-SQL Data from Weak and Strong LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | a capability gap exists between open-source and closed-source large language models (LLMs) . the adoption of closed-sourced LLMs introduces concerns pertaining to openness, privacy, and substantial costs. |
| Approach: | They propose a synthetic data approach that combines strong and weak models for error information . they demonstrate the effectiveness of SENSE, a specialized text-to-SQL model . |
| Outcome: | The proposed method enhances the domain generalization of text-to-SQL models and explores the potential of error data supervision through preference learning. |
Modeling Consistency Preference via Lexical Chains for Document-level Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that consistency preference for lexical chains reduces lexical translation inconsistency . Lexical translation consistency is a common discourse phenomenon . |
| Approach: | They propose a consistency-aware model which captures consistency context . they then define consistency-tailored latent variables which guide translation of corresponding sentences . |
| Outcome: | The proposed model significantly improves translation performance in ChineseEnglish and FrenchEnglish translation tasks. |
Part Represents Whole: Improving the Evaluation of Machine Translation System Using Entropy Enhanced Metrics (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing machine translation metrics have poor correlations with human assessments . entropy-based evaluations are often limited to a limited number of samples . |
| Approach: | They propose a fast and unsupervised approach to enhance machine translation metrics using entropy by introducing sentence-level difficulty. |
| Outcome: | The proposed method outperforms existing metrics on five sub-tracks in the WMT19 Metrics shared tasks. |
Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging (2022.findings-acl)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models (PLMs) have made extraordinary progress in most NLP tasks, but they fail to achieve state-of-the-art (SOTA) performance. |
| Approach: | They propose a Guassian HMM variant for unsupervised POS tagging that incorporates contexualized word representations into the decoder. |
| Outcome: | The proposed model outperforms state-of-the-art models on Penn Treebank and multilingual Universal Dependencies treebank v2.0. |
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)
Copied to clipboard
Chenhao Zhang, Xi Feng, Yuelin Bai, Xeron Du, Jinchang Hou, Kaixin Deng, Guangzeng Han, Qinrui Li, Bingli Wang, Jiaheng Liu, Xingwei Qu, Yifei Zhang, Qixuan Zhao, Yiming Liang, Ziqiang Liu, Feiteng Fang, Min Yang, Wenhao Huang, Chenghua Lin, Ge Zhang, Shiwen Ni
| Challenge: | MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture. |
| Approach: | They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content. |
| Outcome: | The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context. |
Dual Dynamic Memory Network for End-to-End Multi-turn Task-oriented Dialog Systems (2020.coling-main)
Copied to clipboard
| Challenge: | Existing task-oriented dialog systems struggle to dynamically model long dialog context for interactions and effectively incorporate knowledge base (KB) information into dialog generation. |
| Approach: | They propose a dual dynamic memory network for multi-turn dialog generation . the model dynamically expands the dialog memory turn by turn and keeps track of dialog history . |
| Outcome: | The proposed model outperforms baseline models on three benchmark datasets on human evaluation and automatic evaluation. |
Dynamic Planning for LLM-based Graphical User Interface Automation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to planning for GUI tasks are limited due to long historical dialogues. |
| Approach: | They propose a novel approach to dynamic planning based on environmental feedback and execution history to guide action prediction in GUI tasks. |
| Outcome: | The proposed approach surpasses the strong GPT-4V baseline by +12.7% in accuracy. |
Knowledge as A Bridge: Improving Cross-domain Answer Selection with External Knowledge (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to answer selection are limited in domains with limited labeled data. |
| Approach: | They propose a Knowledge-aware Attentive Network framework for cross-domain answer selection that uses the knowledge base as a bridge to enable knowledge transfer from the source domain to the target domain. |
| Outcome: | The proposed model outperforms strong competitors by a noticeable margin in cross-domain answer selection. |
TP-Link: Fine-grained Pre-Training for Text-to-SQL Parsing with Linking Information (2024.lrec-main)
Copied to clipboard
Ziqiang Liu, Shujie Li, Zefeng Cai, Xiangyu Li, Yunshui Li, Chengming Li, Xiping Hu, Ruifeng Xu, Min Yang
| Challenge: | Existing pre-training frameworks for text-to-SQL parsing have shown inherent differences in distributions between tables and plain text. |
| Approach: | They propose a framework to improve context-dependent Text-to-SQL parsing by leveraging Linking information. |
| Outcome: | The proposed framework achieves state-of-the-art performance on two leading downstream benchmarks. |
Context or Knowledge is Not Always Necessary: A Contrastive Learning Framework for Emotion Recognition in Conversations (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on modeling context-sensitive dependencies and knowledge-sensitive dependences. |
| Approach: | They propose a framework based on contrastive learning called CKCL to distinguish utterances for better vector representations. |
| Outcome: | The proposed framework outperforms state-of-the-art models on four datasets. |
DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms (2024.acl-short)
Copied to clipboard
| Challenge: | Existing self-reflection methods lack effective feedback information, limiting the translation performance of large language models (LLMs). |
| Approach: | They propose a framework that leverages the dual learning of translation tasks to provide effective feedback, thereby enhancing the models’ self-reflective abilities and improving translation performance. |
| Outcome: | The proposed framework improves the models’ self-reflective abilities and improves translation accuracy and eliminating ambiguities across translation tasks. |
Reading Like HER: Human Reading Inspired Extractive Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing methods for extracting text summarization are abstractive and extractive. |
| Approach: | They propose a novel approach for extractive summarization by simulating two stages . they adopt a convolutional neural network to encode gist of paragraphs for rough reading . |
| Outcome: | The proposed method significantly outperforms the state-of-the-art extractive methods on CNN and DailyMail datasets. |
Attention Optimization for Abstractive Document Summarization (D19-1)
Copied to clipboard
| Challenge: | Abstractive summarization models require attention to reproduce the most salient information. |
| Approach: | They propose to use local and global variances to augment the vanilla attention model to reproduce the most salient information and avoid repetitions. |
| Outcome: | The proposed attention refinement unit can reproduce the most salient information and avoid repetitions on CNN/Daily Mail dataset. |
DEFT: Distribution-guided Efficient Fine-Tuning for Human Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that the methods enhanced by DEFT outperform the original methods in both alignment capability and generalization ability, with significantly reduced training time. |
| Approach: | They propose a distribution-based alignment framework that integrates data filtering and distributional guidance to improve alignment efficiency and generalization ability. |
| Outcome: | The proposed framework outperforms existing methods in alignment capability and generalization ability with significantly reduced training time. |
PhaseMI: A Motivational Interviewing Dataset for Enhancing Phase Progression in LLM-based Counseling (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing MI datasets do not explicitly model structured progression of MI phases, which is essential for effective and goal-oriented counseling. |
| Approach: | They propose a phase-structured MI dataset with a data generation framework that employs therapist, client, and supervisor LLMs to explicitly control phase transitions. |
| Outcome: | The proposed model achieves 12.3% better coverage of MI phases, 37.6% in guiding, and 61.1% in choosing. |
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions . |
| Approach: | They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification. |
| Outcome: | The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing. |
OpenResearcher: Unleashing AI for Accelerated Scientific Research (2024.emnlp-demo)
Copied to clipboard
Yuxiang Zheng, Shichao Sun, Lin Qiu, Dongyu Ru, Cheng Jiayang, Xuefeng Li, Jifan Lin, Binjie Wang, Yun Luo, Renjie Pan, Yang Xu, Qingkai Min, Zizhao Zhang, Yiwen Wang, Wenjie Li, Pengfei Liu
| Challenge: | Global scientific publications are growing annually by about 4%-5% (Pinedo et al., 2024). |
| Approach: | They introduce an AI-assisted platform that answers diverse questions from researchers using Retrieval-Augmented Generation (RAG) they develop various tools to understand queries, search from the scientific literature, filter retrieved information, provide accurate and comprehensive answers, and self-refine answers. |
| Outcome: | OpenResearcher is built on Retrieval-Augmented Generation (RAG) to integrate Large Language Models (LLMs) with up-to-date, domain-specific knowledge. |
DataSciBench: An LLM Agent Benchmark for Data Science (2026.findings-acl)
Copied to clipboard
Dan Zhang, Sining Zhoubian, Min Cai, Fengzu Li, Lekang Yang, Wei Wang, Tianjiao Dong, Ziniu Hu, Jie Tang, Yisong Yue
| Challenge: | Existing benchmarks focus on single task, simple evaluation metrics, and readily available ground truth (GT) DataSciBench is built on curated, natural, and challenging prompts with complex evaluation criteria and uncertain GT. |
| Approach: | They propose a benchmark for evaluating Large Language Models in data science that integrates LLM-based self-consistency and human verification to ensure accuracy. |
| Outcome: | The proposed framework outperforms open-source models in all metrics and offers rigorous insights into LLM strengths and weaknesses. |
NUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs are not able to handle numerals and units of measurement, but they can be improved by introducing perturbations. |
| Approach: | They propose to analyze existing LLMs on processing numerals and units of measurement by perturbing their datasets. |
| Outcome: | The proposed model improves on ancient Chinese arithmetic problems and can handle numeral and measurement conversions. |
DeMPT: Decoding-enhanced Multi-phase Prompt Tuning for Making LLMs Be Better Context-aware Translators (2024.emnlp-main)
Copied to clipboard
| Challenge: | Concatenating large language models are adapted to context-aware neural machine translation in a concatenated way . a recent paradigm shift has been witnessed in discourse-related challenges such as zero pronoun translation . |
| Approach: | They propose an alternative adaptation approach to make large language models discriminately model and utilize inter- and intra-sentence contexts. |
| Outcome: | The proposed approach outperforms concatenation mode and improves performance in discourse modeling. |
E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
Jinchang Hou, Chang Ao, Haihong Wu, Xiangtao Kong, Zhigang Zheng, Daijia Tang, Chengming Li, Xiping Hu, Ruifeng Xu, Shiwen Ni, Min Yang
| Challenge: | despite the rapid development of Large Language Models, there is no dedicated benchmark for evaluating LLMs in Chinese K-12 education. |
| Approach: | They propose to develop a benchmark specifically tailored for Chinese K-12 education. |
| Outcome: | EVAL is the first evaluation benchmark specifically tailored for Chinese K-12 education. |
Aspect and Sentiment Aware Abstractive Review Summarization (C18-1)
Copied to clipboard
| Challenge: | Abstractive summarization is a task that generates short and concise summaries of user generated reviews. |
| Approach: | They propose an interactive attention mechanism to learn the representations of context and aspect words within reviews, acted as an encoder. |
| Outcome: | The proposed model achieves impressive results compared to other strong competitors on a real-life dataset. |
FlexRAG: A Flexible and Comprehensive Framework for Retrieval-Augmented Generation (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing frameworks for retrieval-augmented generation (RAG) lack new techniques, difficulties in algorithm reproduction and sharing, and high system overhead. |
| Approach: | They propose a retrieval-augmented generation framework specifically designed for research and prototyping that supports text-based, multimodal, and network-based RAG. |
| Outcome: | The proposed framework supports text-based, multimodal, and network-based RAG, providing comprehensive lifecycle support alongside efficient asynchronous processing and persistent caching capabilities. |
A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Any Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing translation pipelines require additional cascade components to achieve speech-to-speech translation. |
| Approach: | They propose a non-autoregressive generation framework for simultaneous speech translation . it integrates both text-to-text and speech-tospeech tasks into a unified framework . |
| Outcome: | The proposed framework outperforms state-of-the-art models in speech-to-text and speech- to-speech tasks. |
HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy (2024.acl-long)
Copied to clipboard
Mengxi Xiao, Qianqian Xie, Ziyan Kuang, Zhicheng Liu, Kailai Yang, Min Peng, Weiguang Han, Jimin Huang
| Challenge: | Large Language Models (LLMs) can be used in psychotherapy to overcome challenges such as shame, distrust, and resource scarcity. |
| Approach: | They propose a cognitive reframing therapy method that uses empathetic dialogue to address deep-rooted negative thoughts and fosters rational, balanced perspectives. |
| Outcome: | The proposed model outperforms other models in terms of empathy, guidance, and logical coherence, demonstrating its effectiveness and potential positive impact on psychotherapy. |
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)
Copied to clipboard
Zhiwei Cao, Baosong Yang, Huan Lin, Suhang Wu, Xiangpeng Wei, Dayiheng Liu, Jun Xie, Min Zhang, Jinsong Su
| Challenge: | Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains. |
| Approach: | They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore. |
| Outcome: | The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore. |
Marathon: A Race Through the Realm of Long Context with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing long-context benchmarks do not accurately evaluate large language models’ comprehension and reasoning abilities in extended texts. |
| Approach: | They propose a new evaluation benchmark that adopts a multiple-choice question format and uses a multi-choke question format to assess the comprehension and reasoning skills of large language models. |
| Outcome: | The proposed benchmark provides a rapid, precise, and unbiased appraisal of the long-context comprehension skills of large language models. |
Multi-perspective Coherent Reasoning for Helpfulness Prediction of Multimodal Reviews (2021.acl-long)
Copied to clipboard
| Challenge: | Existing review helpfulness prediction tasks rely on text and image modalities to analyze review helpfuliness. |
| Approach: | They propose a task to analyze review helpfulness from text and visual modalities and propose 'multi-perspective coherent reasoning' method to combine coherence between product and review is proposed. |
| Outcome: | The proposed method can lead to performance increase of 8.5% compared to the best performing text-only model. |
Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation (2020.coling-main)
Copied to clipboard
| Challenge: | Cross-lingual Machine Reading Comprehension (CLMRC) is a challenging problem due to the lack of large-scale annotated datasets in low-source languages, such as Arabic, Hindi, and Vietnamese. |
| Approach: | They propose a novel approach to augment cross-lingual machine reading comprehension by combining knowledge from multiple language branch models into a single model for all target languages. |
| Outcome: | Extensive experiments on two CLMRC benchmarks show the proposed method is effective and robust to data noises. |
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA (2024.emnlp-main)
Copied to clipboard
Minzheng Wang, Longze Chen, Fu Cheng, Shengyi Liao, Xinghua Zhang, Bingli Wu, Haiyang Yu, Nan Xu, Lei Zhang, Run Luo, Yunshui Li, Min Yang, Fei Huang, Yongbin Li
| Challenge: | Existing benchmarks for evaluating long-context language models employ irrelevant noise texts to artificially extend the length of test cases, diverging from the real-world scenarios of long-constituency applications. |
| Approach: | They propose a long-context benchmark, Loong, aligning with realistic scenarios through extended multi-document question answering (QA) . |
| Outcome: | The proposed model can scale up the context window of large language models to perform in-depth analysis of multiple long documents. |
Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models for non-parametric domain adaptation lack kNN retrieval at each timestep, leading to substantial time overhead. |
| Approach: | They propose a kNN-MT-based model that uses a domain-specific translation knowledge store to interpolate the prediction distribution of the model. |
| Outcome: | The proposed model significantly extends kNN-MT with dynamic retrieval on widely-used datasets. |
A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference Resolution (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing state-of-the-art event coreference resolution systems rely on spurious and spurious associations in the input mention pair text. |
| Approach: | They propose a rationale-centric counterfactual data augmentation method that leverages the debiasing capability of counterfact data haussed by LLM-in-the-loop to mitigate spurious association while emphasizing causation. |
| Outcome: | The proposed method achieves state-of-the-art on three popular cross-document benchmarks and demonstrates robustness in out-of domain scenarios. |
Discourse Structure-Aware Prefix for Generation-Based End-to-End Argumentation Mining (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in AM models overlook the integration of supplementary discourse structure information, resulting in suboptimal outcomes. |
| Approach: | They propose a framework which generates discourse structure-aware prefixes for each layer of the generation model. |
| Outcome: | The proposed framework achieves state-of-the-art performance on two AM benchmarks. |
Selective Preference Optimization via Token-Level Reward Function Estimation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for maximizing preference optimization on all available tokens are noisy and inefficient. |
| Approach: | They propose a selective alignment strategy that centers on efficient key token selection without strong, fine-grained supervision signals. |
| Outcome: | The proposed strategy outperforms baseline methods on three benchmarks with up to 60% reduction in training hours. |
Cooperative Denoising for Distantly Supervised Relation Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from noisy labeling problem, which can severely degrade its performance. |
| Approach: | They propose a framework for distantly supervised relation extraction that leverages text corpus and knowledge graph and a cooperative module involving their mutual learning. |
| Outcome: | The proposed method reduces the noisy labels and achieves substantial improvement over the state-of-the-art methods. |
Non-autoregressive Streaming Transformer for Simultaneous Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Simultaneous machine translation models are trained to strike a balance between latency and translation quality. |
| Approach: | They propose a non-autoregressive streaming Transformer which generates blank tokens and decodes repetitive tokens to adjust its READ/WRITE strategy flexibly. |
| Outcome: | The proposed model outperforms previous strong autoregressive models on various benchmarks on siMT. |
Proxy-Driven Robust Multimodal Sentiment Analysis with Incomplete Data (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on optimizing model structures to handle uncertain missingness, but models still face challenges when dealing with uncertain missing data. |
| Approach: | They propose a data-centric robust multimodal sentiment analysis method, Proxy-Driven Robust Multimodal Fusion, which maps unimodal data to the latent space of Gaussian distributions to capture core features and structure. |
| Outcome: | The proposed method outperforms existing models in noise resistance and achieves state-of-the-art performance on multiple benchmark datasets. |
CTR-Guided Generative Query Suggestion in Conversational Search (2025.emnlp-industry)
Copied to clipboard
Erxue Min, Hsiu-Yuan Huang, Xihong Yang, Min Yang, Xin Jia, Yunfang Wu, Hengyi Cai, Junfeng Wang, Shuaiqiang Wang, Dawei Yin
| Challenge: | Generating effective query suggestions requires aligning model outputs with user click preferences. |
| Approach: | They propose a generative framework that leverages click modeling to denoise implicit feedback and enables reliable preference optimization for improving real-world user engagement. |
| Outcome: | The proposed framework outperforms strong baselines in CTR, relevance, diversity and diversity. |
Addressing the Length Bias Challenge in Document-Level Neural Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Document-level neural machine translation (DNMT) models incorporate context information through increased maximum lengths of source and target sentences. |
| Approach: | They propose a sliding decoding strategy that limits the length of target sentences . they propose 'length-normalized attention mechanism' to aid the model in focusing on target information . |
| Outcome: | The proposed method can achieve state-of-the-art results on open datasets. |
Rejection-to-Acceptance Transition: Model Editing-Based Jailbreak Backdoor Injection Not Limited to Few Output Tokens (2026.findings-acl)
Copied to clipboard
Shiji Yang, Min Cai, Hao Xiong, Congyao Mei, Haodong Zou, Shicheng Tan, Jie Chen, Fulan Qian, Shu Zhao
| Challenge: | Existing methods for jailbreaking LLMs are implemented by binding backdoors to predefined phrases as first few output tokens, inducing the LLM’s next-token prediction to produce continuous responses. |
| Approach: | They propose a model editing-based jailbreak backdoor attack that hijacks LLM representations into a acceptance domain rather than binding to a few output tokens. |
| Outcome: | The proposed model editing method outperforms existing methods, showing stronger jailbreak capabilities across LLMs and datasets. |
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing diverse NMT models lack translation diversity due to a discrepancy between training and inference . despite the success of diverse NTM, there is still a lack of translation diversity . |
| Approach: | They propose a multi-candidate optimization framework for diverse NMT to deal with this defect. |
| Outcome: | The proposed framework is transparent to basic diverse NMT models, and universally makes better trade-off between diversity and quality. |
Probing Structural Knowledge from Pre-trained Language Model for Argumentation Relation Classification (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Argumentation relation classification (ARC) is the most challenging subtask of argumentation mining. |
| Approach: | They propose a dual prior graph neural network to explore probing knowledge and syntactical information for comprehensively modeling the relationship between AC pairs. |
| Outcome: | The proposed model outperforms the state-of-the-art models on three public datasets. |
A Challenge Dataset and Effective Models for Conversational Stance Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | stance detection studies focus on evaluating stances within individual instances, hindering progress of conversational stance analysis. |
| Approach: | They propose a multi-turn conversation stance detection dataset that encompasses multiple targets for conversational stance detector. |
| Outcome: | The proposed dataset encompasses multiple targets for conversational stance detection. |
STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generation (2025.findings-acl)
Copied to clipboard
Jiaming Li, Yukun Chen, Ziqiang Liu, Minghuan Tan, Lei Zhang, Yunshui Li, Run Luo, Longze Chen, Jing Luo, Ahmadreza Argha, Hamid Alinejad-Rokny, Wei Zhou, Min Yang
| Challenge: | Existing methods for storytelling lack coherence and consistency, compromising the overall storytelling experience. |
| Approach: | They propose a novel approach that improves the coherence and consistency of automatically generated stories by managing plot nodes and enabling dynamic interactions between different parts of the story. |
| Outcome: | The proposed approach outperforms existing methods in 84.33% of the trials. |
Submodular-based In-context Example Selection for LLMs-based Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Prior studies have focused on the role of well-chosen examples in in-context learning . |
| Approach: | They propose to use multiple translational factors for in-context example selection by using monotone submodular function maximization. |
| Outcome: | The proposed approach outperforms random selection and robust single-factor baselines across various NLP tasks. |
Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data? (2024.acl-long)
Copied to clipboard
| Challenge: | Existing two-pass direct speech-to-speech translation models require parallel speech data to train, which is challenging to collect. |
| Approach: | They propose a two-pass direct speech-to-speech translation (S2ST) model that decomposes the task into speech- to-text translation (s2TT) and text-tospech (TTS) they propose 'composer' S2ST model that integrates pretrained S2TT and TTS models into a direct S2 ST model. |
| Outcome: | The proposed model integrates pretrained S2TT and TTS models into a direct S2ST model without parallel speech data. |
Making Flexible Use of Subtasks: A Multiplex Interaction Network for Unified Aspect-based Sentiment Analysis (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies aim to integrate multiple sub-tasks into a unified ABSA model but suffer from major disadvantages . |
| Approach: | They propose a multi-task learning approach to make use of sub-tasks for a unified ABSA. |
| Outcome: | The proposed model can work well when some sub-tasks are absent, and the interactive relations among subtasks not adequate. |
Two Intermediate Translations Are Better Than One: Fine-tuning LLMs for Document-level Translation Refinement (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research has shown that large language models (LLMs) can enhance translation quality through self-refinement. |
| Approach: | They propose to extend translation refinement from sentence-level to document-level by using document-to-document (Doc2Doc) translations. |
| Outcome: | The proposed method improves translation quality across ten translation tasks with LLaMA-3-8B-Instruct and Mistral-Nemo-Instru. |
A Knowledge Regularized Hierarchical Approach for Emotion Cause Analysis (D19-1)
Copied to clipboard
| Challenge: | Emotion cause analysis aims to identify the reasons behind emotions . previous models focus on learning architecture with local textual information . |
| Approach: | They propose a method to extract emotion cause with hierarchical neural model and knowledge-based regularizations by sentiment lexicon and common knowledge. |
| Outcome: | The proposed method outperforms baselines on two public datasets in different languages and outperformed competitive baselines by 2.08%. |
DaNet: Dual-Aware Enhanced Alignment Network for Multimodal Aspect-Based Sentiment Analysis (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods assume a direct alignment between images and aspects, matching the entire image with a corresponding aspect. Existing algorithms assume 'direct alignment' between images, introducing noise. |
| Approach: | They propose a Dual-Aware Enhanced Alignment Network (DaNet) that can enhance fine-grained multimodal aspect-image alignment and denoising. |
| Outcome: | The proposed system outperforms existing methods in three subtasks and is available on https://github.com/***/DaNet. |
Progressive Self-Training with Discriminator for Aspect Term Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to extract aspect terms from review sentences are limited due to lack of annotated data. |
| Approach: | They propose to refine conventional self-training to progressive self-teaching to reduce noise . they use a discriminator to filter the noisy pseudo-labels. |
| Outcome: | The proposed model outperforms baseline models and achieves state-of-the-art performance on four SemEval datasets. |
Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Long-context modeling capabilities are important for large language models (LLMs) however, training LLMs with long context windows is insufficient since some samples do not exhibit strong semantic dependencies across long contexts. |
| Approach: | They propose a data mining framework ProLong that assigns each training sample with a long dependency score and ranks and filters them according to their results. |
| Outcome: | The proposed framework can rank and filter training samples that exhibit more powerful long-context modeling abilities. |
Probing Graph Decomposition for Argument Pair Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Argument pair extraction (APE) aims to extract interactive argument pairs from two passages within a discussion. |
| Approach: | They propose a method to extract interactive argument pairs from two passages . they propose to decompose the probing graph into four sub-graphs based on inter- and intra-passage perspectives . |
| Outcome: | The proposed method improves on strong baselines on two benchmark datasets. |
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning (2026.findings-acl)
Copied to clipboard
Ruijun Huang, Zhiqiao Kang, Yuxuan Zhu, Junxiong Li, Jiahao Zhao, Minghuan Tan, Feng Jiang, Min Yang
| Challenge: | Large Language Models (LLMs) exhibit severe hallucinations, which undermine reliability of automated scientific document understanding systems. |
| Approach: | They propose a framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization. |
| Outcome: | The proposed framework significantly reduces hallucination rates and improves overall accuracy on the MeasEval benchmark. |
Locality Preserving Sentence Encoding (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing word embeddings can be used to learn sentence embedds on the sentence level. |
| Approach: | They propose a sentence embedding method that uses the inner product to compute semantic similarity between sentences. |
| Outcome: | The proposed method encodes sentences better in the sense of semantic structures. |
Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have achieved great success in various NLP tasks, but the vast model parameters pose challenges in downstream fine-tuning. |
| Approach: | They propose a task-agnostic prompting strategy that analyzes each dialogue utterance before task execution to enhance LLMs' comprehension in multi-turn dialogues. |
| Outcome: | The proposed strategy outperforms other zero-shot prompts and matches or exceeds efficacy of few-shot ones. |
SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for dialog understanding only consider self-augmented dialogs as positive samples and treat all other dialogs like negative ones. |
| Approach: | They propose a tree-structured pre-trained conversation model which learns dialog representations from limited labeled dialogs and large-scale unlabeled dialog corpora via semi-supervised contrastive pre-training. |
| Outcome: | The proposed model can achieve state-of-the-art results on the DialoGLUE benchmark. |
TemplateGEC: Improving Grammatical Error Correction with Detection Template (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for grammatical error correction (GEC) have been developed. |
| Approach: | They propose a method which integrates the detection labels from a Seq2Edit model to construct a template as the input. |
| Outcome: | The proposed method can perform human-in-the-loop error correction tasks. |
MuCPAD: A Multi-Domain Chinese Predicate-Argument Dataset (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that shallow semantic role labeling (SRL) performance drops under out-of-domain setting. |
| Approach: | They propose to annotate a multi-domain Chinese predicate-argument dataset using a frame-free annotation methodology and strict double annotation for improving data quality. |
| Outcome: | The proposed dataset is compared with a dataset from six different domains. |
M-CNER: A Corpus for Chinese Named Entity Recognition in Multi-Domains (L18-1)
Copied to clipboard
| Challenge: | NER is one of the most important natural language processing tasks. |
| Approach: | They propose to annotate sentences from human-computer interaction, social media, and e-commerce using two rounds of annotation. |
| Outcome: | The proposed system performs the best on all the data sets. |
Basic Reading Distillation (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models require high computational resources which limits their deployment in real-world applications. |
| Approach: | They propose to distill large language models into smaller language models by either knowledge distillation or task distillation. |
| Outcome: | The proposed model outperforms or performs comparable to over 20x bigger LLMs on language inference benchmarks and BIG-bench tasks. |
In-context Learning for Few-shot Multimodal Named Entity Recognition (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition are time-consuming and laborintensive. |
| Approach: | They propose a few-shot multimodal named entity recognition task that uses few examples to locate and identify named entities for a text-image pair. |
| Outcome: | The proposed framework outperforms baselines under several few-shot settings. |
TInR: Exploring Tool-Internalized Reasoning in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on external tool documentation during reasoning, leading to tool mastery difficulty, tool size constraints, and inference inefficiency. |
| Approach: | They propose a tool-internalized reasoning framework for unified reasoning and tool usage that integrates external tools into Large Language Models (LLMs) to address these issues, they propose 'tool-internet-based' reasoning. |
| Outcome: | The proposed method achieves superior performance across in-domain and out-of-domain settings, highlighting its effectiveness and efficiency. |
Improving the Transformer Translation Model with Document-Level Context (D18-1)
Copied to clipboard
| Challenge: | Existing models for document-level context translation ignore documentlevel context. |
| Approach: | They propose a document-level context encoder to represent document- level context and integrate it into the Transformer model. |
| Outcome: | Experiments on NIST Chinese-English and IWSLT French-English datasets show that the proposed translation model outperforms the Transformer model significantly. |
New Terms, New Toxicity: Consensus-based Chinese Neologism Toxicity Detection via Search-Augmented LLMs (2026.acl-long)
Copied to clipboard
Shiyao Cui, QingLin Zhang, Di Wang, Yida Lu, Zhexin Zhang, Jinhua Gao, Jinglin Yang, Min He, Han Qiu, Minlie Huang
| Challenge: | Neologisms can foster new linguistic consensus by stabilizing shared meanings and usage in common communicative norms. |
| Approach: | They propose a taxonomy that captures the origins and consensus-verification criteria of toxic neologisms . they propose 'SeTox' framework that integrates real-time web context for naeologim detection . |
| Outcome: | The proposed framework outperforms large-scale models in detecting neologism toxicity. |
Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing studies in Multimodal Sentiment Analysis lack a mechanism to understand complex relations between different modalities. |
| Approach: | They propose a hierarchical graph contrastive learning framework for multimodal sentiment analysis that explores the relationships between modality representations. |
| Outcome: | The proposed framework outperforms the state-of-the-art in multimodal sentiment analysis on two benchmark datasets. |
Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models struggle to meet user’s needs when required to generate responses of a specific length due to their inherent difficulty in accurately perceiving numerical constraints. |
| Approach: | They propose a Target Length Generation Task and propose RULER, a model-agnostic approach that controls generated length for large language models. |
| Outcome: | The proposed model-agnostic approach improves instruction-following ability of large language models under length-constrained instructions and can generate appropriate MLT when length constraints are not explicitly provided. |
Decoder-Only LLMs can be Masked Auto-Encoders (2025.acl-short)
Copied to clipboard
Dan Qiao, Yuan Gao, Zheming Yang, Di Yang, Ziheng Wu, Pengcheng Lu, Minghui Qiu, Juntao Li, Min Zhang
| Challenge: | Modern NLP workflows require different models for generation and embedding tasks. |
| Approach: | They propose a method that transforms an LLM into a Uni-Directional Masked Auto-Encoder. |
| Outcome: | The proposed method achieves state-of-the-art under unsupervised conditions with merely 100 training steps. |
Language Anisotropic Cross-Lingual Model Editing (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work studies monolingual model editing, which lacks cross-lingual transferability to perform editing simultaneously across languages. |
| Approach: | They propose a framework to naturally adapt monolingual model editing approaches to the cross-lingual scenario using parallel corpus. |
| Outcome: | The proposed framework adapts monolingual model editing approaches to the cross-lingual scenario using parallel corpus and amplifies different subsets of parameters for each language. |
Context Consistency between Training and Inference in Simultaneous Machine Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Simultaneous machine translation (SiMT) aims to yield a partial translation with a monotonically growing source-side context. |
| Approach: | They propose a training approach that encourages consistent context usage between training and inference by optimizing translation quality and latency as bi-objectives and exposing the predictions to the model during the training. |
| Outcome: | The proposed system outperforms existing SiMT systems with context inconsistency for the first time. |
MidPO: Dual Preference Optimization for Safety and Helpfulness in Large Language Models via a Mixture of Experts Framework (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies address safety-constrained online and offline preferences optimizations, but offline methods perform poorly in adaptively balancing safety and helpfulness. |
| Approach: | They propose a mixture of experts framework for safety-helpfulness dual Preference Optimization . they combine a single-preference enhanced direct preference optimization approach with a dynamic routing mechanism . |
| Outcome: | The proposed framework outperforms state-of-the-art methods in safety and helpfulness. |
Quantification of Large Language Model Distillation (2025.acl-long)
Copied to clipboard
Sunbowen Lee, Junting Zhou, Chang Ao, Kaige Li, Xeron Du, Sirui He, Haihong Wu, Tianci Liu, Jiaheng Liu, Hamid Alinejad-Rokny, Min Yang, Yitao Liang, Zhoufutu Wen, Shiwen Ni
| Challenge: | Existing studies have revealed the robustness degra-dation caused by data distillation. |
| Approach: | They propose a framework to evaluate and quantify model distillation . they aim to identify identity cognition contradictions and analyse multi-granularity response similarities across models to measure the extent of homogenization. |
| Outcome: | The proposed framework addresses two key aspects: (1) Identifying identity cognition contradictions to assess discrepancies in how models perceive and represent identity-related information; (2) Analyzing multi-granularity response similarities across models to measure the extent of homogenization. |
Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion (2025.coling-main)
Copied to clipboard
| Challenge: | Empirical evidence suggests that LLMs perform worse than conventional KGC approaches. |
| Approach: | They propose a filter-then-generate paradigm and a multiple-choice question format to harness the capability of LLMs while mitigating the issue casused by hallucinations. |
| Outcome: | The proposed method achieves substantial performance gain compared to existing state-of-the-art methods. |
MoZIP: A Multilingual Benchmark to Evaluate Large Language Models in Intellectual Property (2024.lrec-main)
Copied to clipboard
Shiwen Ni, Minghuan Tan, Yuelin Bai, Fuqiang Niu, Min Yang, Bowen Zhang, Ruifeng Xu, Xiaojun Chen, Chengming Li, Xiping Hu
| Challenge: | Large language models (LLMs) have demonstrated impressive performance in various natural language processing tasks. |
| Approach: | They propose a benchmark for the evaluation of large language models in the IP domain . they also propose supervised multilingual large language model called MoZi . |
| Outcome: | The proposed model outperforms four well-known LLMs on the MoZIP benchmark . the most powerful ChatGPT does not reach the passing level . |
Stance Detection on Social Media with Background Knowledge (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies of stance detection focus on learning stance information about specific targets from context, but in real-world scenarios, we usually have a certain understanding of a target when we express our stance on it. |
| Approach: | They propose to take the background knowledge of the target into account for better stance detection by categorizing it into episodic and discourse knowledge categories and a heuristic retrieval algorithm based on the topic to retrieve the Wikipedia documents relevant to the sample. |
| Outcome: | The proposed framework achieves state-of-the-art on four benchmark datasets showing that the proposed framework is able to detect stances in-target and zero-shot scenarios. |
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)
Copied to clipboard
Yuelin Bai, Xeron Du, Yiming Liang, Leo Jin, Junting Zhou, Ziqiang Liu, Feiteng Fang, Mingshan Chang, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Moore Wang, Ruibin Yuan, Haihong Wu, Hongquan Lin, Wenhao Huang, Jiajun Zhang, Chenghua Lin, Jie Fu, Min Yang, Shiwen Ni, Ge Zhang
| Challenge: | Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns. |
| Approach: | They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users. |
| Outcome: | The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks. |
Interactively-Propagative Attention Learning for Implicit Discourse Relation Recognition (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for discourse relation recognition use self-attention and interactive-attention mechanisms. |
| Approach: | They develop a propagative attention learning model using a cross-coupled two-channel network. |
| Outcome: | The proposed model improves on the baseline models on a Penn Discourse Treebank. |
CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMs (2026.findings-acl)
Copied to clipboard
Siyi Li, Jiajun Shi, Shiwen Ni, Ge Zhang, Shuaimin Li, Shijian Wang, Zhoufutu Wen, Yizhi LI, Hamid Alinejad-Rokny, Jiaheng Liu, Min Yang, Wenhao Huang
| Challenge: | Existing evaluations emphasize final accuracy or coarse token counts, and lack automated tools to separate essential logic from structural redundancy. |
| Approach: | They propose a graph-driven framework that quantifies reasoning efficiency by converting free-form CoTs into directed dependency graphs and extracting the Shortest Effective Path needed to reach a correct solution. |
| Outcome: | Evaluating 21 LRMs, the proposed framework quantifies reasoning efficiency by converting free-form CoTs into directed dependency graphs and extracting the Shortest Effective Path (SEP) needed to reach a correct solution. |
LIME: Less Is More for MLLM Evaluation (2025.findings-acl)
Copied to clipboard
King Zhu, Qianbo Zang, Shian Jia, Siwei Wu, Feiteng Fang, Yizhi Li, Shuyue Guo, Tianyu Zheng, Jiawei Guo, Bo Li, Haoning Wu, Xingwei Qu, Jian Yang, Ruibo Liu, Xiang Yue, Jiaheng Liu, Chenghua Lin, Hamid Alinejad-Rokny, Min Yang, Shiwen Ni, Wenhao Huang, Ge Zhang
| Challenge: | Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs. |
| Approach: | They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding. |
| Outcome: | The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities. |
Unsupervised Speech-text word-level alignment with Dynamic Programming (2025.findings-naacl)
Copied to clipboard
| Challenge: | Word-level alignment in speech-text pretraining models is limited by word-level annotated data . authors propose an iterative training method for USDP that reduces the dependency on scarce annotation resources. |
| Approach: | They propose an Unsupervised Speech-text word-level alignment with Dynamic Programming (USDP) this method uses Dynamic programming principles to iteratively refine temporal alignment predictions . |
| Outcome: | The proposed method significantly improves on speech-text pretraining tasks compared to existing methods. |
Benchmarking LLMs for Translating Classical Chinese Poetry: Evaluating Adequacy, Fluency, and Elegance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models fall short of translating culturally significant content . existing models fall behind in achieving such translations, authors say . |
| Approach: | They propose a suitable benchmark for translating classical Chinese poetry into English . they propose RAT, a retrieval-augmented machine translation method that enhances the translation process . |
| Outcome: | The proposed method improves translation quality in terms of adequate, fluent, and elegant translations. |
BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)
Copied to clipboard
Yue Wang, Ruotian Ma, Xingyu Chen, Zhengliang Shi, Morunliu Yang, Wanshun Chen, Huang Liu, Jiadi Yao, Xin He, Qu Yang, Qingxuan Jiang, Fanghua Ye, Juntao Li, Zhaopeng Tu, Xiaolong Li, Liefeng Bo, Min Zhang
| Challenge: | Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS). |
| Approach: | They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features. |
| Outcome: | The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization. |
Enhancing Cross-target Stance Detection with Transferable Semantic-Emotion Knowledge (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for stance detection are struggling to cope with the data across targets. |
| Approach: | They propose a model that uses external knowledge as a bridge to enable knowledge transfer across different targets. |
| Outcome: | The proposed model outperforms existing methods on a large real-world dataset. |
Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on multimodal sarcasm detection using textual and visual information have been limited to text-only approaches. |
| Approach: | They propose to construct a cross-modal graph for each multi-modal instance to explicitly draw the ironic relations between textual and visual modalities. |
| Outcome: | The proposed model achieves state-of-the-art in multi-modal sarcasm detection. |
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks (2023.acl-long)
Copied to clipboard
| Challenge: | Existing datasets suffer from a lack of fine-grained annotations, such as the toxic type and expressions with indirect toxicity. |
| Approach: | They propose a benchmark model to detect toxic language by incorporating lexical features into a Chinese dataset to facilitate fine-grained annotations. |
| Outcome: | The proposed model is based on insulting vocabulary containing implicit profanity and is able to detect toxic language with lexical features. |
Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models (2025.acl-long)
Copied to clipboard
Suhang Wu, Jialong Tang, Chengyi Yang, Pei Zhang, Baosong Yang, Junhui Li, Junfeng Yao, Min Zhang, Jinsong Su
| Challenge: | Existing methods for terminology translation struggle with interference from irrelevant noise. |
| Approach: | They propose a Locate-and-Focus method that locates terminologies within utterances to construct translation knowledge by minimizing irrelevant information for ST models. |
| Outcome: | The proposed method locates terminologies within utterances and enhances the success rate of terminology translation while maintaining robust general translation performance. |
Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods that confuse tool utilization with knowledge reasoning harm readability and give rise to tool invocation hallucinations. |
| Approach: | They propose to decouple LLM from tool invocation tasks by establishing a memory module with explicit descriptions of query statements and a query memory module to facilitate the KGQA process. |
| Outcome: | The proposed method achieves state-of-the-art on WebQSP and CWQ benchmarks. |
Scaling Law for Document Neural Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) methods fail to capture discourse phenomena such as pronominal anaphora, lexical consistency, and document coherence as the input text exceeds a single sentence. |
| Approach: | They examine the effects of model scale, data scale, and sequence length on translation quality when model size is limited. |
| Outcome: | The proposed model scales and data scales are compared with the existing models and show that increasing sequence length improves translation quality when model size is limited. |