Papers by Zhou Yu
Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing research focuses on task-oriented or open-domain dialogue systems with influence skills. |
| Approach: | They propose to define and introduce a category of social influence dialogue systems that influence users’ cognitive and emotional responses. |
| Outcome: | The proposed system is task-oriented or goal-oriented, but it is not open-domain. |
Domain Adaptive Dialog Generation via Meta Learning (P19-1)
Copied to clipboard
| Challenge: | Existing methods to adapt dialog data to new domains with limited resources are expensive . a domain adaptive dialog system model learns from multiple rich-resource tasks and adapts to new tasks with minimal training samples. |
| Approach: | They propose a domain adaptive dialog generation method based on meta-learning . they train a dialog system model using multiple rich-resource single-domain dialog data . |
| Outcome: | The proposed method can learn a competitive dialog system on a new domain with minimal training examples. |
HSDreport: Heart Sound Diagnosis with Echocardiography Reports (2024.findings-emnlp)
Copied to clipboard
Zihan Zhao, Pingjie Wang, Liudan Zhao, Yuchen Yang, Ya Zhang, Kun Sun, Xin Sun, Xin Zhou, Yu Wang, Yanfeng Wang
| Challenge: | Existing methods for heart sound diagnosis are limited to a few fixed categories and do not utilize echocardiography reports, the gold standard in the diagnosis of related diseases. |
| Approach: | They propose a benchmark that mandates the direct utilization of heart sounds obtained from auscultation to predict echocardiography reports. |
| Outcome: | The proposed method outperforms existing methods and existing multimodal LLMs in detecting key abnormalities in heart sounds. |
CFSum Coarse-to-Fine Contribution Network for Multimodal Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal summarization models ignore the contribution of visual modalities . we propose a novel contribution network to consider different contributions of images . |
| Approach: | They propose a Coarse-to-Fine contribution network for multimodal summarization to consider different contributions of images for summarizing. |
| Outcome: | The proposed system outperforms baselines on the visual and textual modalities. |
Backdoor Collapse: Eliminating Unknown Threats Via Known Backdoor Aggregation In Language Models (2026.acl-long)
Copied to clipboard
Liang Lin, Miao Yu, Moayad Aloqaily, Zhenhong Zhou, Kun Wang, Linsey Pang, Prakhar Mehrotra, Qingsong Wen
| Challenge: | Existing defenses rely on impractical assumptions about trigger settings to mitigate backdoor attacks . a recent study found that small amounts of training data can systematically induce harmful behaviors in large language models. |
| Approach: | They propose a backdoor defense framework that requires no prior knowledge of trigger settings . they use a two-stage process to aggregate backdoor representations and fine-tune recovery . |
| Outcome: | The proposed defense reduces the average Attack Success Rate to 4.41% across multiple benchmarks . the proposed framework generalizes across different types of backdoors, confirming its robustness in practical deployment scenarios. |
Towards Modern Topic Models: A Survey of Taxonomies and Paradigm Shifts from Algorithm-Centric to LLM-Centered Topic Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Topic modeling (TM) is a classic unsupervised learning task in the field of natural language processing. |
| Approach: | They propose a new taxonomy that emphasizes the role of LLMs and the design of end-to-end workflows. |
| Outcome: | The proposed taxonomy emphasizes the role of LLMs and the design of end-to-end workflows. |
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback (2025.acl-long)
Copied to clipboard
Jiakang Yuan, Xiangchao Yan, Bo Zhang, Tao Chen, Botian Shi, Wanli Ouyang, Yu Qiao, Lei Bai, Bowen Zhou
| Challenge: | Recent studies show that AI-assisted research methods can improve research efficiency . a closed-loop framework is used to enhance the automation level of scientific research . |
| Approach: | They propose a closed-loop LLM-driven framework to enhance the automation level of scientific research. |
| Outcome: | The proposed framework improves the efficiency of scientific research by improving data analysis, accelerating computation, and fostering novel idea generation. |
Friend-training: Learning from Models of Different but Related Tasks (2023.eacl-main)
Copied to clipboard
| Challenge: | Current self-training methods focus on improving model performance on a single task. |
| Approach: | They propose a cross-task self-training framework where models trained to do different tasks are used in iterative training, pseudo-labeling, and retraining processes to help each other for better selection of pseudo-labeled labels. |
| Outcome: | The proposed framework achieves the best performance compared to baselines on two dialogue understanding tasks. |
Corpus-Steered Query Expansion with Large Language Models (2024.eacl-short)
Copied to clipboard
| Challenge: | Recent studies show query expansions generate hypothetical documents that answer queries as expansions. |
| Approach: | They propose a corpus-steered query expansion to promote incorporation of knowledge embedded within the corpus. |
| Outcome: | et al. analyzed corpus-based Query Expansion (CSQE) using LLMs to generate hypothetical documents that answer the query. |
TestNUC: Enhancing Test-Time Computing Approaches and Scaling through Neighboring Unlabeled Data Consistency (2025.acl-long)
Copied to clipboard
Henry Peng Zou, Zhengyao Gu, Yue Zhou, Yankai Chen, Weizhi Zhang, Liancheng Fang, Yibo Wang, Yangning Li, Kay Liu, Philip S. Yu
| Challenge: | Test-time computing approaches that leverage additional computational resources during inference have been proven effective in enhancing large language model performance. |
| Approach: | They propose a linearly scaling approach that leverages local consistency of neighboring unlabeled data to improve test-time predictions. |
| Outcome: | The proposed approach outperforms baseline methods such as prompting and self-consistency across eight datasets and performs robustly across embedding models. |
Low-Resource Comparative Opinion Quintuple Extraction by Data Augmentation with Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Comparative Opinion Quintuple Extraction (COQE) aims to predict comparative opinion quintuples from comparative sentences. |
| Approach: | They propose a low-resource approach to extract comparative opinion quintuples from comparative sentences . they propose augmentation using ChatGPT and a data-centric approach . |
| Outcome: | The proposed approach improves the existing pipeline-based method and achieves state-of-the-art results. |
Word Segmentation by Separation Inference for East Asian Languages (2022.findings-acl)
Copied to clipboard
| Challenge: | Chinese Word Segmentation (CWS) is a sequence labeling task that divides sentences into words . despite diverse tagging schemas, they all carry implicit position information. |
| Approach: | They propose to model the separation state of every two consecutive characters by tagging them as two tags. |
| Outcome: | The proposed framework outperforms state-of-the-art on Japanese and Korean Word Segmentation datasets. |
ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge (2025.emnlp-main)
Copied to clipboard
Chaoyue He, Xin Zhou, Yi Wu, Xinjia Yu, Yan Zhang, Lei Zhang, Di Wang, Shengfei Lyu, Hong Xu, Wang Xiaoqiao, Wei Liu, Chunyan Miao
| Challenge: | ESGenius is a comprehensive benchmark for evaluating Large Language Models on ESG and sustainability knowledge. |
| Approach: | They introduce ESGenius, a benchmark for evaluating and enhancing ESG proficiency . they use a rigorous two-stage evaluation protocol and a repository of foundational frameworks . |
| Outcome: | ESGenius is a benchmark for evaluating and enhancing the proficiency of Large Language Models (LLMs) in ESG and sustainability-focused question answering. |
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)
Copied to clipboard
Sashuai Zhou, Qiang Zhou, Jijin Hu, Hanqing Yang, Yue Cao, Junpeng Ma, Yinchao Ma, Jun Song, Tiezheng Ge, Cheng Yu, Bo Zheng, Zhou Zhao
| Challenge: | generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap. |
| Approach: | They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback . |
| Outcome: | The proposed system significantly improves image reasoning and generation quality. |
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)
Copied to clipboard
Bingxian Wu, Yu Zhang, Zonghao Guo, Tang Liu, Chen Qian, Yuxiang Lu, Xingbo Du, Yanghao Li, Yidan Zhang, Chi Chen, Ling Yao, Chenghu Zhou, Maosong Sun
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
AutoSpec: An Agentic Framework for Automatically Drafting Patent Specification (2025.findings-emnlp)
Copied to clipboard
| Challenge: | drafting a patent application is expensive and time-consuming, making it a prime candidate for automation. |
| Approach: | a new framework automates the process of drafting a patent application . the framework decomposes drafting into manageable subtasks . |
| Outcome: | a new framework outperforms existing baselines on drafting patent specification tasks. |
Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing Relation extraction models require extensive annotated training data, which is costly and labor-intensive to collect. |
| Approach: | They propose a new zero-shot RE task where only relation definitions are provided instead of seen-unseen relation instances. |
| Outcome: | The proposed task significantly improves cost-effective zero-shot performance by large margins. |
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models (2022.coling-1)
Copied to clipboard
| Challenge: | Prompting has shown to be sample efficient compared to fine-tuning with pre-trained models. |
| Approach: | They propose a fully automatic prompting method that uses natural language prompts on sequence-to-sequence models and a beam search method to generate a large amount of label sequence candidates. |
| Outcome: | The proposed method significantly outperforms other no-manual-design methods on single label words and generates large amount of label sequence candidates. |
Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on temporal sentence grounding rely on expensive video-query paired annotations . despite this, there are no ground-truth annotations in the current work . |
| Approach: | They propose to use paired video-query and segment boundary annotations to generate temporal sentence grounding without training. |
| Outcome: | The proposed model outperforms existing unsupervised methods and beats supervised ones on two challenging datasets. |
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
Negative Focus Detection via Contextual Attention Mechanism (D19-1)
Copied to clipboard
| Challenge: | Negation is a universal but complicated linguistic phenomenon that reverses the polarity of a statement or its property into opposite. |
| Approach: | They propose a framework which consists of a Bidirectional Long Short-Term Memory neural network and a Conditional Random Fields layer to capture contextual information. |
| Outcome: | The proposed framework improves on the SEM’12 shared task corpus, yielding an absolute improvement of 2.11% over the state-of-the-art. |
EDEN: Empathetic Dialogues for English Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that student passion and perseverance, or grit, is associated with language learning success. |
| Approach: | They hypothesize that as students perceive their English teachers to be more supportive, their grit improves. |
| Outcome: | The proposed chatbot improves student persistence in learning a second language. |
How Alignment and Jailbreak Work: Explain LLM Safety through Intermediate Hidden States (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) rely on safety alignment to avoid malicious user inputs. |
| Approach: | They employ weak classifiers to explain LLM safety through the intermediate hidden states. |
| Outcome: | The proposed model can identify malicious and normal inputs and detect malicious ones without jailbreak. |
ReFreeKV: Towards Threshold-Free KV Cache Compression (2026.findings-acl)
Copied to clipboard
| Challenge: | Towards the KV cache efficiency, we propose a new objective that lifts the threshold constraints for robust KV compression. |
| Approach: | They propose a method that adjusts KV cache budgets while preserving full-cache performance. |
| Outcome: | The proposed method can reduce memory consumption while preserving full-cache performance. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
MedQA-CS: Objective Structured Clinical Examination (OSCE)-Style Benchmark for Evaluating LLM Clinical Skills (2026.eacl-long)
Copied to clipboard
Zonghai Yao, Zihao Zhang, Chaolong Tang, Xingyu Bian, Youxia Zhao, Zhichao Yang, Junda Wang, Huixue Zhou, Won Seok Jang, Feiyun Ouyang, Hong Yu
| Challenge: | Current clinical LLM benchmarks fail to evaluate advanced clinical skills in AI and large language models (LLMs). |
| Approach: | They propose a framework to evaluate large language models (LLMs) using two instruction-following tasks designed to reflect real clinical scenarios. |
| Outcome: | The proposed framework evaluates LLMs through two instruction-following tasks designed to reflect real clinical scenarios. |
Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference (P19-1)
Copied to clipboard
| Challenge: | Existing models for SLU use explicit memory representations, but the context memory is under-exploited. |
| Approach: | They propose a dialogue logistic inference task to consolidate the context memory with SLU in a multi-task framework. |
| Outcome: | The proposed model improves slot filling and domain classification performance in a multi-task framework. |
STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation (2025.findings-acl)
Copied to clipboard
Wenxiang Guo, Yu Zhang, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, ZheTao Chen, Wenhao Xu, Fei Wu, Zhou Zhao
| Challenge: | Existing automated singing annotation (ASA) methods tackle isolated aspects of the annotation pipeline. |
| Approach: | They propose a framework that addresses transcription, alignment, and refined style annotations. |
| Outcome: | The proposed framework delivers comprehensive multi-level annotations encompassing: (1) precise phoneme-audio alignment, (2) robust note transcription and temporal localization, (3) expressive vocal technique identification, and (4) global stylistic characterization including emotion and pace. |
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)
Copied to clipboard
Xiao Sun, null Ymyang, Xinyi Jiang, Yu Tian, Junnan Zhu, Jiang Zhong, Qin Lei, Jingwang Huang, Haoyang Zeng, Xinyu Zhou, Xin Xiao, Kaiwen Wei
| Challenge: | Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility . |
| Approach: | They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning. |
| Outcome: | The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis. |
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)
Copied to clipboard
Ying He, Zhouhong Gu, Zhecheng Hu, Yubo Zhou, Hao Shen, Jiaqing Liang, Zhaoqian Dai, Ma Shuguang, Fei Yu, Yanghua Xiao, Zhixu Li
| Challenge: | Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly. |
| Approach: | They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show . |
| Outcome: | The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models. |
Order Doesn’t Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Logical reasoning is essential for large language models (LLMs) to ensure accurate and coherent inferences. |
| Approach: | They propose an order-centric data augmentation framework based on commutativity in logical reasoning that randomly shuffles independent premises to introduce condition order augmentation. |
| Outcome: | The proposed framework improves LLMs’ reasoning performance and adaptability to diverse logical structures. |
SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialogues (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on identifying entities' relations from the semantics of dialogues-they utilize either the attention mechanism or a refined token graph to locate informative words. |
| Approach: | They propose a sequential structure prediction task to incrementally parse SocAoG for dynamic inference upon any incoming utterance. |
| Outcome: | Empirical results show that the proposed model infers social relations more accurately than the state-of-the-art methods. |
FastKASSIM: A Fast Tree Kernel-Based Syntactic Similarity Metric (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing syntactic similarity metrics are computationally expensive and inconsistent when faced with syntaktically dissimilar documents. |
| Approach: | They propose a metric which pairs and averages the most similar constituency parse trees between a pair of documents based on tree kernels. |
| Outcome: | The proposed metric is more robust to syntactic dissimilarities and runs up to 5.32 times faster than its predecessor over documents in the r/ChangeMyView corpus. |
Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Sparse Mixture-of-Experts (SMoE) architectures require loading all expert parameters . previous work focused on expert pruning and merging but focused on neuron-level structure . |
| Approach: | They propose a task-agnostic framework for expert pruning and reconstruction . it prunes redundant experts using router statistics, then decomposes them into neuron-level expert segments . |
| Outcome: | The proposed framework reduces the number of experts and memory usage, making it easier to deploy. |
Selective Differential Privacy for Language Modeling (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to protect sensitive data from leaking are over-pessimistic and undifferentiated. |
| Approach: | They propose a new privacy notion, selective differential privacy, to provide rigorous privacy guarantees on the sensitive portion of the data to improve model utility. |
| Outcome: | The proposed privacy-preserving mechanism achieves better utility while remaining safe under various privacy attacks compared to baselines. |
Optimizing Question Semantic Space for Dynamic Retrieval-Augmented Multi-hop Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing retrieval-augmented generation methods are insufficient for multi-hop question answering . however, they tend to generate hallucinations due to semantic mismatching . |
| Approach: | They propose to optimize question semantic space for dynamic retrieval-augmented multi-hop question answering by optimizing the semantic embeddings. |
| Outcome: | The proposed method outperforms existing RAG methods in both in- and out-of-domain settings. |
Cross-Lingual Cross-Platform Rumor Verification Pivoting on Multimedia Content (D18-1)
Copied to clipboard
| Challenge: | rumors with multimedia content are becoming more and more common on social networks . a new feature set is proposed to verify rumors pivoting on multimedia content . |
| Approach: | They propose to use multimedia content to find external information on social media platforms . they propose to leverage semantic similarity between rumors and external information . |
| Outcome: | The proposed approach achieves state-of-the-art results on social networks . it leverages semantic similarity between rumors and external information . |
Enhancing Auto-regressive Chain-of-Thought through Loop-Aligned Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought prompting is a powerful technique for enhancing language model’s reasoning capabilities, but generating long and correct CoT trajectories is challenging. |
| Approach: | They propose to align the steps of Chain-of-Thought reasoning with loop iterations and apply intermediate supervision during the training of Looped Transformers. |
| Outcome: | The proposed method generates accurate reasoning chains for complex problems exceeding training length, and improves performance of the auto-regressive model. |
Mixture of Soft Prompts for Controllable Data Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) generate fluent text when the target output follows natural language patterns. |
| Approach: | They propose a method that uses large language models to generate fluent text from a limited ontology rather than direct prediction by using soft prompts. |
| Outcome: | The proposed method produces diverse and natural text while preserving label semantics. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
Cluster-Former: Clustering-based Sparse Transformer for Question Answering (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models for encoding long sequences in deep learning suffer from high latency and memory demands. |
| Approach: | They propose a clustering-based sparse Transformer framework to perform attention across chunked sequences. |
| Outcome: | The proposed framework achieves state-of-the-art on several major QA benchmarks. |
Sentiment Adaptive End-to-End Dialog Systems (P18-1)
Copied to clipboard
| Challenge: | Existing methods to train dialog systems only consider semantic inputs and under-utilize other user information. |
| Approach: | They propose to include user sentiment in the end-to-end learning framework to make dialog systems more user-adaptive and effective. |
| Outcome: | The proposed system improves on a bus information search task with sentiment information. |
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners (2024.acl-long)
Copied to clipboard
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu
| Challenge: | Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages. |
| Approach: | They propose to use large language models as a general-purpose interface across multiple tasks and languages. |
| Outcome: | The proposed model performs better on 200K hours of 6-language data for voice generation applications. |
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)
Copied to clipboard
Jinghan Yu, Junhao Xiao, Chenyu Zhu, Jiaming Li, Jia Li, HanMing Deng, Xirui Wang, Guoli Jia, Jianjun Li, Xiang Bai, Bowen Zhou, Zhiyuan Ma
| Challenge: | Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process . |
| Approach: | They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment. |
| Outcome: | The proposed paradigm outperforms existing methods in compositional editing tasks. |
A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work shows successful methods for unsupervised machine translation (UMT) initialization stage is important since bad initialization may wrongly squeeze the search space and too much noise may hurt the final performance. |
| Approach: | They propose a retrieval and rewriting based method to better initialize unsupervised translation models. |
| Outcome: | The proposed method improves translation performance by over 4 BLEU scores. |
NUT-RC: Noisy User-generated Text-oriented Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing RC models focus on extractive or generative, but ignore integration of them. |
| Approach: | They propose a noisy user-generated text-oriented RC model that integrates extractive and generative RC models by a multi-task learning mechanism and an answer selection module. |
| Outcome: | The proposed model outperforms state-of-the-art models on Twitter. |
Code-Switching Information Retrieval: Benchmarks, Analysis, and the Limits of Current Retrievers (2026.findings-acl)
Copied to clipboard
Qingcheng Zeng, Yuheng Lu, Zeqi Zhou, Heli Qi, Puxuan Yu, Fuheng Zhao, Hitomi Yanaka, Weihao Xuan, Naoto Yokoya
| Challenge: | a new study examines the performance of code-switching IR in monolingual contexts . code-witching is a pervasive linguistic phenomenon in global communication . |
| Approach: | They propose a benchmark to evaluate code-switching IR in monolingual contexts . they propose CS-MTEB, which measures performance declines of up to 27% . |
| Outcome: | The proposed benchmark shows that code-switching performance is degraded by 27% . the proposed benchmark is based on a dataset of mixed-language queries . |
Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations (2024.naacl-long)
Copied to clipboard
Sihao Chen, Hongming Zhang, Tong Chen, Ben Zhou, Wenhao Yu, Dian Yu, Baolin Peng, Hongwei Wang, Dan Roth, Dong Yu
| Challenge: | Sentence embeddings are typically learned to recognize the semantic relation between two text inputs. |
| Approach: | They introduce a contrastively-learned contextual embedding model for fine-grained semantic representation of text. |
| Outcome: | The proposed model is able to produce contextual embeddings corresponding to different atomic propositions, i.e. semantic equivalence between propositions across different text sequences. |
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)
Copied to clipboard
Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, Xiang Chen, Tianhua Zhou
| Challenge: | Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text. |
| Approach: | They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types. |
| Outcome: | The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages. |
MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to perform multimodal information extraction only investigated entity-based tasks under supervised learning with adequate labeled data. |
| Approach: | They propose to investigate the entity-based MIE tasks under the low-resource settings by decomposing the features into image, entity, and context factors. |
| Outcome: | The proposed method is able to perform on two public MIE benchmark datasets and the experimental results confirm it. |
Unregulated Chinese-to-English Data Expansion Does NOT Work for Neural Event Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Experimental results show that cross-language data expansion results in performance degradation. |
| Approach: | They leverage cross-language data expansion and retraining to enhance neural Event Detection on English ACE corpus. |
| Outcome: | The proposed method improves ED performance by 1.6% over the straight data combination. |
Curriculum Pre-training for End-to-End Speech Translation (2020.acl-main)
Copied to clipboard
| Challenge: | End-to-end speech translation requires a powerful encoder to transcribe, understand and learn cross-lingual semantics simultaneously. |
| Approach: | They propose a curriculum pre-training method that includes an elementary course for transcription learning and two advanced courses for understanding the utterance and mapping words in two languages. |
| Outcome: | The proposed method improves on En-De and En-Fr speech translation benchmarks. |
LLM×MapReduce-V3: Enabling Interactive In-Depth Survey Generation through a MCP-Driven Hierarchically Modular Agent System (2025.emnlp-demos)
Copied to clipboard
Yu Chao, Siyu Lin, Xiaorong Wang, Zhu Zhang, Zihan Zhou, Haoyu Wang, Shuo Wang, Jie Zhou, Zhiyuan Liu, Maosong Sun
| Challenge: | Generating high-quality long-form survey articles poses significant challenges to AI Agent systems. |
| Approach: | They propose a hierarchically modular agent system for long-form survey generation . they use atomic models to implement skeleton initialization, digest construction, and skelet refinement . human evaluations demonstrate system surpasses representative baselines . |
| Outcome: | The proposed system surpasses representative baselines in both content depth and length, highlighting the strength of MCP-based modular planning. |
Joint Intent Detection and Entity Linking on Spatial Domain Queries (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Spatial domain queries have unique properties making them more challenging for language understanding than common conversational queries. |
| Approach: | They propose a language understanding framework for spatial domain queries that jointly learns the intent detection and entity linking tasks on a voice assistant service. |
| Outcome: | The proposed framework outperforms baseline methods with a significant margin. |
INSPIRED: Toward Sociable Recommendation Dialog Systems (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on recommendation dialog systems lack a study on communication strategies used by human speakers for making successful and persuasive recommendations. |
| Approach: | They propose to annotate a dataset of human-human movie recommendation dialogs with sociable recommendation strategies. |
| Outcome: | The proposed model outperforms the baseline model in automatic and human evaluation. |
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |
Using active learning to expand training data for implicit discourse relation recognition (D18-1)
Copied to clipboard
| Challenge: | Existing methods to determine semantic relations between text spans are limited in the field of discourse-level relation recognition. |
| Approach: | They propose to expand the training data set using the corpus of explicitly-related arguments by arbitrarily dropping the overtly presented discourse connectives. |
| Outcome: | The proposed model expands the training data set using the corpus of explicitly-related arguments, by arbitrarily dropping the overtly presented discourse connectives. |
Identifying Factual Inconsistencies in Summaries: Grounding LLM Inference via Task Taxonomy (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on specialized BERT-variants and recent LLMs to reason inconsistencies. |
| Approach: | They propose to incorporate task-specific taxonomy into inferences to facilitate both zero-shot and supervised paradigms. |
| Outcome: | The proposed model outperforms specialized non-LLM and recent LLM models in a number of domains. |
P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains (2024.findings-emnlp)
Copied to clipboard
Simeng Han, Aaron Yu, Rui Shen, Zhenting Qi, Martin Riddell, Wenfei Zhou, Yujie Qiao, Yilun Zhao, Semih Yavuz, Ye Liu, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Dragomir Radev, Rex Ying, Arman Cohan
| Challenge: | Existing methods on understanding the capabilities of LLMs in logical reasoning rely on binary entailment classification or synthetically derived rationales. |
| Approach: | They propose to annotate a human-annotated dataset consisting of diverse and complex reasoning chains for a set of realistic logical reasoning stories also written by humans. |
| Outcome: | The proposed model outperforms existing methods on understanding the capabilities of LLMs in logical reasoning by 10% or more. |
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to building task-oriented dialog systems require a substantial amount of annotations and thus are labor-intensive. |
| Approach: | They propose a Pre-trainedRole Alternating Language model (PRAL) that is explicitly designed for task-oriented dialog tasks. |
| Outcome: | The proposed model outperforms or is on par with state-of-the-art models on task-oriented dialog tasks. |
A Deep Relevance Model for Zero-Shot Document Filtering (P18-1)
Copied to clipboard
| Challenge: | Existing methods for document classification do not consider document filtering . existing methods do not include document filter. |
| Approach: | They propose a deep relevance model for zero-shot document filtering called DAZER . they use word embeddings to extract the relevance signals from word embeds . |
| Outcome: | The proposed model outperforms existing models on two document collections . it estimates the relevance between a document and a category by using seed words . |
Fast and Accurate End-to-End Span-based Semantic Role Labeling as Word-based Graph Parsing (2022.coling-1)
Copied to clipboard
| Challenge: | Using end-to-end span-based SRL, we propose a word-based graph parsing task for word-level representation of spans . compared with word-driven SRL, span-Based SRL is more complex due to difficulties in determining argument boundaries. |
| Approach: | They propose to cast end-to-end span-based SRL as a word-based graph parsing task . they propose a constrained Viterbi procedure to ensure the legality of the output graph . |
| Outcome: | The proposed model can parse 669/252 sentences per second without and with pre-trained models. |
Zero-Shot Dialogue State Tracking via Cross-Task Transfer (2021.emnlp-main)
Copied to clipboard
Zhaojiang Lin, Bing Liu, Andrea Madotto, Seungwhan Moon, Zhenpeng Zhou, Paul Crook, Zhiguang Wang, Zhou Yu, Eunjoon Cho, Rajen Subba, Pascale Fung
| Challenge: | Existing approaches to training a dialogue state tracking model require extensive annotated dialogue data. |
| Approach: | They propose to transfer cross-task knowledge from general question answering corpora to QA model that can handle zero-shot DST. |
| Outcome: | The proposed model improves existing zero-shot and few-shot results on MultiWoz and shows better generalization ability in unseen domains. |
Generating Sentences from Disentangled Syntactic and Semantic Spaces (P19-1)
Copied to clipboard
| Challenge: | Variational auto-encoders (VAEs) are widely used in natural language generation due to the regularization of the latent space. |
| Approach: | They propose to generate sentences from disentangled syntactic and semantic spaces by using the linearized tree sequence. |
| Outcome: | The proposed method achieves similar or better performance in various tasks compared with state-of-the-art models. |
ALICE: Active Learning with Contrastive Natural Language Explanations (2020.emnlp-main)
Copied to clipboard
| Challenge: | Annotating a large dataset with annotations is costly and infeasible. |
| Approach: | They propose an expert-in-the-loop training framework that utilizes contrastive natural language explanations to improve data efficiency in learning. |
| Outcome: | The proposed framework outperforms baseline models trained with 40-100% more training data on bird species classification and social relationship classification tasks. |
Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network (P18-1)
Copied to clipboard
| Challenge: | Existing models for matching dialogue responses rely on semantic and functional dependencies . a recent study only uses the last utterance in context for matching a reply . |
| Approach: | They propose a model that matches a response with its multi-turn context using attention. |
| Outcome: | The proposed model outperforms the state-of-the-art models on two large-scale multi-turn response selection tasks. |
Dynamic Uncertainty Ranking: Enhancing Retrieval-Augmented In-Context Learning for Long-Tail Knowledge in LLMs (2025.naacl-long)
Copied to clipboard
| Challenge: | Prior work has shown that in-context learning (ICL) with retriever augmentation can help LLMs better capture long-tail knowledge, reducing their reliance on pre-trained data. |
| Approach: | They propose a reinforcement learning-based dynamic uncertainty ranking method that accounts for the varying impact of each retrieved sample on LLM predictions. |
| Outcome: | The proposed method outperforms baseline models on question-answering datasets by 2.76% and 5.96% on long-tail questions that elude zero-shot inference. |
MES-RAG: Bringing Multi-modal, Entity-Storage, and Secure Enhancements to RAG (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to retrieve entity information are limited by document level retrieval and intermingled storage of information from different entities. |
| Approach: | They propose a framework that enhances entity-specific query handling . MES-RAG introduces proactive security measures that ensure system integrity . |
| Outcome: | Experimental results show that MES-RAG improves accuracy and recall . the framework can be integrated into existing RAG architectures . |
LiGen: Active Lipid Generation via a Molecular Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Lipid nanoparticles (LNPs) can deliver cargos to tumor and immune cells . traditional approaches rely on experimental screening and expert judgment . |
| Approach: | They propose a method to generate lipid molecules efficiently and actively using deep learning. |
| Outcome: | The proposed method outperforms baseline methods on multiple cell lines and achieves a 30% improvement over the current methods. |
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)
Copied to clipboard
Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang, Philip S. Yu
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension (2022.acl-long)
Copied to clipboard
Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Li, Nora Bradford, Branda Sun, Tran Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, Mark Warschauer
| Challenge: | Existing QA datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements. |
| Approach: | They propose to use FairytaleQA to generate 10,580 questions based on 278 children-friendly stories to assess model's fine-grained learning skills. |
| Outcome: | The proposed dataset consists of 10,580 questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations. |
Paraphrase Augmented Task-Oriented Dialog Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural generative models can perform dialog generation tasks with a large data set, but lack of high-quality data and expensive data annotation process limit their application in real world settings. |
| Approach: | They propose to combine paraphrase and response generation models to improve dialog generation performance by annotating dialog states and dialog act labels. |
| Outcome: | The proposed framework outperforms existing methods significantly in dialog generation tasks, especially under low resource settings. |
TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing adversarial models rely on keyword matching and ignore relevant contextual relations for answer prediction. |
| Approach: | They propose to use keyword matching to attack model with two biases that rely on a perturbed answer sentence and a distracting answer sentence to misguide model. |
| Outcome: | The proposed method produces fluent and grammatical adversarial contexts while maintaining gold answers. |
Sparse Black-Box Multimodal Attack for Vision-Language Adversary Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing adversarial attacks using imperceptible perturbations are challenging to simulate . e-commerce product restrictions and hate speech monitoring are examples of such attacks . |
| Approach: | They propose a black-box adversarial attack that leverages sparse perturbations to simulate adversarials exhibited by illegal merchants in the black- box scenario. |
| Outcome: | The proposed method outperforms existing attacks and unimodal attacks by treating images and text in discrete space and outperforming existing models. |
Active Sentence Learning by Adversarial Uncertainty Sampling in Discrete Space (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing uncertainty sampling methods are time-consuming and can't be executed frequently. |
| Approach: | They propose adversarial uncertainty sampling in discrete space to find informative unlabeled text samples for annotation using adversarials. |
| Outcome: | The proposed approach outperforms baselines on effectiveness on five datasets. |
KRLS: Improving End-to-End Response Generation in Task Oriented Dialog with Reinforced Keywords Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Task-oriented dialogs (TOD) require a model to generate a response that optimizes for task-related metrics. |
| Approach: | They propose a faster generation procedure that samples from independent next-word distributions and introduce a fine-grained reward function to help the model focus on learning key information in a dialog. |
| Outcome: | The proposed algorithm achieves state-of-the-art performance on an offline task with 15% training time reduction compared to a standard RL algorithm using auto-regressive generation. |
VocabTailor: Dynamic Vocabulary Selection for Downstream Tasks in Small Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing static vocabulary pruning designs that reduce memory usage suffer from rigid, one-size-fits-all designs that cause information loss during the prefill stage and lack flexibility. |
| Approach: | They propose a decoupled dynamic vocabulary selection framework that addresses memory constraints through offloading embedding and implements a hybrid static-dynamic vocabulary selection strategy for LM Head. |
| Outcome: | The proposed framework reduces memory usage by 99% with minimal or no degradation in performance. |
One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement (2026.acl-long)
Copied to clipboard
| Challenge: | Existing alignment methods for Large Language Models (LLMs) are expensive and lack the flexibility to fully activate their latent reasoning capabilities. |
| Approach: | They propose a modular framework that treats reasoning elicitation as an inference-time alignment task. |
| Outcome: | The proposed framework outperforms baselines by 2.1% on average across diverse architectures and benchmarks. |
Beyond Sequences: Two-dimensional Representation and Dependency Encoding for Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing code generation approaches represent code as a linear sequence of tokens, but positional encodings compromise generalization . explicit positional encoders sacrifice permutation invariance, imposes a strict order on the input sequence . |
| Approach: | They propose to represent code snippets as two-dimensional entities with explicit encodings . they propose to use dictionary learning to perform semantic matching between code lines . |
| Outcome: | The proposed model captures the hierarchical and spatial structure of code, especially the dependencies between code lines. |
Incorporating Global Information in Local Attention for Knowledge Representation Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Graph Attention Networks (GATs) are a promising model that takes advantage of localized attention mechanism to perform knowledge representation learning (KRL) on graph-structure data. |
| Approach: | They propose to incorporate global information into the GAT family of models by using an attention-based global random walk algorithm. |
| Outcome: | Experimental results on KG entity prediction against the state-of-the-arts demonstrate the effectiveness of the proposed model. |
FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings (2025.acl-short)
Copied to clipboard
| Challenge: | Efficient preference optimization algorithms such as Direct Preference Optimization (DPO) have become a popular approach in aligning large language models with human preferences. |
| Approach: | They propose a preference optimization variant that instead down-weighs misranked preference pairs and prioritizes enhancing the model’s understanding of pairs that it can already rank correctly. |
| Outcome: | The proposed model outperforms DPO on benchmarks like Alpaca Eval 2.0 and Arena-Hard using mistral-base-7B and Llama-3-Instruct-8B with the introduced hyperparameter fixed. |
SAGE : A Top-Down Bottom-Up Knowledge-Grounded User Simulator for Multi-turn Agent Evaluation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on static benchmarks or narrow task-specific datasets that fail to capture the open-ended nature of real-world interactions. |
| Approach: | They propose a user Simulation framework for multi-turn AGent Evaluation that integrates top-down knowledge from business contexts and bottom-up knowledge from agent infrastructure. |
| Outcome: | The proposed framework produces interactions that are more realistic and diverse while identifying up to 33% more agent errors. |
LayoutDIT: Layout-Aware End-to-End Document Image Translation with Multi-Step Conductive Decoder (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture the visual layout in complex document images. |
| Approach: | They propose to integrate layout knowledge into document image translation by using a layout-aware encoder and a multi-step conductive decoder to achieve the translation step by step. |
| Outcome: | The proposed model outperforms state-of-the-art methods with better parameter efficiency. |
TabularMath: Understanding Math Reasoning over Tables with Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Mathematical reasoning has long been a key benchmark for evaluating large language models. |
| Approach: | They propose a framework that transforms math word problems into scalable tabular reasoning tasks. |
| Outcome: | The proposed framework transforms math word problems into scalable and verified tabular reasoning tasks. |
ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing sequence-to-sequence models are optimized for future n-gram prediction and n stream self-attention mechanism. |
| Approach: | They propose a self-supervised objective called future n-gram prediction and the proposed n stream self-attention mechanism to optimize the model for sequence-to-sequence learning. |
| Outcome: | The proposed model achieves state-of-the-art on CNN/DailyMail, Gigaword, and SQuAD 1.1 benchmarks compared to the models using the same scale pre-training corpus. |
ProcessBench: Identifying Process Errors in Mathematical Reasoning (2025.acl-long)
Copied to clipboard
Chujie Zheng, Zhenru Zhang, Beichen Zhang, Runji Lin, Keming Lu, Bowen Yu, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | Existing models fail to generalize to more challenging math problems, authors say . existing benchmarks related to assessing language models' reasoning process are limited . |
| Approach: | They propose a tool to measure language models' ability to identify erroneous steps in reasoning . they use two types of models: process reward models and critic models . |
| Outcome: | The proposed model outperforms existing models in evaluating language models' reasoning process . the best open-source model has demonstrated the critique capability competitive with the proprietary model . |
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)
Copied to clipboard
Hao Xiang, Tianyi Tang, Yang Su, Bowen Yu, An Yang, Fei Huang, Yichang Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Jingren Zhou, Junyang Lin, Le Sun
| Challenge: | Existing benchmarks focus on character-centric approach and fail to reflect real-world applications. |
| Approach: | RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds. |
| Outcome: | RMTBench features 80 diverse characters and over 8,000 dialogue rounds. |
Reliable Use of Lemmas via Eligibility Reasoning and Section-Aware Reinforcement Learning (2026.acl-short)
Copied to clipboard
| Challenge: | Recent large language models (LLMs) perform strongly on mathematical benchmarks but often import conclusions without validating assumptions. |
| Approach: | They propose a model that encodes a lemma specification and trains with reinforcement learning and section-aware loss masking to assign penalty to the section responsible for errors. |
| Outcome: | The proposed model performs well on benchmarks but often misapplyes lemmas . the model is able to encode the specification and train with reinforcement learning . |
Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow (2026.findings-acl)
Copied to clipboard
Yangyang Zhong, Yanmei Gu, Zhengqing Zang, Xiaomeng Li, Yuqi Ding, Xibei Jia, Yuting Shen, Zhenzhong Lan, Liwang Zhu, Weiping Liu, Junlin Zhou, Haisheng Liu, Zhong Xin Yu, Pengxin Luo, Donglian Qi, Yunfeng Yan, Junbo Zhao
| Challenge: | Autoregressive (AR) language models dominate modern natural language processing due to strong likelihood-based training objectives and reliable left-to-right decoding. |
| Approach: | They characterize MDLM behavior along two dimensions: parallelism strength and generation order . authors propose a Generate-then-Edit paradigm that mitigates dependency loss . |
| Outcome: | The proposed model improves on tasks that require "backward information" the Generate-then-Edit paradigm improves parallel decoding efficiency while reducing dependency loss. |
AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models require substantial storage space to perform tasks such as text generation and video generation. |
| Approach: | They propose to compress large language models using integer replacements for floating-point numbers, in a process known as Quantization. |
| Outcome: | The proposed model allows for quantization of up to 75% decoder layers with 1 bit while maintaining performance levels comparable to those of the models with floating parameters. |
Structure-adaptive Adversarial Contrastive Learning for Multi-Domain Fake News Detection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing models for fake news detection capture domain-shared semantic features but fail to generalize well due to poor adaptability. |
| Approach: | They propose a framework to enable structure knowledge transfer between multiple domains . they compare content-only and propagation-rich data to preserve structural patterns . |
| Outcome: | The proposed framework can learn semantic and structural features across domains. |
PLACES: Prompting Language Models for Social Conversation Synthesis (2023.findings-eacl)
Copied to clipboard
Maximillian Chen, Alexandros Papangelis, Chenyang Tao, Seokhwan Kim, Andy Rosenbaum, Yang Liu, Zhou Yu, Dilek Hakkani-Tur
| Challenge: | Currently, collecting high quality conversational data is expensive and infeasible for many applications . a promising direction is to generate synthetic dialogues by prompting large language models . |
| Approach: | They propose to use expert-written conversations as in-context examples to generate synthetic dialogues by prompting large language models. |
| Outcome: | The proposed approach is generalizable to multi-party conversations, compared to human-collected conversations. |
Licon: A Diverse, Controllable and Challenging Linguistic Concept Learning Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for Concept Learning focus on visual information, but visual information cannot present abstract concepts exactly, which struggles the introduction of novel concepts related to known concepts. |
| Approach: | They propose a benchmark where concepts in diverse forms are defined by linguistic descriptions and an entailment-based concept learning method to model the relationship among concepts. |
| Outcome: | The proposed benchmark is based on the existing visual concepts learning benchmarks and will be released to the public soon. |
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models fail to generate singing voices rich in stylistic nuances for unseen singers due to multifaceted nature of singing styles. |
| Approach: | They propose a zero-shot SVS model for style transfer across cross-lingual speech and singing styles and multi-level style control. |
| Outcome: | Experimental results show that TCSinger outperforms baseline models in synthesis quality, singer similarity, and style controllability. |
Improving Conversational Recommendation Systems’ Quality with Context-Aware Item Meta-Information (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to integrate the recommendation function and dialog generation function smoothly are lacking. |
| Approach: | They propose to integrate dialog context for recommendation and dialog generation better using a pre-trained language model and an item metadata encoder to integrate the recommendation and dialogue generation. |
| Outcome: | The proposed architecture improves the integration of recommendation and dialog generation functions. |
MuTual: A Dataset for Multi-Turn Dialogue Reasoning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing non-task oriented dialogue systems can yield a relevant and fluent response, but sometimes make logical mistakes because of weak reasoning capabilities. |
| Approach: | They propose a dataset for multi-turn dialogue reasoning that uses annotated dialogues to train a machine to handle various reasoning problems. |
| Outcome: | Empirical results show that state-of-the-art methods only reach 71%, far behind human performance of 94%. |
Taking Actions Separately: A Bidirectionally-Adaptive Transfer Learning Method for Low-Resource Neural Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to train NMT models rely on sparse parallel data . a variety of PC variants yield significant improvements for low-resource NMT . |
| Approach: | They propose to transfer well-trained NMT models to low-resource languages by bidirectionally-adaptive learning strategy . they divide inner constituents of Parent encoder into two "teams" aiming to adapt to characteristics of low- and high-resourced languages . |
| Outcome: | The proposed method improves on low-resource NMT models with a variety of PC variants. |
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)
Copied to clipboard
Kangan Qian, Sicong Jiang, Yang Zhong, Ziang Luo, Zilin Huang, Tianze Zhu, Kun Jiang, Mengmeng Yang, Zheng Fu, Jinyu Miao, Yining Shi, He Zhe Lim, Li Liu, Tianbao Zhou, Hongyi Wang, Huang Yu, Yifei Hu, Guang Li, Guang Chen, Hao Ye, Lijun Sun, Diange Yang
| Challenge: | Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. |
| Approach: | AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks. |
| Outcome: | Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% . |
TROVE: A Challenge for Fine-Grained Text Provenance via Source Sentence Tracing and Relationship Classification (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models have demonstrated great potential in natural language generation, but their widespread adoption has raised concerns regarding content reliability and accountability. |
| Approach: | They propose a challenge to trace each sentence of a target text back to specific source sentences within potentially lengthy or multi-document inputs. |
| Outcome: | The proposed challenge traces each sentence of a target text back to specific source sentences . the dataset includes 11 scenarios covering QA and summarization in english and Chinese . |
Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to integrate knowledge graph (KG) with neural machine translation (NMT) have two problems: knowledge under-utilization and granularity mismatch. |
| Approach: | They propose a multi-task learning method on sub-entity granularity to combine machine translation and knowledge reasoning tasks. |
| Outcome: | The proposed method significantly outperforms baseline models on translation tasks and handling the entities. |
Reverse Modeling in Large Language Models (2025.naacl-short)
Copied to clipboard
| Challenge: | Using pre-trained LLMs with reversed text inputs can improve their performance across multiple languages. |
| Approach: | They propose a way to determine whether LLMs can understand reversed text inputs by reversing entire paragraphs or documents at the token level. |
| Outcome: | The proposed model can be used to improve understanding across multiple languages. |
Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human Demonstration (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Persuasion dialogue systems have long-standing problems of dialogue repetition and inconsistency which could impact user experience and impede the persuaded outcome. |
| Approach: | They propose to refine a language model baseline without user simulators and distill sentence-level information about repetition, inconsistency, and task relevance through rewards. |
| Outcome: | The proposed model outperforms state-of-the-art models on automatic metrics and human evaluation results on a donation persuasion task and generates more diverse, consistent and persuasive conversations according to user feedback. |
Attend, Translate and Summarize: An Efficient Method for Neural Cross-Lingual Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual summarization are pipeline-based, but they suffer from error propagation. |
| Approach: | They propose a method that attends to some words in the source text, then translates them into the target language to get the final summary. |
| Outcome: | The proposed method outperforms baseline methods on Chinese-to-English and English-to Chinese summarization tasks. |
Database Search Results Disambiguation for Task-Oriented Dialog Systems (2022.naacl-main)
Copied to clipboard
Kun Qian, Satwik Kottur, Ahmad Beirami, Shahin Shayandeh, Paul Crook, Alborz Geramifard, Zhou Yu, Chinnadhurai Sankar
| Challenge: | Task-oriented dialog systems can't handle multiplesearch results when querying a database due to the lack of such scenarios in existing datasets. |
| Approach: | They propose a task that focuses on disambiguating database search results by synthetically generating turns through a pre-defined grammar and collecting human paraphrases for a subset. |
| Outcome: | The proposed task improves performance on DSR-disambiguation even in the absence of in-domain data, suggesting it can be learned as a universal dialog skill. |
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)
Copied to clipboard
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
Inference-Time Language Model Alignment via Integrated Value Guidance (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models are fine-tuned to align with human preferences, but tuning large models is computationally intensive and complex. |
| Approach: | They propose a method that uses implicit and explicit value functions to guide language model decoding at token and chunk-level respectively. |
| Outcome: | The proposed method outperforms traditional methods and circumvents the complexities of fine-tuning. |
CROP: Contextual Region-Oriented Visual Token Pruning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing VLMs process entire images, leading to excessive visual tokens . redundant image information also introduces a large number of visual token, requiring much higher memory and computation in VLM. |
| Approach: | They propose a framework to prune visual tokens using localization and pruning . they propose CROP to locate local image regions relevant to the query . |
| Outcome: | The proposed framework outperforms existing visual token pruning methods on a wide range of tasks. |
RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System (2021.naacl-demos)
Copied to clipboard
Haoyang Wen, Ying Lin, Tuan Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan Windisch Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji
| Challenge: | We present a new information extraction system that can construct temporal event graphs from news documents. |
| Approach: | They propose a temporal event graph extraction system that can extract news documents . they extend the system from sentence-level event extraction to cross-document cross-media event extraction . |
| Outcome: | The proposed system can extract temporal event graphs from news documents in multiple languages and multiple data modalities. |
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI (2024.findings-eacl)
Copied to clipboard
Jianguo Zhang, Kun Qian, Zhiwei Liu, Shelby Heinecke, Rui Meng, Ye Liu, Zhou Yu, Huan Wang, Silvio Savarese, Caiming Xiong
| Challenge: | DialogStudio is the largest and most diverse collection of dialogue datasets . existing datasets lack diversity and comprehensiveness, authors say . |
| Approach: | They introduce DialogStudio: the largest and most diverse collection of dialogue datasets . DialogStuio aggregates more than 80 diverse dialogue dataset . |
| Outcome: | a new dataset is created to improve the quality and diversity of dialogue datasets . DialogStudio is the largest and most diverse collection of dialogue data . |
MARCH: Multi-Agent Reinforced Check for Hallucination (2026.acl-long)
Copied to clipboard
Zhuo Li, Yupeng Zhang, Pengyu Cheng, Jiajun Song, Mengyu Zhou, Hao Li, Shujie Hu, Yu Qin, null Erchao.zec, Xiaoxi Jiang, null Guanjunjiang
| Challenge: | Existing methods to detect hallucinations suffer from inherent confirmation bias, where the verifier inadvertently reproduces the errors of the original generation. |
| Approach: | They propose a framework that enforces rigorous factual alignment by leveraging deliberate *information asymmetry* by combining a pipeline of three specialized agents: a Solver, a Proposer, and a Checker. |
| Outcome: | Extensive experiments across hallucination benchmarks demonstrate that MARCH substantially reduces hallucinism rates. |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
Too Correct to Learn: Reinforcement Learning on Saturated Reasoning Data (2026.acl-short)
Copied to clipboard
| Challenge: | Strong base models saturate benchmarks, resulting in weaker performance, a paradox . a new approach to Reinforcement Learning (RL) is needed to improve performance . |
| Approach: | They propose a method that uses constrained uniform top-k sampling to flatten the local optimization landscape by sampling uniformly from constrained high-confidence candidates. |
| Outcome: | Experiments show that the proposed approach prevents policy degeneration and boosts out-of-domain generalization. |
A Knowledge-driven Generative Model for Multi-implication Chinese Medical Procedure Entity Normalization (2020.emnlp-main)
Copied to clipboard
| Challenge: | Medical entity normalization (NEN) is a task that links medical mentions to entities in knowledge bases. |
| Approach: | They propose a sequence generative framework to generate Chinese medical procedure entity normalization by constraint decoding and category-based model refining. |
| Outcome: | The proposed model improves on baselines especially in the case of multi-implication Chinese medical procedures. |
Exploring the Effectiveness of Multi-Lingual Commonsense Knowledge-Aware Open-Domain Dialogue Response Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that commonsense knowledge-aware models can improve informativeness while reducing the hallucination issue. |
| Approach: | They propose a task to use commonsense knowledge in other languages to enhance the current dialogue generation by using commonsensical knowledge in different languages. |
| Outcome: | The proposed model improves the current dialogue generation while reducing the hallucination issue. |
Aspect-Category based Sentiment Analysis with Hierarchical Graph Convolutional Network (2020.coling-main)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis studies focus on identifying sentiment polarities toward explicit aspects but ignore implicit aspects in text. |
| Approach: | They propose a hierarchy-sentiment hierarchy prediction problem to capture explicit and implicit aspects of aspect-based sentiment analysis. |
| Outcome: | The proposed model can consistently achieve the best results on four benchmarks. |
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)
Copied to clipboard
Che Jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou
| Challenge: | Large language models are successful in answering factoid questions but are also prone to hallucination. |
| Approach: | They propose self-reporting to the model when faced with such limitations. |
| Outcome: | The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge. |
RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios (2022.naacl-demo)
Copied to clipboard
Xinya Du, Zixuan Zhang, Sha Li, Pengfei Yu, Hongwei Wang, Tuan Lai, Xudong Lin, Ziqi Wang, Iris Liu, Ben Zhou, Haoyang Wen, Manling Li, Darryl Hannan, Jie Lei, Hyounghun Kim, Rotem Dror, Haoyu Wang, Michael Regan, Qi Zeng, Qing Lyu, Charles Yu, Carl Edwards, Xiaomeng Jin, Yizhu Jiao, Ghazaleh Kazeminejad, Zhenhailong Wang, Chris Callison-Burch, Mohit Bansal, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Martha Palmer, Heng Ji
| Challenge: | Existing methods for event prediction are incomplete and noisy. |
| Approach: | They propose to use news-related event schemas to extract newsworthy events . they build a demo website and include a video demonstrating the framework . |
| Outcome: | The proposed framework can be applied to a wide variety of newsworthy scenarios. |
PRESTO: A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs (2023.emnlp-main)
Copied to clipboard
Rahul Goel, Waleed Ammar, Aditya Gupta, Siddharth Vashishtha, Motoki Sano, Faiz Surani, Max Chang, HyunJeong Choe, David Greene, Chuan He, Rattima Nitisaroj, Anna Trukhina, Shachi Paul, Pararth Shah, Rushin Shah, Zhou Yu
| Challenge: | PRESTO dataset contains 550K contextual multilingual conversations between humans and virtual assistants. |
| Approach: | They propose to use a dataset of 550K contextual multilingual conversations between humans and virtual assistants to study some of the more challenging aspects of parsing realistic conversations. |
| Outcome: | The dataset contains 550K contextual conversations between humans and virtual assistants. |
Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing frameworks treat memory as a static append-only archive . Existing systems focus on passive accumulation, resulting in a 'passive accumulation' of memory. |
| Approach: | They propose a framework for experience-driven agent evolution that integrates procedural memory with contextual information to create a high-quality experience pool. |
| Outcome: | Experiments on BFCL-V3 and AppWorld show that ReMe outperforms memoryless Qwen3-8B. |
HyperHatePrompt: A Hypergraph-based Prompting Fusion Model for Multimodal Hate Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing models for multimodal hate detection lack implicit hateful cues, cross-modal-induced hate, and diversity of hate target groups. |
| Approach: | They propose a hypergraph-based prompting fusion model that uses LLMs to generate hate cue prompts and hypergraph learning to merge multimodal hate features. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets showing that it can detect hate content across multiple modalities. |
Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue StateTracking (2021.naacl-main)
Copied to clipboard
Zhaojiang Lin, Bing Liu, Seungwhan Moon, Paul Crook, Zhenpeng Zhou, Zhiguang Wang, Zhou Yu, Andrea Madotto, Eunjoon Cho, Rajen Subba
| Challenge: | Existing models for zero-shot cross-domain dialogue state tracking require in-domain data to model a new domain. |
| Approach: | They propose a slot descriptions enhanced generative approach for zero-shot cross-domain DST by encoding a dialogue context and a slots with a pre-trained encoder and generating slot value in auto-regressive manner. |
| Outcome: | The proposed model significantly improves state-of-the-art results in zero-shot cross-domain setting. |
Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that LLMs face challenges in effectively using retrieved information . authors propose a method that considers LLM as "Information Refiner" |
| Approach: | They propose a method that considers LLMs as "Information Refiners" they propose INFO-RAG, which is low-cost and general across various tasks . |
| Outcome: | The proposed method improves performance of LLaMA2 by 9.39% relative points . it is low-cost and general across various tasks, and is robust and in-context learning is possible . |
Pairwise Prompt-Based Tuning with Parameter Efficient Fast Adaptation for Generalized Zero-Shot Intent Detection (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to generalize from seen intents to unseen intents are not effective . Xian et al., 2019: a novel approach to generalized zero-shot intent detection is needed . |
| Approach: | They propose a pairwise prompt-based tuning model with parameter efficient fast adaptation . they leverage hybrid contrastive learning in discriminant space and masked language modeling . |
| Outcome: | The proposed model can generalize to unseen intents with the help of seen intents . the proposed model is based on a pairwise prompt-based tuning model with fast adaptation . |
DECOR: Improving Coherence in L2 English Writing with a Novel Benchmark for Incoherence Detection, Reasoning, and Rewriting (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing automated writing evaluation systems only detect incoherence in writing . a recent study has found that incorporating specific reasons for incohence improves the quality of rewrites . |
| Approach: | They propose a benchmark that includes expert annotations for detecting incoherence in L2 English writing, identifying the underlying reasons, and rewriting the incoerent sentences. |
| Outcome: | The proposed benchmark improves coherence in L2 English writing by fine-tuning models . the authors find that incorporating specific reasons improves quality of rewrites . |
On the Emotion Understanding of Synthesized Speech (2026.acl-long)
Copied to clipboard
Yuan Ge, Haishu Zhao, AoKai Hao, Junxiang Zhang, Bei Li, Xiaoqian Liu, Chenglong Wang, Jianjin Wang, Bingsen Zhou, Bingyu Liu, JingBo Zhu, Zhengtao Yu, Tong Xiao
| Challenge: | Existing models for emotion understanding do not capture fundamental features of synthesized speech. |
| Approach: | They evaluate emotion recognition models on synthesized speech using SER models and generative models. |
| Outcome: | The proposed model can't generalize to synthesized speech because of speech token prediction . generative models tend to infer emotion from textual semantics while ignoring paralinguistic cues. |
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)
Copied to clipboard
Shangda Wu, Yashan Wang, Ruibin Yuan, Guo Zhancheng, Xu Tan, Ge Zhang, Monan Zhou, Jing Chen, Xuefeng Mu, Yuejie Gao, Yuanliang Dong, Jiafeng Liu, Xiaobing Li, Feng Yu, Maosong Sun
| Challenge: | Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages . |
| Approach: | They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder . |
| Outcome: | The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities. |
Incorporating Image Matching Into Knowledge Acquisition for Event-Oriented Relation Recognition (C18-1)
Copied to clipboard
| Challenge: | Event relation recognition is a challenging language processing task because the query events are selected from different paragraphs in a document or even different documents, so there is lack of explicit clue. |
| Approach: | They propose to use image processing to acquire similar event instances and use image matching to approximate calculation between events. |
| Outcome: | The proposed model performs comparable to CNN while slightly better than LSTM on the ACE-R2 corpus. |
Structure-Aware Zero-Shot Relational Learning for Knowledge Graphs without External Knowledge (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Zero-shot Relational Learning depend on external knowledge, resulting in increased annotation costs and limited practical applicability. |
| Approach: | They propose a structure-aware paradigm that performs ZRL without external knowledge . it leverages intrinsic structural patterns in KGs to bridge semantic correlations for new relations with existing ones. |
| Outcome: | The proposed paradigm achieves 10.66% improvement in MRR while reducing annotation costs and enhancing practical applicability on three real-world benchmarks. |
Augmenting Operations Research with Auto-Formulation of Optimization Models From Problem Descriptions (2022.emnlp-industry)
Copied to clipboard
Rindra Ramamonjison, Haley Li, Timothy Yu, Shiqi He, Vishnu Rengan, Amin Banitalebi-dehkordi, Zirui Zhou, Yong Zhang
| Challenge: | Existing systems for operations research use NLP to suggest formulations of optimization problems. |
| Approach: | They propose an augmented intelligence system that can be used to simplify and enhance the modeling experience for operations research. |
| Outcome: | The proposed system validates and edits the proposed formulations with a dataset of linear programming problems drawn from various application domains. |
MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Weikang Shi, Aldrich Yu, Rongyao Fang, Houxing Ren, Ke Wang, Aojun Zhou, Changyao Tian, Xinyu Fu, Yuxuan Hu, Zimu Lu, Linjiang Huang, Si Liu, Rui Liu, Hongsheng Li
| Challenge: | Existing approaches to visual chain-of-thought are limited by external tools or fail to generate high-fidelity diagrams. |
| Approach: | They propose a framework to enable large multimodal models with VCoT capabilities . they pre-train a model on a 15.2M-pair corpus and teach it how to leverage visual aids . |
| Outcome: | The proposed framework unlocks complex, human-like visual reasoning in large language models . it pre-trains the model on a 15.2M-pair corpus and fine-tunes it on MathCanvas-Instruct . |
Bring Invariant to Variant: A Contrastive Prompt-based Framework for Temporal Knowledge Graph Forecasting (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graph forecasting are insufficient structural contexts to learn effective representations. |
| Approach: | They propose a Contrastive Prompt-based framework with Entity background information for TKG forecasting that brings time-invariant entity background information to time-variant structural information. |
| Outcome: | The proposed framework is effective and stays competitive in inference with limited structural information. |
Budget-Aware Anytime Reasoning with LLM-Synthesized Preference Data (2026.findings-acl)
Copied to clipboard
Xuanming Zhang, Shwan Ashrafi, Aziza Mirsaidova, Amir H. Rezaeian, Miguel Ballesteros, Lydia Chilton, Zhou Yu, Dan Roth
| Challenge: | Recent work has explored reasoning efficiency via test-time scaling and early exit strategies. |
| Approach: | They propose an anytime reasoning framework and the Anytime Index to improve model quality . they also propose an inference-time self-improvement method to produce better intermediate solutions . |
| Outcome: | The proposed method improves on NaturalPlan, AIME, and GPQA datasets and improves reasoning quality and efficiency under budget constraints. |
Syntax-Aware Retrieval Augmented Code Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Neural code generation models with token-level retrieval capabilities are often noisy and time-consuming. |
| Approach: | They propose a token-level retrieval augmented code generation method that leverages syntax constraints for the retrieval of datastores. |
| Outcome: | The proposed method reduces the impact of retrieve noise on code generation on two datasets. |
Adversarial Category Alignment Network for Cross-domain Sentiment Classification (N19-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification focus on aligning marginal distribution without taking category-specific decision boundaries into consideration. |
| Approach: | They propose an adversarial category alignment network to enhance category consistency . experimental results show the proposed method can achieve state-of-the-art performance . |
| Outcome: | The proposed method achieves state-of-the-art performance and produces more discriminative features on benchmark datasets. |
MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization (2024.findings-acl)
Copied to clipboard
Zhiyu Yang, Zihan Zhou, Shuo Wang, Xin Cong, Xu Han, Yukun Yan, Zhenghao Liu, Zhixing Tan, Pengyuan Liu, Dong Yu, Zhiyuan Liu, Xiaodong Shi, Maosong Sun
| Challenge: | Scientific data visualization is an essential process in research, but its use of large language models remains unexplored. |
| Approach: | They propose a model-agnostic LLM agent framework to automate scientific data visualization tasks. |
| Outcome: | The proposed framework improves performance of commercial and open-source models. |
AoM: Detecting Aspect-oriented Information for Multimodal Aspect-Based Sentiment Analysis (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to extract aspects from text-image pairs and recognize their sentiments are noisy and coarsely establishing image-aspect alignment will interfere with aspect-relevant semantic and sentiment information. |
| Approach: | They propose an Aspect-oriented method to detect aspect-relevant semantic and sentiment information by selecting textual tokens and image blocks that are semantically related to the aspects. |
| Outcome: | The proposed method is superior to existing methods in the field of sentiment analysis. |
Dense Hierarchical Retrieval for Open-domain Question Answering (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA) current dense retrievers require splitting documents into short passages that usually contain local, partial and sometimes biased context, and may yield inaccurate and misleading hidden representations, thus deteriorating the final retrieval result. |
| Approach: | They propose a hierarchical framework which can generate accurate dense representations of passages by utilizing both macroscopic semantics in the document and microscopic specific to each passage. |
| Outcome: | The proposed framework significantly outperforms the original dense passage retriever and helps an end-to-end QA system outperfect the strong baselines on multiple open-domain QA benchmarks. |
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing (2025.findings-acl)
Copied to clipboard
Yifan Lu, Jing Li, Yigeng Zhou, Yihui Zhang, Wenya Wang, Xiucheng Li, Meishan Zhang, Fangming Liu, Jun Yu, Min Zhang
| Challenge: | Existing knowledge editing methods for large language models (LLMs) suffer from over-editing, where detoxified models reject legitimate queries, compromising overall performance. |
| Approach: | They propose a toxicity-aware knowledge editing approach that dynamically detects toxic activation patterns during forward propagation and then routes computations through adaptive inter-layer pathways to mitigate toxicity effectively. |
| Outcome: | The proposed method outperforms existing methods on large language models and enhances the SafeEdit benchmark. |
Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey (2024.acl-long)
Copied to clipboard
Jiawei Li, Yizhe Yang, Yu Bai, Xiaofeng Zhou, Yinghao Li, Huashan Sun, Yuhang Liu, Xingpeng Si, Yuhao Ye, Yixiao Wu, 林一冠 林一冠, Bin Xu, Ren Bowen, Chong Feng, Yang Gao, Heyan Huang
| Challenge: | Existing benchmark-based evaluations cannot accurately reflect the performance of real-world applications. |
| Approach: | They propose a reliable strategy for domains to choose more robust LLMs for real-world applications. |
| Outcome: | The proposed strategy addresses the challenges faced by domains to choose more robust LLMs for real-world applications. |
The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models excel on a variety of reasoning benchmarks, but struggle to generalize to unseen questions due to over-reliance on memorized training examples. |
| Approach: | They propose to identify a set of linear features in the model’s residual stream that govern the balance between genuine reasoning and memory recall. |
| Outcome: | The proposed model can be manipulated to activate the most relevant problem-solving capabilities during answer generation. |
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices (2020.acl-main)
Copied to clipboard
| Challenge: | Empirical studies show that MobileBERT is 4.3x smaller and 5.5x faster than BERT_BASE . BERT is one of the largest models ever in NLP, but suffers from heavy model size and high latency . |
| Approach: | They propose a tool to compress and accelerate the popular BERT model by task-agnostic application. |
| Outcome: | The proposed model is 4.3x smaller and 5.5x faster than BERT_BASE . it achieves competitive results on well-known benchmarks . |
Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are now commonplace in conversation applications, but their misuse for generating harmful responses has raised serious societal concerns. |
| Approach: | They provide a comprehensive overview of recent studies covering attacks, defenses, and evaluations of Large Language Models (LLMs) . |
| Outcome: | The proposed review summarizes three aspects of LLM conversation safety: attacks, defenses, and evaluations. |
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)
Copied to clipboard
Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
How to Build User Simulators to Train RL-based Dialog Systems (D19-1)
Copied to clipboard
| Challenge: | RL-based dialog systems require interaction with the environment and obtaining real human users to interact with the system is time-consuming and labor-intensive. |
| Approach: | They propose a method to standardize user simulator building to compare dialog system quality using the same set of user simulators. |
| Outcome: | The proposed method can be used by the community to compare dialog system quality using the same set of user simulators fairly. |
Your Reasoning Model is Secretly a Reward Model - Optimization-Free Verification from Experience (2026.acl-long)
Copied to clipboard
| Challenge: | Existing verifiers operate on the surface text or on confidence proxies derived from token probabilities, which can be brittle. |
| Approach: | They propose a training-free, non-parametric verifier that summarizes each reasoning trace by an activation delta and compares it to two class centroids computed from labeled experience. |
| Outcome: | The proposed model improves selection and reranking on large and less-calibrated models. |
Structured Attention for Unsupervised Dialogue Structure Induction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Using structured attention, a model can learn dialogue structure in unsupervised fashion. |
| Approach: | They propose to incorporate structured attention layers into a Variational Recurrent Neural Network model with discrete latent states to learn dialogue structure in an unsupervised fashion. |
| Outcome: | The proposed model learns semantic structures similar to templates used to generate a dialogue corpus on two-party datasets and on multi-party dialogues, disentangling dialogues without human annotation. |
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent approaches to language model alignment assume homogeneous human preferences, but actual human preferences vary widely and are hard to satisfy with a single language model. |
| Approach: | They propose an RL-free extension of Direct Preference Optimization (DPO) that folds language modeling directly into reward modeling and trains language models as collective reward models that combine all objectives with specific weights. |
| Outcome: | The proposed method matches or outperforms existing methods in safety alignment and long-form question answering. |
CGIM: A Cycle Guided Interactive Learning Model for Consistency Identification in Task-oriented Dialogue (2022.coling-1)
Copied to clipboard
| Challenge: | Consistency identification in task-oriented dialog usually consists of three subtasks . a proposed model for consistency identification in dialog is based on an explicit interaction paradigm . |
| Approach: | They propose a cycle guided interactive learning model that makes information exchange explicit from all the three tasks. |
| Outcome: | The proposed model achieves state-of-the-art performance pushing the overall score to 56.3% (5.0% point absolute improvement) |
UniGeM: Unifying Data Selection and Mixing via Geometric Exploration and Mining (2026.findings-acl)
Copied to clipboard
Changhao Wang, null Yunfeiyu, Xinhao Yao, Jiaolong Yang, Lu Yu, Junpeng Fang, Chaobo Li, Riccardo Cantoro, Qing Cui, Jun Zhou
| Challenge: | Large Language Models (LLMs) scaling is limited by data quality and domain mixing and instance selection are two separate problems. |
| Approach: | They propose a framework that unifies mixing and selection without training proxy models or relying on external reference datasets. |
| Outcome: | The proposed framework achieves 2.0 data efficiency over a random baseline and further improves overall performance compared to SOTA methods in reasoning-heavy evaluations and multilingual generalization. |
Dual Attention Network for Cross-lingual Entity Alignment (2020.coling-main)
Copied to clipboard
| Challenge: | Experimental results on three real-world cross-lingual entity alignment datasets have shown the effectiveness of DAEA. |
| Approach: | They propose a dual attention network for cross-lingual entity alignment . they use relation-aware graph attention and hierarchical attention to solve this problem . |
| Outcome: | The proposed approach can be applied to three real-world cross-lingual entity alignment datasets. |
PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensembles (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing research has studied privacy in LLM training data memorization, but it does not prevent users from disclosing PII at inference time. |
| Approach: | They propose a task for chaining API-based and local LLMs that uses public data to construct a benchmark that contains personally identifiable information (PII) |
| Outcome: | The proposed model maintains high response quality for 85.5% of user queries while restricting privacy leakage to only 7.5%. |
Using Subtext to Enhance Generative IDRR (2025.acl-short)
Copied to clipboard
| Challenge: | Arguments contain subtexts, but they are connotative and need prompts to be recognized . a lightweight subtext generator is helpful when the prompt doesn't raise a complex CoT. |
| Approach: | They leverage LLaMA to generate subtexts for argument pairs and verify their effectiveness . they construct a baseline IDRR using the decoder-only backbone LLama . |
| Outcome: | The proposed approach achieves higher F1 scores on two benchmarks than previous models. |
Stateful Memory-Augmented Transformers for Efficient Dialogue Modeling (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing Transformers models are computationally expensive for long context inputs. |
| Approach: | They propose a transformer that can interchange information between memory states and context . they evaluate the efficiency of their model on three dialogue datasets and two language datasets . |
| Outcome: | The proposed model is compatible with existing transformer models and can preserve dialogue history information. |
Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systems (2022.emnlp-main)
Copied to clipboard
| Challenge: | Dialog systems often output human-like responses, but some are impossible for a machine to say. |
| Approach: | They collect ratings on the feasibility of 900 two-turn dialogs from 9 data sources . they build classifiers and explore how modeling configuration might affect output permissibly . |
| Outcome: | The proposed model can be used to train human-like dialogs, but it is not anthropomorphic. |
From Script to Stage: Automating Experimental Design for Social Simulations with LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Xu et al., 2024): multi-agent simulations based on large language models are a new paradigm for social science research . traditional experimental design relies on interdisciplinary expertise and technical barriers . Xiaoping and Xin eli argue that LLM-driven agents are unreliable for rigorous experimental design due to hallucinations and limited verifiability. |
| Approach: | They propose a framework for multi-agent experiment design based on script generation . Script Composition, Script Finalization, and Actor Generation are the core phases of the framework . |
| Outcome: | The proposed framework lowers the barrier for social science experimental design and provides scientifically grounded decision support for policy-making. |
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs (2025.emnlp-main)
Copied to clipboard
Yidan Zhang, Yu Wan, Boyi Deng, Baosong Yang, Hao-Ran Wei, Fei Huang, Bowen Yu, Dayiheng Liu, Junyang Lin, Fei Huang, Jingren Zhou
| Challenge: | Recent advances in large language models showcase varied multilingual capabilities across tasks . previous assessments focused on fundamental natural language processing (NLP) or isolated capability-specific tasks. |
| Approach: | They propose a multilingual multitask benchmark to assess multilingual capabilities . they use a large-scale benchmark covering fundamental and capability-specialized datasets . |
| Outcome: | The proposed benchmark compares models and tasks across languages and tasks and examines knowledge transfer from English to other languages. |
DimABSA: Building Multilingual and Multidomain Datasets for Dimensional Aspect-Based Sentiment Analysis (2026.acl-long)
Copied to clipboard
Lung-Hao Lee, Liang-Chih Yu, Natalia V Loukachevitch, Ilseyar Alimova, Alexander Panchenko, Tzu-Mi Lin, Zhe-Yu Xu, Jian-Yu Zhou, Guangmin Zheng, Jin Wang, Sharanya Awasthi, Jonas Becker, Jan Philip Wahle, Terry Ruas, Shamsuddeen Hassan Muhammad, Saif M. Mohammad
| Challenge: | Existing ABSA research relies on coarse-grained categorical labels, which limits its ability to capture nuanced affective states. |
| Approach: | They propose a dimensional approach that represents sentiment with continuous valence–arousal (VA) scores, enabling fine-grained analysis at both the aspect and sentiment levels. |
| Outcome: | The proposed approach represents sentiment with continuous valence–arousal (VA) scores, enabling fine-grained analysis at both the aspect and sentiment levels. |
ErAConD: Error Annotated Conversational Dialog Dataset for Grammatical Error Correction (2022.naacl-main)
Copied to clipboard
| Challenge: | Currently available grammatical error correction datasets focus on written essays . a novel dataset is presented to improve the accuracy of existing educational chatbots . |
| Approach: | They propose a novel grammatical error correction dataset using essays and other long-form text written by language learners. |
| Outcome: | The proposed dataset improves the performance of a conversational chatbot in a human-machine conversational setting. |
Explicit Cross-lingual Pre-training for Unsupervised Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to build initial unsupervised machine translation models with cross-lingual n-gram embeddings are inexplicit and limited. |
| Approach: | They propose a cross-lingual pre-training method that incorporates cross-linguistic training signals into pre-trained models by randomly choosing source n-grams in the input text stream. |
| Outcome: | The proposed method significantly improves the performance of unsupervised machine translation. |
MOCHA: Are Code Language Models Robust Against Multi-Turn Malicious Coding Prompts? (2025.findings-emnlp)
Copied to clipboard
Muntasir Wahed, Xiaona Zhou, Kiet A. Nguyen, Tianjiao Yu, Nirav Diwan, Gang Wang, Dilek Hakkani-Tür, Ismini Lourentzou
| Challenge: | Recent advances in Large Language Models have significantly enhanced their code generation capabilities, but their robustness against adversarial misuse remains underexplored. |
| Approach: | They introduce a code decomposition attack where a malicious coding task is broken down into subtasks across multiple conversational turns to evade safety filters. |
| Outcome: | The proposed code decomposition attacks exploits multi-turn malicious coding prompts . the proposed model improves rejection rates while preserving coding ability . |
Understanding User Resistance Strategies in Persuasive Conversations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Persuasive dialog systems have various usages, such as donation persuation and physical exercise persulasion. |
| Approach: | They adopt a preliminary framework on persuasion resistance in psychology and build a fine-grained resistance strategy annotation scheme to analyze the persuitee's resistance strategies. |
| Outcome: | The proposed system can understand and address user resistance strategies appropriately. |
The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters (2025.acl-long)
Copied to clipboard
Chulun Zhou, Qiujing Wang, Mo Yu, Xiaoqian Yue, Rui Lu, Jiangnan Li, Yifan Zhou, Shunchi Zhang, Jie Zhou, Wai Lam
| Challenge: | Theory-of-Mind (ToM) is a psychological capability that allows humans to understand and interpret the mental states of others. |
| Approach: | They propose a CharToM-QA benchmark to assess the importance of comprehensive contextual understanding about personal backgrounds in ToM. |
| Outcome: | The proposed model outperforms existing models on 1,035 ToM questions based on classic novels and shows that educated participants perform better when they have read the novels than non-educated participants. |
Prompt-Based Monte-Carlo Tree Search for Goal-oriented Dialogue Policy Planning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Optimal policy planning is a difficult task, authors say . many goal-oriented conversations require subjective strategies, they say - a problem in goal-orientated settings . |
| Approach: | They propose an approach to perform goal-oriented dialogue policy planning without model training. |
| Outcome: | The proposed approach performs goal-oriented dialogue policy planning without model training. |
ACE: A LLM-based Negotiation Coaching System (2024.emnlp-main)
Copied to clipboard
| Challenge: | The rapid progress of LLMs has led to the development of more sophisticated AI tutoring systems. |
| Approach: | They develop an LLM-based assistant for coaching negotiation that provides users with targeted feedback for improvement. |
| Outcome: | The proposed system improves negotiation performance significantly compared to a system that doesn’t provide feedback and one which uses an alternative method. |
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation (2021.acl-demo)
Copied to clipboard
Weizhen Qi, Yeyun Gong, Yu Yan, Can Xu, Bolun Yao, Bartuer Zhou, Biao Cheng, Daxin Jiang, Jiusheng Chen, Ruofei Zhang, Houqiang Li, Nan Duan
| Challenge: | Existing models for pre-training are not convenient for users to find and set them up. |
| Approach: | They propose to extend ProphetNet into other domains and languages by pre-training models . they pre-train a cross-lingual generation model ProphetNet-Multi and a Chinese generation model . |
| Outcome: | The proposed models achieve new state-of-the-art on 10 benchmarks. |
NoteChat: A Dataset of Synthetic Patient-Physician Conversations Conditioned on Clinical Notes (2024.findings-acl)
Copied to clipboard
| Challenge: | NoteChat is a cooperative multi-agent framework for generating patient-physician dialogues . evaluator finds it outperforms state-of-the-art models for generating clinical notes . clinical documentation is largely done by physicians at both steps . |
| Approach: | They propose a cooperative multi-agent framework leveraging Large Language Models to generate patient-physician dialogues. |
| Outcome: | The proposed framework outperforms state-of-the-art models for generating clinical notes . it can engage patients directly and help clinical documentation, a leading cause of physician burnout . |
HERALD: An Annotation Efficient Method to Detect User Disengagement in Social Conversations (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work on detecting user disengagement requires hand-labeling many dialog samples . Currently, self-reported user ratings are constrained to a static corpus . |
| Approach: | They propose an efficient annotation framework that denoises dialog samples instead of manually labeling them. |
| Outcome: | The proposed framework improves annotation efficiency significantly and detects user disengagement in two dialog corpora. |
The Lessons of Developing Process Reward Models in Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Zhenru Zhang, Chujie Zheng, Yangzhen Wu, Beichen Zhang, Runji Lin, Bowen Yu, Dayiheng Liu, Jingren Zhou, Junyang Lin
| Challenge: | a recent study shows that process reward models can make mistakes, leading to wrong conclusions. |
| Approach: | They propose a consensus filtering mechanism that integrates MC estimation with LLM-as-a-judge to improve model performance and data efficiency. |
| Outcome: | The proposed model outperforms existing open-source alternatives and provides practical guidelines for future research. |
Adversarial Feature Adaptation for Cross-lingual Relation Classification (C18-1)
Copied to clipboard
| Challenge: | Existing methods for relation classification exploit monolingual data due to lack of annotated data in other languages. |
| Approach: | They propose an adversarial feature adaptation approach for cross-lingual relation classification using a generative adversarial network. |
| Outcome: | The proposed approach yields an improvement of 5.7% over the state-of-the-art. |
Unsupervised Context Rewriting for Open Domain Conversation (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to model conversation context have drawbacks, such as lack of coreferences and long dependency. |
| Approach: | They propose a context rewriting method which explicitly rewrites the last utterance by considering context history. |
| Outcome: | The proposed method outperforms baselines in terms of rewriting quality, multi-turn response generation, and end-to-end retrieval-based chatbots. |
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation. |
| Approach: | They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries. |
| Outcome: | The proposed framework improves translation quality on four translation directions on three benchmarks. |
Learning to Decompose: Hypothetical Question Decomposition Based on Comparable Texts (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to end-to-end questionanswering assume that pre-trained language can decompose complex tasks into more straightforward sub-tasks. |
| Approach: | They propose to use distant supervision to train decomposition-based transformers for large-scale parallel news. |
| Outcome: | The proposed model improves on semantic parsing and on hotpotQA and strategyQA datasets by 20% to 30%. |
A Visual Attention Grounding Neural Model for Multimodal Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to multimodal machine translation do not integrate visual information into the translation process. |
| Approach: | They propose a multimodal machine translation model that utilizes parallel visual and textual information. |
| Outcome: | The proposed model outperforms existing methods on the Multi30K and Ambiguous COCO datasets. |
Sociocultural Norm Similarities and Differences via Situational Alignment and Explainable Textual Entailment (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current research on developing computational models of social norms has focused on American society. |
| Approach: | They propose to leverage a Chinese Q&A platform and a socialchiemistry dataset as proxies for contrasting cultural axes and align social situations cross-culturally. |
| Outcome: | The proposed model can reason across cultures using a Chinese Q&A platform and the existing socialChemistry dataset. |
Dual Context-Guided Continuous Prompt Tuning for Few-Shot Learning (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-based paradigms have shown their competitive performance in many NLP tasks, but their effectiveness varies upon the model and training data. |
| Approach: | They propose a dual context-guided continuous prompt tuning method that integrates contextual information into the input input. |
| Outcome: | The proposed method outperforms existing prompt tuning methods in the few-shot setting and can be used in many NLP tasks. |
Jailbreak Large Vision-Language Models Through Multi-Modal Linkage (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to jailbreak large vision-language models fail against cutting-edge models such as GPT-4o, despite having undergone safety alignment training. |
| Approach: | They propose a new framework for jailbreaking large vision-language models that uses an encryption-decryption process to mitigate the over-exposure of harmful information. |
| Outcome: | The proposed framework jailbreaks GPT-4o with 99.40% success rates on SafeBench, 98.81% on MM-SafeBench and 99.07% on HADES-Dataset. |
VCSearch: Bridging the Gap Between Well-Defined and Ill-Defined Problems in Mathematical Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have improved the performance of Large language models on well-defined mathematical benchmarks, but they often overlook ill-defined problems. |
| Approach: | They develop a large-scale benchmark that contains over 5,000 ill-defined mathematical problems. |
| Outcome: | The proposed framework improves the accuracy of identifying unsolvable problems by at least 12% across different LLMs, thus achieving stronger robust mathematical reasoning ability. |
Save the Good Prefix: Precise Error Penalization via Process-Supervised RL to Enhance LLM Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing reinforcement learning methods rely on sparse outcome rewards, which fail to credit correct intermediate steps in partially successful solutions. |
| Approach: | They propose a process reward model that rewards correct steps only when they detect errors . they propose VPPO, which rewards the correct prefix and an erroneous suffix . |
| Outcome: | a new approach outperforms sparse-reward RL and prior PRM-guided baselines on Pass@1 and Pass@K . a process reward model (PRM) outperformed sparser-rebound RL on multiple reasoning benchmarks . |
Learning Matching Models with Weak Supervision for Response Selection in Retrieval-based Chatbots (P18-2)
Copied to clipboard
| Challenge: | Existing methods to learn matching models for retrieval-based chatbots are lacking. |
| Approach: | They propose a method that uses a sequence-to-sequence architecture model as a weak annotator to judge the matching degree of unlabeled pairs and performs learning with both the weak signals and the unlabed data. |
| Outcome: | The proposed method improves on two public data sets on matching models on retrieval-based chatbots. |
KERS: A Knowledge-Enhanced Framework for Recommendation Dialog Systems with Multiple Subgoals (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing frameworks for multi-subgoal dialogs require a system to build a social bond with users to gain trust and develop affinity. |
| Approach: | They propose a framework for common knowledge-based multi-subgoal dialogs that divides up conversations with multiple subgoals and propose mechanisms to filter noisy knowledge and to include cleaned knowledge in the dialog response generation process. |
| Outcome: | The proposed framework obtains state-of-the-art results on a DuRecDial dataset in both automatic and human evaluation. |
Demonstration Retrieval-Augmented Generative Event Argument Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental results show that our method outperforms all strong baselines and can be generalized to various datasets. |
| Approach: | They propose a generative EAE that uses event knowledge-injected generator and demonstration retriever to generate event arguments from training data. |
| Outcome: | The proposed method outperforms baselines and can be generalized to various datasets. |
Grammar-Based Patches Generation for Automated Program Repair (2021.findings-acl)
Copied to clipboard
| Challenge: | Automated program repair (APR) aims to find an automatic solution to program language bugs without human intervention. |
| Approach: | They propose a grammar-based rule-rule model which regards the repair process as the transformation of grammar rules and employs a tree-based self-attention approach to guarantee grammar correctness. |
| Outcome: | The proposed model outperforms the state-of-the-art models on a Java dataset in terms of generated code accuracy. |
Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing (2022.coling-1)
Copied to clipboard
| Challenge: | Experimental results show that fine-grained entity typing (FET) can be used to deduce specific semantic types of entities. |
| Approach: | They propose a type-enriched hierarchical contrastive strategy to model type differences . their method can make type information directly perceptible and improve distinguishability . |
| Outcome: | The proposed method can model the differences between hierarchical types and distinguish multi-grained similar types at different granularities. |
Memformer: A Memory-Augmented Transformer for Sequence Modeling (2022.findings-aacl)
Copied to clipboard
| Challenge: | Experimental results show that Memformer uses 8.1x less memory space and 3.2x faster on inference. |
| Approach: | They propose an efficient neural network that utilizes an external dynamic memory to encode and retrieve past information. |
| Outcome: | The proposed model achieves comparable performance against baselines with 8.1x less memory space and 3.2x faster on inference. |
LIONs: An Empirically Optimized Approach to Align Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on aligning large language models with pre-trained datasets. |
| Approach: | They conduct a rigorous analysis of a three-stage training pipeline using sequence packing, loss masking and increasing the preference dataset size in DPO to improve the performance of language models. |
| Outcome: | The proposed models outperform the official instruct models tuned with closed-source data and algorithms. |
Mnemis: Dual-Route Retrieval on Hierarchical Graphs for Long-Term LLM Memory (2026.acl-long)
Copied to clipboard
Zihao Tang, Xin Yu, Ziyu Xiao, Zengxuan Wen, Zelin Li, Jiaxi Zhou, Hualei Wang, Haohua Wang, Haizhen Huang, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Existing methods for retrieving historical messages are based on similarity-based mechanisms. |
| Approach: | They propose a system that integrates System-1 similarity search with a complementary System-2 mechanism, termed Global Selection. |
| Outcome: | The proposed framework achieves state-of-the-art on long-term memory benchmarks and 93.9 on LoCoMo and 91.6 on LongMemEval-S. |
Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts (2025.naacl-short)
Copied to clipboard
| Challenge: | Training conversational question-answering systems requires in-domain data, which is often scarce in practice. |
| Approach: | They propose a bottom-up approach where QA pairs are generated first and combined into a coherent dialogue. |
| Outcome: | The proposed approach produces more realistic and higher-quality dialogues compared to top-down methods. |
Self-Paced Learning for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have shown that the training of neural machine translation (NMT) rely on the quality of artificial schedule drawn up with the handcrafted features, e.g. sentence length or word rarity. |
| Approach: | They propose to train NMT model using a self-paced learning approach that allows it to quantify the learning confidence over training examples and flexibly govern its learning via regulating the loss in each iteration step. |
| Outcome: | The proposed model outperforms baseline models and those trained with human-designed curricula on translation quality and convergence speed. |
Learning Logic Rules for Document-Level Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for document-level relation extraction relied on implicitly powerful representations, which makes the model less transparent. |
| Approach: | They propose a probabilistic model for document-level relation extraction by learning logic rules. |
| Outcome: | The proposed model outperforms baseline models in relation performance and logical consistency. |
The Stochastic Parrot on LLM’s Shoulder: A Summative Assessment of Physical Concept Understanding (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent years have witnessed remarkable advancements in large language models (LLMs) many researchers argue that LLMs may not * Equal contribution. |
| Approach: | They propose a task that summarises the memorization issue by using grid inputs that abstractly describe physical phenomena. |
| Outcome: | The proposed task alleviates the memorization issue by using grid-format inputs that abstractly describe physical phenomena. |
CTTA-T: Continual Test-Time Adaptation for Text Understanding via Teacher-Student with a Domain-aware and Generalized Teacher (2026.acl-long)
Copied to clipboard
Tianlun Liu, Zhiliang Tian, Zhen Huang, Xingzhi Zhou, Wanlong Yu, Tianle Liu, Feng Liu, Dongsheng Li
| Challenge: | Existing models for text understanding fail to adapt to domain shifts in real-world applications . current models do not improve themselves as they are applied to new domains . |
| Approach: | They propose a continual test-time adaptation framework that adapts to evolving domains . they propose accumulating domains and a refine-then-filter framework to calibrate teacher predictions . |
| Outcome: | The proposed model excels in a teacher-student framework adaptable to evolving domains. |
LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability (2025.findings-emnlp)
Copied to clipboard
Zikai Xiao, Fei Huang, Jianhong Tu, Jianhui Wei, Wen Ma, Yuxuan Zhou, Jian Wu, Bowen Yu, Zuozhu Liu, Junyang Lin
| Challenge: | Existing benchmarks for long-form generation assess real-world queries with hard-to-verify metrics or use synthetic setups that overlook real-life intricacies. |
| Approach: | They propose a new approach that balances verifiable and real-world assessment with Target-Anchored Evaluation. |
| Outcome: | The proposed model balances real-world and verifiable assessment with Target-Anchored Evaluation (TAE) it generates queries, textual materials, and anchors based on verifier targets within real-life scenarios . |
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning? (2024.acl-long)
Copied to clipboard
| Challenge: | Current temporal reasoning datasets are limited to questions about single or isolated events, falling short in mirroring the realistic temporal characteristics involving concurrent nature and intricate temporal interconnections. |
| Approach: | They propose a co-temporal Question Answering benchmark that contains four co-time scenarios with 4,748 samples for evaluating the co-timing abilities of large language models. |
| Outcome: | The proposed benchmarks show that current LLMs struggle on CoTempQA tasks even when enhanced with Chain of Thought methodologies. |
TimeR4 : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Temporal Knowledge Graph Question Answering (TKGQA) aims to answer temporal questions using knowledge in Temporal knowledge graphs (TKTs). |
| Approach: | They propose a Time-aware retrieve-rewrite-retrieve-rerank framework to integrate temporal knowledge from TKGs into Large Language Models (LLMs) to reduce temporal hallucination, they propose rewrite module to rew questions using background knowledge stored in TKG's, then implement a retrieve-rank module to retrieve semantically and temporally relevant facts from Tkgs and rerank them according to temporal constraints. |
| Outcome: | The proposed approach achieves relative gains of 47.8% and 22.5% on two datasets, underscoring its effectiveness in boosting the temporal reasoning abilities of LLMs. |
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue (EToD) can generate responses in an end-to end fashion without modular training, which attracts escalating popularity. |
| Approach: | They present a systematic review of EToD and propose a unified perspective to summarize existing approaches and recent trends. |
| Outcome: | The proposed approaches can generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. |
Auto-Stega: An Agent-Driven System for Lifelong Strategy Evolution in LLM-Based Text Steganography (2026.findings-acl)
Copied to clipboard
| Challenge: | prevailing methods rely on hand-crafted or pre-specified strategies and struggle to balance efficiency, imperceptibility, and security, particularly at high embedding rates. |
| Approach: | They propose an agent-driven self-evolving framework that is the first to realize self-changing steganographic strategies by automatically discovering, composing, and adapting strategies at inference time. |
| Outcome: | The proposed framework achieves 42.2% perplexity and 1.6% anti-steganalysis performance over SOTA methods at high embedding rates. |
Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs (2026.findings-eacl)
Copied to clipboard
Paiheng Xu, Gang Wu, Xiang Chen, Tong Yu, Chang Xiao, Franck Dernoncourt, Tianyi Zhou, Wei Ai, Viswanathan Swaminathan
| Challenge: | Large Language Models (LLMs) can generate code from natural language queries, but runtime code generation is limited due to unverified code, security risks, longer response times, and higher computational costs. |
| Approach: | They propose an offline simulation framework to curate a software-specific skillset by exploiting large language models and publicly available scripting guides. |
| Outcome: | The proposed framework significantly improves automation success rates, reduces response time, and saves runtime token costs compared to traditional runtime code generation. |
SeRTS: Self-Rewarding Tree Search for Biomedical Retrieval-Augmented Generation (2024.findings-emnlp)
Copied to clipboard
Minda Hu, Licheng Zong, Hongru Wang, Jingyan Zhou, Jingjing Li, Yichen Gao, Kam-Fai Wong, Yu Li, Irwin King
| Challenge: | Existing retrieval-augmented approaches to large language models face performance limitations due to the lack of publicly available training data. |
| Approach: | They propose a plug-and-play LLM-based retrieval method called Self-Rewarding Tree Search based on Monte Carlo Tree Search and a self-rewarding paradigm to address these limitations. |
| Outcome: | The proposed method improves the performance of the BM25 retriever and surpasses the baseline of self-reflection in both efficiency and scalability. |
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)
Copied to clipboard
| Challenge: | Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information. |
| Approach: | They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets. |
| Outcome: | The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios. |
MCQG-SRefine: Multiple Choice Question Generation and Evaluation with Iterative Self-Critique, Correction, and Comparison Feedback (2025.naacl-long)
Copied to clipboard
| Challenge: | Generating multiple-choice questions (MCQG) for professional exams is challenging due to outdated knowledge, hallucination issues, and prompt sensitivity. |
| Approach: | They propose a framework for converting medical cases into high-quality USMLE-style questions using a self-refine-based framework. |
| Outcome: | The proposed framework improves human expert satisfaction regarding quality and difficulty of medical questions. |
Generic Temporal Reasoning with Differential Analysis and Explanation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing temporal reasoning models drop to random guessing on TODAY, suggesting that they heavily rely on spurious information rather than proper reasoning for temporal predictions. |
| Approach: | They propose a task called TODAY that evaluates whether systems can correctly understand the effect of incremental changes in temporal relation distributions. |
| Outcome: | The proposed task outperforms existing models, including GPT-3.5, on in-domain benchmarks while allowing for more appropriate annotations. |
GLGE: A New General Language Generation Evaluation Benchmark (2021.findings-acl)
Copied to clipboard
Dayiheng Liu, Yu Yan, Yeyun Gong, Weizhen Qi, Hang Zhang, Jian Jiao, Weizhu Chen, Jie Fu, Linjun Shou, Ming Gong, Pengcheng Wang, Jiusheng Chen, Daxin Jiang, Jiancheng Lv, Ruofei Zhang, Winnie Wu, Ming Zhou, Nan Duan
| Challenge: | Multi-task benchmarks focus on a range of Natural Language Understanding (NLU) tasks without considering the Natural Language Generation (NLG) models. |
| Approach: | They propose a multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks. |
| Outcome: | The proposed benchmarks are based on GLUE and Su-perGLUE for English and several other languages. |
Meta-Task Prompting Elicits Embeddings from Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for large language modeling are based on task-related instructions or prompts. |
| Approach: | They propose a method for generating high-quality sentence embeddings from Large Language Models (LLMs) using meta-task prompts. |
| Outcome: | The proposed method produces high-quality sentences without fine-tuning . it excels on STS benchmarks and in downstream tasks, surpassing models with similar prompts . |
Affective Idiosyncratic Responses to Music (2022.emnlp-main)
Copied to clipboard
| Challenge: | Affective responses to music are highly personal, but it's difficult to measure marginal effects of these variables . a study of 403M listener comments on a social music platform in china aims to address this gap . |
| Approach: | They propose to measure affective responses to music from 403M listener comments on a Chinese social music platform. |
| Outcome: | The proposed method identifies musical, lyrical, contextual, demographic, and mental health effects that drive listener affective responses from over 403M listener comments on a Chinese social music platform. |
Towards Emotional Support Dialog Systems (2021.acl-long)
Copied to clipboard
| Challenge: | Emotional support is a crucial ability for many conversation scenarios, including social interactions, mental health support, and customer service chats. |
| Approach: | They propose an Emotional Support Conversation task and an ESC Framework to train emotional support into dialog systems. |
| Outcome: | The proposed framework provides an example of an Emotional Support Conversation task and shows that it is more effective than existing models. |
Step-by-Step Mastery: Enhancing Soft Constraint Following Ability of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | In real-world scenarios, user instructions often contain soft constraints, which are semantically related and cannot be rule-based verified, posing challenges for large language models. |
| Approach: | They propose a pipeline to construct datasets with high-quality outputs for instructions containing soft constraints automatically and use Direct Preference Optimization (DPO) as the training method. |
| Outcome: | The proposed model improves the LLMs' soft constraint following ability by using direct preference optimization (DPO) and constraint quantity. |
Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models (2025.findings-acl)
Copied to clipboard
Hao Xiang, Bowen Yu, Hongyu Lin, Keming Lu, Yaojie Lu, Xianpei Han, Ben He, Le Sun, Jingren Zhou, Junyang Lin
| Challenge: | Prior research focused on developing data generation methods, while insufficient attention has been paid to quality control mechanisms and often produces inaccurate and unhelpful data. |
| Approach: | They propose an algorithm that automatically generates high-quality preference data, eliminating manual annotation requirements. |
| Outcome: | The proposed algorithm outperforms baselines in human preference alignment and reward optimization. |
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing TIMT tasks focus on text-line-level images. |
| Approach: | They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation. |
| Outcome: | The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation. |
SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization (2023.emnlp-main)
Copied to clipboard
Hyunwoo Kim, Jack Hessel, Liwei Jiang, Peter West, Ximing Lu, Youngjae Yu, Pei Zhou, Ronan Bras, Malihe Alikhani, Gunhee Kim, Maarten Sap, Yejin Choi
| Challenge: | a dataset of 1.5 million conversations distilled from everyday spoken situations is limited in scale due to its associated costs. |
| Approach: | They propose to make SODA a publicly available, million-scale high-quality social dialogue dataset . they contextualize social commonsense knowledge from a knowledge graph to distill broad spectrum of social interactions . |
| Outcome: | The proposed dataset is the first publicly available, million-scale high-quality social dialogue dataset. |
On the token distance modeling ability of higher RoPE attention dimension (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on extending the context length of language models based on Rotary position embedding (RoPE) has shown promising results in capturing longer-range contextual information. |
| Approach: | They propose to use a hidden dimension of an attention head to investigate its contribution to capturing long-distance dependencies. |
| Outcome: | The proposed model can capture long-distance dependencies by extending the attention of a particular dimension of an attention head. |
Beyond Timestamps: Bridging Forward and Backward Reasoning in Temporal Numerical and Relational Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for Temporal Numerical and Relational reasoning rely on single-task evaluation paradigms. |
| Approach: | They propose a benchmark to evaluate Temporal Numerical and Relational reasoning . they propose QA and verification, and a Consistency Rate to quantify robustness . |
| Outcome: | The proposed framework evaluates both Temporal Numerical and Relational reasoning . it measures the alignment between QA and FV and the Consistency Rate measures robustness across these directions. |
CaTS-Bench: Can Language Models Describe Time Series? (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing time series captioning benchmarks rely on fully synthetic or generic captions . authors propose a pipeline for generating high-fidelity synthetic captions, which is validated . |
| Approach: | They propose a benchmark for Context-aware Time Series reasoning across 11 diverse domains . they evaluate leading Vision-Language Models on their benchmark . |
| Outcome: | The proposed benchmark evaluates 1746 human-rewritten captions and shows they perform better than open-source models. |
Attribute Alignment: Controlling Text Generation from Pre-trained Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can generate text with sentiment polarity or specific topics without changing the original model parameters. |
| Approach: | They propose a method for controlling text generation by aligning disentangled attribute representations. |
| Outcome: | The proposed method shows large performance gains while maintaining diversity and fluency. |
Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation (D19-1)
Copied to clipboard
| Challenge: | Current approaches to visual dialog learning involve an end-to-end framework that maps the multi-modal context to a deep vector and in order to decode a natural dialog response. |
| Approach: | They propose a framework that trains a RL policy for image guessing and a seq2seq model to improve dialog quality. |
| Outcome: | The proposed framework achieves state-of-the-art performance on a guessWhich task . it can be applied to a wide range of tasks including assisting blind people . |
Causal-Debias: Unifying Debiasing in Pretrained Language Models and Fine-tuning via Causal Invariant Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to remove unwanted stereotypical associations from pretrained language models (PLMs) are often focused on removing unwanted stereotypes from PLMs. |
| Approach: | They propose a framework to remove unwanted stereotypical associations in pretrained language models . they propose bias-relevant factors are causal, while labelrelevant factors causal . |
| Outcome: | The proposed framework reduces stereotypical associations after PLMs are fine-tuned . the proposed framework mitigates bias from a causal invariant perspective . |
Seamlessly Integrating Factual Information and Social Content with Persuasive Dialogue (2022.aacl-main)
Copied to clipboard
| Challenge: | Persuasive dialogue systems are designed for chatbots to communicate with and influence users with specific goals. |
| Approach: | They propose a modular dialogue system framework that integrates factual information and social content into persuasive dialogues. |
| Outcome: | The proposed framework is generalizable to any dialogue tasks that have mixed social and task contents. |
Dynamically Fused Graph Network for Multi-hop Reasoning (P19-1)
Copied to clipboard
| Challenge: | Text-based question answering (TBQA) has been studied extensively in recent years. |
| Approach: | They propose a Dynamically Fused Graph Network to answer questions requiring multiple scattered evidence and reasoning over them. |
| Outcome: | The proposed method achieves competitive results on a public TBQA dataset and produces interpretable reasoning chains. |
Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questions (2024.acl-long)
Copied to clipboard
| Challenge: | a novel graph for narrative comprehension captures coherence between passages in narratives . end-to-end paradigms are effective for comprehension tasks, but may not be sufficient for all comprehension scenarios. |
| Approach: | They propose a graph dubbed NarCo which explicitly depicts task-agnostic coherence dependencies that are ready to be consumed by downstream tasks. |
| Outcome: | The proposed graph is practically instantiated by LLMs without human annotations. |
Localizing Active Objects from Egocentric Vision with Symbolic World Knowledge (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on active object grounding from an egocentric perspective is focusing on localizing and tracking active objects that undergo major state change as a result of human actions/interactions to the environment without being told exactly what/where to ground. |
| Approach: | They propose to use a narrated egocentric video dataset to localize and track active objects that undergo major state change as a result of human actions/interactions to the environment without being told exactly what/where to ground. |
| Outcome: | The proposed framework leads to 54% improvement in standard metrics on the TREK-150-OPE-Det localization + tracking task, and >7% improvement in all standard metrics. |
WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback (2025.findings-emnlp)
Copied to clipboard
Minda Hu, Tianqing Fang, Jianshu Zhang, Jun-Yu Ma, Zhisong Zhang, Jingyan Zhou, Hongming Zhang, Haitao Mi, Dong Yu, Irwin King
| Challenge: | Web agents powered by Large Language Models lack the ability to perform in uncertain web environments. |
| Approach: | They propose to reconstruct web agents' reasoning skills into chain-of-thought rationales by fine-tuning their LLM backbone into a web-based model. |
| Outcome: | The proposed approach significantly improves the agent self-improving benchmark OpenWebVoyager, demonstrating that it can be used to improve the agent's reasoning skills. |
PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models (2025.acl-long)
Copied to clipboard
| Challenge: | Recent large language models (LLMs) have achieved significant performance in complex reasoning tasks such as mathematics and code generation. |
| Approach: | They propose a process-level benchmark specifically designed to assess the fine-grained error detection capabilities of PRMs. |
| Outcome: | The proposed model measures the accuracy, soundness, and sensitivity of 25 models across open-source and closed-source large language models. |
A Multi-Persona Chatbot for Hotline Counselor Training (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a chatbot cannot replace a counselor, but a simulation of intimate situations is needed to train counselors. |
| Approach: | They propose a counseling strategy annotation scheme and a multi-task framework that mimics prototype conversations to train counselors. |
| Outcome: | The proposed framework significantly increases response diversity and specificity, with limited impact to coherence. |
A Fine-grained Chinese Software Privacy Policy Dataset for Sequence Labeling and Regulation Compliant Identification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets that ignore law requirements are limited to English. |
| Approach: | They construct a Chinese privacy policy dataset that can be used to analyze software privacy policies. |
| Outcome: | The proposed dataset includes 483 Chinese Android privacy policies, over 11K sentences, and 52K fine-grained annotations. |
ChainCQG: Flow-Aware Conversational Question Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Current datasets for conversational question answering lack realistic, domain-specific training data. |
| Approach: | They propose a model that generates question-answer representations across dialogue turns . they use flow propagation training to improve conversational flow and fluidity . |
| Outcome: | The proposed model outperforms answer-aware and answer-unaware SOTA baselines significantly . it generates different types of questions with improved fluidity and coreference alignment. |
Self-regulation: Employing a Generative Adversarial Network to Improve Event Detection (P18-1)
Copied to clipboard
| Challenge: | Recent studies show that neural networks can be used for event detection but can be contaminated by spurious features. |
| Approach: | They propose a self-regulated learning approach by utilizing a generative adversarial network to generate spurious features. |
| Outcome: | The proposed method is highly effective and adaptable on the ACE 2005 and TAC-KBP 2015 corpora. |
AutoReply: Detecting Nonsense in Dialogue with Discriminative Replies (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for dialogue detection make many errors in their own messages . a dataset of long dialogues richly grounded in the game state contains many errors . |
| Approach: | They propose to use an annotated dialogue dataset to generate automatic responses for dialogue models. |
| Outcome: | The proposed model outperforms handcrafted replies and performs on par with supervised learning approaches. |
Investigating Hallucinations in Simultaneous Machine Translation: Knowledge Distillation Solution and Components Analysis (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to mitigate hallucinations in siMT generate fluency but unfaithful translation. |
| Approach: | They propose a method that utilizes the OMT model to mitigate hallucinations in SiMT. |
| Outcome: | The proposed method reduces hallucinations and improves the SiMT performance. |
LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing (2021.acl-demo)
Copied to clipboard
| Challenge: | Currently, researchers use automatic metrics and human evaluation to evaluate dialogue systems. |
| Approach: | They propose to use a Python API to easily evaluate dialogue systems using Amazon Mechanical Turk. |
| Outcome: | The open-source toolkit provides a fast, consistent method for reproducing human evaluation results. |
HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy (2026.acl-industry)
Copied to clipboard
| Challenge: | relying on large language models for information has raised concerns about reliability and accuracy of outputs. |
| Approach: | They propose a hallucination taxonomy with 11 categories for various NLG tasks and propose HAllucination Detection models which integrate hallucinism detection, span-level identification, and correction into a single inference process. |
| Outcome: | The proposed models outperform baselines on HaluEval, FactCHD, and FaithBench, confirming their robustness and versatility. |
CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing summarization methods are prone to generate redundant and incoherent summaries, causing the performance to be worse. |
| Approach: | They propose a Chinese dataset for Customer Service Dialogue Summarization (CSDS) that provides role-oriented summaries to acquire different speakers' viewpoints. |
| Outcome: | The proposed dataset improves the abstractive summaries in two aspects . it also provides role-oriented summary to acquire different speakers’ viewpoints . |
MELOV: Multimodal Entity Linking with Optimized Visual Features in Latent Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multimodal entity linking focus on textual contexts but lack in social media vision modality. |
| Approach: | They propose a latent space vision feature optimization framework MELOV to address these challenges . they exploit variational autoencoder to mine shared information and generate text-based visual features . |
| Outcome: | The proposed framework is superior to existing methods on three benchmark datasets. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking (2023.findings-eacl)
Copied to clipboard
| Challenge: | Prompt-based methods with large pre-trained language models have shown impressive unaided performance across many NLP tasks. |
| Approach: | They propose a meta-learning scheme to stabilize the ability of the model to perform well under various prompts and introduce a saliency model to limit dialogue text length. |
| Outcome: | The proposed model improves on large pre-trained language models with labeled in-context exemplars and can be used to generate more exemplar queries. |
Self-Modifying State Modeling for Simultaneous Machine Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for simultaneous machine translation fail to optimize the policy . existing methods require building a decision path to learn the policy, but they cannot explore all potential paths . |
| Approach: | They propose a new training paradigm that uses a read/write policy to optimize the policy . existing methods usually require building a decision path to learn a suitable policy a user makes . |
| Outcome: | The proposed model outperforms strong baselines and allows offline models to acquire SiMT ability with fine-tuning. |
Understanding LLMs’ Fluid Intelligence Deficiency: An Analysis of the ARC Task (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent research on fluid intelligence assessments has highlighted significant deficiencies in LLMs’ abilities. |
| Approach: | They analyze the challenges LLMs face in demonstrating fluid intelligence through controlled experiments using the most representative ARC task as an example. |
| Outcome: | The proposed model shows that it lacks the ability to combine skill composition and abstract input formats and lacks left-to-right decoding. |
Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to fine tune LLMs produce unsafe responses and unreliable reasoning, but this solution introduces substantial time and space overhead due to the separate models required. |
| Approach: | They propose to insert extra parameters into transformer architecture to predict calibration signals along with original LLM output. |
| Outcome: | The proposed model reduces time and space costs while enabling seamless online deployment. |
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)
Copied to clipboard
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, Jingyu Lu, Rongjie Huang, Ruiyuan Zhang, Zhiqing Hong, Ziyue Jiang, Zhou Zhao
| Challenge: | Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment. |
| Approach: | VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control. |
| Outcome: | Experimental results show that VersBand performs better than baseline models across multiple song generation tasks. |
Clues Before Answers: Generation-Enhanced Multiple-Choice QA (2022.naacl-main)
Copied to clipboard
| Challenge: | Multiple-choice question answering (MCQA) uses text-to-text framework . but, there is an under-utilization of the decoder and knowledge that can be decoded . |
| Approach: | They propose a generative multiple-choice question answering model which generates a clue from the question and leverages it to enhance a reader for MCQA. |
| Outcome: | The proposed model outperforms text-to-text models on multiple MCQA datasets. |
Building LLMs Like LEGO: Two-dimensional Architecture Reassembly of Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to LLM reuse treat LLMs as monolithic artifacts. |
| Approach: | They propose to recompose pretrained large language models as modular building blocks . they propose a chromosome-based architectural encoding and evolutionary optimization . |
| Outcome: | The proposed model can be recomposed as modular building blocks without training data. |
Effective Unsupervised Constrained Text Generation based on Perturbed Masking (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for constrained text generation stochastically sample edit positions and actions, which cause unnecessary search steps. |
| Approach: | They propose to extend perturbed masking technique to search for most incongruent token to edit and introduce four multi-aspect scoring functions to select edit action to further reduce search difficulty. |
| Outcome: | The proposed method achieves state-of-the-art in two representative tasks . it does not require supervised data, so it could be applied to different generation tasks. |
TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis (2025.findings-acl)
Copied to clipboard
Yu Zhang, Wenxiang Guo, Changhao Pan, Dongyu Yao, Zhiyuan Zhu, Ziyue Jiang, Yuhan Wang, Tao Jin, Zhou Zhao
| Challenge: | Existing zero-shot singing voice synthesis models depend on phoneme and note boundary annotations, limiting their robustness and producing poor transitions between phonemes and notes. |
| Approach: | They propose a multi-task multilingual zero-shot SVS model with style transfer and style control based on various prompts. |
| Outcome: | Experimental results show that TCSinger 2 outperforms baseline models in subjective and objective metrics across multiple related tasks. |
Byte Latent Transformer: Patches Scale Better Than Tokens (2025.acl-long)
Copied to clipboard
Artidoro Pagnoni, Ramakanth Pasunuru, Pedro Rodriguez, John Nguyen, Benjamin Muller, Margaret Li, Chunting Zhou, Lili Yu, Jason E Weston, Luke Zettlemoyer, Gargi Ghosh, Mike Lewis, Ari Holtzman, Srini Iyer
| Challenge: | Existing large language models (LLMs) are trained on bytes, except for tokenization, which groups bytes into a static set of tokens. |
| Approach: | They propose a new byte-level LLM architecture that encodes bytes into dynamically sized patches, which serve as the primary units of computation. |
| Outcome: | The proposed architecture matches tokenization-based models with improvements in inference efficiency and robustness. |
RiskLab: A Controlled Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems (2026.acl-demo)
Copied to clipboard
Yu Jiang, Wenjie Wang, Yue Huang, Yanbo Wang, Zhenhong Zhou, Xiuying Chen, Yang Liu, Pin-Yu Chen, Wei Wang, Xiangliang Zhang
| Challenge: | Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks. |
| Approach: | They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions. |
| Outcome: | The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks. |
Neural Topic Model with Reinforcement Learning (D19-1)
Copied to clipboard
| Challenge: | Experimental results show superior performance on perplexity and topic coherence measures compared to state-of-the-art topic models. |
| Approach: | They propose to incorporate topic coherence measures as reward signals to guide the learning of a VAE-based topic model. |
| Outcome: | The proposed model is able to separating background words dynamically from topic words eliminating the pre-processing step of filtering infrequent and/or top frequent words, typically required for learning traditional topic models. |
MarkLLM: An Open-Source Toolkit for LLM Watermarking (2024.emnlp-demo)
Copied to clipboard
Leyi Pan, Aiwei Liu, Zhiwei He, Zitian Gao, Xuandong Zhao, Yijian Lu, Binglin Zhou, Shuliang Liu, Xuming Hu, Lijie Wen, Irwin King, Philip Yu
| Challenge: | Large Language Models (LLMs) embed imperceptible yet algorithmically detectable signals in outputs to identify LLM-generated text. |
| Approach: | They propose to develop an open-source toolkit for LLM watermarking that embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text. |
| Outcome: | MarkLLM provides a unified framework for implementing LLM watermarking algorithms, while providing user-friendly interfaces to ensure ease of access. |
Discovering Dialogue Slots with Weak Supervision (2021.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems typically require manual annotation of dialogue slots in training data. |
| Approach: | They propose a method that uses weak supervision to identify slot candidates and automatically identify domain-relevant slots by using clustering algorithms. |
| Outcome: | The proposed method significantly improves an end-to-end dialogue response generation model compared to using no slot annotation at all. |
Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing goal-oriented dialogue datasets focus on identifying slots and values, but in reality, customer service agents follow multi-step procedures derived from explicit company policies. |
| Approach: | They propose to use a fully-labeled dataset to study customer service dialogue systems in real-world scenarios. |
| Outcome: | The proposed dataset outperforms existing models but still lacks 50.8% absolute accuracy to reach human-level performance on the dataset. |
Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment (2024.acl-long)
Copied to clipboard
| Challenge: | Existing work cheaply emulates LLMs, allowing users to create profiles for their preferred characters. |
| Approach: | They propose a self-alignment method that encourages an instruction-following LLM to simulate role-play dialogues as a variant of reading comprehension. |
| Outcome: | The proposed model outperforms open-source role-play benchmarks and the roleplay subset of MT-Bench in multiple parameters. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |
Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good (P19-1)
Copied to clipboard
| Challenge: | Persuasion agents are a form of communication that can be used to change people's opinions and actions for social good. |
| Approach: | They designed an online persuasion task where one participant was asked to persult the other to donate to a specific charity. |
| Outcome: | The proposed system could change people's opinions and actions for social good. |
GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Prior methods for detecting out-of-scope (OOS) utterances in text are limited and require a limited amount of data to obtain. |
| Approach: | They propose an orthogonal technique that augments existing data to train better OOS detectors operating in low-data regimes. |
| Outcome: | The proposed method outperforms existing methods on key metrics across three benchmarks and achieves relative gains of 52.4%, 48.9% and 50.3%. |
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)
Copied to clipboard
Yu Zou, Yan Chen, Lida He, Qi Zhou, Xiaorui Zhou, Aixi Zhong, Yi Wang, Wei Li, Qingyu Wang, Jiatao Li, Wei Gong, Jialei Zeng, Jingmei Zhao, Ke Jiang, Qing Li
| Challenge: | Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge. |
| Approach: | They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage. |
| Outcome: | The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold. |
Improving Autoformalization Using Direct Dependency Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for hallucinate formal dependencies lack scalability and precision to leverage ever-growing public datasets. |
| Approach: | They propose a retrieval-augmented framework based on Direct Dependency Retrieval to generate formal dependencies from natural-language mathematical descriptions and verify their existence via an efficient Suffix Array Check (SAC). |
| Outcome: | The proposed framework outperforms state-of-the-art methods in retrieval precision and recall and can be used to validate formal representations in a public dataset. |
SPS: Steering Probability Squeezing for Better Exploration in Reinforcement Learning for Large Language Models (2026.findings-acl)
Copied to clipboard
Yifu Huo, Chenglong Wang, Ziming Zhu, Shunjie Xing, Peinan Feng, Tongran Liu, Qiaozhi He, Tian Hua Zhou, null Changxiaojia, JingBo Zhu, Zhengtao Yu, Tong Xiao
| Challenge: | Reinforcement learning (RL) training typically improves single-sample success rates but limited exploration of diverse reasoning trajectories. |
| Approach: | They propose a training paradigm that interleaves conventional RL with inverse reinforcement learning (IRL) they propose 'Steering Probability Squeezing' to enhance exploration without external supervision . |
| Outcome: | The proposed training paradigm improves Pass@k and improves exploration of diverse reasoning trajectories without external supervision. |
Personality Understanding of Fictional Characters during Book Reading (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to predict characters' personalities have not been studied in the NLP field due to the lack of appropriate datasets mimicking the process of book reading. |
| Approach: | They propose a dataset to predict characters' personalities that uses an exhaustive vocabulary of personality traits as targets. |
| Outcome: | The proposed dataset is efficient and accurate and relies on long-term context to achieve accurate predictions for both machines and humans. |
Language Models can Evaluate Themselves via Probability Discrepancy (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation frameworks focus on superficial text differences and fail to align with human judgment. |
| Approach: | They propose a new method to evaluate the performance of Large Language Models (LLMs) by calculating probability discrepancies between original response generation and revised versions of LLMs. |
| Outcome: | The proposed method eliminates the need for training an additional evaluation model or relying on external proprietary models such as GPT-4 as a judger. |
Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to enhance credibility and verifiability of large language models (LLMs) mainly focus on passage-level or paragraph-level references or citations, which fall short in verifikatability. |
| Approach: | They propose a method that provides sentence-level citations in LLM-generated responses. |
| Outcome: | The proposed method achieves 90% accuracy in long-form question-answering tasks. |
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for summarizing dialogues lack in taking into account the structure of dialogues and rely heavily on labeled data. |
| Approach: | They propose a pre-trained encoder-decoder model for summarizing dialogues in any new domain. |
| Outcome: | The proposed model outperforms existing methods on six datasets and shows ROUGE scores in zero-shot and few-shot settings. |
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference (2025.acl-long)
Copied to clipboard
Jinglong Luo, Guanzhong Chen, Yehong Zhang, Shiyu Liu, Hui Wang, Yue Yu, Xun Zhou, Yuan Qi, Zenglin Xu
| Challenge: | Existing privacy-preserving Transformer Inference frameworks suffer from high computational overhead and performance losses. |
| Approach: | They propose a framework that integrates random permutations and SMPC to address the "impossible trinity" CENTAUR resists diverse data reconstruction attacks and boosts inference speed by 5.030.4 times . |
| Outcome: | CENTAUR achieves an unprecedented balance between privacy, efficiency, and performance. |
Multilingual Knowledge Graph Completion with Language-Sensitive Multi-Graph Attention (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multilingual knowledge graph completion have two drawbacks: alignment dependency and training inefficiency. |
| Approach: | They propose a multilingual knowledge graph completion framework with language-sensitive multi-graph attention to predict missing links on all given KGs. |
| Outcome: | The proposed model improves on the DBP-5L and E-PKG datasets. |
MIDAS: A Dialog Act Annotation Scheme for Open Domain HumanMachine Spoken Conversations (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing dialog act schemes are designed for human-human conversations, but are not suitable for automatic speech recognition. |
| Approach: | They propose a dialog act annotation scheme for open-domain human-machine conversations . they collected 24K utterances from a large open- domain spoken conversation dataset . |
| Outcome: | The proposed scheme achieves an F1 score of 0.79 on a 24K spoken conversation dataset. |
CVAE-based Re-anchoring for Implicit Discourse Relation Classification (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies show that training implicit discourse relation classifiers suffers from data sparsity. |
| Approach: | They propose a re-anchoring strategy to reduce the risk of erroneous sampling . they use Conditional VAE to estimate the risk and migrate the anchor to reduce it . |
| Outcome: | The proposed method improves the baseline classifier performance on PDTB v2.0 . |
WebAnchor: Anchoring Agent Planning to Stabilize Long-Horizon Web Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL)-based agents struggle with long-horizon planning and strategy coherence. |
| Approach: | They propose a reinforcement learning framework that decouples planning and execution. |
| Outcome: | The proposed framework outperforms baseline and first-step RL frameworks on four benchmarks. |
Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension (2023.findings-acl)
Copied to clipboard
| Challenge: | Compared to standard RC tasks, dialogue reading comprehension (DRC) has raised challenges because of the complex speaker information and noisy dialogue context. |
| Approach: | They propose a new method for dialogue reading comprehension that extracts answers from dialogues by using key-utterances-extracting methods and a Question-Interlocutor Scope Realized Graph. |
| Outcome: | The proposed method achieves state-of-the-art performance against previous works. |
Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on cultural understanding with vision-language models primarily emphasize geographic diversity, often overlooking the critical temporal dimensions. |
| Approach: | They propose a multimodal vision-language model that examines temporal features and cultural image transcreation. |
| Outcome: | The novel model performs better than non-experts on visual cutural understanding but falls short to human experts on cultural image transcreation task. |
CCIM: Cross-modal Cross-lingual Interactive Image Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on text image machine translation (TIMT) lacks recognized source language information resulting in a decrease in translation performance. |
| Approach: | They propose a cross-modal cross-lingual interactive model which incorporates source language information by synchronizing source and target language results. |
| Outcome: | The proposed model outperforms end-to-end models and has faster decoding speed with smaller model size than cascade models. |
NCLS: Neural Cross-Lingual Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual summarization divide the task into two steps: summarizing and translation. |
| Approach: | They propose to integrate two related tasks into the training process of CLS under multi-task learning to improve cross-lingual summarization. |
| Outcome: | The proposed framework improves on English-to-Chinese and Chinese-to English CLS human-corrected test sets. |
On the Generation of Medical Dialogs for COVID-19 (2021.acl-short)
Copied to clipboard
Meng Zhou, Zechen Li, Bowen Tan, Guangtao Zeng, Wenmian Yang, Xuehai He, Zeqian Ju, Subrato Chakravorty, Shu Chen, Xingyi Yang, Yichen Zhang, Qingyang Wu, Zhou Yu, Kun Xu, Eric Xing, Pengtao Xie
| Challenge: | under the pandemic of COVID-19, people experiencing COVI D19-related symptoms have a pressing need to consult doctors. |
| Approach: | They develop a medical dialog system that can provide COVID19-related consultations . they use two dialog datasets containing conversations between doctors and patients . |
| Outcome: | The proposed system can provide COVID19-related consultations, but is too small compared with general-domain dialog datasets. |
ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction (2024.findings-acl)
Copied to clipboard
Henry Zou, Vinay Samuel, Yue Zhou, Weizhi Zhang, Liancheng Fang, Zihe Song, Philip Yu, Cornelia Caragea
| Challenge: | Existing datasets for attribute value extraction focus on explicit attribute values while neglecting the implicit ones. |
| Approach: | They present a multimodal dataset for implicit attribute value extraction that includes AVE and multimodality. |
| Outcome: | The proposed dataset includes 68k training and 1.6k testing data across five domains. |
COF: Adaptive Chain of Feedback for Comparative Opinion Quintuple Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Comparative Opinion Quintuple Extraction (COQE) aims to extract all comparative sentiment quintuples from product review text. |
| Approach: | They propose a model-unaware adaptive chain-of-feedback method to extract quintuples from product review text. |
| Outcome: | The proposed method improves performance on three benchmarks. |
Glancing Transformer for Non-Autoregressive Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing non-autoregressive neural machine translation methods are either inferior to Transformer or require multiple decoding passes, leading to reduced speedup. |
| Approach: | They propose a Glancing Language Model (GLM) for single-pass parallel generation models and Glancing Transformer (GLAT) with only single- pass decoding, GLAT is able to generate high-quality translation with 8-15 speedup. |
| Outcome: | The proposed model outperforms all previous non-autoregressive methods on multiple language directions and is nearly comparable to Transformer. |
Semantic Contribution-Aware Adaptive Retrieval for Black-Box Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-agmented generation fail to generalize effectively in black-box scenarios. |
| Approach: | They propose a framework that leverages the semantic importance of words to dynamically adjust retrieval thresholds and filter information. |
| Outcome: | The proposed framework achieves the highest score on four long-form, knowledge-intensive generation datasets. |
Rethinking the Video Sampling and Reasoning Strategies for Temporal Sentence Grounding (2022.findings-emnlp)
Copied to clipboard
Jiahao Zhu, Daizong Liu, Pan Zhou, Xing Di, Yu Cheng, Song Yang, Wenzheng Xu, Zichuan Xu, Yao Wan, Lichao Sun, Zeyu Xiong
| Challenge: | Existing methods for temporal sentence grounding ignore two crucial issues . 1) Boundary-bias: the video downsampling process may lose these two frames . 2) Reasoning-biases: such incorrect new boundary frames lead to the reasoning bias . |
| Approach: | They propose a siamese sampling mechanism to generate additional contextual frames . they use a reasoning strategy to learn the inter-relationship among these frames a . |
| Outcome: | Extensive experiments demonstrate the effectiveness of a new siamese sampling network on three challenging datasets. |
Teaching Language Models to Self-Improve through Interactive Demonstrations (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been shown to improve performance on downstream tasks by prompting them to analyze and revise their outputs. |
| Approach: | They propose a training algorithm that prompts large language models to analyze and revise their own outputs and uses this feedback to train the small model. |
| Outcome: | The proposed approach improves LLaMA-7B's performance on math and reasoning tasks by up to 7.13%. |
Joint Optimization of Training Data and Policy in RLHF (2026.findings-acl)
Copied to clipboard
Zhuohao Yu, Jiali Zeng, Weizheng Gu, Mengyuan Sun, Yidong Wang, Fandong Meng, Jie Zhou, Shikun Zhang, Wei Ye
| Challenge: | JODP optimizes policies on fixed training inputs, limiting the diversity of learning signals. |
| Approach: | They propose a framework where policy generates improved variants of training problems to enhance its own learning. |
| Outcome: | The proposed framework improves on safety alignment tasks by allowing 4B models to reach 8B model performance with less than 1% additional computational overhead. |
Controllable Mixed-Initiative Dialogue Generation through Prompting (2023.acl-short)
Copied to clipboard
| Challenge: | Mixed initiative dialogue systems allow all interacting agents to initiate actions to control the interaction. |
| Approach: | They propose to prompt large language models as a drop-in replacement for fine-tuning on conditional generation. |
| Outcome: | The proposed prompts improve fine-tuning and ground truth responses . the results show that generated responses are high . |
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing tools for augmented question-answering do not support researchers and developers to customize the training, testing, and deployment process. |
| Approach: | They propose an open-source toolkit that features a wide selection of model training algorithms, evaluation methods, and deployment tools curated from the latest research. |
| Outcome: | The proposed framework trains and deploys 7B-models with the same performance as OpenAI’s text-ada-002 and GPT-4-turbo. |
End-to-End Chinese Speaker Identification (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for speaker identification in texts are incomplete and introduce errors that propagate and seriously affect the final output. |
| Approach: | They propose to use speaker identification (SI) in texts to identify the speaker(s) for each utterance in texts. |
| Outcome: | The proposed model can achieve comparable or better than previous state-of-the-art methods on all public SI datasets for Chinese. |
Gunrock: A Social Bot for Complex and Engaging Long Conversations (D19-3)
Copied to clipboard
Dian Yu, Michelle Cohn, Yi Mang Yang, Chun Yen Chen, Weiming Wen, Jiaping Zhang, Mingyang Zhou, Kevin Jesse, Austin Chau, Antara Bhowmick, Shreenath Iyer, Giritheja Sreenivasulu, Sam Davidson, Ashwin Bhandare, Zhou Yu
| Challenge: | Gunrock is a speech-based social chatbot that can be used to understand complex sentences and have in-depth conversations. |
| Approach: | They propose a system that allows users to understand complex sentences and have in-depth conversations in open domains. |
| Outcome: | The proposed system produces longer sentences, which are directly related to user engagement (e.g., ratings, number of turns). |
LEPO: Latent Reasoning Policy Optimization for Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing latent reasoning methods that use chain of thought (CoT) are limited to selecting one discrete token at each reasoning step, which potentially induces information loss. |
| Approach: | They propose a framework that injects controllable stochasticity into latent reasoning via Gumbel-Softmax, restoring LLMs' exploratory capacity and enhancing their compatibility with Reinforcement Learning (RL). |
| Outcome: | The proposed framework preserves richer information for more comprehensive reasoning and is compatible with Reinforcement Learning (RL). |
Towards Robust Temporal Activity Localization Learning with Noisy Labels (2024.lrec-main)
Copied to clipboard
Daizong Liu, Xiaoye Qu, Xiang Fang, Jianfeng Dong, Pan Zhou, Guoshun Nan, Keke Tang, Wanlong Fang, Yu Cheng
| Challenge: | Existing methods for temporal activity localization are expensive and difficult to satisfy due to subjective labeling. |
| Approach: | They propose a new TAL setting where a TAL model should be robust to mixed training data with noisy moment boundaries. |
| Outcome: | The proposed method is significantly more robust to noisy training data than existing methods. |
ArrowGEV: Grounding Events in Video via Learning the Arrow of Time (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches for grounding events in videos are limited by their time-sensitive nature . arrow of time in physics characterizes intrinsic directionality of temporal processes . |
| Approach: | They propose a framework that explicitly models temporal directionality in events to improve event grounding and temporal understanding in VLMs. |
| Outcome: | The proposed framework improves event grounding and directionality understanding in VLMs. |
LOCR: Location-Guided Transformer for Optical Character Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Academic documents are packed with texts, equations, tables, and figures, posing challenges for accurate OCR results. |
| Approach: | They propose a model that integrates location guiding into the transformer architecture during autoregression. |
| Outcome: | The proposed model outperforms existing methods on an original large-scale dataset comprising 53M text-location pairs from 89K academic document pages. |
Simulating Classroom Education with LLM-Empowered Agents (2025.naacl-long)
Copied to clipboard
Zheyuan Zhang, Daniel Zhang-Li, Jifan Yu, Linlu Gong, Jinchang Zhou, Zhanxin Hao, Jianxiao Jiang, Jie Cao, Huiqin Liu, Zhiyuan Liu, Lei Hou, Juanzi Li
| Challenge: | Initial studies have focused on task-specific, independent LLM-empowered agents, but the potential of LLMs within a multi-agent collaborative framework for classroom simulation with real user participation remains unexplored. |
| Approach: | They propose a multi-agent classroom simulation teaching framework that recognizes representative class roles and introduces a novel class control mechanism for automatic classroom teaching. |
| Outcome: | The proposed framework can simulate dynamic learning environment for users with active teacher-student and student-studente interactions. |
TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization (2026.findings-acl)
Copied to clipboard
Shichao Ma, Zhiyuan Ma, Ming Yang, Xiaofan Li, Xing Wu, Jintao Du, Yu Cheng, Weiqiang Wang, Qiliang Liu, Zhengyang Zhou, Yang Wang
| Challenge: | Large Language Models (LLMs) can solve complex tasks through iterative information retrieval. |
| Approach: | They propose a turn-level stage-aware policy optimization approach to solve this problem . they introduce a first-occurrence latent reward mechanism to allocate partial rewards . |
| Outcome: | Experiments show that TSPO outperforms state-of-the-art models on Qwen2.5-3B and 7B models. |
Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for role-oriented dialogue summarization ignore information from other roles, resulting in omitted information. |
| Approach: | They propose a novel method that uses cross attention and decoder self-attention interactions to acquire other roles' critical information. |
| Outcome: | The proposed method significantly outperforms baselines on two public role-oriented dialogue summarization datasets. |
TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios (2025.findings-acl)
Copied to clipboard
Xiaokang Zhang, Sijia Luo, Bohan Zhang, Zeyao Ma, Jing Zhang, Yang Li, Guanlin Li, Zijun Yao, Kangli Xu, Jinchang Zhou, Daniel Zhang-Li, Jifan Yu, Shu Zhao, Juanzi Li, Jie Tang
| Challenge: | TableLLM is a robust large language model capable of handling tabular data manipulation tasks. |
| Approach: | They propose a distant supervision method for training which includes a reasoning process extension strategy and a cross-way validation strategy. |
| Outcome: | The proposed model has 8 billion parameters and is capable of handling tabular data tasks. |
Dunhuang-Bench: How Well Do MLLMs Understand Cultural Heritage? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Language Models (MLLMs) have led to extensive evaluations on Chinese cultural benchmarks. |
| Approach: | They construct a large-scale benchmark comprising 486 images and 22,970 QA pairs to evaluate MLLMs' cultural understanding. |
| Outcome: | The proposed benchmark incorporates three task formats to evaluate MLLMs’ cultural understanding: Question Answering with Text Description, Multi-turn Dialogue, and Question Answers with Choices. |
latent-GLAT: Glancing at Latent Variables for Parallel Text Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Recent advances in text generation have limited applications due to multimodality problem. |
| Approach: | They propose a method which uses latent variables to capture word categorical information and invoke an advanced curriculum learning technique to overcome multi-modality problem. |
| Outcome: | The proposed method outperforms strong baselines without an autoregressive model, which further broadens the application scenarios of the parallel decoding paradigm. |
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models (2025.findings-emnlp)
Copied to clipboard
Haibo Wang, Zhiyang Xu, Yu Cheng, Shizhe Diao, Yufan Zhou, Yixin Cao, Qifan Wang, Weifeng Ge, Lifu Huang
| Challenge: | Video Large Language Models (VLMs) have been praised for their performance in coarse-grained video understanding but still face ineffective temporal grounding and inadequate timestamp representations. |
| Approach: | They propose a novel Video-LLM that senses and reasoned over specific video moments with fine-grained temporal precision. |
| Outcome: | The proposed model surpasses existing models in fine-grained video understanding tasks and exhibits strong potential as a general video understanding assistant. |
Beyond User Self-Reported Likert Scale Ratings: A Comparison Model for Automatic Dialog Evaluation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing automatic dialog evaluation metrics are mostly reference-based . Existing models that measure self-reported user ratings are biased and variance among different users. |
| Approach: | They propose an automatic evaluation model that automatically cleans self-reported user ratings as it trains on them. |
| Outcome: | The proposed model achieves 89.2% accuracy in the dialog comparison task. |
RCBSF: A Multi-Agent Framework for Automated Contract Revision via Stackelberg Game (2026.findings-acl)
Copied to clipboard
| Challenge: | despite the adoption of Large Language Models (LLMs), contract revision remains impeded because generic models treat strict legal constraints as mere suggestions. |
| Approach: | They propose a risk-constrained bilevel Stackelberg framework that models high-stakes revision as a strategic interaction rather than an open-ended conversation. |
| Outcome: | The proposed framework achieves state-of-the-art performance with an average RRR of 84.21% and enhanced token efficiency. |
Born a BabyNet with Hierarchical Parental Supervision for End-to-End Text Image Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing research on text image machine translation (TIMT) is divided into two types: Cascade methods combine text image recognition and MT models to recognize source language text images. |
| Approach: | They propose a method which is optimized with hierarchical parental supervision to improve translation performance. |
| Outcome: | The proposed method significantly outperforms existing methods on synthetic and real-world tests on both synthetic and realistic images. |
RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World Scenarios (2025.acl-long)
Copied to clipboard
| Challenge: | RuleArena assesses the ability of large language models (LLMs) to follow complex, real-world rules in reasoning. |
| Approach: | They propose a benchmark to evaluate the ability of large language models (LLMs) to follow complex, real-world rules in reasoning. |
| Outcome: | The proposed benchmark covers airline baggage fees, NBA transactions, and tax regulations. |
GA-S3: Comprehensive Social Network Simulation with Group Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing social network simulations focus on discrete events or system dynamics instead of elucidating underlying mechanisms or causal relationships. |
| Approach: | They propose a Social network simulation system that leverages newly designed Group Agents to make intelligent decisions regarding various online events. |
| Outcome: | The proposed system can make intelligent decisions regarding online events at a manageable cost. |
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges. |
| Approach: | They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages. |
| Outcome: | The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages. |
Enhancing Automatic Readability Assessment with Pre-training and Soft Labels for Ordinal Regression (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models do not exploit ordinal nature of difficulty grades and make little effort for initialization to facilitate fine-tuning. |
| Approach: | They propose a readability assessment task that assigns a difficulty grade to a text . they use ordinal regression and pairwise relative text difficulty to train the model . |
| Outcome: | The proposed model outperforms competitive neural models and statistical classifiers on most datasets. |
Pay More Attention to Images: Numerous Images-Oriented Multimodal Summarization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing multimodal summarization approaches struggle with scenarios involving multiple images as input. |
| Approach: | They propose a task to generate multimodal summaries by integrating multiple images as input . they propose 'multimodal information evaluation' method that measures differences between generated summary and input based on multimodal input - and compares various methods . |
| Outcome: | The proposed method correlates more closely with human judgments than five widely used metrics . |
SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on the text modality or are limited to specific tasks. |
| Approach: | They propose a framework to teach Large Vision-Language Models to selectively utilize retrieved information and improve their robustness against irrelevant or misleading references. |
| Outcome: | The proposed framework improves LVLMs’ ability to utilize retrieved multimodal references and their robustness against irrelevant or misleading information. |
Dense Retrievers Can Fail on Simple Queries: Revealing The Granularity Dilemma of Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a limited number of text encoders are able to recognize fine-grained entities or events within encoded semantics. |
| Approach: | They propose a new evaluation dataset to examine embeddings' ability to recognize fine-grained entities or events within encoded semantics. |
| Outcome: | The proposed dataset shows embeddings struggle with fine-grained matching . the proposed encoder outperforms the state-of-the-art 7B model in a small sample . |
Bringing Pedagogy into Focus: Evaluating Virtual Teaching Assistants’ Question-Answering in Asynchronous Learning Environments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing assessments rely on surface-level metrics and lack sufficient grounding in educational theory . a new framework is proposed to evaluate VTAs in asynchronous learning environments . |
| Approach: | They propose a pedagogically-oriented evaluation framework tailored to asynchronous forum discussions . they construct classifiers using expert annotations of VTA responses on a diverse set of forum posts . |
| Outcome: | The proposed evaluation framework is rooted in learning sciences and tailored to asynchronous forum discussions. |
The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identity (2021.acl-long)
Copied to clipboard
| Challenge: | We analyze 2,500 phrasings related to the intent of “Are you a robot?” and 2,500 adversarially selected utterances to determine whether systems are non-human. |
| Approach: | They analyze 2,500 phrasings related to the intent of "Are you a robot?" and 2,500 adversarially selected utterances to determine whether systems are non-human. |
| Outcome: | The proposed model and two systems fail to confirm non-human intent, and the proposed model is complex. |
Data Annealing for Informal Language Understanding Tasks (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that improve formal and informal language understanding tasks do not transfer to informal data directly. |
| Approach: | They propose a data annealing transfer learning procedure to bridge the performance gap on informal natural language understanding tasks. |
| Outcome: | The proposed procedure outperforms state-of-the-art models on three common tasks. |
AI, Take the Wheel: What Drives Delegation and Trust in Human–Computer Cooperative Question Answering? (2026.findings-acl)
Copied to clipboard
Maharshi Gor, Yoo Yeon Sung, Yu Hou, Eve Fleisig, Zhu Irene Ying, Tianyi Zhou, Jordan Lee Boyd-Graber
| Challenge: | Human-AI collaboration is already happening, both in proactive delegation and deliberative adoption settings. |
| Approach: | They study delegating a task to AI without seeing its output and evaluating AI suggestions to decide whether to adopt them how AI output shapes final decisions. |
| Outcome: | The proposed game pairs 23 experts with 16 AI agents, capturing 387 delegation and 1440 adoption decisions. |
Focus! Relevant and Sufficient Context Selection for News Image Captioning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work only coarsely leverages the article to extract the necessary context, which makes it difficult for models to identify relevant events and named entities. |
| Approach: | They propose to use a vision and language retrieval model CLIP to localize the visually grounded entities in the news article and then capture the non-visual entities via an open relation extraction model. |
| Outcome: | The proposed model significantly improves on existing models and achieves state-of-the-art on multiple benchmarks. |
Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language (C18-1)
Copied to clipboard
| Challenge: | a study aims to develop a language transferring system to avoid the trouble of acquiring and labeling a new big SLU corpus . general-purpose translators cannot handle the lot of semantic labels, not to mention cultural differences . a RL-based language transfer method can be used to adapt the adapted translator to a target language . |
| Approach: | They propose to use reinforcement learning to adapt a spoken language understanding model to a target language. |
| Outcome: | The proposed language transferring method improves domain classification accuracy by 22% compared with naive translation . the proposed language transfer method can be used on Chinese to English translators with more proper slot tags . |
LLMs as Collaborator: Demands-Guided Collaborative Retrieval-Augmented Generation for Commonsense Knowledge-Grounded Open-Domain Dialogue Systems (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to capture the unique knowledge demands of LLMs are unsatisfactory because of their overestimation and lack of knowledge. |
| Approach: | They propose a novel approach to capture the unique knowledge demands for each dialogue context using CoT and RAG methods. |
| Outcome: | The proposed model can capture the unique knowledge demands for each dialogue context and bring higher-quality responses. |
ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Mining (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to model resume-job fit are sparse since job seekers apply to only a few jobs. |
| Approach: | They propose two techniques to enhance the encoder’s contrastive training process by augmenting job data with hypothetical reference resume generated by a large language model and creating high-quality hard negatives from unlabeled resume/job pairs using a novel hard-negative mining strategy. |
| Outcome: | The proposed method outperforms ConFit and prior methods on two real-world datasets and achieves an average improvement of 13.8% in recall and 17.5% in nDCG across job-ranking and resume-ranker tasks. |
GUI Agents: A Survey (2025.findings-acl)
Copied to clipboard
Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Dac Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt
| Challenge: | Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life. |
| Approach: | They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities. |
| Outcome: | The proposed framework delineates their perception, reasoning, planning, and acting capabilities. |
Building Persona Consistent Dialogue Agents with Offline Reinforcement Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve persona consistency are centered around supervised learning or online reinforcement learning (RL). Existing approaches to improve consistency are expensive and require additional training. |
| Approach: | They propose an offline supervised learning framework to improve persona consistency of dialogue systems by punishing and rewarding specific utterances. |
| Outcome: | The proposed framework improves both the persona consistency and dialogue quality of a state-of-the-art social chatbot. |
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)
Copied to clipboard
Yang Yuguang, Yu Pan, Jixun Yao, Xiang Zhang, Jianhao Ye, Hongbin Zhou, Lei Xie, Lei Ma, Jianjun Zhao
| Challenge: | Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech . |
| Approach: | They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling. |
| Outcome: | The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness. |
Uncertainty-Aware Curriculum Learning for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has proven to be facilitated by curriculum learning which presents examples in an easy-to-hard order at different training stages. |
| Approach: | They propose to use an uncertainty-aware curriculum learning approach to assess data difficulty and model competence to provide examples in an easy-to-hard order at different training stages. |
| Outcome: | The proposed approach outperforms baseline and related methods on translation quality and convergence speed. |
From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing research on PTQ spans three primary directions. |
| Approach: | They conduct a systematic analysis of post-training quantization failures using PTQ . they show that targeted repair can mitigate Signal Degradation but remains ineffective for Computation Collapse . |
| Outcome: | The proposed method mitigates Signal Degradation but remains ineffective for Computation Collapse. |
CharacterGLM: Customizing Social Characters with Large Language Models (2024.emnlp-industry)
Copied to clipboard
Jinfeng Zhou, Zhuang Chen, Dazhen Wan, Bosi Wen, Yi Song, Jifan Yu, Yongkang Huang, Pei Ke, Guanqun Bi, Libiao Peng, JiaMing Yang, Xiyao Xiao, Sahand Sabour, Xiaohan Zhang, Wenjing Hou, Yijia Zhang, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang
| Challenge: | Character-based dialogue systems (CharacterDial) allow users to customize social characters for social interactions. |
| Approach: | They will collect a large-scale Chinese corpus of characters with diverse categories and behaviors and develop CharacterGLM models to address these challenges. |
| Outcome: | Experiments show that CharacterGLM outperforms most popular open- and closed-source LLMs and performs comparable to GPT-4. |
Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation still face problems with low context utilization and frequent hallucinations. |
| Approach: | They propose a framework that reformulates retrieval and generation as constrained optimization and path planning. |
| Outcome: | The proposed framework significantly improves reasoning accuracy on complex queries while reducing hallucinations. |
Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing scaling laws focus on general performance, overlooking crucial fine-grained factors and how quantization differentially impacts diverse knowledge capabilities. |
| Approach: | They propose a framework that unifies model size, bit-width, and fine-grained factors into memorization, application, and reasoning. |
| Outcome: | The proposed framework shows strong fit and cross-architecture consistency on 293 different PTQ configurations. |
HoWToBench: Holistic Evaluation for LLM’s Capability in Human-level Writing using Tree of Writing (2026.acl-long)
Copied to clipboard
Andrew Zhuoer Feng, Cunxiang Wang, Yu Luo, Lin Fan, Irene Zhou, Zikang Wang, Xiaotao Gu, Jie Tang, Hongning Wang, Minlie Huang
| Challenge: | Evaluating the writing capabilities of large language models remains a significant challenge due to the multidimensional nature of writing skills and the limitations of existing metrics. |
| Approach: | They propose to model the aggregation weights of sub-features in a tree-structured workflow and propose a Chinese writing benchmark that mitigates biases. |
| Outcome: | The proposed tree-of-writing (ToW) measures the writing capabilities of large language models (LLMs) in Chinese and shows that it mitigates biases and achieves a *0.93* Pearson correlation with human judgments. |
SAS: Dialogue State Tracking via Slot Attention and Slot Information Sharing (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models with excessive information are inefficient and costly . |
| Approach: | They propose to integrate a Dialogue State Tracker with Slot Attention and Slot Information Sharing to reduce redundant information’s interference and improve long dialogue context tracking. |
| Outcome: | The proposed model significantly outperforms existing models on the MultiWOZ dataset. |
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures inside Arguments (2022.coling-1)
Copied to clipboard
| Challenge: | Recent works of SRL mainly fall into two lines: 1) BIO-based; 2) span-based. |
| Approach: | They propose to regard flat argument spans as latent subtrees, thus reducing SRL to a tree parsing task. |
| Outcome: | The proposed model performs better than previous syntax-agnostic models on CoNLL05 and CoNll12 benchmarks. |
FormGym: Doing Paperwork with Agents (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing studies focus on parsing, extraction and web form interaction, rather than end-to-end completion of document-style forms. |
| Approach: | They propose a benchmark formulation of the end-to-end form filling task that evaluates form completion and accuracy. |
| Outcome: | The proposed task is based on three existing datasets and adds one new dataset to achieve more challenging, diverse, and realistic test cases. |
Is LLM a Reliable Reviewer? A Comprehensive Evaluation of LLM on Automatic Paper Reviewing Tasks (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing datasets and methods targeting review-related tasks have not thoroughly inspected model's review ability. |
| Approach: | They propose to evaluate GPT-3.5 and GPT-4 on two types of tasks under different settings: the score prediction task and the review generation task. |
| Outcome: | The proposed model can give passable decisions (> 60% accuracy) on single options, but it always makes mistakes. |
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing (2022.acl-long)
Copied to clipboard
Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
| Challenge: | Existing work shows that pre-trained models can improve in various natural language processing tasks. |
| Approach: | They propose a unified-modal encoder-decoder framework that pre-trains speech-text representations using large-scale unlabeled speech and text data. |
| Outcome: | The proposed framework is superior to existing models on speech-to-text processing tasks. |
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification (2025.acl-long)
Copied to clipboard
| Challenge: | MM-Verifier and MM Reasoner are a powerful multimodal reasoning model . large language models (LLMs) have demonstrated exceptional performance across tasks spanning myriad domains. |
| Approach: | They propose a method which combines tree search and verification to generate high-quality chain-of-thought data. |
| Outcome: | The proposed method outperforms all larger models on the MathCheck, MathVista, and MathVerse benchmarks. |
Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing dialog system models require extensive human annotations and are difficult to generalize to different tasks. |
| Approach: | They propose a framework that uses pre-trained language to model each speaker separately . it can be generalized to more challenging, non-collaborative tasks such as persuasion . |
| Outcome: | The proposed framework outperforms or is on par with state-of-the-art methods on two popular datasets: CamRest676 and MultiWOZ. |
POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion (2025.emnlp-main)
Copied to clipboard
Yuan Liu, Zhongyin Zhao, Le Tian, Haicheng Wang, Xubing Ye, Yangxiu You, Zilin Yu, Chuhan Wu, Zhou Xiao, Yang Yu, Jie Zhou
| Challenge: | Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications. |
| Approach: | They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts. |
| Outcome: | The proposed model outperforms existing models and improves on annotated documents. |
UTC-IE: A Unified Token-pair Classification Architecture for Information Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Information Extraction (IE) tasks have been solved with different models because of their output structures. |
| Approach: | They propose a Unified Token-pair Classification architecture for Information Extraction that introduces Plusformer on top of the token-pear feature matrix. |
| Outcome: | The proposed approach outperforms task-specific and unified models on all tasks in 10 datasets and achieves better results on 2 joint IE datasets. |
From Chaotic OCR Words to Coherent Document: A Fine-to-Coarse Zoom-Out Network for Complex-Layout Document Image Translation (2025.coling-main)
Copied to clipboard
| Challenge: | Document Image Translation (DIT) aims to translate documents in images from one language to another. |
| Approach: | They propose a novel end-to-end network called Zoom-out DIT to improve document translation by combining word positioning, sentence recognition and document organization. |
| Outcome: | The proposed network improves word positioning, sentence recognition and document organization, and improves translation quality. |
Enhancing Reasoning Capabilities by Instruction Learning and Chain-of-Thoughts for Implicit Discourse Relation Recognition (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for implicit discourse relation recognition are based on generative models, but some studies suggest they do not perform as well as generic encoder-only models for NLU tasks. |
| Approach: | They propose a classification method that is solely based on generative models and utilize Chain-of-Thoughts to partition the inference process into a sequence of three successive stages. |
| Outcome: | The proposed model outperforms existing models on a natural language understanding task. |
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL (2022.emnlp-main)
Copied to clipboard
Jiexing Qi, Jingyao Tang, Ziwei He, Xiangpeng Wan, Yu Cheng, Chenghu Zhou, Xinbing Wang, Quanshi Zhang, Zhouhan Lin
| Challenge: | Experimental results show RASAT can leverage a variety of relational structures while inheriting the pretrained parameters from the T5 model. |
| Approach: | They propose a Transformer seq2seq architecture augmented with relation-aware self-attention that leverages relational structures while inheriting pretrained parameters from the T5 model. |
| Outcome: | The proposed model can leverage relational structures while inheriting pretrained parameters from the T5 model effectively. |
SEAL: Structure and Element Aware Learning Improves Long Structured Document Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for document retrieval use contrastive learning on datasets lacking explicit structural information. |
| Approach: | They propose a contrastive learning framework that preserves semantic hierarchies and masked element alignment for fine-grained semantic discrimination. |
| Outcome: | The proposed framework preserves semantic hierarchies and masked element alignment for fine-grained semantic discrimination. |
CopyNE: Better Contextual ASR by Copying Named Entities (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to transcribe contextual named entities (NEs) treat entities as tokens and generate them token-by-token, which may result in incomplete transcriptions of entities. |
| Approach: | They propose a mechanism that can copy entities from the NE dictionary and reduce errors during entity transcription. |
| Outcome: | The proposed mechanism can copy entities from the NE dictionary, reducing errors during entity transcription, ensuring the completeness of the entity. |
A Survey of Large Language Model-Based Search Agents (2026.acl-long)
Copied to clipboard
Yunjia Xi, Jianghao Lin, Yongzhao Xiao, Zheli Zhou, Rong Shan, Te Gao, Jiachen Zhu, Weiwen Liu, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have revolutionized web search, but their integration is static and cannot handle complex contexts. |
| Approach: | They analyze existing research and analyze existing work from the perspectives of architecture, optimization, application, and evaluation. |
| Outcome: | The proposed models can comprehend user intentions and context and execute multi-turn retrieval with dynamic planning, extending search capabilities far beyond the web. |
Order Matters: Investigate the Position Bias in Multi-constraint Instruction Following (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models struggle to follow multi-constraint instructions in real-world applications. |
| Approach: | They propose to quantify the difficulty distribution of constraints by a novel Difficulty Distribution Index (CDDI) they find that LLMs are more performant when presented with constraints in a “hard-to-easy” order. |
| Outcome: | The proposed model is more performant when presented with constraints in a “hard-to-easy” order, compared with existing models with different architectures and sizes of parameters. |
Phrase-level Textual Adversarial Attack with Label Preservation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing adversarial attacks are usually realized through word-level or sentence-level perturbations, which either limit the perturbation space or sacrifice fluency and textual quality. |
| Approach: | They propose a phrase-level perturbation-based adversarial ATtack that generates adversarials through phrase- level perturbations. |
| Outcome: | The proposed approach improves the performance of natural language processing models by reducing the need for word-level perturbations and preserving the fluency and grammaticality of the samples. |
Continual Learning in Task-Oriented Dialogue Systems (2021.emnlp-main)
Copied to clipboard
Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Pascale Fung, Zhiguang Wang
| Challenge: | Existing continuous learning systems are not designed to add new domains and functionalities through time without incurring the high cost of retraining the whole system. |
| Approach: | They propose a first-ever continual learning benchmark for task-oriented dialogue systems . they propose 'architecture' method based on residual adapters to implement continual training . |
| Outcome: | The proposed architectural method performs better than multitask learning while being 20X faster in learning new domains. |
Plot Retrieval as an Assessment of Abstract Semantic Association (2024.acl-srw)
Copied to clipboard
| Challenge: | Existing information retrieval datasets cannot capture abstract semantic associations well. |
| Approach: | They propose a task that retrieves relevant plots from the book for a query using a labeled dataset. |
| Outcome: | The proposed task can be used to evaluate the performance of IR models on the novel task Plot Retrieval. |
Token-level Adaptive Training for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing token imbalance phenomenon in natural language as different tokens appear with different frequencies, which leads to different learning difficulties for tokens in Neural machine translation (NMT). |
| Approach: | They propose to assign tokens with different frequencies to target tokens during training to encourage the model to pay more attention to low-frequency tokens. |
| Outcome: | The proposed model yields consistent improvements on ZH-EN, EN-RO, and EN-DE translation tasks, especially on sentences that contain more low-frequency tokens. |
Rectifying the Emotional Flow: Aligning Priors and Dynamic Guidance for High-Arousal Text-to-Speech (2026.acl-long)
Copied to clipboard
| Challenge: | Existing systems suffer from linguistic collapse when pursuing high intensity or fail to meet target emotional levels. |
| Approach: | They propose an inference framework that introduces a neutral prosody bias and a uniform Classifier-Free Guidance that distorts the acoustic manifold, leading to artifacts. |
| Outcome: | The proposed framework achieves superior linguistic accuracy and expressiveness without model retraining. |
Parallel Structures in Pre-training Data Yield In-Context Learning (2024.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (LMs) are capable of in-context learning (ICL) however, it is unclear where this ability comes from as there is a stark distribution shift between pre-training text and ICL prompts. |
| Approach: | They find that pre-trained language models are capable of in-context learning (ICL) they detect parallel structures in the pre-training data and conduct ablation experiments to study their effect on ICL. |
| Outcome: | The proposed model can adapt to a task with a few examples given in the prompt without any parameter update. |
A Fairness-Driven Method for Learning Human-Compatible Negotiation Strategies (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in AI and NLP have led researchers to develop techniques to build autonomous agents which can achieve human-level performance in bargaining games such as Deal-orno-Deal. |
| Approach: | They propose a negotiation framework which incorporates fairness into reward design and search to learn human-compatible negotiation strategies. |
| Outcome: | The proposed framework achieves more egalitarian negotiation outcomes and improves negotiation quality. |
Unsupervised Dialog Structure Learning (N19-1)
Copied to clipboard
| Challenge: | Current dialog systems require human experts to design the dialog structure, which is time consuming and sometimes insufficient to satisfy various customer needs. |
| Approach: | They propose to extract dialog structure using a modified VRNN model with discrete latent vectors. |
| Outcome: | The proposed model outperforms existing models on the ability to predict unseen data and is faster and more effective in a reinforcement learning setting. |
Robust Singing Voice Transcription Serves Synthesis (2024.acl-long)
Copied to clipboard
| Challenge: | Current AST methods struggle with accuracy and robustness when used for practical annotation. |
| Approach: | They propose a model that converts singing recordings into note sequences for automatic annotation of singing datasets. |
| Outcome: | The proposed model outperforms baseline models on enlarged, automatically annotated datasets. |
Interactively-Propagative Attention Learning for Implicit Discourse Relation Recognition (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for discourse relation recognition use self-attention and interactive-attention mechanisms. |
| Approach: | They develop a propagative attention learning model using a cross-coupled two-channel network. |
| Outcome: | The proposed model improves on the baseline models on a Penn Discourse Treebank. |
Nirvana: A Specialized Generalist Model With Task-Aware Memory Mechanism (2026.acl-long)
Copied to clipboard
Yuhua Jiang, Shuang Cheng, Yihao Liu, Ermo Hua, Che Jiang, Weigao Sun, Yu Cheng, Feifei Gao, Biqing Qi, Bowen Zhou
| Challenge: | Existing models lack task-guided specialized memory mechanisms . specialized generalist models excel at general language tasks but struggle in specialized domains. |
| Approach: | They propose a specialized generalist model with specialized memory and updater that can optimize for specialized domains. |
| Outcome: | The proposed model matches or surpasses baselines on general benchmarks and achieves lowest perplexity across specialized domains. |
Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Zelin Tan, Hejia Geng, Xiaohang Yu, Mulei Zhang, Guancheng Wan, Yifan Zhou, Qiang He, Xiangyuan Xue, Heng Zhou, Yutao Fan, Zhong-Zhi Li, Zaibin Zhang, Guibin Zhang, Chen Zhang, Zhenfei Yin, Philip Torr, Lei Bai
| Challenge: | elucidating scaling laws for large language models (LLMs) during pre-training remains unexplored. |
| Approach: | They characterize how model scale, data, and compute interact during pre-training . they find that large models consistently demonstrate superior compute and data efficiency . |
| Outcome: | The proposed scaling laws offer practical guidance for scaling reasoning capabilities through reinforcement learning post-training. |
ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution (2024.findings-acl)
Copied to clipboard
| Challenge: | Lexical Substitution fails to consider substitutes of equal or higher proficiency than the target word. |
| Approach: | They propose a task to find appropriate substitutes for a given word in a context sentence but not those that are of equal or higher proficiency than the target. |
| Outcome: | The proposed model outperforms ChatGPT by an average of 3.2% in F-score and achieves comparable results with GPT-4 on ProLex. |
Let the Comments Speak: A Multi-Agent Framework based on Large Language Model for Comment-Guided Code Refactoring (2026.findings-acl)
Copied to clipboard
| Challenge: | Current Large Language Models focus on syntax and ignore the vital semantic signals in code comments. |
| Approach: | They propose a Multi-Agent framework for COmment-guided code Refactoring that populates original code with precise comments to provide necessary semantic guidance for subsequent refactoring. |
| Outcome: | The proposed framework significantly improves code quality and achieves higher developer acceptance compared to baselines. |
LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Models (2025.acl-long)
Copied to clipboard
Zihan Zhou, Chong Li, Xinyi Chen, Shuo Wang, Yu Chao, Zhili Li, Haoyu Wang, Qi Shi, Zhixing Tan, Xu Han, Xiaodong Shi, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing studies have focused on extending the context length of large language models (LLMs) due to their quadratic computational complexity and a lack of high-quality long training examples, most LLMs are trained with a limited window size. |
| Approach: | They propose a training-free framework that enables large language models to effectively process long texts using a divide-and-conquer strategy for comprehensive document understanding. |
| Outcome: | The proposed framework outperforms open-source and commercial long-context LLMs and is compatible with several models. |
Non-Sequential Graph Script Induction via Multimedia Grounding (2023.acl-long)
Copied to clipboard
| Challenge: | Existing scripts for everyday tasks are presented in a linear manner, which does not reflect the flexibility displayed by people executing tasks in real life. |
| Approach: | They propose to use loosely aligned videos to train a non-sequential graph script induction task by using a multimodal framework to ground procedural videos to WikiHow textual steps. |
| Outcome: | The proposed model outperforms the WikiHow linear baseline by 48.76% . it can predict future steps given a partial step sequence and generate explicit graph scripts . |
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)
Copied to clipboard
Yuhang Zhou, Yuchen Ni, Zhiheng Xi, Zhangyue Yin, Yu He, Gan Yunhui, Xiang Liu, Zhang Jian, Sen Liu, Xipeng Qiu, Yixin Cao, Guangnan Ye, Hongfeng Chai
| Challenge: | Existing studies on biases within specific domains, such as finance, remain limited. |
| Approach: | They propose a framework to detect, detect, analyze and mitigate financial biases in large language models. |
| Outcome: | The proposed framework reduces bias by 68% for the most biased model, according to key metrics. |
Situated Embedding Models for Context-Aware Dense Retrieval (2026.acl-short)
Copied to clipboard
| Challenge: | Existing embedding models are not well-equipped to encode situated context effectively, i.e., situating a chunk’s meaning within its context. |
| Approach: | They propose to represent short chunks in a way that is conditioned on a broader context window to enhance retrieval performance. |
| Outcome: | The proposed model outperforms state-of-the-art embedding models on a book-plot retrieval dataset. |
Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning general-purpose audio representations are limited in scope and coverage of audio attributes. |
| Approach: | They propose to use a 10.7M caption dataset to compare ALP with captioning . they find that contrastive learning yields competitive, transferable representations . |
| Outcome: | The proposed model yields competitive, transferable representations, while captioning exhibits better scalability. |
R3-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL (2024.findings-emnlp)
Copied to clipboard
Yuhang Zhou, Yu He, Siyu Tian, Yuchen Ni, Zhangyue Yin, Xiang Liu, Chuanjun Ji, Sen Liu, Xipeng Qiu, Guangnan Ye, Hongfeng Chai
| Challenge: | Adapting existing approaches for converting natural language to SQL encounters hurdles due to distinct nature of GQL compared to SQL. |
| Approach: | They propose a method that integrates both small and large Foundation Models for ranking, rewriting, and refining tasks. |
| Outcome: | The proposed approach integrates both small and large Foundation Models for ranking, rewriting, and refining tasks while capitalizing on the superior generalization and query generation prowess of larger models for the final transformation of natural language queries into GQL formats. |
More Than Sum of Its Parts: Deciphering Intent Shifts in Multimodal Hate Speech Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing systems struggle with multimodal content where the emergent meaning transcends the aggregation of individual modalities. |
| Approach: | They propose a framework to characterize semantic intent shifts where modalities interact to construct implicit hate from benign cues or neutralize toxicity through semantic inversion. |
| Outcome: | The proposed framework outperforms state-of-the-art benchmarks on H-VLI and on established benchmarks. |
On the Relation between Sensitivity and Accuracy in In-Context Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning (ICL) suffers from oversensitivity to the prompt, making it unreliable in real-world scenarios. |
| Approach: | They propose a few-shot selective prediction method that abstains from sensitive predictions. |
| Outcome: | The proposed method outperforms confidence-based and entropy-based methods on ten classification datasets. |
VenusFactory: An Integrated System for Protein Engineering with Data Retrieval and Language Model Fine-Tuning (2025.acl-demo)
Copied to clipboard
Yang Tan, Chen Liu, Jingyuan Gao, Wu Banghao, Mingchen Li, Ruilin Wang, Lingrong Zhang, Huiqun Yu, Guisheng Fan, Liang Hong, Bingxin Zhou
| Challenge: | Pre-trained protein language models have been used in protein engineering, but their adoption is limited due to data collection, task benchmarking, and application challenges. |
| Approach: | They propose a versatile engine that integrates biological data retrieval, standardized task benchmarking, and modular fine-tuning of PLMs. |
| Outcome: | The proposed engine integrates biological data retrieval, task benchmarking, and modular fine-tuning of PLMs. |
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs (2026.findings-acl)
Copied to clipboard
Jie Sun, Yu Liu, Lu Han, Qiwen Deng, Xiang Shu, Yang Xiao, Lintao Ma, Xingyu Lu, Jun Zhou, Pengfei Liu, Jiancan Wu, Xiang Wang
| Challenge: | Existing large-scale large-context models suffer from performance degradation when processing long numerical sequences. |
| Approach: | They propose a framework to mitigate attention dispersion by strategically inserting separator tokens into the model to recalibrat attention to local segments while preserving global context. |
| Outcome: | The proposed framework improves accuracy and reduces inference token consumption by 16.4% on 9 widely-adopted LLMs. |
CogCompNLP: Your Swiss Army Knife for NLP (L18-1)
Copied to clipboard
Daniel Khashabi, Mark Sammons, Ben Zhou, Tom Redman, Christos Christodoulopoulos, Vivek Srikumar, Nicholas Rizzolo, Lev Ratinov, Guanheng Luo, Quang Do, Chen-Tse Tsai, Subhro Roy, Stephen Mayhew, Zhili Feng, John Wieting, Xiaodong Yu, Yangqiu Song, Shashank Gupta, Shyam Upadhyay, Naveen Arivazhagan, Qiang Ning, Shaoshi Ling, Dan Roth
| Challenge: | a corpus-reader module supports popular corpora, feature extraction and annotation modules for semantic and syntactic tasks. |
| Approach: | They propose a library that provides modules to address different challenges . they provide a corpus-reader module that supports popular corpora in the NLP community . |
| Outcome: | The proposed library simplifies the process of design and development of NLP applications by providing modules to address different challenges. |
Safety Alignment via Constrained Knowledge Unlearning (2025.acl-long)
Copied to clipboard
Zesheng Shi, Yucheng Zhou, Jing Li, Yuxin Jin, Yu Li, Daojing He, Fangming Liu, Saleh Alharbi, Jun Yu, Min Zhang
| Challenge: | Existing defense mechanisms have not fully deleted harmful knowledge in large language models (LLMs) Existing methods to address safety alignment have not completely deleted harmful information in LLMs. |
| Approach: | They propose a safety alignment strategy that uses scoring neurons to identify useful knowledge in LLMs and pruning the gradients of neurons in U to preserve beneficial information. |
| Outcome: | The proposed method significantly improves model safety while maintaining utility compared to existing methods. |
MSMO: Multimodal Summarization with Multimodal Output (D18-1)
Copied to clipboard
| Challenge: | Existing studies show that multimodal summarization can improve user satisfaction for informativeness of summaries by using information in visual modality. |
| Approach: | They propose a task to generate text and select the most relevant image from the multimodal input and a novel multimodal automatic evaluation method to evaluate multimodal outputs. |
| Outcome: | The proposed method improves user satisfaction by 12.4% compared to the current system . |
VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent benchmarks release only training and validation sets, keeping the test set labels closed-source. |
| Approach: | They propose to extract variables from each test case and define a value range for each variable. |
| Outcome: | The proposed method improves the accuracy of the evaluations on four datasets covering mathematical generation and multiple-choice tasks. |
Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models (2023.emnlp-main)
Copied to clipboard
Yifan Hou, Jiaoda Li, Yu Fei, Alessandro Stolfo, Wangchunshu Zhou, Guangtao Zeng, Antoine Bosselut, Mrinmaya Sachan
| Challenge: | Recent work has shown that language models (LMs) have strong multi-step (i.e., procedural) reasoning capabilities. |
| Approach: | They propose a mechanistic interpretation of language models for multi-step reasoning tasks by introducing a new probing approach that recovers the reasoning tree from the model’s attention patterns. |
| Outcome: | The proposed model implicitly embeds a reasoning tree resembling the correct reasoning process within it, and detects the information from the model’s attention patterns for most examples. |
TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text style transfer rely on few-shot capabilities of large language models or complex controllable text generation approaches that are inefficient and underperform on fluency metrics. |
| Approach: | They propose a lightweight but effective approach which leverages a small language model and pre-trained authorship embeddings to perform efficient, few-shot text style transfer. |
| Outcome: | The proposed method outperforms strong approaches such as GPT-4 and performs form attribute style transfer with automatic and human evaluations. |
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)
Copied to clipboard
Jiawei Zhou, Xiaoguang Li, Lifeng Shang, Lan Luo, Ke Zhan, Enrui Hu, Xinyu Zhang, Hao Jiang, Zhao Cao, Fan Yu, Xin Jiang, Qun Liu, Lei Chen
| Challenge: | Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance. |
| Approach: | They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents. |
| Outcome: | The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain. |
Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Distant Supervision (DS) generates large-scale annotated data but has wrong labels that result in incorrect evaluation scores during testing. |
| Approach: | They build a dataset using DS-generated data as training data and hire annotators to label test data. |
| Outcome: | The proposed dataset NYTH has a much larger test set and performs more accurate and consistent evaluation. |
Chinese Spoken Named Entity Recognition in Real-world Scenarios: Dataset and Approaches (2024.findings-acl)
Copied to clipboard
| Challenge: | Current Chinese Spoken NER datasets are laboratory-controlled and are limited in topics. |
| Approach: | They propose to use Chinese Spoken NER datasets to extract entities from speech to help voice assistants better grasp the intent behind user's questions and instructions. |
| Outcome: | The proposed methods improve on self-training-asr and mapping then distilling, and even compared with GPT4.0, they achieve better results. |
Diverse Few-Shot Text Classification with Multiple Metrics (N18-1)
Copied to clipboard
Mo Yu, Xiaoxiao Guo, Jinfeng Yi, Shiyu Chang, Saloni Potdar, Yu Cheng, Gerald Tesauro, Haoyu Wang, Bowen Zhou
| Challenge: | Existing methods for few-shot learning are insufficient to capture task variations in natural language domains. |
| Approach: | They propose an adaptive metric learning approach that automatically determines the best weighted combination from a set of metrics obtained from meta-training tasks for a newly seen few-shot task. |
| Outcome: | The proposed method performs favorably against state-of-the-art few shot learning algorithms on real-world sentiment analysis and dialog intent classification datasets. |
Dependency Parsing for Spoken Dialog Systems (D19-1)
Copied to clipboard
| Challenge: | Dependency parsing of conversational input can help to understand dialogs . currently available annotation schemes do not adapt well to spoken human-machine dialogs. |
| Approach: | They propose an annotation scheme that extends Universal Dependencies guidelines to spoken dialogs. |
| Outcome: | The proposed scheme disambiguates relationships between entities extracted from dialogs . it is better than existing models on public datasets and fine-tuned on ConvBank data . |
Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech (2023.findings-acl)
Copied to clipboard
| Challenge: | Expressive text-to-speech aims to generate high-quality samples with rich prosody . prosodic attributes in highly dynamic voices are difficult to capture and model without intonation . |
| Approach: | They propose a pipeline that enhances prosody modeling and sampling by introducing a self-supervised masked autoencoder and a diffusion model to sample diverse prosodic patterns within the latent space. |
| Outcome: | The proposed pipeline achieves new state-of-the-art in text-to-speech with natural and expressive synthesis. |
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to protect language models from privacy leakage suffer from limited user control and low utility . et al., 2018: a novel framework that achieves SDP for state-of-the-art large transformer-based models. |
| Approach: | They propose a framework that applies differential privacy to large language models . they use redacted in-domain data to fine-tune the model with original in- domain data . |
| Outcome: | The proposed framework achieves strong utility compared to baselines. |
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing data augmentation techniques for natural language processing tasks are difficult to design. |
| Approach: | They propose a controllable rewriting based question data augmentation method for machine reading comprehension, question generation and question-answering natural language inference tasks. |
| Outcome: | The proposed method generates high-quality, high-quality question data samples on machine reading comprehension, question generation, and question-answering natural language inference tasks. |