Papers by Chang Yang
Enhancing Reinforcement Learning for Radiology Report Generation with Evidence-aware Rewards and Self-correcting Preference Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent reinforcement learning approaches have advanced radiology report generation (RRG) however, there are two limitations: report-level rewards offer limited evidence-grounded guidance for clinical faithfulness . |
| Approach: | They propose a method that uses group-wise evidence-aware alignment rewards and self-correcting preference learning to build a reliable, disease-agnostic preference dataset without human supervision. |
| Outcome: | ESC-RL promotes clinically faithful, disease-aligned reward and supports continual self-improvement during training. |
A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagation (2025.naacl-long)
Copied to clipboard
| Challenge: | Current large language models (LLMs) produce factually incorrect statements . |
| Approach: | They propose a probabilistic framework for LLM hallucination detection that generates a belief tree by expanding a statement into logically related claims and reasoning globally about the relationships between these claims. |
| Outcome: | The proposed method improves on multiple hallucination detection benchmarks by 3%-9% over state-of-the-art models. |
Rethinking Data Selection at Scale: Random Selection is Almost All You Need (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results . |
| Approach: | They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method . |
| Outcome: | The proposed methods outperform random selection on large datasets on large data pools. |
Thread: A Logic-Based Data Organization Paradigm for How-To Question Answering with Retrieval Augmented Generation (2025.emnlp-main)
Copied to clipboard
Kaikai An, Fangkai Yang, Liqun Li, Junting Lu, Sitao Cheng, Shuzheng Si, Lu Wang, Pu Zhao, Lele Cao, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Baobao Chang
| Challenge: | Recent advances in retrieval-augmented generation (RAG) have substantially improved question-answering systems, particularly for factoid ‘5Ws’ questions. |
| Approach: | They propose a data organization paradigm where large language models transform documents into more structured and loosely interconnected LUs. |
| Outcome: | Experiments in open-domain and industrial settings show that the proposed paradigm outperforms existing paradigms and shows high adaptability across diverse document formats. |
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities (2022.acl-long)
Copied to clipboard
Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-wen Yang, Shuyan Dong, Andy Liu, Cheng-I Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee
| Challenge: | Existing evaluation methods for transfer learning are limited in speech research . authors show that pre-trained models transfer well across multiple tasks . |
| Approach: | They propose a benchmark to evaluate pre-trained models by increasing task diversity and difficulty over SUPERB. |
| Outcome: | The proposed benchmark increases task diversity and difficulty over SUPERB-SG. |
Breaking Down Power Barriers in On-Device Streaming ASR: Insights and Solutions (2025.naacl-industry)
Copied to clipboard
Yang Li, Yuan Shangguan, Yuhao Wang, Liangzhen Lai, Ernie Chang, Changsheng Zhao, Yangyang Shi, Vikas Chandra
| Challenge: | Streaming automatic speech recognition models use high power consumption to improve usability and accuracy. |
| Approach: | They propose to optimize on-device speech recognition models by adjusting component energy sensitivities based on their specific energy sensitities to reduce power consumption. |
| Outcome: | The proposed approach achieves up to 47% lower energy usage while preserving comparable model accuracy and improving real-time performance compared to leading methods. |
Repairing Catastrophic-Neglect in Text-to-Image Diffusion Models via Attention-Guided Feature Enhancement (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-Image Diffusion models generate high-quality images from textual descriptions, but they often produce images that do not fully align with the input prompts, resulting in semantic inconsistencies. |
| Approach: | They propose an automated repair approach to address catastrophic-neglect in T2I DMs. |
| Outcome: | The proposed model achieves 10.1%-16.3% higher Correct Rate in image generation compared to baselines. |
MetaVL: Transferring In-Context Learning Ability From Language Models to Vision-Language Models (2023.acl-short)
Copied to clipboard
| Challenge: | Large-scale pre-trained vision-language models do not possess the ability to conduct in-context learning. |
| Approach: | They propose to meta-train a language model to perform in-context learning on NLP tasks and then transfer this model to VL tasks by attaching a visual encoder. |
| Outcome: | The proposed model outperforms the baseline model on VQA, OK-VQA, and GQA while having 20 times fewer parameters. |
Rethinking Cooperative Rationalization: Introspective Extraction and Complement Control (D19-1)
Copied to clipboard
| Challenge: | Selective rationalization is a common mechanism to ensure that predictive models reveal how they use any available features. |
| Approach: | They propose a co-operative method which uses introspection to explicitly predict and incorporate the outcome into the selection process. |
| Outcome: | The proposed model maintains high predictive accuracy and leads to comprehensive rationales. |
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web (2025.findings-acl)
Copied to clipboard
Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Shaosheng Cao, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou, Zhoujun Li
| Challenge: | Existing models have been introduced to improve image comprehension, but there is no robust benchmark for imagetoweb conversion. |
| Approach: | They propose a benchmark to assess imagetoweb conversion proficiency of large multimodal models . they propose to measure layout information of web pages by parsing the Document Object Model tree . |
| Outcome: | The proposed benchmark measures the layout information of web pages—i.e., the positional relationships between elements—which has been overlooked by prior work. |
WebDART: Dynamic Decomposition and Re-planning for Complex Web Tasks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large-language-model (LLM) agents are competent at straightforward web tasks, but struggle with complex tasks. |
| Approach: | They propose a general framework that decomposes web tasks into three subtasks . they show that WebDART lifts end-to-end success rates by 13.7 percentage points . |
| Outcome: | Evaluated on WebChoreArena, WebDART lifts success rates by 13.7 percentage points over previous state-of-the-art agents. |
LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing path planning algorithms suffer from significant computational and memory inefficiencies as the state space grows . large language models excel in environmental analysis but fall short in detailed spatial and temporal reasoning . |
| Approach: | They propose a new path planning method that synergistically combines A* and LLMs to improve pathfinding efficiency. |
| Outcome: | The proposed method improves pathfinding efficiency while maintaining integrity of path validity in large-scale scenarios. |
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners (2024.acl-long)
Copied to clipboard
Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu
| Challenge: | Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages. |
| Approach: | They propose to use large language models as a general-purpose interface across multiple tasks and languages. |
| Outcome: | The proposed model performs better on 200K hours of 6-language data for voice generation applications. |
ExplainaBoard: An Explainable Leaderboard for NLP (2021.acl-demo)
Copied to clipboard
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Graham Neubig
| Challenge: | Using leaderboards, researchers can track the performance of various systems on various NLP tasks. |
| Approach: | They propose a new conceptualization and implementation of NLP evaluation using a leaderboard. |
| Outcome: | The ExplainaBoard is an evaluation tool for natural language processing (NLP) it covers more than 400 systems, 50 datasets, 40 languages, and 12 tasks. |
Towards Fine-grained Text Sentiment Transfer (P19-1)
Copied to clipboard
| Challenge: | Existing methods for fine-grained text sentiment transfer only reverse the sentiment polarity of text, but they lack a robust and parallel learning algorithm. |
| Approach: | They propose a novel fine-grained text sentiment transfer task that revises a sequence to satisfy a given sentiment intensity while preserving the original semantic content. |
| Outcome: | The proposed model outperforms existing methods by a large margin in automatic evaluation and human evaluation. |
Out-of-Domain Detection for Low-Resource Text Classification Tasks (D19-1)
Copied to clipboard
| Challenge: | Existing methods for OOD detection and ID classification tasks require massive amounts of ID labeled data and no OOD labeles. |
| Approach: | They propose to use OOD-resistant Prototypical Network to detect OOD cases with limited in-domain (ID) training data to solve this task. |
| Outcome: | The proposed solution outperforms state-of-the-art methods in zero-shot OOD detection task while maintaining a competitive performance on ID classification task. |
CB-Whisper: Contextual Biasing Whisper Using Open-Vocabulary Keyword-Spotting (2024.lrec-main)
Copied to clipboard
Yuang Li, Yinglu Li, Min Zhang, Chang Su, Jiawei Yu, Mengyao Piao, Xiaosong Qiao, Miaomiao Ma, Yanqing Zhao, Hao Yang
| Challenge: | End-to-end automatic speech recognition systems struggle to recognize rare name entities such as personal names, organizations and terminologies that are not frequently encountered in the training data. |
| Approach: | They propose a convolutional neural network-based ASR system that performs open-vocabulary keyword-spotting before the decoder to match the features between the entities and the utterances. |
| Outcome: | The proposed system significantly improves mixed-error-rate (MER) and entity recall compared to the original Whisper model on three internal datasets and two publicly available datasets. |
Each graph is a new language: Graph Learning with LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Natural language is used to describe graphs, but graph descriptions become verbose and only relying on attribute embeddings limits LLM’s ability to capture adequate graph structural information. |
| Approach: | They propose a graph-defined language for large language model that translates the graph into a corpus instead of graph descriptions and pre-trains LLMs on this corpus to adequately understand the graph. |
| Outcome: | Experiments on five datasets show that the proposed framework outperforms description-based and embedding-based baselines by efficiently modeling different orders of neighbors. |
Efficient Shapley Values Estimation by Amortization for Text Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Shapley Values are often estimated with a small number of stochastic model evaluations, but this can only be mitigated by aggregating thousands of model evaluation. |
| Approach: | They propose to combine a model with thousands of model evaluations to estimate Shapley Values without additional model evaluation. |
| Outcome: | The proposed model estimates Shapley Values accurately with up to 60 times speedup compared to traditional methods and does not suffer from stability issues as inference is deterministic. |
Augment before You Try: Knowledge-Enhanced Table Question Answering via Table Expansion (2025.findings-emnlp)
Copied to clipboard
Yujian Liu, Jiabao Ji, Tong Yu, Ryan A. Rossi, Sungchul Kim, Handong Zhao, Ritwik Sinha, Yang Zhang, Shiyu Chang
| Challenge: | Existing methods to integrate external information into a given table neglect the structured nature of the table. |
| Approach: | They propose a simple yet effective method to integrate external information into a given table by first building an augmenting table and then generating a SQL query over the two tables to answer the question. |
| Outcome: | The proposed method outperforms strong baselines on three table QA benchmarks. |
MiniELM: A Lightweight and Adaptive Query Rewriting Framework for E-Commerce Search Optimization (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for rewriting query terms struggle with natural language understanding . generative methods face high inference latency and cost in offline settings . |
| Approach: | They propose a hybrid pipeline for rewriting query queries using offline knowledge distillation and online reinforcement learning. |
| Outcome: | The proposed pipeline improves query relevance, diversity, adaptability and cost-effective evaluation without manual annotations on Amazon ESCI dataset. |
FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models (2026.findings-acl)
Copied to clipboard
Junzhe Jiang, Chang Yang, Aixin Cui, Sihan Jin, Yujing Zhang, Yilin Xiao, Ruiyu Wang, Bo Li, Xiao Huang, Danny Dongning Sun, Xinrun Wang
| Challenge: | Existing benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow- level evaluation. |
| Approach: | a new benchmark evaluates large language models on financial management workflows . the global financial services market is projected to grow to $37 trillion by 2027 . |
| Outcome: | a new benchmark for large language models on financial management workflows reveals critical capability gaps . accuracy drops from 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning . the global financial services market reached $25.8 trillion in 2022 and is projected to grow to $37 trillion by 2027 . |
SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis (2025.findings-naacl)
Copied to clipboard
Hengxing Cai, Xiaochen Cai, Junhan Chang, Sihang Li, Lin Yao, Wang Changxin, Zhifeng Gao, Hongshuai Wang, Li Yongge, Mujie Lin, Shuwen Yang, Jiankun Wang, Mingjun Xu, Jin Huang, Xi Fang, Jiaxi Zhuang, Yuqi Yin, Yaqi Li, Changhong Chen, Zheng Cheng, Zifeng Zhao, Linfeng Zhang, Guolin Ke
| Challenge: | Existing benchmarks fail to adequately evaluate the proficiency of Large Language Models (LLMs) Existing standards do not cover the skills needed to evaluate LLMs in scientific literature analysis. |
| Approach: | They propose a benchmark to evaluate the proficiency of large language models in scientific literature analysis. |
| Outcome: | SciAssess evaluates 11 LLMs on multiple tasks across scientific fields. |
Towards Comprehensive Description Generation from Factual Attribute-value Tables (P19-1)
Copied to clipboard
| Challenge: | Existing models for comprehensive descriptions for factual attribute-value tables might suffer from missing key attributes and groundless information problems. |
| Approach: | They propose a force attention method to encourage the generator to pay more attention to uncovered attributes to avoid potential key attributes missing. |
| Outcome: | The proposed model outperforms the state-of-the-art baselines on automatic and human evaluation. |
Cool English: a Grammatical Error Correction System Based on Large Learner Corpora (C18-2)
Copied to clipboard
| Challenge: | Existing systems that correct grammatical errors are lacking in second language learning due to limited vocabulary and inadequate command of grammar. |
| Approach: | They propose a grammatical error correction system that provides corrective feedback for essays using a sequence-to-sequence model. |
| Outcome: | The proposed system achieves competitive performance on a number of publicly available testsets. |
Frustratingly Simple Few-Shot Slot Tagging (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing fewshot methods for slot tagging are weak in encoding slot name semantics and slot dependencies. |
| Approach: | They propose a simple and effective few-shot model for slot tagging which incorporates machine reading comprehension (MRC) using source domain and target domain data. |
| Outcome: | The proposed model outperforms state-of-the-art methods on the SNIPS dataset. |
Can Large Language Models Always Solve Easy Problems if They Can Solve Harder Ones? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive capabilities, but still suffer from inconsistency issues. |
| Approach: | They develop a ConsisEval benchmark to evaluate LLMs' inconsistency . they find that LLM models can paradoxically fail at easier problems . |
| Outcome: | The proposed model achieves highest consistency score but inconsistent to specific questions due to distraction by redundant information, misinterpretation of questions, etc. |
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing Language Models lack the power to store all required knowledge, resulting in a lack of ability to infer out-of-context knowledge. |
| Approach: | They propose a Knowledge Interaction Layer that can be flexibly plugged into existing Transformer-based LMs to interact with a differentiable Knowledge Graph Reasoning module collaboratively. |
| Outcome: | The proposed model can be plugged into existing Transformer-based LMs to interact with a differentiable Knowledge Graph Reasoning module collaboratively. |
A Reinforcement Learning Framework for Robust and Secure LLM Watermarking (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing watermarking algorithms rely on heuristic green/red token lists . however, these lists are inconsistent and can be compromised . |
| Approach: | They propose a framework for robust and secure LLM watermarking using reinforcement learning. |
| Outcome: | The proposed method achieves state-of-the-art trade-off across all criteria with notable improvements in resistance to spoofing attacks without degrading other criteria. |
Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principles (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for improving LLMs in simulations are limited due to privacy concerns and limited domain knowledge. |
| Approach: | They propose a pipeline that elicits qualitative feedback from a domain-expert and transforms it into a set of principles that govern an LLM-prompted roleplay. |
| Outcome: | The proposed pipeline shows a 30% improvement in response quality and principle following for the downstream task. |
A Semi-Supervised Stable Variational Network for Promoting Replier-Consistency in Dialogue Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods favor uninformative and non replier-specific responses due to lack of relevant information guidance. |
| Approach: | They propose to use a semi-supervised variable network to generate replier-specific responses . they use vMF as latent space to obtain stable KL performance . |
| Outcome: | The proposed model outperforms baseline models on two large conversation datasets and generates diverse and replier-specific responses. |
Quantifying and Improving the Robustness of Retrieval-Augmented Language Models Against Spurious Features in Grounding Data (2026.acl-long)
Copied to clipboard
Shiping Yang, Jie Wu, Wenbiao Ding, Ning Wu, Shining Liang, Ming Gong, Hongzhi Li, Hengyuan Zhang, Angel X. Chang, Dongmei Zhang
| Challenge: | Existing studies on robustness to explicit noise (e.g., document semantics) but overlook implicit noise (spurious features). |
| Approach: | They propose a framework to quantify the robustness of RAGs against spurious features by integrating a data synthesis pipeline and a taxonomy. |
| Outcome: | The proposed framework quantifies the robustness of RALMs against spurious features. |
Rumor Detection on Social Media with Crowd Intelligence and ChatGPT-Assisted Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on rumor detection challenges the expressive power of text encoding sequences, and insufficient mining of semantic structural information. |
| Approach: | They propose a Crowd Intelligence-based semantic feature learning module to capture textual content’s sequential and hierarchical features and a knowledge-based structural mining module that leverages ChatGPT for knowledge enhancement. |
| Outcome: | The proposed system achieves performance improvement in rumor detection tasks validating the effectiveness and rationality of using large language models as auxiliary tools. |
MolTC: Towards Molecular Relational Modeling In Language Models (2024.findings-acl)
Copied to clipboard
Junfeng Fang, Shuai Zhang, Chang Wu, Zhengyi Yang, Zhiyuan Liu, Sihang Li, Kun Wang, Wenjie Du, Xiang Wang
| Challenge: | Molecular Relational Learning (MRL) is a promising way to understand interactions between molecular pairs. |
| Approach: | They propose a novel LLM-based multi-modal framework for molecular interaction modeling following Chain-of-Thought (CoT) theory which integrates graphical information of two molecules in pair. |
| Outcome: | The proposed framework integrates graphical information of two molecules in pair. |
CIFLEX: Contextual Instruction Flow for Sub-task Execution in Multi-Turn Interactions with a Single On-Device LLM (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experiments show that CIFLEX significantly reduces computational costs without degrading task performance. |
| Approach: | They propose a new execution system for efficient sub-task handling with a single large language model. |
| Outcome: | Experiments show that CIFLEX significantly reduces computational costs without degrading task performance. |
Improving Radiology Summarization with Radiograph and Anatomy Prompts (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies focus on automatic impression generation, but this task is time-consuming and in high demand. |
| Approach: | They propose to use an anatomy-enhanced multimodal model to generate automatic impressions by combining radiology images with textual features. |
| Outcome: | The proposed model achieves state-of-the-art on two benchmark datasets and compares with existing models. |
Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth (2025.emnlp-main)
Copied to clipboard
| Challenge: | Despite excelling at many natural language processing tasks, large language models fail to grasp the layered semantics of Drivelological text. |
| Approach: | They construct a benchmark dataset of over 1,200+ carefully curated and diverse examples across English, Mandarin, Spanish, French, Japanese, and Korean to examine their Drivelological characteristics. |
| Outcome: | The proposed models lack conceptual understanding and lack conceptual and semantic accuracy. |
Scaling Parameter-Constrained Language Models with Quality Data (2024.emnlp-industry)
Copied to clipboard
Ernie Chang, Matteo Paltenghi, Yang Li, Pin-Jie Lin, Changsheng Zhao, Patrick Huber, Zechun Liu, Rastislav Rabatin, Yangyang Shi, Vikas Chandra
| Challenge: | Scaling laws in language modeling quantify training loss as a function of dataset size and model parameters, but neglect the critical role of data quality in model generalization. |
| Approach: | They propose to use effective training tokens as a combination of text diversity and syntheticity as measured by a teacher model to calculate scaling laws. |
| Outcome: | The proposed term effective training tokens is a combination of two readily-computed indicators of text diversity and syntheticity as measured by a teacher model. |
FaithLM: Towards Faithful Explanations for Large Language Models (2026.eacl-long)
Copied to clipboard
Yu-Neng Chuang, Guanchu Wang, Chia-Yuan Chang, Ruixiang Tang, Shaochen Zhong, Fan Yang, Andrew Wen, Mengnan Du, Xuanting Cai, Vladimir Braverman, Xia Hu
| Challenge: | Large language models (LLMs) produce natural language explanations, but they lack faithfulness and do not reflect the evidence the model uses to decide. |
| Approach: | They propose a model-agnostic framework that evaluates and improves the faithfulness of LLM explanations without token masking or task-specific heuristics. |
| Outcome: | The proposed framework improves faithfulness of large language models without masking or heuristics. |
Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak attacks primarily utilize scenario camouflage techniques, however their explicit mention of malicious intent will be easily recognized and defended by LLMs. |
| Approach: | They propose an indirect jailbreak attack approach, Puzzler, which can bypass LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query. |
| Outcome: | The proposed approach can bypass the LLM’s defensive strategies and obtain malicious response by implicitly providing LLMs with some clues about the original malicious query. |
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference (2022.findings-acl)
Copied to clipboard
| Challenge: | Previously, it's common to disregard it as noise or as a sign of poor-quality data, as their annotations are heavily based on personal experience and opinions. |
| Approach: | They propose to capture the human disagreement distribution from the perspective of model calibration. |
| Outcome: | The proposed model can achieve competitive performance when well-calibrated, on divergence scores between predictive probability and the true human opinion distribution, and the accuracy. |
HiTRANS: A Hierarchical Transformer Network for Nested Named Entity Recognition (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies for named entity recognition focus on flat NER, i.e., without nested entities, by sequence labeling methods. |
| Approach: | They propose a Hierarchical Transformer network which decomposes the input sentence into multi-grained spans and enhances the representation learning in a hierarchical manner. |
| Outcome: | The proposed method achieves much better performance than the state-of-the-art approaches on GENIA, ACE-2004, ace-2005 and NNE datasets. |
Pun-GAN: Generative Adversarial Network for Pun Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for generating pun sentences with word senses lack large-scale corpus for supervised learning . a pun is a clever and amusing use of a word with two meanings (word senses) |
| Approach: | They propose an adversarial generative network for pun generation with a generator and a discriminator to distinguish between generated pun sentences and real sentences with specific word senses. |
| Outcome: | The proposed network generates sentences that are more ambiguous and diverse in both automatic and human evaluation. |
A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for fake news detection focus on fact-checked reports, resulting in limited coverage and debunking delays. |
| Approach: | They propose a Coarse-to-fine Cascaded Evidence-Distillation neural network for explainable fake news detection based on raw reports . they use hierarchical encoders and cascaded selectors to select most explainable sentences for verdicts on top of selected top-K reports based upon raw reports. |
| Outcome: | The proposed model outperforms baseline detection methods and generates high-quality explanations from diverse evaluation perspectives. |
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following (2023.emnlp-main)
Copied to clipboard
| Challenge: | Embodied Instruction Following has shown an impressive success rate when the environment has been seen in training, but when deployed in an unseen environment, it tends to struggle when deployed with an unsightly environment. |
| Approach: | They propose to explicitly align the agent’s hidden states with the instructions via contrastive learning to bridge the semantic gap between high-level language instructions and the agent's low-level action space. |
| Outcome: | The proposed meta-actions achieve a 4.5% success rate in unseen environments compared to a strong multi-modal Transformer baseline . |
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing frameworks for guiding a language model in reasoning tasks are limited by their tendency to generate low-quality rationales that are repetitive and vacuous. |
| Approach: | They propose a framework that leverages a lightweight language model for guiding a black-box large LM in reasoning tasks. |
| Outcome: | The proposed framework outperforms baselines in answer prediction accuracy. |
Mimicking the Familiar: Dynamic Command Generation for Information Theft Attacks in LLM Tool-Learning System (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to attack Large Language Model (LLM) tool-learning systems are black-box oriented and rely on static commands that cannot adapt flexibly to the changes in user queries and the invocation chain. |
| Approach: | They propose a dynamic attack comment generation approach for information theft attacks in LLM tool-learning systems that mimics the familiar by inferring the information utilized by upstream tools. |
| Outcome: | The proposed approach outperforms baselines with +13.2% ASRTheft and can be generalized to new tool-learning systems to expose their information leakage risks. |
LinggleWrite: a Coaching System for Essay Writing (2020.acl-demos)
Copied to clipboard
| Challenge: | Existing writing services that provide feedback on writing skills are not providing sufficient "coaching" information. |
| Approach: | They propose a writing coach that provides writing suggestions, assesses writing proficiency levels, detects grammatical errors, and offers corrective feedback in response to user’s essay. |
| Outcome: | The proposed system improves on public test sets and shows that both AES and GED models achieve state-of-the-art performance. |
PRiSM: Benchmarking Phone Realization in Speech Models (2026.acl-long)
Copied to clipboard
Shikhar Bharadwaj, Chin-Jou Li, Yoonjae Kim, Kwanghee Choi, Eunjung Yeo, Ryan Soh-Eun Shim, Hanyu Zhou, Brendon Boldt, Karen Rosero, Kalvin Chang, Darsh Agrawal, Keer Xu, Chao-Han Huck Yang, Jian Zhu, Shinji Watanabe, David R. Mortensen
| Challenge: | Existing evaluations of phone recognition systems only measure surface-level transcription accuracy. |
| Approach: | They propose to standardize transcription-based evaluation and assess downstream utility in clinical, educational, and multilingual settings with transcription and representation probes. |
| Outcome: | The proposed system outperforms LALMs in clinical, educational, and multilingual settings. |
Learn from Relation Information: Towards Prototype Representation Rectification for Few-Shot Relation Extraction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for Few-shot Relation Extraction focus on implicitly introducing relation information to constrain the prototype representation learning. |
| Approach: | They propose a parameter-less method to promote few-shot relation extraction . they use a prototype rectification module to rectify original prototypes by relation information . |
| Outcome: | The proposed method achieves state-of-the-art on fewRel 1.0 and 2.0 datasets. |
SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model (2024.emnlp-demo)
Copied to clipboard
Dayong Wu, Jiaqi Li, Baoxin Wang, Honghong Zhao, Siyuan Xue, Yanjie Yang, Zhijun Chang, Rui Zhang, Li Qian, Bo Wang, Shijin Wang, Zhixiong Zhang, Guoping Hu
| Challenge: | Large language models (LLMs) have shown remarkable achievements across various language tasks. |
| Approach: | They propose a scientific literature LLM and a knowledge service system based on it . they collect scientific literature and then pre-train it using autoregressive training . |
| Outcome: | The proposed system provides literature investigation, paper reading, and academic writing functions. |
DAGCN: Distance-based and Aspect-oriented Graph Convolutional Network for Aspect-based Sentiment Analysis (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances in sentiment analysis tend to interference from local factors such as irrelevant words and edges, hindering the precise identification of opinion words. |
| Approach: | They propose a distance-based syntactic weight and Aspect-Fusion Attention to solve this problem. |
| Outcome: | The proposed model outperforms state-of-the-art models on three public datasets and verify its effectiveness. |
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings (2022.naacl-main)
Copied to clipboard
Yung-Sung Chuang, Rumen Dangovski, Hongyin Luo, Yang Zhang, Shiyu Chang, Marin Soljacic, Shang-Wen Li, Scott Yih, Yoon Kim, James Glass
| Challenge: | Recent work shows that finetuning pretrained models with contrastive learning makes it possible to learn good sentence embeddings without labeled data. |
| Approach: | They propose an unsupervised contrastive learning framework for learning sentence embeddings . they use a masked language model to mask out the edited sentence . |
| Outcome: | The proposed framework outperforms SimCSE on semantic textual similarity tasks by 2.3 absolute points. |
A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to introduce relation information into the model are limited by labeling and data scarcity. |
| Approach: | They propose a direct addition approach to introduce relation information into a model by concatenating two views of relations and adding them to the original prototype. |
| Outcome: | The proposed approach improves on the benchmark dataset FewRel 1.0 and shows comparable results to the state-of-the-art. |
Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device (2025.findings-naacl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is valuable in specialized domains where precision is critical. |
| Approach: | They propose a chain-of-rank algorithm which allows LLMs to access a target domain early via finetuning. |
| Outcome: | The proposed method achieves state-of-the-art in benchmarks and analyzes its efficacy. |
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for table-to-text generation suffer from poor faithfulness and low coverage. |
| Approach: | They propose a method that combines Autoregressive and Non-Autoregressive generation to generate a table-to-text from a key-value table using a skeleton and an edit-based non-autoregressively generation model. |
| Outcome: | The proposed method outperforms the existing methods on WikiPerson and WikiBio datasets on coverage and faithfulness. |
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions? (2023.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained vision and language models have demonstrated state-of-the-art capabilities over existing tasks involving images and texts. |
| Approach: | They analyze a visual question answering dataset tailored for info-seeking questions . they show that pre-trained visual and language models can use fine-grained knowledge . |
| Outcome: | The proposed dataset elicits models to use fine-grained knowledge learned during pre-training. |
Efficient Integration of External Knowledge to LLM-based World Models via Retrieval-Augmented Generation and Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to enhance LLM-based world models through prompting or fine-tuning approaches are either requiring human knowledge or computationally extensive. |
| Approach: | They propose a framework that leverages retrieval-augmented generation to integrate external knowledge to LLM-based world models. |
| Outcome: | The proposed framework outperforms baseline models and exhibits strong generalizability. |
Feedback Adaptation for Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation protocols focus on overall accuracy and fail to capture how systems adapt after feedback is introduced. |
| Approach: | They propose to use feedback adaptation as a problem setting for RAG systems . they propose a minimal inference-time instantiation that incorporates feedback without retraining . |
| Outcome: | The proposed evaluations show that training-based approaches exhibit a trade-off between delayed correction and reliable adaptation. |
RED: Unleashing Token-Level Rewards from Holistic Feedback via Reward Redistribution (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results demonstrate the superiority of our approach to aligning large language models with human preferences. |
| Approach: | They propose a method that evaluates and assigns specific credit to each token using an off-the-shelf reward model. |
| Outcome: | The proposed method evaluates and assigns specific credit to each token using an off-the-shelf reward model. |
Advancing the Robustness of Large Language Models through Self-Denoised Smoothing (2024.naacl-short)
Copied to clipboard
Jiabao Ji, Bairu Hou, Zhen Zhang, Guanhua Zhang, Wenqi Fan, Qing Li, Yang Zhang, Gaowen Liu, Sijia Liu, Shiyu Chang
| Challenge: | Existing adversarial attacks can cause LLMs to make wrong predictions on downstream tasks or generate harmful content misaligned with human values. |
| Approach: | They propose to use randomized smoothing to add noise to the input and then make predictions based on these denoised versions. |
| Outcome: | The proposed method surpasses existing methods in both empirical and certified robustness in defending against adversarial perturbations for both downstream tasks and human alignments (i.e., jailbreak attacks). |
Rethink Rumor Detection in the Era of LLMs: A Review (2025.findings-emnlp)
Copied to clipboard
| Challenge: | rumor detection has been reshaped by large language models (LLMs) this paper proposes a Cognition-Interaction-Behavior (CIB) framework for rumour detection based on collective intelligence . |
| Approach: | They propose a Cognition-Interaction-Behavior framework for rumor detection based on collective intelligence and explore synergistic relationship between LLMs and collective intelligence in rumour governance. |
| Outcome: | The proposed framework unifies existing methods and reveals synergistic relationship between LLMs and collective intelligence in rumor governance. |
Synthesizing Text-to-SQL Data from Weak and Strong LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | a capability gap exists between open-source and closed-source large language models (LLMs) . the adoption of closed-sourced LLMs introduces concerns pertaining to openness, privacy, and substantial costs. |
| Approach: | They propose a synthetic data approach that combines strong and weak models for error information . they demonstrate the effectiveness of SENSE, a specialized text-to-SQL model . |
| Outcome: | The proposed method enhances the domain generalization of text-to-SQL models and explores the potential of error data supervision through preference learning. |
MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification (2026.findings-acl)
Copied to clipboard
Jingwei Song, Xinyu Wang, Hanbin Wang, Xiaoxuan Lei, Tianyu Shi, Shixin Han, Eric Yang, Xiao-Wen Chang, Lynn Ai
| Challenge: | Autoregressive large language models suffer from high inference latency due to memorybandwidth constraints. |
| Approach: | They propose a method that decouples generation and verification by decoupling tokens and a lightweight draft model. |
| Outcome: | The proposed method delivers consistent and significant speedups over state-of-the-art baselines while preserving generation quality across diverse benchmarks. |
Part Represents Whole: Improving the Evaluation of Machine Translation System Using Entropy Enhanced Metrics (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing machine translation metrics have poor correlations with human assessments . entropy-based evaluations are often limited to a limited number of samples . |
| Approach: | They propose a fast and unsupervised approach to enhance machine translation metrics using entropy by introducing sentence-level difficulty. |
| Outcome: | The proposed method outperforms existing metrics on five sub-tracks in the WMT19 Metrics shared tasks. |
Cognitive Graph for Multi-Hop Reading Comprehension at Scale (P19-1)
Copied to clipboard
| Challenge: | a new framework for multi-hop reading comprehension question answering is needed to cross the chasm of reading comprehension between machine and human. |
| Approach: | They propose a CogQA framework for multi-hop reading comprehension question answering in web-scale documents that builds a cognitive graph in an iterative process by coordinating an implicit extraction module and an explicit reasoning module. |
| Outcome: | The proposed framework outperforms the best competitor in the hotpotQA dataset in F1 . it provides explainable reasoning paths and accurate answers, while giving accurate answers . |
Re-ReST: Reflection-Reinforced Self-Training for Language Agents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to fine tune language agents with reasoning-action trajectories require high-quality model-generated samples, which are hard to obtain for challenging language agent tasks. |
| Approach: | They propose a method to employ reflection during inference without ground-truth feedback to improve agents more autonomously. |
| Outcome: | The proposed method improves self-training performance on open-source language agents by 7.6% and 14.1% respectively. |
Learning to Respond to Mixed-code Queries using Bilingual Word Embeddings (N19-4)
Copied to clipboard
| Challenge: | Many queries are submitted to search engines on the Web every day to retrieve linguistic information for learning a second language (L2) due to limited L2 vocabulary knowledge, users often submit mix-coded queries without converting them into target language queries. |
| Approach: | They propose a method for learning bilingual word embeddings to support second language learners . mixed-code queries are transformed into target language queries . preliminary evaluation shows method performs reasonablly well . |
| Outcome: | The proposed method performs reasonablly well on a list of common word-translation queries. |
Scattered Hypothesis Generation for Open-Ended Event Forecasting (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event forecasting focus on the most probable outcomes, neglecting the intrinsic uncertainty of real-world events. |
| Approach: | They propose a reinforcement learning framework that optimizes inclusiveness and diversity of the hypothesis by integrating validity-gated score into the overall objective. |
| Outcome: | The proposed framework outperforms baselines on two real-world benchmark datasets. |
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension (2024.acl-long)
Copied to clipboard
Qian Yang, Jin Xu, Wenrui Liu, Yunfei Chu, Ziyue Jiang, Xiaohuan Zhou, Yichong Leng, Yuanjun Lv, Zhou Zhao, Chang Zhou, Jingren Zhou
| Challenge: | Existing benchmarks for audio-centric interaction have impeded advancements in this field . AIR-Bench evaluates LALMs' ability to understand audio signals and interact with humans . |
| Approach: | They propose a benchmark to evaluate the ability of large audio-language models to understand audio signals . they use 19 tasks with approximately 19k single-choice questions to examine single-task ability . |
| Outcome: | The proposed framework evaluates the ability of large audio-language models to understand audio signals and interact with humans in the textual format. |
E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
Jinchang Hou, Chang Ao, Haihong Wu, Xiangtao Kong, Zhigang Zheng, Daijia Tang, Chengming Li, Xiping Hu, Ruifeng Xu, Shiwen Ni, Min Yang
| Challenge: | despite the rapid development of Large Language Models, there is no dedicated benchmark for evaluating LLMs in Chinese K-12 education. |
| Approach: | They propose to develop a benchmark specifically tailored for Chinese K-12 education. |
| Outcome: | EVAL is the first evaluation benchmark specifically tailored for Chinese K-12 education. |
Target-Aware Language Modeling via Granular Data Sampling (2024.emnlp-main)
Copied to clipboard
Ernie Chang, Pin-Jie Lin, Yang Li, Changsheng Zhao, Daeil Kim, Rastislav Rabatin, Zechun Liu, Yangyang Shi, Vikas Chandra
| Challenge: | Language model pretraining is the cornerstone of universal language models (LMs), creating generalpurpose representations to excel across a variety of downstream tasks. |
| Approach: | They propose to use multi-granular tokens to sample large-scale language models for domain-specific use cases. |
| Outcome: | The proposed model outperforms random sampled samples on eight benchmarks with 1% of the data and performs on par with the full RefinedWeb data. |
Level-Up: Learning to Improve Proficiency Level of Essays (P19-3)
Copied to clipboard
| Challenge: | Many essays are submitted to tutoring services by English learners on the Web every day . few systems provide focused suggestions on how to raise the level of proficiency. |
| Approach: | They propose a method for generating suggestions on a sentence for improving proficiency . they propose identifying grammatical elements and ranking related elements to provide suggestions . |
| Outcome: | The proposed method helps english learners improve their writing and reading skills. |
AutoSUIT Bench - Automated Security UnIt Test Benchmark for LLM Coding (2026.findings-acl)
Copied to clipboard
Samuel Osebe, Fan Yang, Junyi Li, Yue Gu, Yongxin Wang, Satyapriya Krishna, Kai-Wei Chang, Aram Galstyan, Rahul Gupta, Weitong Ruan
| Challenge: | Large Language Models (LLMs) are evolving rapidly on code generation tasks. |
| Approach: | They propose to automate the vulnerability code benchmark creation with iterative auto validation. |
| Outcome: | The proposed benchmark covers 232 CWE categories across C/C++, Java, and Python languages. |
Deciphering Rumors: A Multi-Task Learning Approach with Intent-aware Hierarchical Contrastive Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Social networks are rife with noise and misleading information, presenting multifaceted challenges for rumor detection. |
| Approach: | They propose a new multi-task learning framework that mines latent intentions and rumor semantic features . they propose to use event-level and intent-level strategies to establish cognitive anchors . |
| Outcome: | The proposed framework improves the effectiveness of rumor detection and addresses the challenges present in the field. |
Large Dual Encoders Are Generalizable Retrievers (2022.emnlp-main)
Copied to clipboard
Jianmo Ni, Chen Qu, Jing Lu, Zhuyun Dai, Gustavo Hernandez Abrego, Ji Ma, Vincent Zhao, Yi Luan, Keith Hall, Ming-Wei Chang, Yinfei Yang
| Challenge: | Experimental results show that dual encoders outperform sparse and dense retrievers on the BEIR dataset significantly. |
| Approach: | They challenge belief that bottleneck layer is too limited for out-of-domain generalization . they scale up the model while keeping bottleneck as a single dot-product with a fixed size . |
| Outcome: | The proposed model outperforms sparse and dense retrievers on the BEIR dataset significantly. |
Retrieved Sequence Augmentation for Protein Representation Learning (2024.emnlp-main)
Copied to clipboard
Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Sheng Wang, Lingpeng Kong
| Challenge: | Using multiple sequence alignments (MSA) to extract evolutionary knowledge is limited. |
| Approach: | They propose to use multiple sequence alignments to augment protein representations . they propose to employ Retrieved Sequence Augmentation to enhance protein representation learning . |
| Outcome: | The proposed method surpasses MSA Transformer by 5% in structural and property prediction tasks while being 373 times faster. |
LLM-SLM Collaborative Framework of Idiomatic Expression Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for idiomatic expression generation lack parallel data and manual annotations. |
| Approach: | They propose an iterative LLM-SLM collaborative framework that replaces human supervision for idiomatic expression data generation. |
| Outcome: | The proposed framework outperforms DeepSeek-R1 in Chinese Idiom Polishing with a 25.2% improvement in accuracy. |
A Survey of Retentive Network (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the effectiveness of the Retentive Networks have not yet been conducted. |
| Approach: | They propose a retention mechanism that integrates the inductive bias of recurrent neural networks with the parallelizable training advantages of attention-based models. |
| Outcome: | The proposed retention mechanism combines the inductive bias of recurrent neural networks with the parallelizable training advantages of attention-based models. |
Revisiting Who’s Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing and new datasets show that our approach achieves competitive performance in all of the criteria. |
| Approach: | They propose a new task of LLM targeted unlearning where unlearning targets only the information about the unlearning target, rather than everything in the unlearned documents. |
| Outcome: | The proposed method achieves competitive performance on existing and new datasets without optimizing for the aforementioned criteria. |
Nonparametric Decoding for Generative Retrieval (2023.findings-acl)
Copied to clipboard
Hyunji Lee, JaeYoung Kim, Hoyeon Chang, Hanseok Oh, Sohee Yang, Vladimir Karpukhin, Yi Lu, Minjoon Seo
| Challenge: | Existing text retrieval models depend on the information encoded in its parameters without external memory, its information capacity is limited and fixed. |
| Approach: | They propose a nonparametric decoding approach which uses external memory instead of vanilla vocab embeddings as decoder voka embedds. |
| Outcome: | The proposed model can utilize parametric and nonparametric space. |
Prompt Tuning for Unified Multimodal Pretrained Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt tuning has demonstrated success in natural language pretraining and even vision pretraining. |
| Approach: | They propose to apply prompt tuning to a unified sequence-to-sequence pretrained model by adding a sequence of learnable embeddings to each layer and finetuning the pretrained models on downstream tasks. |
| Outcome: | The proposed method outperforms other parameter-efficient tuning methods on multimodal models and is robust against adversarial attacks. |
Think Both Ways: Teacher-Student Bidirectional Reasoning Enhances MCQ Generation and Distractor Quality (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating high-quality MCQs struggle with contextual relevance and plausible distractors. |
| Approach: | They propose a framework that integrates bidirectional reasoning perspectives to generate contextually relevant questions and plausible distractors while student reasoning evaluates question clarity and the misleading nature of distractors. |
| Outcome: | The proposed framework outperforms existing methods in generating text-grounded questions and high-quality distractors for narrative contexts. |
One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems (2025.findings-emnlp)
Copied to clipboard
Zhiyuan Chang, Mingyang Li, Xiaojun Jia, Junjie Wang, Yuekai Huang, Ziyou Jiang, Yang Liu, Qing Wang
| Challenge: | Existing knowledge poisoning attacks against RAG systems require multiple poisoned documents or can only function effectively on simplistic queries. |
| Approach: | They propose a more realistic knowledge poisoning attack that poisons only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements. |
| Outcome: | The proposed attack achieves success by poisoning only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements. |
Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have shown that training language models with rationales augmentation is beneficial, but this view does not hold consistently. |
| Approach: | They conduct comprehensive investigations to thoroughly inspect the impact of rationales on model performance and a novel perspective of model reliability. |
| Outcome: | The proposed method outperforms untrained models in several areas and provides informative regulations on the broad utilization of rationales. |
AutoMixer: Checkpoint Artifacts as Automatic Data Mixers (2025.acl-long)
Copied to clipboard
| Challenge: | In language model training, it is difficult to obtain the right data mixtures for various tasks as the relationship between data and tasks is difficult. |
| Approach: | They propose to identify checkpoint models based on their respective capabilities and leverage them as data mixers by using their aggregated first-order influence approximation over source data. |
| Outcome: | The proposed framework shows significant improvements on eight reasoning benchmarks, with accuracy increases of up to 1.93%. |
Boosting LLM Agents with Recursive Contemplation for Effective Deception Handling (2024.findings-acl)
Copied to clipboard
Shenzhi Wang, Chang Liu, Zilong Zheng, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, Gao Huang
| Challenge: | Recent advances in large language models (LLMs) have led to significant success in using LLMs as agents. |
| Approach: | They propose a cognitive framework that incorporates first-order and second-order perspective transitions into LLMs to enhance their ability to identify and counteract deceptive information. |
| Outcome: | The proposed framework enhances LLMs’ ability to identify and counteract deceptive information without extra fine-tuning and data. |
DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | DiMo-GUI is a training-free framework for GUI grounding that splits input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models. |
| Approach: | They propose a training-free framework for GUI grounding that leverages two core strategies: dynamic visual grounding and modality-aware optimization. |
| Outcome: | The proposed framework splits the input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models. |
Trainable Hard Negative Examples in Contrastive Learning for Unsupervised Abstractive Summarization (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for contrastive learning rely on manual negative examples and are poor in quality and adaptability during training. |
| Approach: | They propose a framework that learns trainable negative examples for contrastive learning in unsupervised abstractive summarization by combining a negative example network and a representation network. |
| Outcome: | The proposed approach eliminates the need for manual negative example design and improves on two benchmark datasets. |
Gold-Medal-Level Olympiad Geometry Solving with Efficient Heuristic Auxiliary Constructions (2026.acl-long)
Copied to clipboard
Boyan Duan, Xiao Liang, Shuai Lu, Yaoxiang Wang, Yelong Shen, Kai-Wei Chang, Ying Nian Wu, Mao Yang, Weizhu Chen, Yeyun Gong
| Challenge: | Existing methods for geometry theorem proving in Euclidean geometry are challenging and require a neural network to perform. |
| Approach: | They propose a method for adding auxiliary points in geometry that runs on CPUs without relying on neural network-based inference. |
| Outcome: | The proposed method achieves silver-medal-level human performance on IMO-30 benchmark. |
Learning to Control the Fine-grained Sentiment for Story Ending Generation (P19-1)
Copied to clipboard
| Challenge: | Existing studies focus on controlling the sentiment of story endings. |
| Approach: | They propose a generic and novel framework which controls fine-grained sentiment intensity for automatic story ending generation without manually annotating sentiment labels. |
| Outcome: | The proposed framework can generate story endings which meet the given sentiment intensity better. |
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)
Copied to clipboard
Jie Zhang, Changzai Pan, Sishi Xiong, Kaiwen Wei, Yu Zhao, Xiangyu Li, Jiaxin Peng, Xiaoyan Gu, Jian Yang, Wenhan Chang, Zhenhe Wu, Jiang Zhong, Shuangyong Song, Xuelong Li
| Challenge: | Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications. |
| Approach: | They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning. |
| Outcome: | The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation. |
Learning Contextual Retrieval for Robust Conversational Search (2025.emnlp-main)
Copied to clipboard
| Challenge: | Effective conversational search requires a deep understanding of user intent across multiple dialogue turns. |
| Approach: | They propose a novel LLM-based retriever that directly incorporates conversational context into the retrieval process. |
| Outcome: | The proposed method outperforms existing methods while incurring no additional inference overhead. |
SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to training large language models lack topologyaware task scheduling mechanisms and model parallelization strategies. |
| Approach: | They propose a topology-aware scheduling system specifically designed for decentralized GPU clusters . they propose heuristic methods at the inter-cluster level with ILP-based optimization within clusters. |
| Outcome: | The proposed system reduces job completion time by 1.2-1.3 and improves throughput by 1.12-1.25 . it also reduces scheduling overhead by 20-90 on average compared to state-of-the-art scheduling systems. |
Hero-Gang Neural Model For Named Entity Recognition (2022.naacl-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a fundamental and important task in natural language processing. |
| Approach: | They propose a novel Hero-Gang Neural structure to leverage both global and local information to promote NER by using a Transformer-based encoder and a Gang module. |
| Outcome: | The proposed model can extract local features and position information from the Hero and Gang modules, and it performs on multiple datasets. |
What Makes an Ideal Quote? Recommending “Unexpected yet Rational” Quotations via Novelty (2026.acl-long)
Copied to clipboard
| Challenge: | Prior systems focus on topical relevance and overlook what makes quotes memorable. |
| Approach: | They propose a system that maps quotations and contexts into deep-meaning labels for label-enhanced retrieval. |
| Outcome: | The proposed system can recommend quotations that are contextually novel while semantically coherent. |
Human-Agent Collaborative Paper-to-Page Crafting (2026.findings-acl)
Copied to clipboard
Qianli Ma, Siyu Wang, Chen Yilin, Yinhao Tang, Yixiang Yang, Chang Guo, Bingjie Gao, Zhening Xing, Yanan Sun, Zhipeng Zhang
| Challenge: | Existing approaches to create project pages from academic papers have focused on static slides and posters, but the dynamic nature of webpages remains an unaddressed challenge. |
| Approach: | They propose a novel multi-agent system that deconstructs paper-to-page creation into a coarse-to fine pipeline from narrative planning to multimodal content generation and interactive rendering. |
| Outcome: | The proposed system generates high-quality, visually appealing pages in under 15 minutes for less than $0.1 . |
NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs (2026.acl-long)
Copied to clipboard
Yingfeng Luo, Ziqiang Xu, Yuxuan Ouyang, MuRun Yang, DingYang Lin, Kaiyan Chang, Tong Zheng, Bei Li, Peinan Feng, Quan Du, Tong Xiao, JingBo Zhu
| Challenge: | Large language models have significantly advanced Multilingual Machine Translation (MMT) yet scaling to many languages while maintaining robust performance across directions remains challenging. |
| Approach: | They propose a strategy to reduce the number of translations in one direction . they propose auxiliary parallel sentences to promote cross-lingual transfer . |
| Outcome: | The proposed model performs on par with or better than substantially larger baselines. |
Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models are highly advanced to user-requested tasks. |
| Approach: | They propose a device-server hybrid inference strategy for on-device LLM customization . they construct a pool of diverse base adapters and then blend them into a customized adapter . |
| Outcome: | The proposed method can be used on a large scale without extra training . it can be applied to large-scale LLMs without sacrificing the benefits of on-device customization. |
Event Detection from Social Media for Epidemic Prediction (2024.naacl-long)
Copied to clipboard
Tanmay Parekh, Anh Mac, Jiarui Yu, Yuxuan Dong, Syed Shahriar, Bonnie Liu, Eric Yang, Kuan-Hao Huang, Wei Wang, Nanyun Peng, Kai-Wei Chang
| Challenge: | Social media is an easy-to-access platform providing timely updates about societal trends and events. |
| Approach: | They propose a framework to extract epidemic-related events from social media posts to provide early warnings. |
| Outcome: | The proposed framework can detect epidemic events for three unseen epidemics of Monkeypox, Zika, and Dengue while existing models fail miserably. |
Quantification of Large Language Model Distillation (2025.acl-long)
Copied to clipboard
Sunbowen Lee, Junting Zhou, Chang Ao, Kaige Li, Xeron Du, Sirui He, Haihong Wu, Tianci Liu, Jiaheng Liu, Hamid Alinejad-Rokny, Min Yang, Yitao Liang, Zhoufutu Wen, Shiwen Ni
| Challenge: | Existing studies have revealed the robustness degra-dation caused by data distillation. |
| Approach: | They propose a framework to evaluate and quantify model distillation . they aim to identify identity cognition contradictions and analyse multi-granularity response similarities across models to measure the extent of homogenization. |
| Outcome: | The proposed framework addresses two key aspects: (1) Identifying identity cognition contradictions to assess discrepancies in how models perceive and represent identity-related information; (2) Analyzing multi-granularity response similarities across models to measure the extent of homogenization. |
Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation (2026.acl-long)
Copied to clipboard
Hengyuan Zhang, Shiping Yang, Xiao Liang, Chenming Shang, Yuxuan Jiang, Chaofan Tao, Jing Xiong, Hayden Kwok-Hay So, Ruobing Xie, Angel X. Chang, Ngai Wong
| Challenge: | Existing studies show that stronger models are not always optimal teachers, suggesting a mismatch between the teacher’s output and the student’s learning ability. |
| Approach: | They propose a method that routes each prompt to its optimal teacher via a query-level router that jointly considers the student models’ learnability and teacher models’ response quality. |
| Outcome: | The proposed method outperforms baselines on six benchmarks including instruct tuning and math reasoning settings. |
Learning to Link Grammar and Encyclopedic Information of Assist ESL Learners (P19-3)
Copied to clipboard
Jhih-Jie Chen, Chingyu Yang, Peichen Ho, Ming Chiao Tsai, Chia-Fang Ho, Kai-Wen Tuan, Chung-Ting Tsai, Wen-Bin Han, Jason Chang
| Challenge: | Linggle Booster provides rich lexical information such as collocations and grammar patterns for target words. |
| Approach: | They propose a system that takes an article, identifies target vocabulary, provides lexical information, and generates a quiz on target words. |
| Outcome: | The proposed system has been evaluated on a set of target words and has a good performance. |
Consistency Rating of Semantic Transparency: an Evaluation Method for Metaphor Competence in Idiom Understanding Tasks (2025.coling-main)
Copied to clipboard
| Challenge: | Idioms condense complex semantics into fixed phrases, making idiom comprehension a test of metaphor competence. |
| Approach: | They propose a method to evaluate the metaphor competence of LLMs for the idiom understanding task: the Consistency Rating of Semantic Transparency (CR-ST). |
| Outcome: | The proposed method assesses the difficulty of understanding idioms through two dimensions: overall semantic transparency and constituent semantic transparency, aiming to gauge LLMs’ mastery of metaphor competence. |
LanguageNet: Learning to Find Sense Relevant Example Sentences (C18-2)
Copied to clipboard
| Challenge: | LanguageNet is a system that can help second language learners to search for different meanings and usages of a word . the polysemy of words, namely words with more than one sense, is one of the major challenges for ESOL learners . |
| Approach: | They propose a system which can help second language learners to search for different meanings of a word. |
| Outcome: | The proposed system can help second language learners to search for different meanings and usages of a word. |
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)
Copied to clipboard
Yuelin Bai, Xeron Du, Yiming Liang, Leo Jin, Junting Zhou, Ziqiang Liu, Feiteng Fang, Mingshan Chang, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Moore Wang, Ruibin Yuan, Haihong Wu, Hongquan Lin, Wenhao Huang, Jiajun Zhang, Chenghua Lin, Jie Fu, Min Yang, Shiwen Ni, Ge Zhang
| Challenge: | Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns. |
| Approach: | They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users. |
| Outcome: | The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks. |
IMPACT: Importance-Aware Activation Space Reconstruction (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) achieve strong performance across domains but remain difficult to deploy in resource-constrained environments due to their massive size. |
| Approach: | They propose an importance-aware activation reconstruction framework that links compression to its effect on model performance. |
| Outcome: | Experiments show that IMPACT reduces model size by 55.4% while maintaining accuracy comparable to or better than state-of-the-art models. |
Into the Gray Zone: Domain Contexts Can Blur LLM Safety Boundaries (2026.acl-long)
Copied to clipboard
Ki Sen Hung, Xi Yang, Chang Liu, Haoran Li, Kejiang Chen, Changxuan Fan, Tsun On Kwok, Weiming Zhang, Xiaomeng Li, Yangqiu Song
| Challenge: | a goal of LLM alignment is to balance usefulness with harmlessness, but this conflictes when knowledge serves both legitimate and malicious purposes. |
| Approach: | They propose a framework that combines safety-research contexts with adversarial interactions to exploit a vulnerability in Jargon queries. |
| Outcome: | a framework outperforms existing methods in analyzing Jargon queries, a study shows . it achieves 93% of attacks across seven models, while remaining useful, the authors say . |
Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing definition generation methods take the source word as an indecomposable semantic unit, but in parataxis languages like Chinese, word meanings can be composed using the word formation process. |
| Approach: | They propose to use word formation features to enhance Definition Generation (DG) in Chinese to generate an explanatory text. |
| Outcome: | The proposed model enhances Definition Generation (DG) in Chinese by decomposing the word meaning into different semantic components. |
Personalized Video Comment Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Generating personalized responses in video poses a unique challenge for language models. |
| Approach: | They propose a new automatic metric based on Large Language Models with few-shot in-context learning that measures quality from the aspects of emotion, language style and content relevance. |
| Outcome: | The proposed metric measures quality from emotion, language style and content relevance with human evaluations. |
Transferring General Multimodal Pretrained Models to Text Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text recognition rely on large-scale pretraining on human-annotated or synthetic data. |
| Approach: | They propose a method to transfer multimodal pretrained models to text recognition using image captioning. |
| Outcome: | The proposed method outperforms the baselines and achieves state-of-the-art performance in the Chinese text recognition benchmark. |
Human-AI Collaboration: How AIs Augment Human Teammates (2025.acl-tutorials)
Copied to clipboard
| Challenge: | Despite the potential of general-purpose models, they are far from perfect, excelling at certain tasks while struggling with others. |
| Approach: | This tutorial will review recent developments related to human-AI teaming and collaboration. |
| Outcome: | This tutorial will review recent developments related to human-AI teaming and collaboration. |
Enhancing Agentic Textual Graph Retrieval with Synthetic Stepwise Supervision (2026.acl-long)
Copied to clipboard
Ge Chang, Jinbo Su, Jiacheng Liu, Pengfei Yang, Yuhao Shang, Huiwen Zheng, Hongli Ma, Yan Liang, Yuanchun Li, Yunxin Liu
| Challenge: | Existing methods for integrating textual graphs with LLMs are limited by symbolic inference and high annotation costs. |
| Approach: | They propose a textual graph reasoning framework that integrates textual diagrams with large language models. |
| Outcome: | The proposed approach achieves 15.6% accuracy and 17.2% in F1 score on three common datasets. |