Papers by Lu Li
ITERATE: Image-Text Enhancement, Retrieval, and Alignment for Transmodal Evolution with LLMs (2025.coling-main)
Copied to clipboard
| Challenge: | a new framework for visual annotation of text-based questions is needed to improve performance . obtaining corresponding images through manual annotation often entails high costs . |
| Approach: | They propose a framework that uses visual modality to enhance the performance of text-based questions. |
| Outcome: | The proposed framework improves the alignment between text and images by using search engines or web scraping techniques. |
TeleMelody: Lyric-to-Melody Generation with a Template-Based Two-Stage Method (2022.emnlp-main)
Copied to clipboard
Zeqian Ju, Peiling Lu, Xu Tan, Rui Wang, Chen Zhang, Songruoyao Wu, Kejun Zhang, Xiang-Yang Li, Tao Qin, Tie-Yan Liu
| Challenge: | a new lyric-to-melody generation system bridges the gap between lyrics and melodies . previous generation systems lack paired data and lack of control on generated melodie. |
| Approach: | They develop a lyric-to-melody generation system with music template to bridge the gap between lyrics and melodies. |
| Outcome: | The proposed system bridges the gap between lyrics and melodies by using music template. |
Enhance Robustness of Language Models against Variation Attack through Graph Integration (2024.lrec-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are used in many NLP applications but their vulnerability to adversarial attacks can lead to false or misleading information being distributed. |
| Approach: | They propose a method to incorporate a Chinese character variation graph into pre-trained language models to increase their robustness against character variation attacks in Chinese content. |
| Outcome: | The proposed method outperforms existing language models in combating adversarial attacks in Chinese content. |
Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for code retrieval struggle to balance scalability and annotation quality. |
| Approach: | They propose a method that integrates functions called within the repository and information on third-party APIs to enhance the annotation context. |
| Outcome: | The proposed method improves the annotation context by incorporating functions called within the repository and information on third-party API functionalities. |
Thread: A Logic-Based Data Organization Paradigm for How-To Question Answering with Retrieval Augmented Generation (2025.emnlp-main)
Copied to clipboard
Kaikai An, Fangkai Yang, Liqun Li, Junting Lu, Sitao Cheng, Shuzheng Si, Lu Wang, Pu Zhao, Lele Cao, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Baobao Chang
| Challenge: | Recent advances in retrieval-augmented generation (RAG) have substantially improved question-answering systems, particularly for factoid ‘5Ws’ questions. |
| Approach: | They propose a data organization paradigm where large language models transform documents into more structured and loosely interconnected LUs. |
| Outcome: | Experiments in open-domain and industrial settings show that the proposed paradigm outperforms existing paradigms and shows high adaptability across diverse document formats. |
Two Heads Are Better Than One: Dual-Model Verbal Reflection at Inference-Time (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing LLMs struggle to reliably detect subtle reasoning errors in ASAS tasks. |
| Approach: | They propose a dual-model framework with a dedicated Critic model trained for effective reflection that generates precise verbal feedback. |
| Outcome: | The proposed framework outperforms existing ASAS benchmarks and provides valuable insights into the performance of the proposed framework. |
Pretrain-Finetune Based Training of Task-Oriented Dialogue Systems in a Real-World Setting (2021.naacl-industry)
Copied to clipboard
| Challenge: | a challenge in building task-oriented dialogue systems is the limited amount of supervised training data available. |
| Approach: | They propose a method for training retrieval-based dialogue systems using annotated data and a larger, unlabeled dataset. |
| Outcome: | The proposed method improves model performance offline and online compared with no pretraining . the model is deployed in an agent-support application and evaluated on live customer service contacts . |
Are U a Joke Master? Pun Generation via Multi-Stage Curriculum Learning towards a Humor LLM (2024.findings-acl)
Copied to clipboard
Yang Chen, Chong Yang, Tu Hu, Xinhao Chen, Man Lan, Li Cai, Xinlin Zhuang, Xuan Lin, Xin Lu, Aimin Zhou
| Challenge: | Existing research has demonstrated that the ability of large language models (LLMs) to generate humorous sentences is limited to producing 25 unique jokes. |
| Approach: | They propose a multi-stage curriculum preference learning framework to optimize both pun structure preferences and humor preferences by a Chinese Pun dataset. |
| Outcome: | The proposed method significantly outperforms baseline models on Chinese and English benchmark datasets. |
AGD: Adversarial Game Defense Against Jailbreak Attacks in Large Language Models (2025.acl-long)
Copied to clipboard
Shilong Pan, Zhiliang Tian, Zhen Huang, Wanlong Yu, Zhihua Wen, Xinwang Liu, Kai Lu, Minlie Huang, Dongsheng Li
| Challenge: | Existing defenses, including post-training alignment and prompt engineering, struggle with adaptability to out-of-distribution (OOD) attacks. |
| Approach: | They propose an adversarial game-based defense method that dynamically adjusts LLMs’ internal representations to achieve a balanced trade-off between helpfulness and harmlessness. |
| Outcome: | The proposed method improves LLMs’ safety over all baselines. |
MM-StanceDet: Retrieval-Augmented Multi-modal Multi-agent Stance Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal stance detection face contextual grounding, cross-modal interpretation ambiguity, and single-pass reasoning fragility. |
| Approach: | They propose a multi-agent framework that integrates Retrieval Augmentation for contextual grounding, specialized Multimodal Analysis agents for nuanced interpretation, Reasoning-Enhanced Debate stage and Self-Reflection for robust adjudication. |
| Outcome: | Extensive experiments on five datasets show that the proposed framework outperforms state-of-the-art methods. |
Cross-media Structured Common Space for Multimedia Event Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | We propose a new task to extract events and their arguments from multimedia documents . traditional methods target text, images or videos, but multimedia content is distributed via multimedia . |
| Approach: | They propose a method that encodes structured representations of semantic information from textual and visual data into a common embedding space. |
| Outcome: | The proposed method achieves 4.0% and 9.8% absolute gains on text event argument role labeling and visual event extraction. |
InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training (2026.acl-long)
Copied to clipboard
| Challenge: | Existing GUI agent benchmarks are manually constructed and lack scale and diversity as training environments. |
| Approach: | They propose a GUI agent training system that automatically generates web environments at scale. |
| Outcome: | The proposed system outperforms commercial GUI agents at realistic website construction and improves on OSWorld and Online-Mind2Web. |
MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models have demonstrated outstanding capabilities in mathematical reasoning, but there is a performance gap between open-source models and closed-source ones. |
| Approach: | They propose a method for generating diverse and reliable math problems by leveraging the ground-truth solutions of the seed data. |
| Outcome: | The proposed model outperforms open-source models across five representative mathematical reasoning datasets. |
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)
Copied to clipboard
Bingxian Wu, Yu Zhang, Zonghao Guo, Tang Liu, Chen Qian, Yuxiang Lu, Xingbo Du, Yanghao Li, Yidan Zhang, Chi Chen, Ling Yao, Chenghu Zhou, Maosong Sun
| Challenge: | Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows. |
| Approach: | They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. |
| Outcome: | Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution . |
SmartBench: Is Your LLM Truly a Good Chinese Smartphone Assistant? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for Large Language Models focus on objective tasks like mathematics and coding in English, which do not reflect the practical use cases of on-device LLMs in real-world mobile scenarios. |
| Approach: | They propose a benchmark to evaluate the capabilities of on-device Large Language Models in Chinese mobile contexts. |
| Outcome: | The proposed framework evaluates on-device LLMs and MLLMs in Chinese . it provides a standardized framework for evaluating LLM performance on real smartphones . |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition (2024.acl-long)
Copied to clipboard
| Challenge: | Experiments show that ChunkAttention can speed up the self-attention kernel by 3.2-4.8 compared to the start-of-the-art implementation. |
| Approach: | They propose a prefix-aware self-attention module that can detect matching prompt prefixes across multiple requests and share their key/value tensors in memory at runtime. |
| Outcome: | The proposed module can speed up the self-attention kernel by 3.2-4.8 compared to the start-of-the-art implementation, with the length of the system prompt ranging from 1024 to 4096. |
Consecutive Batch Model Editing with HooK Layers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that retrain are time- and resource-consuming, but they lack the memory to support sequential and batch editing. |
| Approach: | They propose a model editing method that supports sequential and batch editing . they use a small amount of memory to store several hook layers that remain unchanged over time . |
| Outcome: | The proposed method is memory-friendly and can store hook layers that remain unchanged over time. |
Distantly Supervised Course Concept Extraction in MOOCs with Academic Discipline (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to extract knowledge concepts from MOOCs are noisy and incomplete because of the limited dictionary and diverse MOOC. |
| Approach: | They propose to automatically extract course concepts using distant supervision to eliminate the heavy work of human annotations. |
| Outcome: | The proposed framework outperforms state-of-the-art methods with 7% absolute improvement in F1 score. |
Scalable Fine-tuning from Multiple Data Sources: A First-Order Approximation Approach (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a new algorithm to estimate fine-tuning performance for a target task is proposed . conventional subset selection methods require repeated training on subsets of auxiliary tasks . |
| Approach: | They propose an algorithm to fine-tune a language model for a target task by optimally using auxiliary tasks' information. |
| Outcome: | The proposed method can estimate fine-tuning performance on CPUs in seconds. |
PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration (2025.acl-long)
Copied to clipboard
| Challenge: | Existing privacy protection methods for large language models suffer from performance degradation or large inference time overhead. |
| Approach: | They propose a plug-and-play method to protect the privacy of user inputs during LLM inference . they use offline restoration vectors to train restoration vector for each privacy span type . |
| Outcome: | The proposed method can prevent the linear growth of the privacy budget. |
Entropy Scheduling in Reinforcement Learning for Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | entropy in reinforcement learning functions analogously to the learning rate in LLMs. |
| Approach: | They propose an entropy scheduling system that optimizes different pre-set goals by controlling and scheduling entropicy at each step of the RL process. |
| Outcome: | The proposed method improves AIME2024 from 50.9 to 54.9 within 40 training steps. |
Maximizing the Effectiveness of Larger BERT Models for Compression (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for capturing large BERT models as teachers do not fully exploit the potential advantages of larger teachers. |
| Approach: | They propose a method that leverages a pretrained teacher model to guide the training of a lightweight student model to enhance knowledge transfer. |
| Outcome: | The proposed method enhances knowledge transfer by leveraging a pretrained teacher model to guide the training of a lightweight student model. |
TrInk: Ink Generation with Transformer Network (2025.emnlp-main)
Copied to clipboard
Zezhong Jin, Shubhang Desai, Xu Chen, Biyi Fang, Zhuoyi Huang, Zhe Li, Chong-Xin Gan, Xiao Tu, Man-Wai Mak, Yan Lu, Shujie Liu
| Challenge: | Existing methods for handwriting generation capture global dependencies and can generate high-quality handwritten samples. |
| Approach: | They propose a Transformer-based model for ink generation, TrInk, which captures global dependencies. |
| Outcome: | The proposed model reduces character error rate and word error rate by 35.56% on the IAM-OnDB dataset compared to previous models. |
GCML: Gradient Coherence Guided Meta-Learning for Cross-Domain Emerging Topic Rumor Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing domain adaptation rumor detection methods ignore the data generalization differences and rely on a large amount of unlabeled target domain samples to achieve domain adaptation. |
| Approach: | They propose a Gradient Coherence guided Meta-Learning approach for emerging topics rumor detection that selectively learns more "generalizable" tasks that are more beneficial in adapting to the target domain. |
| Outcome: | The proposed method outperforms baselines on real-world datasets and significantly outperformed traditional methods on the in-domain condition. |
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)
Copied to clipboard
Zhiheng Xi, Dingwen Yang, Jiaqi Liu, Jixuan Huang, Honglin Guo, Baodai Huang, Tinggang Chen, Qi Zhang, Zhonghang Lu, Chenyu Liu, Jiajun Sun, Jiazheng Zhang, Dingwei Zhu, Xin Guo, Junzhe Wang, Zhihao Zhang, Yuming Yang, Junjie Ye, Minghe Gao, Dongrui Liu, Jiaming Ji, Guohao Li, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified. |
| Approach: | They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
| Outcome: | Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 . |
AHP-Powered LLM Reasoning for Multi-Criteria Evaluation of Open-Ended Responses (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Question answering (QA) tasks have been extensively studied in the field of natural language processing. |
| Approach: | They propose a method that leverages large language models and the analytic hierarchy process to assess open-ended questions. |
| Outcome: | The proposed method more closely aligns with human judgment compared to baselines on four datasets. |
Reflection on Knowledge Graph for Large Language Models Reasoning (2025.findings-acl)
Copied to clipboard
Yigeng Zhou, Wu Li, Yifan Lu, Jing Li, Fangming Liu, Meishan Zhang, Yequan Wang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Existing methods for supplementing Large Language Models (LLMs) with knowledge graphs often introduce noise in the retrieval and reasoning pipeline, hindering their ability to integrate external knowledge for complex multi-hop question answering. |
| Approach: | They propose a framework to enhance LLMs' reasoning capabilities through reflective engagement with knowledge graphs by Query Decoupling, LLM-Driven Knowledge Graph Exploration, and Inference with Knowledge Reconstruction. |
| Outcome: | The proposed framework integrates external knowledge into LLMs and trains them to leverage this knowledge for answering questions. |
Exploiting Node Content for Multiview Graph Convolutional Network and Adversarial Regularization (2020.coling-main)
Copied to clipboard
Qiuhao Lu, Nisansa de Silva, Dejing Dou, Thien Huu Nguyen, Prithviraj Sen, Berthold Reinwald, Yunyao Li
| Challenge: | Existing graph autoencoders and its variants have been used for node embedding . a new method is proposed to model consistency across different views of networks . |
| Approach: | They propose a network embedding method which enforces latent representations to be consistent across different views of networks by incorporating a multiview adversarial regularization module. |
| Outcome: | The proposed method compares favorably with the state-of-the-art methods on benchmark datasets and on a real-world application. |
Temporal Token Matters: Investigating and Interpreting the Consistency of Temporal Ordering in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit notable deficiencies in temporal reasoning . phrasing changes can lead LLMs to produce inconsistent outputs . |
| Approach: | They investigate the mechanistic interpretability of temporal ordering within event temporal reasoning . they identify a sparse subset of attention heads that are causally responsible for reasoning outcomes . |
| Outcome: | The proposed model outperforms other models in a variety of tasks and is validated by intervention-based experiments. |
MemSearcher: Iterative Memory Integration for Search Agent via End-to-End Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Qianhao Yuan, Jie Lou, Zichao Li, Jiawei Chen, Yaojie Lu, Hongyu Lin, Le Sun, Debing Zhang, Xianpei Han
| Challenge: | Recent LLM-based search agents often concatenate the full interaction history into the context, producing long and noisy inputs and increasing compute cost and memory overhead. |
| Approach: | They propose an agent framework that maintains a compact memory during multi-turn interactions. |
| Outcome: | The proposed framework outperforms strong history-concatenation (ReAct-style) baselines on a range of public datasets while maintaining nearly constant token counts across multi-turn interactions. |
Towards Knowledge Checking in Retrieval-augmented Generation: A Representation Perspective (2025.naacl-long)
Copied to clipboard
Shenglai Zeng, Jiankun Zhang, Bingheng Li, Yuping Lin, Tianqi Zheng, Dante Everaert, Hanqing Lu, Hui Liu, Hui Liu, Yue Xing, Monica Xiao Cheng, Jiliang Tang
| Challenge: | Existing studies have shown that LLMs struggle to identify the boundaries of their own knowledge and tend to prioritize external information over internal knowledge learned during pre-training. |
| Approach: | They conduct a comprehensive analysis of LLM representation behaviors and demonstrate the significance of using representations in knowledge checking. |
| Outcome: | The proposed classifiers improve performance even when dealing with noisy knowledge databases. |
CREAD: Combined Resolution of Ellipses and Anaphora in Dialogues (2021.naacl-main)
Copied to clipboard
Bo-Hsiang Tseng, Shruti Bhargava, Jiarui Lu, Joel Ruben Antony Moniz, Dhivya Piraviperumal, Lin Li, Hong Yu
| Challenge: | Traditionally, anaphora resolution and ellipses resolution are limited in dialogues . despite rapid progress in dialogue systems, several difficulties remain . |
| Approach: | They propose a joint learning framework for modeling coreference resolution and query rewriting for complex, multi-turn dialogues. |
| Outcome: | The proposed model outperforms the state-of-the-art model on a rewritten dialogue dataset. |
Curriculum-RLAIF: Curriculum Alignment with Reinforcement Learning from AI Feedback (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to align large language models with human preferences are limited in generalizability due to distribution shift, preference label noise, and mismatch of challenging samples with model capacity. |
| Approach: | They propose a framework that constructs preference pairs with varying difficulty levels and then produces a specific curriculum for reward model training. |
| Outcome: | The proposed framework improves generalizability of reward models by a significant margin without incurring additional inference costs compared to existing non-curriculum baselines. |
CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for MLLMs are weak on explicit attacks, but weak on implicit ones. |
| Approach: | They propose an automated red-teaming pipeline that leverages reinforcement learning with tailored reward modules to generate diverse implicit samples across 14 domains. |
| Outcome: | The proposed method outperforms existing methods in implicit and explicit attacks while maintaining high utility. |
Few-Shot Multimodal Named Entity Recognition Based on Mutlimodal Causal Intervention Graph (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal named entity recognition are limited due to limited resources. |
| Approach: | They propose a Few-shot Multimodal Named Entity Recognition task to address these relation types by constructing a multimodal graph and a new multimodal causal intervention strategy. |
| Outcome: | The proposed model improves on two multimodal named entity recognition datasets. |
Investigating the Multilingual Calibration Effects of Language Model Instruction Tuning (2026.eacl-short)
Copied to clipboard
Jerry Huang, Peng Lu, Qiuhao Zeng, Yusuke Iwasawa, Yutaka Matsuo, Sarath Chandar, Edison Marrese-Taylor, Irene Li
| Challenge: | despite advances in foundation model research, the relationship between large language models and their calibration remains an open area of research. |
| Approach: | They examine a gap in the calibration of large language models within multilingual settings to better understand how data scarcity can potentially lead to different calibration effects. |
| Outcome: | The proposed calibration gap is found in two multilingual benchmarks over 29 and 42 languages. |
MalURLBench: A Benchmark Evaluating Agents’ Vulnerabilities When Processing Web URLs (2026.findings-acl)
Copied to clipboard
Dezhang Kong, Zhuxi Wu, Shiqi Liu, ZhiCheng Tan, Kuichen Lu, Minghao Li, Qichen Liu, Shengyu Chu, Zhenhua Xu, Xuan Liu, Meng Han
| Challenge: | Existing models struggle to detect elaborately disguised malicious URLs, despite their ability to process malicious URL's. |
| Approach: | They propose a benchmark to evaluate LLMs’ vulnerabilities to malicious URLs and a lightweight defense module to mitigate the vulnerability. |
| Outcome: | The proposed framework analyzes 61,845 attack instances spanning 10 real-world scenarios and 7 categories of real malicious websites. |
NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and Sentence-matching Summarization (2023.findings-eacl)
Copied to clipboard
| Challenge: | a recent study shows that accessing medical literature is difficult for laypeople because it is written for specialists and contains medical jargon. |
| Approach: | They propose a two-stage strategy to identify relevant content to be simplified . they first generate reference summaries via sentence matching between the original and simplified abstracts . |
| Outcome: | The proposed approach improves on a seq2seq-based test set on an English medical corpus . it also improves the SARI score by 1.1% . |
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing learning metrics are limited to tasks where large human ratings are available. |
| Approach: | They propose a model-based natural language generation (NLG) evaluation metric that is highly correlated with human judgements without requiring human annotation. |
| Outcome: | The proposed metric outperforms all prior unsupervised metrics on multiple NLG tasks including translation, image captioning, and WebNLG text generation. |
TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models (LLMs) encounter performance limitations, impeding further enhancements in code generation tasks. |
| Approach: | They propose to combine two distinct prompts through a hybridization process to enhance the evolution of training prompts for code LLMs. |
| Outcome: | The proposed method significantly improves the performance of Code LLMs across five code generation benchmarks. |
MCTS: A Multi-Reference Chinese Text Simplification Dataset (2024.lrec-main)
Copied to clipboard
Ruining Chong, Luming Lu, Liner Yang, Jinran Nie, Zhenghao Liu, Shuo Wang, Shuhan Zhou, Yaoxin Li, Erhong Yang
| Challenge: | Existing studies on text simplification systems have focused on unsupervised methods due to the limited evaluation data in language and domain. |
| Approach: | They propose a Chinese text simplification dataset that provides a detailed analysis and an annotation process. |
| Outcome: | The proposed dataset evaluates the performance of unsupervised methods and advanced large language models. |
Exploring Schema Generalizability of Text-to-SQL (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing text-to-SQL models are limited in their generalizability, despite their performance being over-estimated. |
| Approach: | They propose a framework to generate novel text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
| Outcome: | The proposed framework generates text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. |
When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved impressive performance across NLP tasks. |
| Approach: | They propose to use long-context SFT to improve short-contemporary performance . they also decouple and analyze two key components, Multi-Head Attention and Feed-Forward Network . |
| Outcome: | The proposed model improves short-context performance, contrary to pretraining. |
CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical Dataset (2023.findings-acl)
Copied to clipboard
| Challenge: | a cross-domain text-to-SQL task aims to parse user questions into SQL on complete unseen databases . a single-domain task evaluates the performance on identical databases based on the same domain . |
| Approach: | They propose a cross-domain text-to-SQL task that parses user questions into SQL on unseen databases. |
| Outcome: | The proposed system can parse user questions into SQL on complete unseen databases. |
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Ke Wang, Junting Pan, Linda Wei, Aojun Zhou, Weikang Shi, Zimu Lu, Han Xiao, Yunqiao Yang, Houxing Ren, Mingjie Zhan, Hongsheng Li
| Challenge: | Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning. |
| Approach: | They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures . |
| Outcome: | The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
Demystifying Small Language Models for Edge Deployment (2025.acl-long)
Copied to clipboard
Zhenyan Lu, Xiang Li, Dongqi Cai, Rongjie Yi, Fangming Liu, Wei Liu, Jian Luan, Xiwen Zhang, Nicholas D. Lane, Mengwei Xu
| Challenge: | Small language models (SLMs) are a promising solution for resource-constrained devices such as smartphones and the Web of Things. |
| Approach: | They propose to use SLMs to build and optimize a set of small language models that are publicly accessible. |
| Outcome: | The proposed models outperform 7B models in general tasks, while their in-context learning capabilities remain limited and their efficiency has significant optimization potential. |
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient. |
| Approach: | They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve. |
| Outcome: | The proposed approach improves on three SLT datasets conducted under the gloss-free setting. |
A Prism Module for Semantic Disentanglement in Name Entity Recognition (P19-1)
Copied to clipboard
| Challenge: | Xu et al., 2015) proposed a noise reduction mechanism to disentangle semantics of words . hard and soft attention mechanisms are used to reduce noise in NLP tasks . |
| Approach: | They propose a prism module to disentangle semantic aspects of words and reduce noise . they propose combining prism modules with downstream models to improve model performance . |
| Outcome: | The proposed method significantly improves the performance of baselines on named entity recognition (NER) tasks. |
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models respond well in high-resource languages but struggle in low-resourced languages. |
| Approach: | They propose a method to construct cross-lingual instruction following samples with instruction in English and response in low-resource languages. |
| Outcome: | The proposed method builds a large-scale cross-lingual instruction tuning dataset on 10 languages. |
Interpretable Composition Attribution Enhancement for Visio-linguistic Compositional Understanding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Despite promising progress, vision-language models still exhibit significant challenges in understanding visio-linguistic concepts beyond object terms. |
| Approach: | They propose a framework that encourages the model to pay greater attention to composition words denoting relationships and attributes within the text. |
| Outcome: | The proposed framework improves the ability to discern intricate details and construct more sophisticated interpretations of combined visual and linguistic elements. |
ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors (2024.findings-emnlp)
Copied to clipboard
Zhexin Zhang, Yida Lu, Jingyuan Ma, Di Zhang, Rui Li, Pei Ke, Hao Sun, Lei Sha, Zhifang Sui, Hongning Wang, Minlie Huang
| Challenge: | Existing tools for detecting safety issues in LLMs are expensive and inefficient. |
| Approach: | They propose an LLM-based safety detector which annotates the safety of queries and provides explanations for its decisions. |
| Outcome: | The proposed detector outperforms baselines on four sets of query-response pairs and is effective as a safety evaluator for advanced LLMs. |
Prompt Space Optimizing Few-shot Reasoning Success with Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. |
| Approach: | They propose a new approach that uses text embeddings to obtain basis vectors by matrix decomposition and constructs a space for representing all prompts. |
| Outcome: | The proposed approach significantly outperforms state-of-the-art prompt paradigms on ten public reasoning benchmarks. |
Can Large Language Models Understand Context? (2024.findings-eacl)
Copied to clipboard
Yilun Zhu, Joel Moniz, Shruti Bhargava, Jiarui Lu, Dhivya Piraviperumal, Site Li, Yuan Zhang, Hong Yu, Bo-Hsiang Tseng
| Challenge: | Existing evaluation methodologies for Large Language Models (LLMs) have been inadequate to evaluate their ability to understand contextual features. |
| Approach: | They propose a benchmark to assess large language models' ability to understand context by adapting existing datasets to suit their evaluation. |
| Outcome: | The proposed model performs better under the in-context learning pretraining scenario than state-of-the-art models. |
RATE-Nav: Region-Aware Termination Enhancement for Zero-shot Object Navigation with Vision-Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Object navigation is a fundamental task in embodied artificial intelligence. |
| Approach: | They propose a region-aware Termination-Enhanced method that incorporates visual language models and exploration rates to enable efficient termination. |
| Outcome: | The proposed method achieves a success rate of 67.8% and an SPL of 31.3% on the HM3D dataset. |
Ciron: a New Benchmark Dataset for Chinese Irony Detection (2020.lrec-1)
Copied to clipboard
| Challenge: | Automatic Chinese irony detection often lacks labeled benchmark datasets . despite its pervasive nature, irony is a trope whose actual meaning differs from what is literally enunciated. |
| Approach: | They propose to use a Chinese benchmark dataset for automatic Chinese irony detection to provide a benchmark for machine learning models. |
| Outcome: | The proposed dataset includes more than 8.7K posts, collected from Weibo, a micro blogging platform. |
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) face memory challenges due to the high cost of backpropagation. |
| Approach: | They propose a zeroth-order (ZO) optimization that matches memory usage to inference . they propose scalable and memory-efficient zeroth order (ZE) optimizer that integrates annealed A-GNB gradients with diagonal Hessian estimation and layer-wise clipping as a second-order pre-conditioner. |
| Outcome: | The proposed algorithm outperforms state-of-the-art methods with an average speedup of 20 over MeZO on RoBERTa-large and OPT-1.3B. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
LeakDojo: Decoding the Leakage Threats of RAG Systems (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have failed to assess RAG leakage risks for large language models . constructing and maintaining highquality RAG knowledge databases has become increasingly costly . |
| Approach: | They propose a framework for controlled evaluation of RAG leakage using query generation and adversarial instructions. |
| Outcome: | The proposed framework compares six existing attacks across fourteen LLMs, four datasets, and diverse RAG systems. |
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders (2025.emnlp-main)
Copied to clipboard
Weiqiao Shan, Yuang Li, Yuhao Zhang, Yingfeng Luo, Chen Xu, Xiaofeng Zhao, Long Meng, Yunfei Lu, Min Zhang, Hao Yang, Tong Xiao, JingBo Zhu
| Challenge: | Existing work on integrating audio encoders with large language models (LLMs) has focused on semantic understanding tasks, but different tasks may require distinct features that emphasize either semantic or acoustic aspects. |
| Approach: | They propose to use a prompt-aware mixture to enhance the Speech LLM that uses multiple audio encoders to extract different features based on the prompt. |
| Outcome: | The proposed approach outperforms all single-encoder Speech LLMs on ASR, speaker number verification, and AC tasks. |
Visual Evidence Prompting Mitigates Hallucinations in Large Vision-Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | LVLMs have shown impressive progress by integrating visual perception with linguistic understanding to produce contextually grounded outputs. |
| Approach: | They propose a visual evidence prompting method to mitigate hallucinations in large vision-language models by using small visual models to complement them. |
| Outcome: | The proposed method reduces hallucinations by reducing false activation and enhancing correct ones. |
Clear Up Confusion: Advancing Cross-Domain Few-Shot Relation Extraction through Relation-Aware Prompt Learning (2024.naacl-short)
Copied to clipboard
Ge Bai, Chenji Lu, Daichi Guo, Shilong Li, Ying Liu, Zhang Zhang, Guanting Dong, Ruifang Liu, Sun Yong
| Challenge: | Existing approaches to few-shot Relation Extraction (RE) are prone to confusion when applying knowledge to a target domain with entirely new types of relations. |
| Approach: | They propose a relation-aware prompt learning method with pre-training to clear confusion by decomposing relation types through an innovative label prompt. |
| Outcome: | The proposed method outperforms previous sota methods and yields better results on cross-domain few-shot RE tasks. |
Multilingual Knowledge Graph Completion with Self-Supervised Adaptive Graph Alignment (2022.acl-long)
Copied to clipboard
Zijie Huang, Zheng Li, Haoming Jiang, Tianyu Cao, Hanqing Lu, Bing Yin, Karthik Subbian, Yizhou Sun, Wei Wang
| Challenge: | Existing methods to predict missing facts in knowledge graphs are limited in language alignment . SS-AGA uses seed alignment as an edge type to fuses all KGs as a whole graph . |
| Approach: | They propose a self-supervised adaptive graph alignment method that fuses all KGs as a whole graph by regarding alignment as 'a new edge type' they propose SS-AGA method that uses relation-aware attention weights to capture potential alignment pairs in a new paradigm. |
| Outcome: | The proposed method can predict missing facts in a knowledge graph (KG) but language alignment is scarce and new alignment identification is noisy. |
PaperRegister: Boosting Flexible-grained Paper Search via Hierarchical Register Indexing (2026.acl-long)
Copied to clipboard
| Challenge: | Existing paper search systems lack detailed information to support finer-grained queries. |
| Approach: | They propose a paper-based index that transforms abstract-based corpus index into hierarchical index tree and offline can support paper search queries. |
| Outcome: | The proposed system achieves the SOTA performance and excels in fine-grained scenarios. |
Breaking the Noise Barrier: LLM-Guided Semantic Filtering and Enhancement for Multi-Modal Entity Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multimodal knowledge graphs. |
| Approach: | They propose a novel LLMguided MMEA framework that prioritizes noise reduction before fusion. |
| Outcome: | The proposed framework prioritizes noise reduction before fusion and improves semantics on the noisy FB YG dataset. |
Prototype-based Prompt-Instance Interaction with Causal Intervention for Few-shot Event Detection (2024.lrec-main)
Copied to clipboard
| Challenge: | Few-shot Event Detection (FSED) requires limited labeled data and expensive manual labeling. |
| Approach: | They propose a prototype-based prompt-instance Interaction with causal Intervention model to utilize both prompts and verbalizers and effectively eliminate all biases. |
| Outcome: | The proposed model utilizes both prompts and verbalizers and eliminates all biases on RAMS and ACE datasets. |
Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing metrics for video captioning are based on text-based comparisons with ground-truth references. |
| Approach: | They propose a reference-free benchmark that assesses video captions based on their utility . they will release the benchmark to facilitate reproducible research . |
| Outcome: | The proposed benchmark improves on human-verified, fine-grained questions . it correlates significantly better with human judgments than existing metrics . |
JointCoder: Exploring Automated ICD Coding on Real-World Chinese EHRs with a Multi-Agent Framework (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing automated ICD coding systems face several fundamental challenges due to the limited availability of publicly available Chinese ICD datasets. |
| Approach: | They propose to use a Chinese ICD coding dataset and a multi-agent framework to reformulate ICD as a joint disease-procedure coding task. |
| Outcome: | The proposed system outperforms state-of-the-art methods on real-world Chinese ICD coding datasets and 1.7B-parameter models. |
Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network (P18-1)
Copied to clipboard
| Challenge: | Existing models for matching dialogue responses rely on semantic and functional dependencies . a recent study only uses the last utterance in context for matching a reply . |
| Approach: | They propose a model that matches a response with its multi-turn context using attention. |
| Outcome: | The proposed model outperforms the state-of-the-art models on two large-scale multi-turn response selection tasks. |
Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for full-attention dLLMs rely on random masking strategies that overlook intrinsic token dependencies. |
| Approach: | They propose an attention-guided denoising and optimization framework that aligns training and optimization with attention-derived dependencies. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on mathematical and coding benchmarks. |
Navigating the Infinite Dynamic Web Space: Effective In-Context Exploration via Cognitive Multi-Agent Collaboration (2026.eacl-long)
Copied to clipboard
Guozhao Mo, Yanjiang Liu, Yafei Shi, Jiawei Chen, Yang Li, Yaojie Lu, Hongyu Lin, Ben He, Le Sun, Bo Zheng, Xianpei Han
| Challenge: | Existing methods for dynamic web navigation rely on greedy strategies or value estimation, struggle to achieve effective backtracking and are heavily dependent on proprietary models. |
| Approach: | They propose a cognitive multi-agent collaboration framework that enhances cyberspace exploration capability through In-Context Exploration. |
| Outcome: | The proposed framework surpasses the proprietary model Claude-3.5 Sonnet on the WebArena benchmark. |
HomoGraphAdapter: A Homogeneous Graph Neural Network as an Effective Adapter for Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing adaptation methods overlook structural knowledge between text and image modalities or create overly complex graphs containing redundant information for alignment. |
| Approach: | They propose a method to adapt visual models to downstream tasks using text and image modalities. |
| Outcome: | The proposed method improves classification accuracy by 1.51% for 1-shot and 0.74% for 16-shot on 11 datasets. |
StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children’s Story-Based Learning (2024.emnlp-main)
Copied to clipboard
Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong, Ying Xu, Yunyao Li, Qianwen Wang, Dakuo Wang, Yuling Sun
| Challenge: | Existing story reading systems fail to capture the nuances of how education experts think when conducting interactive story reading activities. |
| Approach: | They propose to use existing question-answering (QA) datasets to capture experts' annotations and thinking process to construct a story-based annotation framework. |
| Outcome: | The proposed framework captures experts’ annotations and thinking process and can be used to generate 5, 868 expert-annotated QA pairs with real-world knowledge. |
Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies focus on enhancing large-scale language models' reasoning abilities, but the research question of how to GSM8K Performance vs. computational cost remains. |
| Approach: | They propose to train small-scale language models with their own outputs to avoid relying on large models' outputs. |
| Outcome: | The proposed approach outperforms baseline models with comparable sizes while minimizing the required compute. |
Memorizing is Not Enough: Deep Knowledge Injection Through Reasoning (2025.acl-long)
Copied to clipboard
Ruoxi Xu, Yunjie Ji, Boxi Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Ben He, Yingfei Sun, Xiangang Li, Le Sun
| Challenge: | Existing knowledge injection frameworks focus on knowledge memorization and retrieval, but static nature of large language models leads to outdated information as the real world evolves or when adapting to domain-specific knowledge. |
| Approach: | They propose a four-tier knowledge injection framework that defines the levels of knowledge injection: memorization, retrieval, reasoning, and association. |
| Outcome: | The proposed framework defines the levels of knowledge injection: memorization, retrieval, reasoning, and association. |
Through the Valley: Path to Effective Long CoT Training for Small Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Long chain-of-thought (CoT) supervision is effective for large language models . but small models trained on limited long CoT data experience performance degradation . |
| Approach: | They identify a phenomenon called Long CoT Degradation in small language models . long CoT data can be used to generate long chain-of-thought (CoT) responses . |
| Outcome: | The results show that models trained on 8k long CoT examples lose up to 75% of their original performance before fine-tuning. |
Sparsity-Accelerated Training for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated proficiency across various NLP tasks but often require additional training, such as continual pre-training and supervised fine-tuning. |
| Approach: | They propose to leverage sparsity in pre-trained LLMs to accelerate training by disregarding computations for unimportant neurons. |
| Outcome: | The proposed framework achieves comparable or superior performance to standard training while significantly accelerating the process. |
D-Artemis: A Deliberative Cognitive Framework for Mobile GUI Multi-Agents (2026.findings-acl)
Copied to clipboard
Hongze Mi, Yibo Feng, WenJie Lu, Yuqi Wang, Jinyuan Li, Song Cao, He Cui, Tengfei Tian, Xuelin Zhang, Haotian Luo, Di Sun, Jun Fang, Hua Chai, Naiqiang Tan, Gang Pan
| Challenge: | Graphical User Interface (GUI) agents aim to automate a wide spectrum of human tasks by emulating user interaction. |
| Approach: | They propose a deliberative framework that leverages a fine-grained tip retrieval mechanism to inform its decision-making process. |
| Outcome: | The proposed framework achieves SOTA among open-source general models on AndroidWorld and ScreenSpot-V2 . it leverages a fine-grained, app-specific tip retrieval mechanism to inform its decision-making process . |
Measuring Pointwise 𝒱-Usable Information In-Context-ly (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning (ICL) is a new learning paradigm that has gained popularity along with the development of large language models. |
| Approach: | They propose to adapt a recently proposed hardness metric, pointwise V-usable information (PVI), to an in-context version. |
| Outcome: | The proposed hardness metric is compared with the original model and is more efficient because it requires only a few exemplars and does not require fine-tuning. |
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Zhitong Wang, Cheng Gao, Chaojun Xiao, Yufei Huang, Shuzheng Si, Kangyang Luo, Yuzhuo Bai, Wenhao Li, Tangjian Duan, Chuancheng Lv, Guoshan Lu, Gang Chen, Fanchao Qi, Maosong Sun
| Challenge: | Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence. |
| Approach: | They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary. |
| Outcome: | Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training. |
Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization (P19-1)
Copied to clipboard
| Challenge: | Semantic parsing aims to transform natural language utterances into formal meaning representations (MRs) whereas an NL generator achieves the reverse, the two tasks are often studied separately. |
| Approach: | They propose a method of dual information maximization to regularize the learning process by matching the joint distributions of p and q of NLs. |
| Outcome: | The proposed method empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs. |
ToM-Synth: Scaling Robust Theory of Mind in LLMs via 6,912 Structured Social Units (2026.findings-acl)
Copied to clipboard
Guiyang Hou, Xiang Huang, Shangke Lyu, Yuchuan Wu, Weiyao Luo, Xinyu Mei, Yongliang Shen, Weiming Lu, Yongbin Li
| Challenge: | Existing methods endowing LLMs with Theory of Mind fail to internalize the augmented ToM into the LLM. |
| Approach: | They propose a factorial combinatorial synthesis framework that enables systematic synthesis of ToM data and uses it for RL fine-tuning. |
| Outcome: | The proposed framework yields a training dataset of 27,648 instances. |
Dynamic Online Conversation Recommendation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models that assume static user interests are unable to capture the temporal aspects of user interactions and interest changes over time. |
| Approach: | They propose a neural architecture to exploit changes of user interactions and interests over time to predict which discussions they are likely to enter. |
| Outcome: | The proposed model outperforms state-of-the-art models that assume static user interests and handle future conversations that are unseen during training time. |
Tuna: Instruction Tuning using Feedback from Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | LLms like LLaMA have shown to be cost-effective for generating better responses . however, the instruction-tuned model has only seen one response per instruction . |
| Approach: | They propose to fine tune an instruction-tuned LLM using probabilistic ranking and contextual ranking approaches to increase the likelihood of generating better responses. |
| Outcome: | The proposed model improves on Super Natural Instructions, LMentry and Vicuna QA. |
Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference (2025.naacl-long)
Copied to clipboard
Zeping Li, Xinlong Yang, Ziheng Gao, Ji Liu, Guanchen Li, Zhuang Liu, Dong Li, Jinzhang Peng, Lu Tian, Emad Barsoum
| Challenge: | Existing methods such as Medusa lack adequate information interaction between different drafting heads. |
| Approach: | They propose an enhanced speculative decoding framework that builds upon Medusa and integrates a drafting block capable of parallel inference. |
| Outcome: | The proposed framework outperforms Medusa in terms of head accuracy and latency. |
FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model Compression (2026.findings-eacl)
Copied to clipboard
| Challenge: | Low-rank decomposition methods suffer from accuracy degradation and expensive calibration procedures. |
| Approach: | They propose a fast and accurate, training-free structural compression method based on fine-grained low-rank transformations in the activation space. |
| Outcome: | The proposed method outperforms pruning baselines in generalization and downstream performance while delivering inference speedups. |
Social Bot-Aware Graph Neural Network for Early Rumor Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models do not distinguish genuine users from social bots, and their failure in identifying rumors timely. |
| Approach: | They propose to account for social bots’ behavior and construct a Social Bot-Aware Graph Neural Network to model early propagation of posts and then use it to detect rumors. |
| Outcome: | The proposed method achieves significant improvements over baselines and identifies rumors within 3 hours while maintaining more than 90% accuracy. |
Reasoning Makes Good Annotators : An Automatic Task-specific Rules Distilling Framework for Low-resource Relation Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to extract knowledge from unlabeled data generate noise labels. |
| Approach: | They propose an automatic task-specific rules distilling framework to generate a logic rule from unlabeled data. |
| Outcome: | The proposed framework could power the labeling ability by discovering reliable model-labeled data. |
Re3Syn: A Dependency-Based Data Synthesis Framework for Long-Context Post-training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for constructing long-context data by concatenating short documents have overlooked a crucial characteristic of long-constituency data quality, semantic dependency. |
| Approach: | They propose a framework called Retrieval, Dependency Recognition, and Reorder for data synthesis which leverages semantic similarity to retrieve relevant documents and form several batches. |
| Outcome: | The proposed framework leverages semantic similarity to retrieve relevant documents and form several batches. |
Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering (2026.acl-long)
Copied to clipboard
Qiming Li, Xiaocheng Feng, Yixuan Ma, Ruihan Chen, Zihe Tong, Zekai Ye, Xiachong Feng, Libo Qin, Haoyu Ren, Kun Chen, Yunfei Lu, Dandan Tu, Bing Qin
| Challenge: | Existing approaches to enhance multilingual reasoning capabilities rely on costly multilingual training or employ prompting with external translation tools. |
| Approach: | They propose a training-free inference-time method to enhance multilingual reasoning capabilities via Representation Engineering without additional training data or tools. |
| Outcome: | The proposed method outperforms existing methods on four reasoning benchmarks in English and Thai and Swahili. |
RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-Following (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing role-playing datasets mostly contribute to controlling role style and knowledge boundaries, but overlook role-following in instruction-follower scenarios. |
| Approach: | They propose a fine-grained role-playing and instruction-following composite benchmark, named RoleMRC, which includes multi-turn dialogues between ideal roles and humans, including free chats or discussions upon given passages . |
| Outcome: | The proposed model improves instruction-following without compromising general role-playing and reasoning capabilities. |
Which Sense Dominates Multisensory Semantic Understanding? A Brain Decoding Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Decoding semantic meanings from brain activity is open to multisensory stimulation, as word meanings can be delivered by both auditory and visual inputs. |
| Approach: | They aim to develop a computational model to probing what information from the act of language understanding is represented in human brain. |
| Outcome: | The proposed model dissociates multisensory integration of word understanding into written text, spoken text and image perception respectively, exploring the decoding efficiency and reliability of unisensory information in the brain representation. |
NOVA: An Iterative Planning Framework for Enhancing Scientific Innovation with Large Language Models (2025.findings-acl)
Copied to clipboard
Xiang Hu, Hongyu Fu, Jinge Wang, Yifeng Wang, Zhikun Li, Renjun Xu, Yu Lu, Yaochu Jin, Lili Pan, Zhenzhong Lan
| Challenge: | Existing approaches to generate research ideas rely on retrieval or prompt engineering to generate ideas. |
| Approach: | They propose a method that uses iterative planning and search to boost creative potential of LLMs by integrating external knowledge with broader and deeper insights. |
| Outcome: | The proposed method outperforms the current state-of-the-art in generating 2.5 times more top-rated ideas based on 170 seed papers in a Swiss Tournament evaluation. |
Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning (2026.findings-acl)
Copied to clipboard
Haiyang Yu, Yuchuan Wu, Fan Shi, Jinghui Lu, Ke Niu, Xiaodong Ge, Minghan Zhuo, Jingqun Tang, Bin Li
| Challenge: | Existing document benchmarks focus on English printed texts or simplified Chinese . current vision-language models struggle with visual complexity and poor adaptability . |
| Approach: | They propose a benchmark to evaluate Chinese ancient documents' visual/linguistic complexity . ancient documents are valuable cultural heritage, but they face challenges in digitization and understanding . |
| Outcome: | the first benchmark for Chinese ancient documents evaluates VLMs from OCR to knowledge reasoning . ancient documents carry thousands of years of Chinese history and culture . traditional methods only scan images, while current models struggle with visual complexity . |
Always the Best Fit: Adaptive Domain Gap Filling from Causal Perspective for Few-Shot Relation Extraction (2023.findings-emnlp)
Copied to clipboard
Ge Bai, Chenji Lu, Jiaxiang Geng, Shilong Li, Yidong Shi, Xiyan Liu, Ying Liu, Zhang Zhang, Ruifang Liu
| Challenge: | Existing approaches to cross-domain relation extraction have been limited by domains . data bias between domains can be difficult to fill, especially in few-shot scenarios . |
| Approach: | They propose a framework to bridge the semantic gap caused by data bias between domains . they use syntactic structure, label distribution, and entities to calculate causal effects . |
| Outcome: | The proposed framework fills the domain gap and yields better results on the few-shot task. |
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)
Copied to clipboard
Wenhao Liu, Zhenyi Lu, Xinyu Hu, Jerry Zhang, Dailin Li, Jiacheng Cen, Huilin Cao, Haiteng Wang, Yuhan Li, Xie Kun, Dandan Li, Pei Zhang, Chengbo Zhang, Yuxiang Ren, Xiaohong Huang, Yan Ma
| Challenge: | Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation. |
| Approach: | They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset. |
| Outcome: | The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations. |
GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Media (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to detect fake news on social media are based on textual features and advanced linguistic features. |
| Approach: | They propose a neural network-based model to detect fake news on social media . they use a short-text tweet and a sequence of retweets without text comments to predict whether the source tweet is fake or not. |
| Outcome: | The proposed model outperforms state-of-the-art methods by 16% on real tweet datasets and produces reasonable explanations. |
Contextual Distortion Reveals Constituency: Masked Language Models are Implicit Parsers (2023.acl-long)
Copied to clipboard
| Challenge: | a novel chart-based method for extracting parse trees from masked language models is proposed . a graph-based approach can be used to extract parser trees without training separate parsers . |
| Approach: | They propose a chart-based method for extracting parse trees from masked language models . they use a set of perturbations motivated by the linguistic concept of constituency tests to score each span . |
| Outcome: | The proposed method outperforms state-of-the-art methods on english with masked LMs and in multilingual settings. |
Tell Me What You Don’t Know: Enhancing Refusal Capabilities of Role-Playing Agents via Representation Space Analysis and Editing (2025.findings-acl)
Copied to clipboard
Wenhao Liu, Siyu An, Junru Lu, Muling Wu, Tianlong Li, Xiaohua Wang, Changze Lv, Xiaoqing Zheng, Di Yin, Xing Sun, Xuanjing Huang
| Challenge: | Role-playing Agents (RPAs) struggle to recognize and respond to hard queries that conflict with their role-play knowledge. |
| Approach: | They propose a lightweight representation editing approach that conveniently shifts conflicting requests to the rejection region, thereby enhancing the model’s refusal accuracy. |
| Outcome: | The proposed model improves RPAs’ refusal ability of conflicting requests while maintaining their general role-playing capabilities. |
SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training (2025.findings-acl)
Copied to clipboard
Wenxi Chen, Ziyang Ma, Ruiqi Yan, Yuzhe Liang, Xiquan Li, Ruiyang Xu, Zhikang Niu, Yanqiao Zhu, Yifan Yang, Zhanxun Liu, Kai Yu, Yuxuan Hu, Jinyu Li, Yan Lu, Shujie Liu, Xie Chen
| Challenge: | a new spoken dialogue system with single-stage training is demonstrating its low latency and high quality . SLAM-Omni achieves zero-shot timbre control by modeling spoken language with semantic tokens . |
| Approach: | They propose a timbre-controllable, end-to-end voice interaction system with single-stage training. |
| Outcome: | The proposed system outperforms previous models on 4 GPUs with limited data. |
LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios (2025.naacl-long)
Copied to clipboard
Pei Chen, Hongye Jin, Cheng-Che Lee, Rulin Shao, Jingfeng Yang, Mingyu Zhao, Zhaoyu Zhang, Qin Lu, Kaiwen Men, Ning Xie, Huasheng Li, Bing Yin, Han Li, Lingyun Wang
| Challenge: | LongLeader aims to assess different LLMs' long-context comprehension abilities . long-constext comprehension is a key bottleneck for many use cases . |
| Approach: | They propose a leaderboard to assess different LLMs' long-context comprehension abilities . they offer open-source access to the benchmarks and maintain a dedicated website . |
| Outcome: | The proposed model assesses different LLMs on selected benchmarks and provides open-source access to the benchmarks. |
Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimization (2024.acl-long)
Copied to clipboard
Wenqi Zhang, Ke Tang, Hai Wu, Mengna Wang, Yongliang Shen, Guiyang Hou, Zeqi Tan, Peng Li, Yueting Zhuang, Weiming Lu
| Challenge: | Large Language Models (LLMs) are designed as specific task solvers with sophisticated prompt engineering, but are inherently incapacitating to address complex dynamic scenarios. |
| Approach: | They propose an LLM-based agent with policy-level reflection and optimization that can learn from interactive experiences and progressively elevate its behavioral policy. |
| Outcome: | The proposed agent outperforms vanilla LLM and specialized models in blackjack and Texas hold’em. |
Event Extraction as Multi-turn Question Answering (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to event extraction fail to model rich interactions among event types and arguments of different roles. |
| Approach: | They propose a new paradigm that formulates event extraction as multi-turn question answering . they propose to use reading comprehension problems to extract triggers and arguments . |
| Outcome: | The proposed approach outperforms current state-of-the-art on argument extraction tasks . it makes full use of dependency among arguments and event types, and generalizes well . |
Multi-Agent Comedy Club: Investigating Community Discussion Effects on LLM Humor Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on the use of multi-turn interaction and feedback for LLM writing focus on prompts and localized feedback. |
| Approach: | They build a controlled multi-agent sandbox that instantiates a small standup comedy community and allows it to manipu-late whether public reception is generated, logged, and fed back into later rounds. |
| Outcome: | The proposed model improves craft/clarity and social response with occasional increases in aggressive humor. |
Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research (2025.acl-demo)
Copied to clipboard
Qianqian Zhang, Jiajia Liao, Heting Ying, Yibo Ma, Haozhan Shen, Jingcheng Li, Peng Liu, Lu Zhang, Chunxin Fang, Kyusong Lee, Ruochen Xu, Tiancheng Zhao
| Challenge: | Language agents powered by large language models (LLMs) have demonstrated remarkable capabilities in understanding, reasoning, and executing complex tasks. |
| Approach: | They propose a flexible framework that addresses engineering overhead and insufficient evaluation frameworks for fair comparison. |
| Outcome: | The proposed framework simplifies language agent development and establishes a foundation for reproducible agent research. |
Evaluating Saliency Explanations in NLP by Crowdsourcing (2024.lrec-main)
Copied to clipboard
| Challenge: | a crowdsourced method to evaluate saliency methods in NLP is proposed . saliencies are difficult for humans to understand, and can cause psychological harm . |
| Approach: | They propose a method to evaluate saliency methods in NLP by crowdsourcing . they recruited 800 crowd workers and empirically evaluated seven salience methods . |
| Outcome: | The proposed method evaluates saliency methods on two datasets using crowdsourced data . it shows that the results are comparable to existing methods on NLP and CV fields . |
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing quantization methods are compromising performance of large language models (LLMs) despite their high computational intensity, LLMs are still demanding intensive computation. |
| Approach: | They propose to generate the KV cache of pivot tokens losslessly from the full-precision model. |
| Outcome: | The proposed method generates the KV cache of pivot tokens losslessly from the full-precision model with no extra inference overhead. |
Structured Episodic Event Memory (2026.acl-long)
Copied to clipboard
| Challenge: | Current approaches to memory in Large Language Models (LLMs) rely on static Retrieval-Augmented Generation (RAG) this lacks the cognitive organization necessary to model the dynamic and associative nature of long-term interaction. |
| Approach: | They propose a hierarchical framework that transforms interaction streams into structured Episodic Event Frames (EEFs) anchored by precise provenance pointers. |
| Outcome: | The proposed framework outperforms baseline approaches on LoCoMo and LongMemEval benchmarks. |
Teaching According to Talents! Instruction Tuning LLMs with Competence-Aware Curriculum Learning (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Tingwei Lu, Yinghui Li, Yankai Chen, Wei-Chieh Huang, Wenhao Jiang, Hui Wang, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Efficient instruction tuning aims to enhance the ultimate performance of large language models (LLMs) current methods suffer from the curriculum rigidity, resulting in a fixed and potentially sub-optimal learning trajectory. |
| Approach: | a framework for efficient instruction tuning is proposed to address the issue of curriculum rigidity . current methods rely on static heuristic difficulty metrics and fail to adapt to evolving capabilities . |
| Outcome: | Efficient instruction tuning aims to enhance the ultimate performance of large language models . current methods suffer from the curriculum rigidity, resulting in a fixed learning trajectory . |
Probability-Consistent Preference Optimization for Enhanced LLM Reasoning (2025.findings-acl)
Copied to clipboard
Yunqiao Yang, Houxing Ren, Zimu Lu, Ke Wang, Weikang Shi, Aojun Zhou, Junting Pan, Mingjie Zhan, Hongsheng Li
| Challenge: | Recent advances in preference optimization have demonstrated significant potential for improving mathematical reasoning capabilities in large language models. |
| Approach: | They propose a framework that establishes two quantitative metrics for preference selection: surface-level answer correctness and intrinsic token-level probability consistency. |
| Outcome: | The proposed framework outperforms existing outcome-only criterion approaches across a diverse range of LLMs and benchmarks. |
Theory-optimal Quantization Based on Flatness (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantization of Large Language Models (LLMs) have been widely adopted due to activation outliers, which degrade model performance especially at lower bit precision. |
| Approach: | They propose a new metric for quantization that strategically distributes outlier magnitudes across matrix dimensions via optimized diagonal operations. |
| Outcome: | The proposed framework achieves less than 1% accuracy drop in W4A4 quantization on the LLaMA-3-8B model and reduces the performance gap by 39.1% on the more challenging W2A4KV16 model. |
LLM-based Rumor Detection via Influence Guided Sample Selection and Game-based Perspective Analysis (2025.acl-long)
Copied to clipboard
Zhiliang Tian, Jingyuan Huang, Zejiang He, Zhen Huang, Menglong Lu, Linbo Qiao, Songzhu Mei, Yijie Wang, Dongsheng Li
| Challenge: | Existing methods for rumor detection on social media are limited by limited modeling capacity and insufficient training corpora. |
| Approach: | They propose an SFT-based rumor detection model with Influence guided Sample selection and Game-based multi-perspective analysis to address these issues. |
| Outcome: | The proposed model outperforms existing SOTA on three datasets. |
Towards Table-to-Text Generation with Pretrained Language Model: A Table Structure Understanding and Text Deliberating Approach (2022.emnlp-main)
Copied to clipboard
| Challenge: | Currently, the generalization issues hinder the applicability of neural table-to-text models due to the limited source tables. |
| Approach: | They propose a table-structureaware text generation model with pretrained language model and propose TASD to bridge the gap between the structured table and text input. |
| Outcome: | The proposed model bridges the gap between the structured table and text input and generates accurate and fluent descriptive texts on two public datasets. |
An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to build parallel sentence simplification corpora are limited . SS is used to rephrase sentences into simpler forms for those with cognitive disabilities . |
| Approach: | They propose to build SS corpora from large-scale bilingual translation corpors using a parallel approach. |
| Outcome: | The proposed method outperforms the existing methods on WikiLarge and achieves state-of-the-art results. |
CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention (2025.acl-long)
Copied to clipboard
Zekai Ye, Qiming Li, Xiaocheng Feng, Libo Qin, Yichong Huang, Baohang Li, Kui Jiang, Yang Xiang, Zhirui Zhang, Yunfei Lu, Duyu Tang, Dandan Tu, Bing Qin
| Challenge: | Large Vision-Language Models (LVLMs) have impressive multimodal abilities but remain prone to multilingual object hallucination. |
| Approach: | They propose a cross-lingual attention intervention method to mitigate multilingual object hallucination in LVLMs by aligning attention patterns. |
| Outcome: | The proposed method improves 13.56% (up to 30%) on the POPE and 21.75% on the hallucination subsets across languages. |
LipoAgent: Coordinating Fine-Tuned LLM Agents for Safer Lipid Design (2026.findings-acl)
Copied to clipboard
| Challenge: | Lipid nanoparticles (LNPs) are among the most clinically mature platforms for nucleic acid delivery, yet designing lipids that are effective and biologically safe remains a major bottleneck. |
| Approach: | They propose a safety-aware multi-agent LLM framework for lipid discovery that enforces toxicity as a prerequisite for efficiency prediction. |
| Outcome: | The proposed framework achieves an average improvement in mRNA transfection efficiency prediction across multiple foundation models. |
Document-level Biomedical Relation Extraction Based on Multi-Dimensional Fusion Information and Multi-Granularity Logical Reasoning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models with reasoning are single-granularity based on one element information, ignoring complementary fact of different granularities. |
| Approach: | They propose a document-level biomedical relation extraction model called FILR . it uses multi-dimensional information fusion and multi-granularity logic to obtain rich inferences . |
| Outcome: | The proposed model extracts all relation facts from biomedical documents . it is based on multi-dimensional information fusion and multi-granularity logic reasoning . the proposed model achieves state-of-the-art performance on two widely used biomedically corpora . |
VQAGuider: Guiding Multimodal Large Language Models to Answer Complex Video Questions (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) can grasp the intention of a question and decomposing it to a series of visual recognition sub-tasks to find out the answer with the help of an agent. |
| Approach: | They propose a framework for multimodal large language models to grasp the intention of a question and decompose it into a series of visual recognition sub-tasks to find out the answer. |
| Outcome: | The proposed framework improves the accuracy of complex video-related questions by 29.6% and 17.2% on CVQA and the existing VQA datasets. |
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)
Copied to clipboard
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
Unknown Intent Detection Using Gaussian Mixture Model with an Application to Zero-shot Intent Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for unknown intent detection are limited by prior knowledge of class labels. |
| Approach: | They propose to use a Gaussian mixture model to model utterance embeddings with a distribution and inject dynamic class semantic information into Gausssian means. |
| Outcome: | The proposed model performs well on three real task-oriented dialogue datasets in two languages. |
Beyond Labels: Empowering Human Annotators with Natural Language Explanations through a Novel Active-Learning Architecture (2023.findings-emnlp)
Copied to clipboard
Bingsheng Yao, Ishan Jindal, Lucian Popa, Yannis Katsis, Sayan Ghosh, Lihong He, Yuxuan Lu, Shashank Srivastava, Yunyao Li, James Hendler, Dakuo Wang
| Challenge: | Existing low-resource learning techniques focus on label annotation while neglecting the natural language explanation of a data point. |
| Approach: | They propose a novel architecture that leverages an explanation-generation model to produce explanations guided by human explanations and a prediction model that utilizes generated explanations toward prediction faithfully. |
| Outcome: | The proposed architecture produces explanations guided by human explanations, a prediction model that utilizes generated explanations toward prediction faithfully, and a data diversity-based AL sampling strategy that benefits from the explanation annotations. |
LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit exceptional translation capabilities in high-resource language tasks, yet their effectiveness in low-resourced languages is suboptimal. |
| Approach: | They conduct extensive multilingual continual pre-training on the LLaMA series models and develop LLiMAX for translation support across more than 100 languages. |
| Outcome: | The proposed model achieves higher translation performance than existing open-source models and performs on-par with specialized translation model on the Flores-101 benchmark. |
Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intents (2026.acl-long)
Copied to clipboard
Ziyi Wang, Yuxuan Lu, Yimeng Zhang, Pei Chen, Ziwei Dong, Jing Huang, Jiri Gesi, Xianfeng Tang, Chen Luo, Qun Liu, Yisi Sang, Hanqing Lu, Manling Li, Jin Lai, Dakuo Wang
| Challenge: | Tool-calling agents are increasingly deployed in real-world customer-facing workflows . but most studies on tool-callers focus on idealized settings with general, fixed, and well-specified tasks. |
| Approach: | They propose a tool-calling agent-based data pipeline that converts trajectories into user-facing tasks with controlled intent adaptations. |
| Outcome: | The proposed pipeline can be used to study tool use under three scenarios. |
Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document Understanding (2023.acl-long)
Copied to clipboard
Haoli Bai, Zhiguang Liu, Xiaojun Meng, Li Wentao, Shuang Liu, Yifeng Luo, Nian Xie, Rongfu Zheng, Liangwei Wang, Lu Hou, Jiansheng Wei, Xin Jiang, Qun Liu
| Challenge: | Existing solutions for visual document understanding lack granularity of document textlines. |
| Approach: | They propose a supervised pre-training program to leverage structural knowledge nested in document textlines to achieve fine-grained alignment between visual regions and texts. |
| Outcome: | The proposed system performs better on various VDU tasks in English and Chinese. |
ModRWKV: Transformer Multimodality in Linear Time (2025.emnlp-main)
Copied to clipboard
| Challenge: | Currently, multimodal studies are based on large language models with quadratic-complexity Transformer architectures. |
| Approach: | They propose a decoupled multimodal framework built upon the RWKV7 architecture as its LLM backbone and a lightweight architecture to achieve multi-source information fusion. |
| Outcome: | The proposed framework achieves multi-source information fusion through dynamically adaptable heterogeneous modality encoders. |
CogBench: Benchmarking Cognitive Alignment of Large Language Models in Educational Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) possess strong capabilities in language understanding and generation, as well as remarkable problem-solving abilities. |
| Approach: | They propose a benchmark to assess the cognitive alignment capabilities of large language models in educational QA. |
| Outcome: | The proposed evaluation benchmark assesses the cognitive alignment capabilities of large language models in educational QA. |
An Entropy-based Text Watermarking Detection Method (2024.acl-long)
Copied to clipboard
| Challenge: | Existing text watermarking algorithms for large language models (LLMs) are effective in identifying machine-generated texts, but they are not effective in low-entropy scenarios. |
| Approach: | They propose an Entropy-based text watermarking detection method that takes into account the influence of token entropy to better reflect the degree of watermark detection. |
| Outcome: | The proposed method is training-free and fully automated. |
Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for hallucination mitigation are based on external dependency and require external annotations or auxiliary models for preference data collection. |
| Approach: | a new method is proposed to help model-generated hallucinations without external dependencies. |
| Outcome: | a new method that self-injects hallucinations into a generated response improves halluuutations mitigation. |
CogNet-KG: Empowering Tutoring Dialogues with a Cognitively-Structured Knowledge Graph for STEM Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Educational knowledge graphs are a critical component of intelligent tutoring systems that are structured around cognitive principles and provide support for interactive teaching. |
| Approach: | They propose a cognitively-structured large-scale knowledge graph for STEM learning that models nearly 500 core concepts across five subjects with various cognitively grounded relations corresponding to specific learning objectives. |
| Outcome: | The proposed model generates a high-quality tutoring dialogue dataset CogDialogue-QA and a specialized tutorial LLM that internalizes this structured pedagogical reasoning. |
Unleashing the Power of LLMs in Court View Generation by Stimulating Internal Knowledge and Incorporating External Knowledge (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made remarkable strides in language generation, but they encounter difficulties in the knowledge-intensive legal domain. |
| Approach: | They propose to decompose court views into different parts, stimulate internal knowledge, and incorporate external information to unleash the power of LLMs in the task. |
| Outcome: | The proposed method generates more accurate and reliable court views on two real-world datasets LAIC2021 and CJO2022. |
SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment (2025.findings-emnlp)
Copied to clipboard
Yuqing Huang, Rongyang Zhang, Qimeng Wang, Chengqiang Lu, Yan Gao, null Yiwu, Yao Hu, Xuyang Zhi, Guiquan Liu, Xin Li, Hao Wang, Enhong Chen
| Challenge: | Existing solutions for supervised fine-tuning often lead to catastrophic forgetting, where models lose their previously acquired knowledge and general capabilities. |
| Approach: | They propose a self-distribution alignment method that aligns input sequence logits to preserve the model’s semantic distribution, thereby mitigating catastrophic forgetting and improving downstream performance. |
| Outcome: | The proposed method achieves a superior balance between downstream learning and general capability retention. |
CARD: Cross-modal Agent Framework for Generative and Editable Residential Design (2025.emnlp-main)
Copied to clipboard
| Challenge: | Architectural design automation has made significant progress, but the complexity of open-world environments makes residential design a challenging task. |
| Approach: | They propose a framework that leverages a system of specialized cross-modal agents to adapt to open-world residential design. |
| Outcome: | The proposed framework enables users to generate and edit residential design without requiring specialized expertise. |
DeepSolution: Boosting Complex Engineering Solution Design via Tree-based Exploration and Bi-point Thinking (2025.acl-long)
Copied to clipboard
Zhuoqun Li, Haiyang Yu, Xuanang Chen, Hongyu Lin, Yaojie Lu, Fei Huang, Xianpei Han, Yongbin Li, Le Sun
| Challenge: | Existing studies in retrieval-augmented generation (RAG) do not sufficiently address the design of complex engineering solutions. |
| Approach: | They propose a retrieval-augmented generation system that leverages tree-based exploration and bi-point thinking mechanism to generate reliable solutions. |
| Outcome: | Experiments show that the proposed system achieves state-of-the-art (SOTA) performance on the SolutionBench, highlighting its potential to enhance the automation and reliability of complex engineering solution design in real-world applications. |
Position-Aware Tagging for Aspect Sentiment Triplet Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing research efforts focus on extracting the triplets of target entities, their associated sentiment, and opinion spans explaining the reason for the sentiment. |
| Approach: | They propose a position-aware tagging scheme that can extract triplets using a sequence tapping approach. |
| Outcome: | The proposed model improves performance on multiple datasets and compares with existing models. |
LitVISTA: A Benchmark for Narrative Orchestration in Literary Text (2026.acl-long)
Copied to clipboard
Mingzhe Lu, Yiwen Wang, Yanbing Liu, Qi You, Chong Liu, Ruize Qin, Haoyu Dong, Wenyu Zhang, JiaRui Zhang, Yue Hu, Yunpeng Li
| Challenge: | Existing large language models focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives. |
| Approach: | They propose a high-dimensional framework for narrative orchestration that unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. |
| Outcome: | The proposed framework unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. |
RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought (2025.acl-long)
Copied to clipboard
Yi Lu, Jiawang Cao, Yongliang Wu, Bozheng Li, Licheng Tang, Yangguang Ji, Chong Wu, Jay Wu, Wenbo Zhu
| Challenge: | Recent advances in multi-modal learning have enhanced MLLMs' ability to reason about visual content. |
| Approach: | They propose a framework that unifies multi-step multimodal reasoning with grounded visual understanding. |
| Outcome: | The proposed framework surpasses state-of-the-art methods by +6.5 gIoU and +9.2 cIou on ReasonSeg and achieves 49.7 mAP on SegInW under zero-shot settings. |
Seeing but Not Thinking: Routing Distraction in Multimodal Mixture-of-Experts (2026.acl-long)
Copied to clipboard
Haolei Xu, Haiwen Hong, Hongxing Li, Rui Zhou, Yang Zhang, Longtao Huang, Hui Xue, Yongliang Shen, Weiming Lu, Yueting Zhuang
| Challenge: | Existing multimodal Mixture-of-Experts models accurately perceive image content yet fail in subsequent reasoning . Seeing but not thinking phenomenon is a puzzling phenomenon . |
| Approach: | They propose a routing-guided intervention method that enhances domain expert activation. |
| Outcome: | The proposed method achieves consistent improvements on visual reasoning tasks. |
MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Weikang Shi, Aldrich Yu, Rongyao Fang, Houxing Ren, Ke Wang, Aojun Zhou, Changyao Tian, Xinyu Fu, Yuxuan Hu, Zimu Lu, Linjiang Huang, Si Liu, Rui Liu, Hongsheng Li
| Challenge: | Existing approaches to visual chain-of-thought are limited by external tools or fail to generate high-fidelity diagrams. |
| Approach: | They propose a framework to enable large multimodal models with VCoT capabilities . they pre-train a model on a 15.2M-pair corpus and teach it how to leverage visual aids . |
| Outcome: | The proposed framework unlocks complex, human-like visual reasoning in large language models . it pre-trains the model on a 15.2M-pair corpus and fine-tunes it on MathCanvas-Instruct . |
PychoAgent: Psychology-driven LLM Agents for Explainable Panic Prediction on Social Media during Sudden Disaster Events (2025.emnlp-main)
Copied to clipboard
Mengzhu Liu, Zhengqiu Zhu, Chuan Ai, Chen Gao, Xinghong Li, Lingnan He, Kaisheng Lai, Yingfeng Chen, Xin Lu, Yong Li, Quanjun Yin
| Challenge: | Social media's rich information content and spatiotemporal granularity provide unique opportunities for emotion prediction and management. |
| Approach: | They propose a Psychology-driven generative Agent framework for explainable panic prediction based on emotion arousal theory. |
| Outcome: | The proposed framework improves panic emotion prediction performance by 13% to 21% compared to baseline models. |
A Survey on Training-free Alignment of Large Language Models (2025.findings-emnlp)
Copied to clipboard
Birong Pan, Yongqi Li, Weiyu Zhang, Wenpeng Lu, Mayi Xu, Shen Zhou, Yuanyuan Zhu, Ming Zhong, Tieyun Qian
| Challenge: | a survey of large language models (LLMs) aims to ensure outputs adhere to human values, ethical standards, and legal norms. |
| Approach: | They present the first systematic review of TF alignment methods . they categorize them by stages of pre-decoding, in-decoder and post-decoration . |
| Outcome: | The proposed methods are based on training-free (TF) alignment techniques . they are able to be used in open-source and closed-source environments without retraining . |
Value Compass Benchmarks: A Comprehensive, Generative and Self-Evolving Platform for LLMs’ Value Evaluation (2025.acl-demo)
Copied to clipboard
Jing Yao, Xiaoyuan Yi, Shitong Duan, Jindong Wang, Yuzhuo Bai, Muhua Huang, Yang Ou, Scarlett Li, Peng Zhang, Tun Lu, Zhicheng Dou, Maosong Sun, James Evans, Xing Xie
| Challenge: | Current evaluation methods for large language models face two key challenges: 1. evaluation validity and 2. Result interpretation reduce the pluralistic and incommensurable values to one-dimensional scores. |
| Approach: | They propose a platform for comprehensive value diagnosis of large language models (LLMs) that provides a generative evaluation paradigm that automatically creates real-world test items co-evolving with ever-advancing LLMs. |
| Outcome: | The proposed platform provides a framework for comprehensive value diagnosis of large language models (LLMs) with fine-grained scores and case studies across 27 value dimensions for 33 leading LLMs, customized comparisons, and visualized analysis of LLM’s alignment with cultural values. |
Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing monolithic models for multilingual neural machine translation encounter parameter interference and inefficient inference for large models. |
| Approach: | They propose a detachable multi-way model that assigns each language to an individual branch . they use data from OPUS to build a translation benchmark covering 433 languages . |
| Outcome: | The proposed model outperforms existing models in OPUS and is faster than existing models. |
Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing (2025.findings-acl)
Copied to clipboard
Yifan Lu, Jing Li, Yigeng Zhou, Yihui Zhang, Wenya Wang, Xiucheng Li, Meishan Zhang, Fangming Liu, Jun Yu, Min Zhang
| Challenge: | Existing knowledge editing methods for large language models (LLMs) suffer from over-editing, where detoxified models reject legitimate queries, compromising overall performance. |
| Approach: | They propose a toxicity-aware knowledge editing approach that dynamically detects toxic activation patterns during forward propagation and then routes computations through adaptive inter-layer pathways to mitigate toxicity effectively. |
| Outcome: | The proposed method outperforms existing methods on large language models and enhances the SafeEdit benchmark. |
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning language models are efficient when adapting to a single dataset. |
| Approach: | They propose to use an ensemble method for fine-tuning a language model to multiple datasets instead of a single adapter per task. |
| Outcome: | The proposed method improves performance on multiple datasets while preserving low-rank adaptation properties. |
OCNLI: Original Chinese Natural Language Inference (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent efforts to extend natural language understanding to other languages have focused on (automatically) translating existing English datasets. |
| Approach: | They propose to use a Chinese dataset to generate annotated sentences from native speakers specializing in linguistics to elicit annotations. |
| Outcome: | The proposed dataset does not rely on automatic translation or non-expert annotation. instead, it elicits annotations from native speakers specializing in linguistics. |
Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Domain-specific question answering (QA) requires a comprehensive understanding of a specific domain to answer specialized questions. |
| Approach: | They propose a new alignment objective to align the LLM preference with different human preferences uniformly to optimize LLM performance in real-world, domain-specific QA settings. |
| Outcome: | The proposed pipeline is superior for real-scenario domain-specific question answering with LLMs. |
BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing text summarization datasets are compiled from news articles, where summary-worthy content often appears in the beginning of input articles. |
| Approach: | They present a novel dataset, BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. |
| Outcome: | The proposed dataset is compared with existing summarization datasets and demonstrates that salient content is evenly distributed in the input. |
Linear-Time Demonstration Selection for In-Context Learning via Gradient Estimation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to select demonstration examples for in-context learning are based on token embeddings. |
| Approach: | They propose an algorithm to select demonstration examples for in-context learning of a query set . they use gradients of the output taken in the input embedding space to estimate model outputs . |
| Outcome: | The proposed algorithm outperforms existing methods based on token embeddings by 11% . it scales up subset selection that would otherwise run full inference by 37.7 on models with 34 billion parameters . |
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)
Copied to clipboard
Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
Is the Attention Matrix Really the Key to Self-Attention in Multivariate Long-Term Time Series Forecasting? (2026.acl-long)
Copied to clipboard
| Challenge: | In multivariate long-term time series forecasting, it is widely believed that the effectiveness of self-attention arises from its attention matrix. |
| Approach: | They propose a multi-branch MLP that isolates the ‘multi-brain mapping with element-wise operation’ structure from the Transformer and shows that it achieves competitive performance. |
| Outcome: | The proposed model outperforms three classic and three latest Transformer models and shows that it achieves competitive performance. |
LNE-Blocking: An Efficient Framework for Contamination Mitigation Evaluation on Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a problem of data contamination is now almost inevitable during the development of large language models, with the training data often integrating evaluation benchmarks even unintentionally. |
| Approach: | They propose a framework to restore model performance prior to data contamination on potentially leaked datasets by using contamination detection and disruption operation. |
| Outcome: | The proposed framework restores model performance prior to contamination on potentially leaked datasets. |
Efficient Context and Schema Fusion Networks for Multi-Domain Dialogue State Tracking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to track dialogue state are limited due to data sparsity and long dialogues. |
| Approach: | They propose to use the previous dialogue state and current dialogue utterance as input for DST. |
| Outcome: | The proposed approach outperforms existing methods and improves existing ones. |
CA-GAR: Context-Aware Alignment of LLM Generation for Document Retrieval (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent techniques such as Generation-Augmented Retrieval (GAR) and Generative Document Retrieleval (GDR) leverage LLMs to enhance retrieval performance but face key challenges: GAR’s generated content may not always align with the target document corpus, while GDR limits the generative capacity of LLM. |
| Approach: | They propose a Context-Aware Generation-Augmented Retrieval approach which integrates corpus information into their generation process. |
| Outcome: | Experimental results show that CA-GAR outperforms existing methods on seven tasks and four non-English languages. |
Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies attributed verbosity to biased labels, but new research shows that DPO can be effective in mitigating verboses. |
| Approach: | They propose to use a method to reduce the amount of verbosity in LLMs by using a downsampling approach. |
| Outcome: | The proposed approach overcomes the problem of verbosity by reducing the length reliance of the proposed algorithm. |
NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering (2025.acl-long)
Copied to clipboard
Ruisheng Cao, Hanchong Zhang, Tiancheng Huang, Zhangyi Kang, Yuxin Zhang, Liangtai Sun, Hanqi Li, Yuxun Miao, Shuai Fan, Lu Chen, Kai Yu
| Challenge: | Existing approaches to retrieval augmented generation neglect PDF structure and layout . individual PDFs often exceed prompt limits and user queries may span multiple documents. |
| Approach: | They propose a hybrid neural symbolic retrieval framework which combines both paradigms in an interactive process. |
| Outcome: | The proposed framework organizes semi-structured PDF content into relational database and vectorstore . it defeats both RAG and structured baselines on three PDF-based QA datasets . |
UniGeM: Unifying Data Selection and Mixing via Geometric Exploration and Mining (2026.findings-acl)
Copied to clipboard
Changhao Wang, null Yunfeiyu, Xinhao Yao, Jiaolong Yang, Lu Yu, Junpeng Fang, Chaobo Li, Riccardo Cantoro, Qing Cui, Jun Zhou
| Challenge: | Large Language Models (LLMs) scaling is limited by data quality and domain mixing and instance selection are two separate problems. |
| Approach: | They propose a framework that unifies mixing and selection without training proxy models or relying on external reference datasets. |
| Outcome: | The proposed framework achieves 2.0 data efficiency over a random baseline and further improves overall performance compared to SOTA methods in reasoning-heavy evaluations and multilingual generalization. |
Spec-o3: A Tool-Augmented Vision-Language Agent for Rare Celestial Object Candidate Vetting via Automated Spectral Inspection (2026.acl-long)
Copied to clipboard
| Challenge: | Spec-o3 is a tool-augmented vision-language agent that performs astronomer-aligned spectral inspection. |
| Approach: | They propose a tool-augmented vision-language agent that performs astronomer-aligned spectral inspection via interleaved multimodal chain-of-thought reasoning. |
| Outcome: | Spec-o3 outperforms traditional visual inspection methods on rare-object inspection tasks. |
LLMs for Now, Fine-Tuning for Later: An Ensemble Approach to Data Drift in Domain-Specific Tasks (2026.acl-srw)
Copied to clipboard
Yuxuan Lu, Bingsheng Yao, Shao Zhang, Yisi Sang, Yun Wang, Hansu Gu, Peng Zhang, Tun Lu, Toby Jia-Jun Li, Dakuo Wang
| Challenge: | Deploying machine learning models in domain-specific scenarios is challenged by data drift and the scarcity of expert annotations. |
| Approach: | They propose a system that combines an LLM, an AL-assisted compact model and an automatic switch module to assist the active learning process. |
| Outcome: | The proposed system achieves 96–98% switch accuracy and outperforms both models used alone. |
UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expression (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on geometry problem solving treats calculation and proving as two specific tasks hindering a deep model to unify reasoning ability on multiple math tasks. |
| Approach: | They propose a large-scale Unified Geometry problem benchmark to unify geometry on multiple math tasks. |
| Outcome: | The proposed framework outperforms the existing model with 5.6% and 3.2% accuracies on calculation and proving problems. |
Does Chain-of-Thought Reasoning Really Reduce Harmfulness from Jailbreaking? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing jailbreak attacks fail against reasoning models enhanced by Chain-of-Thought (CoT) reasoning. |
| Approach: | They propose a jailbreak method that uses Chain-of-Thought reasoning to reduce harmfulness from jailbreaking. |
| Outcome: | The proposed jailbreak method performs well against open AI models and deepseek-R1 reasoning models. |
Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation (2024.emnlp-main)
Copied to clipboard
Raphael Tang, Crystina Zhang, Lixinyu Xu, Yao Lu, Wenyan Li, Pontus Stenetorp, Jimmy Lin, Ferhan Ture
| Challenge: | Current diffusion models do not cover recent models, thus we curate three test sets for evaluation. |
| Approach: | They propose a human-calibrated measure of variability in a set of images bootstrapped from existing image-pair perceptual distances. |
| Outcome: | The proposed model outperforms nine baselines by 18 points in accuracy and matches graded human judgements 78% of the time. |
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge (2025.emnlp-main)
Copied to clipboard
Dawei Li, Bohan Jiang, Liangjie Huang, Alimohammad Beigi, Chengshuai Zhao, Zhen Tan, Amrita Bhattacharjee, Yuxuan Jiang, Canyu Chen, Tianhao Wu, Kai Shu, Lu Cheng, Huan Liu
| Challenge: | Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios . |
| Approach: | They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios. |
| Outcome: | The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm. |
Noisy Positive-Unlabeled Learning with Self-Training for Speculative Knowledge Graph Reasoning (2023.findings-acl)
Copied to clipboard
Ruijie Wang, Baoyu Li, Yichen Lu, Dachun Sun, Jinning Li, Yuchen Yan, Shengzhong Liu, Hanghang Tong, Tarek Abdelzaher
| Challenge: | State-of-the-art methods fail in speculative reasoning task on knowledge graphs . state-of the-art approaches assume correctness of fact is determined by its presence in KG . |
| Approach: | They propose a speculative reasoning task on real-world knowledge graphs . they propose nPUGraph that estimates correctness of both collected and uncollected facts . |
| Outcome: | The proposed framework improves the robustness of a label posterior-aware graph encoder against false positive links and identifies missing facts to provide high-quality grounds of reasoning. |
Towards Universal Debiasing for Language Models-based Tabular Data Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing large language models have exacerbated fairness issues in tabular data generation . inherent historical biases in tabulated data cause LLMs to exacerbate fairness problems . |
| Approach: | They propose a universal debiasing framework that minimizes group-level dependencies . it leverages the autoregressive structure and analytic sampling distributions of LLM-based tabular data generators . |
| Outcome: | The proposed framework minimizes group-level dependencies while reducing mutual information between advantaged and protected attributes. |
MultiConIR: Towards Multi-Condition Information Retrieval (2025.findings-emnlp)
Copied to clipboard
Xuan Lu, Sifan Liu, Bochao Yin, Yongqi Li, Xinghao Chen, Hui Su, Yaohui Jin, Wenjun Zeng, Xiaoyu Shen
| Challenge: | MultiConIR is a benchmark designed to evaluate retrieval and reranking models under nuanced multi-condition query scenarios. |
| Approach: | They propose a benchmark to evaluate retrieval and reranking models under nuanced multi-condition query scenarios. |
| Outcome: | The proposed benchmark evaluates retrieval and reranking models under nuanced multi-condition query scenarios across five domains. |
CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments (2026.acl-long)
Copied to clipboard
Haotian Xu, Yue Hu, Zhengqiu Zhu, Chen Gao, Ziyou Wang, Junreng Rao, Wenhao Lu, Weishi Li, Quanjun Yin, Yong Li
| Challenge: | Existing benchmarks focus on indoor or street settings, overlooking challenges of open-ended urban spaces. |
| Approach: | They propose a benchmark to probe cross-view spatial reasoning capabilities of current VLMs in urban settings. |
| Outcome: | The citycube benchmark examines the performance of current vision-language models in urban environments. |
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Mixture-of-Experts (MoE) LLMs achieve higher performance with fewer active parameters, but are still difficult to deploy due to their immense parameter sizes. |
| Approach: | They propose expert-level sparsification techniques to enhance the deployment efficiency of large language models by introducing plug-and-play expert pruning and skipping techniques. |
| Outcome: | The proposed methods reduce model sizes and increase inference speed while maintaining satisfactory performance across a wide range of tasks. |
SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding (2026.findings-acl)
Copied to clipboard
Songcheng Cai, Zhiheng Lyu, Yuansheng Ni, Xiangchao Chen, Baichuan Zhou, Shenzhe Zhu, Yi Lu, Haozhe Wang, Chi Ruan, Benjamin Schneider, Weixu Zhang, Xiang Li, Andy Zheng, Yuyu Zhang, Ping Nie, Wenhu Chen
| Challenge: | Existing benchmarks for agentic repository-level code understanding overlook long tail topics and rely on memorized knowledge. |
| Approach: | They propose a repository-level agentic code understanding benchmark that uses long-tail repositories with executable environments to enforce topical balance. |
| Outcome: | Empirically, a Qwen3-8B model trained with the proposed benchmark outperforms GPT-4o by 2.3 points. |
DoCIA: An Online Document-Level Context Incorporation Agent for Speech Translation (2025.findings-acl)
Copied to clipboard
Xinglin Lyu, Wei Tang, Yuang Li, Xiaofeng Zhao, Ming Zhu, Junhui Li, Yunfei Lu, Min Zhang, Daimeng Wei, Hao Yang, Min Zhang
| Challenge: | Document-level context is crucial for speech translation due to noise from ASR . incorporating document-level contextual information into ST remains a challenge . |
| Approach: | They develop an online framework that integrates document-level context into machine translation . they use document-based modules to integrate document- level context into ST . |
| Outcome: | The proposed framework outperforms baselines in sentence and discourse metrics . it can correct ASR transcription errors and improve translation performance . |
TempCompass: Do Video LLMs Really Understand Videos? (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks on video large language models lack a comprehensive feedback on temporal perception ability . current models cannot distinguish between different temporal aspects and are limited in task formats . |
| Approach: | They propose a benchmark to evaluate temporal perception ability of video large language models . they construct conflicting videos that share the same static content but differ in a specific temporal aspect . |
| Outcome: | The proposed benchmarks show that video large language models exhibit poor temporal perception ability. |
READoc: A Unified Benchmark for Realistic Document Structured Extraction (2025.findings-acl)
Copied to clipboard
Zichao Li, Aizier Abulaiti, Yaojie Lu, Xuanang Chen, Jia Zheng, Hongyu Lin, Xianpei Han, Shanshan Jiang, Bin Dong, Le Sun
| Challenge: | Document Structured Extraction (DSE) is a field of document structure analysis that aims to extract structured content from raw documents. |
| Approach: | They propose a benchmark to evaluate document structured extraction systems by converting unstructured PDFs into semantically rich Markdown. |
| Outcome: | The proposed benchmark is based on 3,576 diverse and real-world documents from arXiv, GitHub, and Zenodo. |
Measuring Correlation-to-Causation Exaggeration in Press Releases (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies have found that press releases are a major source of exaggeration in science communication, which is later spread to mainstream media. |
| Approach: | They propose an NLP approach to identify exaggerated causal claims in health press releases that report on observational studies. |
| Outcome: | The proposed approach can identify causal claims in press releases that report on observational studies. |
The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters (2025.acl-long)
Copied to clipboard
Chulun Zhou, Qiujing Wang, Mo Yu, Xiaoqian Yue, Rui Lu, Jiangnan Li, Yifan Zhou, Shunchi Zhang, Jie Zhou, Wai Lam
| Challenge: | Theory-of-Mind (ToM) is a psychological capability that allows humans to understand and interpret the mental states of others. |
| Approach: | They propose a CharToM-QA benchmark to assess the importance of comprehensive contextual understanding about personal backgrounds in ToM. |
| Outcome: | The proposed model outperforms existing models on 1,035 ToM questions based on classic novels and shows that educated participants perform better when they have read the novels than non-educated participants. |
DeMAC: Enhancing Multi-Agent Coordination with Dynamic DAG and Manager-Player Feedback (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-agent systems (MAS) powered by large language models struggle to adapt to evolving task dependencies and to handle uncertainties. |
| Approach: | They propose a Dynamic Environment-Aware Manager-Player Agents Coordination framework that enhances multi-agent coordination through long-term strategic planning. |
| Outcome: | The proposed framework outperforms traditional reinforcement learning and human-agent collaboration in the Overcooked simulation. |
Constructing Your Model’s Value Distinction: Towards LLM Alignment with Anchor Words Tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a study of large language models (LLMs) shows that they can generate outputs that are honest, positive, harmless, etc. |
| Approach: | They propose a method that amplifies logits difference between positive and negative tokens . they propose to use the logits gap to generate positive and positive tokens after alignment . |
| Outcome: | The proposed method achieves effective alignment, but requires fewer computational resources compared to training-time alignment methods. |
Benchmarking Language Model Creativity: A Case Study on Code Generation (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent studies on LLM creativity evaluation focus on open-ended generation tasks . however, the degree to which LLMs possess and utilize creativity for problem-solving remains unclear . |
| Approach: | They propose a framework for quantifying LLM creativity that incorporates design ingredients . they introduce DENIAL PROMPTING which pushes LLMs to develop more creative solutions . |
| Outcome: | The proposed framework quantifies creativity in LLMs on Codeforces problems . it also finds that even the most creative model fails to demonstrate human-like creativity . |
WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
Zhepei Wei, Wenlin Yao, Yao Liu, Weizhi Zhang, Qin Lu, Liang Qiu, Changlong Yu, Puyang Xu, Chao Zhang, Bing Yin, Hyokun Yun, Lihong Li
| Challenge: | Existing work on reinforcement learning has focused on single-turn tasks such as solving math problems. |
| Approach: | They propose a framework that learns directly from online interactions by asynchronously generating diverse trajectories, guided by binary rewards depending on task success. |
| Outcome: | Experiments on the WebArena-Lite benchmark show that the framework outperforms state-of-the-art methods and strong proprietary models. |
FlexGuard: Continuous Risk Scoring for Strictness-Adaptive LLM Content Moderation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing guardrail models for content moderation assume a fixed definition of harmfulness, but enforced strictness varies across platforms and evolves over time, resulting in brittle moderators. |
| Approach: | They propose a strictness-adaptive LLM moderation benchmark that enables controlled evaluation under multiple strictness regimes. |
| Outcome: | The proposed moderator performs better under one regime and under another, and is more robust under varying strictness. |
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to extract event records from text decompose complex structure prediction task into multiple subtasks. |
| Approach: | They propose a sequence-to-structure generation paradigm that can extract events from text . they propose unified event extraction, constrained decoding algorithm and curriculum learning algorithm . |
| Outcome: | The proposed method can achieve competitive performance using record-level annotations in both supervised learning and transfer learning settings. |
Doctor Recommendation in Online Health Forums via Expertise Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Currently, manual doctor allocations are used to handle large volumes of queries, limiting the efficiency to help patients in sheer quantities. |
| Approach: | They propose to use patient queries to model doctor recommendation using their profiles and past dialogues to estimate their capabilities. |
| Outcome: | The proposed model outperforms baseline models on a Chinese online health forum, outperforming baseline models. |
Learning Confidence for Transformer-based Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | A well-calibrated confidence estimate is not sufficient for neural machine translation (NMT) where probabilities from softmax distribution fail to describe when the model is probably mistaken. |
| Approach: | They propose an unsupervised confidence estimate learning jointly with the training of a neural machine translation model to quantify confidence. |
| Outcome: | The proposed model outperforms standard label smoothing and can predict failures in two real-world scenarios. |
Discrete Argument Representation Learning for Interactive Argument Pair Identification (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing research on monological argumentation covers claims generation, argument structure prediction, and essay scoring. |
| Approach: | They propose to identify argument pairs from two posts with opposite stances to a certain topic. |
| Outcome: | The proposed framework outperforms competing models on a large-scale dataset . it also proves that it is useful for analyzing argument pairs from two posts . |
Web Sitemap Knowledge Can Enhance Autonomous Browsing (2026.findings-acl)
Copied to clipboard
Yuyao Zhang, Hongyu Lu, Jiajie Jin, Hongjin Qian, Shiyu Li, Zhao Yang, Yutao Zhu, Ji-Rong Wen, Zhicheng Dou
| Challenge: | Existing web agents suffer from limited robustness, efficiency and task success due to lack of structural understanding of websites and lack of browsing priors in pre-trained models. |
| Approach: | They propose an agent-oriented sitemap protocol that integrates structured website knowledge into web agents. |
| Outcome: | The proposed agent-oriented sitemap improves robustness, efficiency and effectiveness without extra training. |
FaStFact: Faster, Stronger Long-Form Factuality Evaluations in LLMs (2025.findings-emnlp)
Copied to clipboard
Yingjia Wan, Haochen Tan, Xiao Zhu, Xinyu Zhou, Zhiwei Li, Qingsong Lv, Changxuan Sun, Jiaqi Zeng, Yi Xu, Jianqiao Lu, Yinhong Liu, Zhijiang Guo
| Challenge: | Prior evaluation pipelines fail to evaluate factuality of long-form LLMs due to inefficiency and costly human assessment. |
| Approach: | They propose a fast and strong evaluation pipeline that can evaluate factuality of long-form LLMs . they propose 'faStFact' to reduce cost of web searching and inference calling . |
| Outcome: | The proposed evaluation pipeline achieves highest alignment with human evaluation and efficiency among existing baselines. |
Decoupled Dialogue Modeling and Semantic Parsing for Multi-Turn Text-to-SQL (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work on Text-to-SQL for multi-turn dialogue has attracted great interest . current approaches mostly employ end-to end models and face data sparsity problems . |
| Approach: | They propose a decoupled multi-turn text-to-SQL framework where dialogue context is explicitly solved by an utterance rewrite model and a single-turn Text-toSQl parser are proposed. |
| Outcome: | The proposed method outperforms existing models on SParC and CoSQL datasets without annotated in-domain data. |
OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation (2026.acl-long)
Copied to clipboard
Ziyi Wang, Yuxuan Lu, Wenbo Li, Amirali Amini, Bo Sun, Yakov Bart, Weimin Lyu, Jiri Gesi, Tian Wang, Jing Huang, Yu Su, Upol Ehsan, Malihe Alikhani, Toby Jia-Jun Li, Lydia Chilton, Dakuo Wang
| Challenge: | evaluating LLMs' ability to mimic real user behavior remains an open challenge due to the lack of high-quality, publicly available datasets that capture both the observable actions and the internal reasoning of an actual user. |
| Approach: | They propose a dataset of Observation, Persona, Rationale, and Action collected from real human participants during online shopping sessions. |
| Outcome: | The proposed dataset is the first to evaluate how well current LLMs can accurately simulate the next web action of a specific user. |
Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Text summarization is a key natural language generation task, but the high cost of inaccurate summaries raises concerns about the reliability of uncertainty estimation on text summarisation (UE-TS) evaluation methods. |
| Approach: | They propose a UE-TS benchmark that evaluates the uncertainty estimation capabilities of two large language models and one pre-trained language model on three datasets. |
| Outcome: | The proposed benchmark evaluates the uncertainty estimation capabilities of two large language models and one pre-trained language model on three datasets, with human-annotation analysis incorporated where applicable. |
Meta-Cognitive Analysis: Evaluating Declarative and Procedural Knowledge in Datasets and Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have push NLP into a new era, moving away from traditional task-specific pre-train finetuning paradigm. |
| Approach: | They provide a comprehensive analysis of declarative and procedural knowledge for large language models and evaluate their effectiveness. |
| Outcome: | The proposed model can perform better with both kinds of knowledge, but at different speeds. |
Reasoning-Oriented and Analogy-Based Methods for Locating and Editing in Zero-Shot Event-Relational Reasoning (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for zero-shot event-relational reasoning require large computational resources and lack interpretability. |
| Approach: | They propose a method for Reasoning-Oriented Locating and Editing which locates and edits key modules of the language model for reasoning about event relations. |
| Outcome: | The proposed method improves interpretability and efficiency with reduced computational cost and achieves SOTA results in zero-shot event-relational reasoning. |
MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models generate erroneous information and evaluations fail to assess factual correctness of models. |
| Approach: | They propose to use MoleculeQA to evaluate molecular factual correctness in large language models by organizing molecules into a taxonomy and building QA pairs through human and LLM efforts. |
| Outcome: | The proposed model improves the factual correctness of generated information and enables the development of new models. |
NOTA: Multimodal Music Notation Understanding for Visual Large Language Model (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing general-domain visual language models lack ability of music notation understanding . Symbolic music is represented in two distinct forms: auditory music and symbolic music . |
| Approach: | They propose to train a multimodal music notation model using a large-scale dataset . they use cross-modal alignment to train the model for music notations analysis . |
| Outcome: | The proposed model improves on music understanding by training with a multimodal music notation model. |
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning (2024.acl-long)
Copied to clipboard
Chengpeng Li, Zheng Yuan, Hongyi Yuan, Guanting Dong, Keming Lu, Jiancan Wu, Chuanqi Tan, Xiang Wang, Chang Zhou
| Challenge: | In math reasoning with large language models, fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective. |
| Approach: | They propose to fine-tune data augmentation by query evolution and diverse reasoning paths. |
| Outcome: | The proposed model achieves new state-of-the-art on GSM8K and MATH. |
Reducing Token Redundancy in LVLMs: A Systematic Review of Token Pruning Methods (2026.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) excel at visual understanding but face severe computational bottlenecks when processing high-resolution images and long videos due to massive visual token counts. |
| Approach: | They propose a taxonomy categorizing methods into vision-side, LLM-side and hybrid paradigms and analyze token selection mechanisms and pruning strategy. |
| Outcome: | The proposed method selectively removes less informative tokens while maintaining performance. |
Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning (2024.emnlp-main)
Copied to clipboard
Abhinav Bandari, Lu Yin, Cheng-Yu Hsieh, Ajay Jaiswal, Tianlong Chen, Li Shen, Ranjay Krishna, Shiwei Liu
| Challenge: | Existing approaches to prune LLMs rely on the C4 dataset as calibration data . arithmetic datasets perform better than pre-training datasets for pruning, whereas chain-of-thought is only useful on certain tasks. |
| Approach: | They evaluate the selection of calibration data for LLM pruning across a wide range of datasets . they find that C4 is not the optimal calibration data, and that CoT is only useful on certain tasks. |
| Outcome: | The chosen calibration data significantly impacts the performance of pruned LLMs, the authors found . their results shed light on the importance of carefully selecting calibration data for LLM pruning . |
Advancing SMoE for Continuous Domain Adaptation of MLLMs: Adaptive Router and Domain-Specific Loss (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have explored Continual Instruction Tuning (CIT) in Multimodal Large Language Models (MLLMs), with a primary focus on Task-incremental CIT, where MLLM are required to continuously acquire new tasks. |
| Approach: | They propose a Sparse Mixture of Expert (SMoE) based method for domain-incremental CIT in Multimodal Large Language Models (MLLMs) . they equip the SMoA module with a domain-specific autoregressive loss (DSAL) they establish a new benchmark to evaluate the efficacy of their method . |
| Outcome: | The proposed method outperforms all baselines and is based on a Sparse Mixture of Experts (SMoE) module . |
Debiasing In-Context Learning by Instructing LLMs How to Follow Demonstrations (2024.findings-acl)
Copied to clipboard
Lvxue Li, Jiaqi Chen, Xinyu Lu, Yaojie Lu, Hongyu Lin, Shuheng Zhou, Huijia Zhu, Weiqiang Wang, Zhongyi Liu, Xianpei Han, Le Sun
| Challenge: | In-context learning (ICL) has gained considerable attention due to its data efficiency and task adaptability. |
| Approach: | They propose to de-biase demonstration bias in in-context learning by focusing on semantic ambiguity induced by demonstrations and reducing the semantic hazard. |
| Outcome: | The proposed methods significantly improve performance on six datasets. |
Decoding the Market’s Pulse: Context-Enriched Agentic Retrieval Augmented Generation for Predicting Post-Earnings Price Shocks (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods for forecasting large stock price movements after corporate earnings calls are prone to **narrative bias** Existing approaches lack temporal-causal reasoning and are unable to predict large stock prices. |
| Approach: | They propose a retrieval-augmented framework that deploys a team of cooperative LLM agents . they retrieve structured evidence from a Causal-Temporal Knowledge Graph built from financial statements and earnings calls . |
| Outcome: | The proposed framework outperforms larger LLMs and fine-tuned models in macro-F1, MCC, and Sharpe for the same forecasting horizon. |
Unraveling Feature Extraction Mechanisms in Neural Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Neural networks have become indispensable across a variety of natural language processing tasks. |
| Approach: | They propose a theoretical approach based on Neural Tangent Kernels to investigate neural networks' internal mechanisms. |
| Outcome: | The proposed approach can be applied to analyze language modeling tasks . it shows that the choice of activation function can affect feature extraction . |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Non-Autoregressive Machine Translation as Constrained HMM (2024.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive (AR) models have some drawbacks due to slow inference speed and label bias due to local normalization. |
| Approach: | They propose to use a left-to-right Hidden Markov Model (HMM) to control label bias in non-autoregressive translation (NAT) They propose a bi-directional HMM, which can regularize each other's biases via shared parameters. |
| Outcome: | The proposed models can achieve comparable performance to autoregressive Transformers using various decoding methods. |
Simple or Complex? Complexity-controllable Question Generation with Soft Templates and Deep Mixture of Experts Model (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on complex questions does not consider controlling complexity of generated questions. |
| Approach: | They propose an end-to-end neural complexity-controllable question generation model that incorporates a mixture of experts as the selector of soft templates to capture question similarity while avoiding the expensive construction of actual templates. |
| Outcome: | The proposed model is superior to state-of-the-art methods in both automatic and manual evaluations on two benchmark QA datasets. |
Adversarial Preference Learning for Robust LLM Alignment (2025.findings-acl)
Copied to clipboard
Yuanfu Wang, Pengyu Wang, Chenyang Xi, Bo Tang, Junyi Zhu, Wenqiang Wei, Chen Chen, Chao Yang, Jingfeng Zhang, Chaochao Lu, Yijun Niu, Keming Mao, Zhiyu Li, Feiyu Xiong, Jie Hu, Mingchuan Yang
| Challenge: | Modern language models rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors, but they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of human annotation; (2) the vast diversity of potential adversarials; and (3) the risk of feedback bias and reward hacking. |
| Approach: | They propose an iterative adversarial training method that incorporates three key innovations to address these challenges. |
| Outcome: | Experiments on Mistral-7B-Instruct-v0.3 show that the proposed method significantly enhances robustness and reduces harmful outputs from 5.88% to 0.43%. |
MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in NoSQL database support focus on English . however, the intricacy and heterogeneity of NoSqL query languages present a formidable challenge . |
| Approach: | They propose a multilingual benchmark for natural language to NoSQL query generation that covers six languages. |
| Outcome: | The proposed framework improves performance in English and non-English settings, while ignoring lexical and syntactic differences. |
Adam’s Law: Textual Frequency Law on Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Textual frequency is a topic of understudied research, but its relevance to Large Language Models is not well understood. |
| Approach: | They propose a framework to estimate textual data frequency using a paraphraser and a textual distillation method to refine LLMs. |
| Outcome: | The proposed framework can be used to estimate sentence-level frequency with word-level frequencies. |
DaMSTF: Domain Adversarial Learning Enhanced Meta Self-Training for Domain Adaptation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to domain adaptation only use reliable pseudo instances, i.e., pseudo instances with high prediction confidence, to retrain the model. |
| Approach: | They propose a domain adversarial learning enhanced self-training framework that uses meta-learning to estimate the importance of each pseudo instance and a meta constructor to construct the meta-validation set. |
| Outcome: | The proposed framework reduces label noise and preserves hard examples while maintaining accuracy. |
Detection of Propaganda Using Logistic Regression (D19-50)
Copied to clipboard
| Challenge: | Various propaganda techniques are used to manipulate peoples perspectives to foster a predetermined agenda. |
| Approach: | They propose a Logistic Regression-based tool that automatically classifies whether a sentence is propagandistic or not. |
| Outcome: | The proposed tool outperforms the baseline on linguistic and semantic features. |
ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities (2025.findings-naacl)
Copied to clipboard
Jiarui Lu, Thomas Holleis, Yizhe Zhang, Bernhard Aumayer, Feng Nan, Haoping Bai, Shuang Ma, Shen Ma, Mengyu Li, Guoli Yin, Zirui Wang, Ruoming Pang
| Challenge: | Recent advances in large language models have led to a growing interest in tool assisted LLMs . toolSandbox includes stateful tool execution, implicit state dependencies between tools . |
| Approach: | a new tool-based evaluation tool is released to help LLMs evaluate their tool-use capabilities. a tool-driven evaluation tool includes stateful tool execution, implicit state dependencies between tools and a built-in user simulator. |
| Outcome: | the toolSandbox evaluation benchmark shows that open source and proprietary models have a performance gap . the benchmarks show that even the most capable LLMs are challenged by state dependent tasks . |
SAM3-I: Segment Anything with Instructions (2026.acl-long)
Copied to clipboard
Jingjing Li, Yue Feng, Yuchen Guo, Jincai Huang, Wei Ji, Qi Bi, Yongri Piao, Miao Zhang, Xiaoqi Zhao, Qiang Chen, Shihao Zou, Huchuan Lu, Li Cheng
| Challenge: | Existing methods for concept-level grounding and instruction-level reasoning use coarse representations and iterative mask filtering. |
| Approach: | They propose an instruction-following extension of the Segment Anything Model 3 family that unifies concept-level grounding and instruction-level reasoning within a single segmentation framework. |
| Outcome: | Experiments show that SAM3-I achieves appealing performance across referring and reasoning-based segmentation while maintaining its strong concept recall ability. |
How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition (2024.acl-long)
Copied to clipboard
Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, Jingren Zhou
| Challenge: | supervised fine-tuning (SFT) is a technique used to enhance multiple abilities in large language models. |
| Approach: | They propose to study the interplay of data composition between mathematical reasoning, code generation, and general human-aligning abilities during supervised fine-tuning. |
| Outcome: | The proposed model improves math reasoning and code generation with increasing data amount . the proposed model size and SFT strategies can be used to learn multiple skills with different scaling patterns. |
Graph of Trace: Visualizing Execution Traces of Scientific Agents (2026.acl-demo)
Copied to clipboard
| Challenge: | Scientific AI agents can perform complex research tasks, but these unfolded workflows are difficult for humans to inspect and review, limiting interpretable, controllable and effective human–AI collaboration. |
| Approach: | They propose a monitoring and visualization framework that records fine-grained execution events and organizes them into a directed graph that makes agent workflows explicit as they proceed. |
| Outcome: | The proposed framework records intermediate steps (e.g. tool calls and code executions) and renders them as real-time updated visual traces that expose workflow structure. |
Transferable Post-training via Inverse Value Learning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing algorithms for post-training large datasets are requiring a large computational effort. |
| Approach: | They propose to model the changes at logits level during post-training using a separate neural network . they demonstrate that the value network can be seamlessly integrated with another pre-trained model . |
| Outcome: | The proposed model can be integrated with another pre-trained model during inference, enabling similar capability enhancements. |
Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on large language models focus on literal-level translation quality, such as adequacy and fluency. |
| Approach: | They propose a Culture-Aware Novel-Driven Parallel Dataset for Machine Translation and a multi-dimensional evaluation framework for assessing cultural translation quality. |
| Outcome: | The proposed model improves evaluation reliability in LLM-as-a-judge scenarios under culture-aware constraints. |
LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts (2025.acl-long)
Copied to clipboard
Qibing Ren, Hao Li, Dongrui Liu, Zhanxu Xie, Xiaoya Lu, Yu Qiao, Lei Sha, Junchi Yan, Lizhuang Ma, Jing Shao
| Challenge: | Current safety training focuses on teaching models to reject harmful queries, but recent research shows that adversarial attacks or jailbreak methods bypass these safety mechanisms. |
| Approach: | They propose to use a new attack method to craft multi-turn toxic prompts that gradually lead LLMs to reveal unsafe content. |
| Outcome: | The proposed method outperforms existing methods in diversity, effectiveness, and efficiency across aligned LLMs. |
Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning with benign data can compromise safety of aligned LLMs. |
| Approach: | They propose a Layer-Aware Representation Filtering method that detects safety-degrading layers within the LLM and leverages their representations to detect them. |
| Outcome: | The proposed method can detect safety-degrading features in benign data and remove them from the model. |
Alignment with Fill-In-the-Middle for Enhancing Code Generation (2025.emnlp-main)
Copied to clipboard
Houxing Ren, Zimu Lu, Weikang Shi, Haotian Hou, Yunqiao Yang, Ke Wang, Aojun Zhou, Junting Pan, Mingjie Zhan, Hongsheng Li
| Challenge: | Existing methods for generating test cases with limited training data are not reliable and may be counterproductive. |
| Approach: | They propose a method that splits code snippets into smaller, granular blocks, creating more diverse DPO pairs from the same test cases. |
| Outcome: | The proposed approach shows significant improvements in code generation tasks on benchmark datasets such as HumanEval (+), MBPP (+), and APPS. |
MONTROSE: LLM-driven Monte Carlo Tree Search Self-Refinement for Cross-Domain Rumor Detection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing feature alignment methods are susceptible to task interference during training. |
| Approach: | MONTROSE is a cross-domain rumor detection method that generates high-quality synthetic data for the target domain and a domain-sharpness-aware approach to train models with these synthetic data. |
| Outcome: | Experiments show that MONTROSE improves in cross-domain rumor detection. |
BehaviorSFT: Behavioral Token Conditioning for Health Agents Across the Proactivity Spectrum (2025.findings-emnlp)
Copied to clipboard
Yubin Kim, Zhiyuan Hu, Hyewon Jeong, Eugene W Park, Shuyue Stella Li, Chanwoo Park, Shiyun Xiong, MingYu Lu, Hyeonhoon Lee, Xin Liu, Daniel McDuff, Cynthia Breazeal, Samir Tulebaev, Hae Won Park
| Challenge: | Large Language Models (LLMs) struggle with proactive engagement, authors say . a blind clinical evaluation confirmed that trained agents exhibit more realistic clinical behavior . |
| Approach: | They propose a training strategy using behavioral tokens to explicitly condition LLMs for dynamic behavioral selection. |
| Outcome: | The proposed training strategy boosts performance on both benchmarks. |
Microblog Conversation Recommendation via Joint Modeling of Topics and Discourse (N18-1)
Copied to clipboard
| Challenge: | Existing methods for recommendation focus on content of individual posts, but we exploit both context and user content and behavior preferences. |
| Approach: | They propose a method that captures conversational context and user content and behavior preferences. |
| Outcome: | The proposed method outperforms methods that only model content without considering discourse on two Twitter datasets. |
Neural Chinese Address Parsing (N19-1)
Copied to clipboard
| Challenge: | Recent research shows that systems that perform address parsing can be useful for building e-commerce or product recommendation systems. |
| Approach: | They propose a task of parsing Chinese addresses into semantically meaningful chunks using a linear-chain structure. |
| Outcome: | The proposed model is able to capture complex dependencies between labels that cannot be readily captured by a simple linear-chain structure. |
Tree Representations in Transition System for RST Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies have proposed a series of actions to build a right-heavy binarized tree for RST parsing, but the nodes of the binary-nuclear relations have the same nuclear type as those of the multi-nullar relations. |
| Approach: | They propose a nuclear type for multi-nuclear relations and a new action to construct a multi-branch tree. |
| Outcome: | The proposed nuclear type and action are more capable of capturing multi-nuclear relation and the joint action is more suitable than the separate one. |
Towards Robust Real-World Spreadsheet Understanding with Multi-Agent Multi-Format Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Spreadsheets are among the most widely used data formats in real-world applications . existing large language models treat tables as plain text, overlooking layout cues and visual semantics. |
| Approach: | They propose a two-stage multi-agent framework for spreadsheet understanding that adopts a step-by-step reading and reasoning paradigm. |
| Outcome: | Extensive experiments on two spreadsheet datasets show the proposed framework outperforms existing methods on Spreadsheet Bench. |
AutoAlign: Get Your LLM Aligned with Minimal Annotations (2025.acl-demo)
Copied to clipboard
Xinyu Lu, Dong Xu, Chunkang Zhang, Xinyan Guan, Junxiang Wang, Qingyu Zhang, Pengbo Wang, Yingzhi Mao, Hao Xiang, Xueru Wen, Zichao Li, Yaojie Lu, Hongyu Lin, Le Sun, Xianpei Han
| Challenge: | Automated Alignment (ALM) is a set of algorithms designed to align Large Language Models (LLMs) with human intentions and values while minimizing manual intervention. |
| Approach: | They propose an open-source toolkit that integrates mainstream automated algorithms through a consistent interface and an accessible workflow supporting one-click execution for prompt synthesis and automatic alignment signal construction. |
| Outcome: | The proposed framework enables easy reproduction of existing results through extensive benchmarks and facilitates the development of novel approaches via modular components. |
Are All Prompt Components Value-Neutral? Understanding the Heterogeneous Adversarial Robustness of Dissected Prompt in LLMs (2026.eacl-long)
Copied to clipboard
Yujia Zheng, Tianhao Li, Haotian Huang, Tianyu Zeng, Jingyu Lu, Chuangxin Chu, Yuekai Huang, Ziyou Jiang, Qian Xiong, Yuyao Ge, Mingyang Li
| Challenge: | Existing studies treat prompts as flat text, overlooking their internal structure, and different components within a prompt contribute unequally to robustness. |
| Approach: | They propose a framework that decomposes prompts into functional components and a method that selectively modifies components to expose component-wise vulnerabilities. |
| Outcome: | The proposed framework exposes component-wise vulnerabilities while ensuring linguistic plausibility through perplexity-based filtering. |
AscendKernelGen: LLM-Driven Kernel Generation for NPUs (2026.findings-acl)
Copied to clipboard
Xinzi Cao, Jianyang Zhai, Pengfei Li, Zhiheng Hu, Cen Yan, null Mubingxu, Guanghuan Fang, Bin She, Jiayu Li, Yihan Su, Dongyang Tao, Feidiao Yang, Chang-Dong Wang, Yutong Lu, Weicheng Xue, Bin Zhou, Yonghong Tian
| Challenge: | Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs). |
| Approach: | They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say . |
| Outcome: | The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels. |
Retrieved Sequence Augmentation for Protein Representation Learning (2024.emnlp-main)
Copied to clipboard
Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Sheng Wang, Lingpeng Kong
| Challenge: | Using multiple sequence alignments (MSA) to extract evolutionary knowledge is limited. |
| Approach: | They propose to use multiple sequence alignments to augment protein representations . they propose to employ Retrieved Sequence Augmentation to enhance protein representation learning . |
| Outcome: | The proposed method surpasses MSA Transformer by 5% in structural and property prediction tasks while being 373 times faster. |
Neural Conversation Recommendation with Online Interaction Modeling (D19-1)
Copied to clipboard
| Challenge: | Existing models that only use lexical features and ignore past user interactions in online conversations are inadequate to identify and engage in online discussions. |
| Approach: | They propose a framework that automatically recommends conversations based on user's prior conversation behaviors by exploring deep semantic features that measure how a user’s preferences match an ongoing conversation’s context. |
| Outcome: | The proposed model outperforms state-of-the-art models on two large-scale datasets from Twitter and Reddit showing that it incorporates deep semantic features that measure how a user’s preferences match an ongoing conversation’s context. |
STRICT: Stress-Test of Rendering Image Containing Text (2025.emnlp-main)
Copied to clipboard
| Challenge: | Despite the advances in diffusion models, the generation of coherent text remains a major bottleneck. |
| Approach: | They propose a benchmark to test the ability of diffusion models to render coherent text in images. |
| Outcome: | The proposed model fails to generate coherent and legible text in images despite its iterative nature . the model fails in both the maximum length of readable text and correctness and legibility of the generated text . |
Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic (2024.lrec-main)
Copied to clipboard
| Challenge: | Experimental evaluations of large language models demonstrate the efficacy of enhanced reasoning by logic. |
| Approach: | They propose a framework that uses symbolic logic to verify and rectify reasoning steps by steps. |
| Outcome: | The proposed framework improves the zero-shot chain-of-thought reasoning ability of large language models by verifying and rectifying the reasoning steps step by step. |
LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking (2021.acl-long)
Copied to clipboard
Hang Jiang, Sairam Gurajada, Qiuhao Lu, Sumit Neelam, Lucian Popa, Prithviraj Sen, Yunyao Li, Alexander Gray
| Challenge: | Existing work deals with EL in the context of longer text, such as a sentence. |
| Approach: | They propose a neuro-symbolic approach that uses interpretable rules based on first-order logic to achieve better performance with black-box neural approaches. |
| Outcome: | The proposed approach achieves better performance than heuristics-based approaches on short-text EL . it can easily blend existing rule templates with multiple types of features, and even with scores resulting from previous EL methods. |
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies study sentiment and emotion separately and do not fully exploit the complementary knowledge behind the two. |
| Approach: | They propose a multimodal sentiment knowledge-sharing framework that unifies MSA and ERC tasks from features, labels, and models. |
| Outcome: | The proposed framework achieves consistent improvements on four public benchmark datasets on MOSI, MOSEI, MELD, and IEMOCAP. |
How Do LLMs and VLMs Understand Viewpoint Rotation Without Vision? An Interpretability Study (2026.acl-long)
Copied to clipboard
Zhen Yang, Ping Jian, Zhongbin Guo, Zuming Zhang, Chengzhi Li, Yonghong Deng, Xinyue Zhang, Wenpeng Lu
| Challenge: | Existing studies on spatial intelligence from the perspective of visual-spatial intelligence have not explored whether visual intelligence alone is sufficient to endow models with spatial intelligence. |
| Approach: | They propose to use a linguistic perspective to investigate spatial intelligence from a theoretical perspective. |
| Outcome: | The proposed model performs poorly on the proposed dataset while human can easily achieve 100% accuracy. |
Experience-Driven Reflective Co-Evolution of Prompts and Heuristics for Autonomous Algorithm Design (2026.findings-acl)
Copied to clipboard
| Challenge: | Combinatorial optimization has long been dominated by manually engineered heuristics, which require substantial expert intuition and implementation overhead. |
| Approach: | They propose a framework that couples an island migration model with elite selection to maintain population diversity. |
| Outcome: | The proposed framework achieves superior accuracy on the Traveling Salesman and Bin Packing Problems. |
One vs. Many QA Matching with both Word-level and Sentence-level Attention Network (C18-1)
Copied to clipboard
| Challenge: | Existing studies on question answer matching focus on formal text . however, there exists many scenarios where the QA text is informal . |
| Approach: | They propose a novel QA matching approach using informal text from a product review site. |
| Outcome: | The proposed approach improves word-level and sentence-level attentions for solving the noisy problem in the informal text. |
ToW: Thoughts of Words Improve Reasoning in Large Language Models (2025.naacl-long)
Copied to clipboard
Zhikun Xu, Ming Shen, Jacob Dineen, Zhaonan Li, Xiao Ye, Shijie Lu, Aswin Rrv, Chitta Baral, Ben Zhou
| Challenge: | Unlike other data augmentation methods, thoughts of words (TOW) views next-word prediction as a core reasoning task and injects fine-grained thoughts into pre-training texts. |
| Approach: | They propose a training-time data-augmentation method called thoughts of words (TOW) that injects fine-grained thoughts directly into a next-word prediction task and teaches the model to understand how the observed next word is related to previous contexts. |
| Outcome: | The proposed method reduces model hallucination by 10% and improves reasoning performance by 7% to 9% on average. |
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)
Copied to clipboard
Yu Zhang, Wenxiang Guo, Changhao Pan, Zhiyuan Zhu, Ruiqi Li, Jingyu Lu, Rongjie Huang, Ruiyuan Zhang, Zhiqing Hong, Ziyue Jiang, Zhou Zhao
| Challenge: | Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment. |
| Approach: | VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control. |
| Outcome: | Experimental results show that VersBand performs better than baseline models across multiple song generation tasks. |
BrainLoc: Brain Signal-Based Object Detection with Multi-modal Alignment (2025.findings-emnlp)
Copied to clipboard
Jiaqi Duan, Xiaoda Yang, Kaixuan Luan, Hongshun Qiu, Weicai Yan, Xueyi Zhang, Youliang Zhang, Zhaoyang Li, Donglin Huang, JunYu Lu, Ziyue Jiang, Xifeng Yang
| Challenge: | BrainLoc is a lightweight object detection model guided by fMRI signals. |
| Approach: | They propose a brain-based object detection model guided by fMRI signals . they employ a multi-modal alignment strategy that enhances fmr feature extraction . |
| Outcome: | The proposed model improves fMRI-based object detection accuracy and convenience. |
VoxMind: An End-to-End Agentic Spoken Dialogue System (2026.acl-long)
Copied to clipboard
Tianle Liang, Yifu Chen, Shengpeng Ji, Yijun Chen, Zhiyang Jia, Jingyu Lu, Fan Zhuo, Xueyi Pu, Yangzhuo Li, Zhou Zhao
| Challenge: | Existing research on end-to-end spoken dialogue models has focused on core perception and generation, with limited exploration of tool-augmented extensions. |
| Approach: | They propose a framework to equip end-to-end spoken dialogue models with comprehensive agentic abilities by leveraging a 470-hour AgentChat dataset. |
| Outcome: | The proposed framework outperforms Gemini-2.5-Pro on spoken agent tasks while maintaining general conversational quality. |
Narrative Order Aware Story Generation via Bidirectional Pretraining Model with Optimal Transport Reward (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing storytelling systems suffer from insufficient understanding of event correlations and inadequate awareness of event temporal order. |
| Approach: | They propose a narrative order aware framework to generate coherent stories with flashbacks . they propose 'bidirectional pretraining model with Optimal Transport Reward' to improve quality . |
| Outcome: | The proposed framework generates coherent stories with flashbacks with a novel optimal transport reward. |
TreeRL: LLM Reinforcement Learning with On-Policy Tree Search (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for On-Policy LLM RL typically train a separate process reward model, which suffers from distribution mismatch and reward hacking. |
| Approach: | They propose a reinforcement learning framework that directly incorporates on-policy tree search for RL training. |
| Outcome: | Experiments on math and code reasoning benchmarks show that tree search achieves superior performance compared to traditional ChainRL. |
DiffusionNER: Boundary Diffusion for Named Entity Recognition (2023.acl-long)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) tasks are fundamental to many structured information extraction tasks. |
| Approach: | They propose a named entity recognition task that uses a boundary-denoising diffusion process to denoise noisy spans. |
| Outcome: | The proposed method achieves comparable or even better performance than previous state-of-the-art models on flat and nested datasets. |
More Samples or More Prompts? Exploring Effective Few-Shot In-Context Learning for LLMs with In-Context Sampling (2024.findings-naacl)
Copied to clipboard
Bingsheng Yao, Guiming Chen, Ruishi Zou, Yuxuan Lu, Jiachen Li, Shao Zhang, Yisi Sang, Sijia Liu, James Hendler, Dakuo Wang
| Challenge: | Existing studies on LLM prompting focus on selecting a better set of data samples inside one single prompt input, but why not design and leverage multiple ICL prompts together to further improve the LLM’s performance? |
| Approach: | They propose a low-resource LLM prompting technique to optimize the construction of multiple ICL prompt inputs to produce confident predictions. |
| Outcome: | The proposed technique can produce confident predictions by optimizing the construction of multiple ICL prompt inputs on four NLI datasets and one QA dataset. |
Learning Explicit and Implicit Structures for Targeted Sentiment Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing research efforts focus on targeting sentiment analysis as a sequence labeling problem, building models that can capture explicit structures in the output space. |
| Approach: | They argue that both implicit and explicit structural information are crucial for building a successful targeted sentiment analysis model. |
| Outcome: | The proposed model outperforms existing models by capturing implicit and explicit structural information. |
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)
Copied to clipboard
Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
| Challenge: | Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. |
| Approach: | They propose a comprehensive benchmark covering 29 languages, built on an English benchmark. |
| Outcome: | The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark. |
The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks to evaluate LLMs' capabilities are inadequate for assessing their musical capabilities. |
| Approach: | They propose to use a large-scale music benchmark specifically designed to evaluate the music-related capabilities of large language models (LLMs). |
| Outcome: | The proposed framework evaluates 16 large language models in the domain of music. |
ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models (2024.acl-long)
Copied to clipboard
Haochen Tan, Zhijiang Guo, Zhan Shi, Lu Xu, Zhili Liu, Yunlong Feng, Xiaoguang Li, Yasheng Wang, Lifeng Shang, Qun Liu, Linqi Song
| Challenge: | Existing evaluation methods for large language models are labor-intensive and lack efficiency. |
| Approach: | They propose a framework dedicated to assessing long-text generation that includes in-depth human-curated meta-questions spanning various domains . they use a set of proxy-quests with pre-annotated answers to assess the content's quality by incorporating the generated texts as contextual background. |
| Outcome: | The proposed framework assesses the quality of long-text content by matching it with references through human evaluation or automated metrics. |
Learning with Structured Representations for Negation Scope Extraction (P18-2)
Copied to clipboard
| Challenge: | Existing approaches to negation scope detection have been criticized for capturing information related to negations, long-distance dependencies and structural information. |
| Approach: | They propose to use conditional random fields, semi-Markov CRF and latent-variable CRF models to capture useful information such as long-distance dependencies and some latent structural information. |
| Outcome: | The proposed approaches can capture useful information such as features related to negation cue, long-distance dependencies and some latent structural information. |
CogDual: Enhancing Dual Cognition of LLMs via Reinforcement Learning with Implicit Rule-Based Rewards (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to role-playing language models rely on prompt engineering or supervised fine-tuning to emulate character behaviors but neglect the underlying cognitive mechanisms driving these behaviors. |
| Approach: | They propose a novel RPLA adopting a cognize-then-respond reasoning paradigm that leverages dual cognition for more contextually grounded and psychologically coherent responses. |
| Outcome: | The proposed RPLA outperforms baselines and generalizes effectively across diverse role-playing tasks. |
DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current Event Extraction methods focus on high-resource scenarios, which requires large amount of annotated data. |
| Approach: | They propose a demonstration-based learning paradigm for EE to fully use annotated data . they propose EE as a natural language generation task guided by schema-based prompts . |
| Outcome: | The proposed model outperforms current methods in low-resource scenarios. |
AutoFigure-Edit: Generating Editable Scientific Illustrations via Reference-Guided Styling (2026.acl-demo)
Copied to clipboard
Zhen Lin, Qiujie Xie, Minjun Zhu, Shichen Li, QiYao Sun, Enhao Gu, Yiran Ding, Ke Sun, Fang Guo, Panzhong Lu, Zhiyuan Ning, Yixuan Weng, Yue Zhang
| Challenge: | Existing automated systems for scientific illustrations are limited in editability, stylistic controllability, and efficiency. |
| Approach: | They propose an end-to-end system that generates fully editable scientific illustrations from long-form scientific text while enabling flexible style adaptation through user-provided reference images. |
| Outcome: | The proposed system generates fully editable scientific illustrations from long-form scientific texts while enabling flexible style adaptation through user-provided reference images. |
Rethinking the Reversal Curse of LLMs: a Prescription from Human Knowledge Reversal (2024.emnlp-main)
Copied to clipboard
Zhicong Lu, Li Jin, Peiguang Li, Yu Tian, Linhao Zhang, Sirui Wang, Guangluan Xu, Changyuan Tian, Xunliang Cai
| Challenge: | Existing methods for large language models (LLMs) are limited by their aggressive sample permutation and lack a detailed understanding of the underlying reasons for the reversal curse. |
| Approach: | They propose a method which enhances bidirectional entity correlation modeling and pairwise relationship reasoning to overcome the reversal curse. |
| Outcome: | The proposed method overcomes the reversal curse by augmenting the samples with entity order-reversals and semantically preserved question-answer pairs. |
Verifiable LLM-Generated Text Detection via Projected Semantic-Structural Distributions (2026.acl-long)
Copied to clipboard
Ruochong Xiong, Qien Li, Wangwang Lian, Yulong Wan, Hanlin Xue, Zhouxing Tan, Han Yang, Fengyu Lu, Junfei Liu
| Challenge: | Existing methods for detecting LLM-Generated text suffer from distribution misalignment and limited interpretability. |
| Approach: | They propose a statistical framework utilizing supervised subspace learning to extract compact features and construct conditional semantic distributions based on syntactic structures. |
| Outcome: | The proposed framework is superior in cross-domain, cross-model, and adversarial scenarios. |
On the Representation Geometry of LoRA Model Merging (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for low-rank Adaptation (LoRA) fine-tuning focus on globally shared structure . combining SVD with CUR improves performance of LoRA model merging . |
| Approach: | They propose a training-free method that combines SVD and CUR decomposition to improve LoRA merging performance. |
| Outcome: | The proposed procedure improves on vision and language benchmarks. |
Language Model Adaption for Reinforcement Learning with Natural Language Action Space (2024.acl-long)
Copied to clipboard
| Challenge: | Previous research has focused on reducing the size of the natural language action space due to the combinatorial nature of the language. |
| Approach: | They propose mutual-information regularized policy optimization to reduce the action space by dynamically adjusting the prior provided by the pretrained model. |
| Outcome: | The proposed method improves monotonically on the mutual-information regularized RL objective. |
Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing frameworks for semi-supervised text mining with lightweight models are limited by label data scarcity. |
| Approach: | They propose a framework for semi-supervised text mining with lightweight models . it incorporates online distillation to train lightweight student models by imitating the Teacher model . |
| Outcome: | The proposed framework exhibits notable performance enhancements over existing frameworks. |
Interpret and Improve In-Context Learning via the Lens of Input-Label Mappings (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models excel at downstream NLP tasks through in-context learning . however, the internal mechanisms behind ICL remain under-explored . |
| Approach: | They propose a PC patching approach to identify modules where input-label mappings function . they observe and verify that key heads utilize input-labeled mappings to generate target labels for new queries. |
| Outcome: | The proposed approach detects modules where input-label mappings function . it also detects that key heads use the mappings to generate labels for new queries . |
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark (2025.coling-main)
Copied to clipboard
Zhikun Xu, Yinghui Li, Ruixue Ding, Xinyu Wang, Boli Chen, Yong Jiang, Haitao Zheng, Wenlian Lu, Pengjun Xie, Fei Huang
| Challenge: | Recent work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer dynamic questions well. |
| Approach: | They propose a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest dynamic questions on the Chinese Internet. |
| Outcome: | The proposed benchmark will be one of the key data resources for improving LLMs’ Chinese question-answering ability in the future. |
Beyond A Single AI Cluster: A Survey of Decentralized LLM Training (2025.emnlp-main)
Copied to clipboard
| Challenge: | Decentralized LLM training leverages dispersed resources at varying scales. |
| Approach: | They propose a resource-driven paradigm that leverages dispersed resources across clusters, datacenters and even regions. |
| Outcome: | The proposed model scales are 175 billion to 660 billion parameters, and the exponential growth in computational requirements poses significant challenges. |
Learning to Generate Structured Output with Schema Reinforcement Learning (2025.acl-long)
Copied to clipboard
Yaxi Lu, Haolun Li, Xin Cong, Zhong Zhang, Yesai Wu, Yankai Lin, Zhiyuan Liu, Fangming Liu, Maosong Sun
| Challenge: | Recent advances in large language models have facilitated the development of intelligent applications like automatic web search (Qin et al., 2023) Several methods exist for generating JSON strings from LLMs, including Prompting but often miss certain schemas. |
| Approach: | They propose to use 40K different JSON schemas to assess models' ability to generate valid JSON outputs. |
| Outcome: | The proposed model improves both in generating JSON outputs and downstream tasks. |
Decomposed Prompt Tuning via Low-Rank Reparameterization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have achieved remarkable performance on various tasks. |
| Approach: | They propose a decomposed prompt tuning approach that utilizes low-rank matrices to initialize the soft prompt. |
| Outcome: | The proposed method significantly reduces the number of trainable parameters while maintaining effectiveness. |
Better Modeling of Incomplete Annotations for Named Entity Recognition (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition (NER) assume that the training data is fully annotated with named entity information. |
| Approach: | They propose a supervised setup for named entity recognition where annotated data is assumed to be available during training. |
| Outcome: | The proposed approach is able to recognize named entities with incomplete annotations. |
Thermometer of Thoughts: Enhancing LLM’s Exploration via Attention Temperature Modulation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in the reasoning capabilities of large language models have enabled them to tackle complex tasks such as mathematics reasoning. |
| Approach: | They propose a method that modulates attention temperature dynamically to shift LLM's internal focus during reasoning, enabling a dynamic shift between exploratory and focused modes. |
| Outcome: | The proposed method improves Pass@10 by 6.78–14.20% and aggregation accuracy by 9.74% across 7 reasoning benchmarks. |
TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that TESTA reduces the number of visual tokens by 75% and thus accelerates video encoding. |
| Approach: | They propose a method to condense video semantics by aggregating similar frames and patches within each frame. |
| Outcome: | The proposed method reduces visual tokens by 75% and accelerates video encoding. |
H-MAS: Hierarchical Multi-Agent Scheduling for Multi-Tenant LLM Serving (2026.findings-acl)
Copied to clipboard
Yuhan Liu, Cong Xu, Qi Jia, Yihua Wang, Feiyu Chen, Liang Jin, Lu Liu, Yaqian Zhao, Yuting Ding, Xiang Li
| Challenge: | Multi-tenant Model-as-a-Service (MaaS) workloads exhibit non-stationarity across multiple time scales . existing request schedulers often rely on a fixed policy that remains unchanged at runtime . |
| Approach: | They propose a hierarchical multi-agent scheduler that operates in a layered closed loop . they propose to maintain 1.2–3.0 higher Goodput than SGLang and vLLM . |
| Outcome: | Experiments show that H-MAS achieves 1.2–3.0 higher Goodput than SGLang and vLLM . it maintains more stable QoS under diverse request lengths and heterogeneous SLO targets . |
ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summary (2025.coling-main)
Copied to clipboard
| Challenge: | Literature review is an indispensable step in the research process, but literature summary is challenging and time consuming. |
| Approach: | They propose an LLM agent with human workflow guidance for comparative literature summary . they use a human workflow to extract key elements from relevant literature and generate summaries . |
| Outcome: | The proposed method outperforms the CoT model in several dimensions. |
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)
Copied to clipboard
Tianrui Wang, Ziyang Ma, Yizhou Peng, Haoyu Wang, Zhikang Niu, Zikang Huang, Yihao Wu, Yi-Wen Chao, Yu Jiang, Yuheng Lu, Guanrou Yang, Xuanchen Li, Hexin Liu, Chunyu Qiang, Cheng Gong, Yifan Yang, Tianchi Liu, Junyu Wang, Nana Hou, Meng Ge, Fuming You, Yang Wei, Zhongqian Sun, Hu Haifeng, Xiaobao Wang, Eng Siong Chng, Xie Chen, Longbiao Wang, Jianwu Dang
| Challenge: | Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level. |
| Approach: | They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context. |
| Outcome: | The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set. |
DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Quantization-aware Training (QAT) is a popular technique for reducing memory usage and improving computational efficiency in large language models. |
| Approach: | They propose a weight-decomposed low-rank quantization-aware training approach that integrates QAT with a group-specific quantization magnitude adjustment. |
| Outcome: | The proposed method outperforms the state-of-the-art method on LLaMA and LLama2 models. |
InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions (2024.naacl-long)
Copied to clipboard
| Challenge: | In order to perform downstream tasks, Large Language Models (LLMs) need continual adaptation without catastrophic forgetting. |
| Approach: | They propose a new paradigm that allows for continual adaptation without catastrophic forgetting . they propose to replay previous data based on task similarity with instructions . |
| Outcome: | The proposed method improves performance over 16 tasks with different training orders. |
Using Interactive Feedback to Improve the Accuracy and Explainability of Question Answering Systems Post-Deployment (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing work on question answering focuses on the pre-deployment stage; building an accurate model for deployment. |
| Approach: | They collect feedback from users and train a neural model with the feedback data. |
| Outcome: | The proposed model can explain the correctness or incorrectness of an answer. |
Seg2Act: Global Context-aware Action Generation for Document Logical Structuring (2024.emnlp-main)
Copied to clipboard
Zichao Li, Shaojie He, Meng Liao, Xuanang Chen, Yaojie Lu, Hongyu Lin, Yanxiong Lu, Xianpei Han, Le Sun
| Challenge: | Document logical structuring is crucial for document intelligence due to the complexity of text segment dependencies in the document. |
| Approach: | They propose an end-to-end, generation-based method for document logical structuring that generates the action sequence via a global context-aware generative model and updates its global context and current logical structure based on the generated actions. |
| Outcome: | Experiments on ChCatExt and HierDoc datasets show that Seg2Act performs better than previous methods in both supervised and transfer learning settings. |
LoRASC: Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing low-rank adaptations have limited expressiveness, a tendency to overfit, and sensitivity to hyperparameter settings. |
| Approach: | They propose a technique to enhance LoRA’s expressiveness and generalization capabilities while preserving its training efficiency. |
| Outcome: | The proposed method outperforms baselines, mitigates overfitting, enhances model stability, and improves OOD robustness. |
WSDPO: A Generative Word Sense Disambiguation Framework with Chain-of-Thought and Preference Optimization (2026.acl-long)
Copied to clipboard
Kunpeng Kang, Shuaimin Li, Kaiyuan Zhang, Luyang Zhang, Jiasheng Si, Bing Xu, Kehai Chen, Muyun Yang, Wenpeng Lu
| Challenge: | Word sense disambiguation (WSD) is a fundamental task in natural language processing. |
| Approach: | They propose a training framework for generative WSD with chain-of-thought (CoT) and preference optimization. |
| Outcome: | The proposed framework achieves significant performance gains on rare and unseen settings and exhibits strong generalization in standard evaluation settings. |
Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing cross-lingual transfer are limited by parallel resources and lack linguistic and domain coverage. |
| Approach: | They propose a cross-lingual in-context pre-training approach that leverages semantically related bilingual Wikipedia documents to enhance cross-linguistic transfer. |
| Outcome: | The proposed approach improves multilingual performance on three models across six target languages. |
DPGA-TextSyn: Differentially Private Genetic Algorithm for Synthetic Text Generation (2025.findings-acl)
Copied to clipboard
Zhonghao Sun, Zhiliang Tian, Yiping Song, Yuyi Si, Juhua Zhang, Minlie Huang, Kai Lu, Zeyu Xiong, Xinwang Liu, Dongsheng Li
| Challenge: | Existing methods to fine-tune large language models pose privacy risks . researchers have synthesized data with strong generation capabilities closed-source LLMs to alleviate this problem . |
| Approach: | They propose to combine general LLMs with genetic algorithm to produce relevant and diverse synthetic text under differential privacy constraints. |
| Outcome: | The proposed method significantly improves the performance of the model in downstream tasks while ensuring privacy. |
M-CNER: A Corpus for Chinese Named Entity Recognition in Multi-Domains (L18-1)
Copied to clipboard
| Challenge: | NER is one of the most important natural language processing tasks. |
| Approach: | They propose to annotate sentences from human-computer interaction, social media, and e-commerce using two rounds of annotation. |
| Outcome: | The proposed system performs the best on all the data sets. |
Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing methods to extract unseen relations require laborious manual annotation . a new approach uses fine-grained matching to reduce manual annotation cost . |
| Approach: | They propose an efficient multi-grained matching approach that uses virtual entity matching to reduce manual annotation cost. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods and achieves inference efficiency and accuracy in zero-shot relation extraction tasks. |
Legal Judgment Prediction based on Knowledge-enhanced Multi-Task and Multi-Label Text Classification (2025.naacl-long)
Copied to clipboard
| Challenge: | Legal judgment prediction (LJP) is an essential task for legal AI, aiming at predicting judgments based on the facts of a case. |
| Approach: | They propose a knowledge-enhanced approach that incorporates 'label-level knowledge' to enhance the representation of case facts for each task and 'task-level' knowledge to improve synergy. |
| Outcome: | The proposed method is effective in comparison to state-of-the-art (SOTA) baselines. |
LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to train a single model for massive languages have huge communication overheads and parameter interference. |
| Approach: | They propose an efficient training approach with an asymmetric multi-way model architecture for massive multilingual neural machine translation. |
| Outcome: | The proposed model is 16.2 faster than the distributed training method for M2M-100-12B while improving the translation performance by an average of 2.2 BLEU on Flores-101. |
LEASH: Adaptive Length Penalty and Reward Shaping for Efficient Large Reasoning Model (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to long reasoning traces are hard to tune and fail to adapt to evolving LLMs. |
| Approach: | They propose a reinforcement learning framework that optimizes the length of reasoning traces by a Lagrangian primal–dual method. |
| Outcome: | The proposed framework reduces the average reasoning length by 60% across diverse tasks while maintaining competitive performance. |
Closing the Modality Reasoning Gap for Speech Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Speech Large Language Models have a modality reasoning gap that is not addressed by prior work. |
| Approach: | They propose a reinforcement-learning framework that aligns text-conditioned and speech-conditioned trajectories through an asymmetric reward design. |
| Outcome: | Experiments on MMSU and OBQA show that the proposed framework narrows the modality reasoning gap and achieves state-of-the-art performance among 7B-scale Speech LLMs. |
A Neural Multi-digraph Model for Chinese NER with Gazetteers (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to incorporating gazetteers into NER systems rely on manually defined selection strategies or handcrafted templates, which may not lead to optimal effectiveness. |
| Approach: | They propose to use graph neural networks to automatically learn how to incorporate multiple gazetteers into an NER system by capturing the information that the gazetteer offers. |
| Outcome: | The proposed model outperforms existing methods on Chinese NER datasets while incorporating rich gazetteer information while resolving ambiguities. |
Intra-Correlation Encoding for Chinese Sentence Intention Matching (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to improve sentence intention matching for Chinese text are limited due to the particularity of the text. |
| Approach: | They propose a method that combines character-granularity and word-granulularity features to perform sentence intention matching. |
| Outcome: | The proposed method can capture sentence feature information from multiple perspectives and correlation information between different levels of sentences. |
AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists (2025.emnlp-main)
Copied to clipboard
Yifei Li, Hanane Nour Moussa, Ziru Chen, Shijie Chen, Botao Yu, Mingyi Xue, Benjamin Burns, Tzu-Yao Chiu, Vishal Dey, Zitong Lu, Chen Wei, Qianheng Zhang, Tianyu Zhang, Song Gao, Xuhui Huang, Xia Ning, Nesreen K. Ahmed, Ali Payani, Huan Sun
| Challenge: | AutoSDT-5K is the only automatically collected and the largest open dataset for data-driven scientific discovery. |
| Approach: | They propose an automatic pipeline that collects high-quality coding tasks in real-world data-driven discovery workflows. |
| Outcome: | The proposed pipeline synthesizes accurate tasks and tasks from a dataset of 5,404 tasks covering four scientific disciplines and 756 Python packages. |
Aligning Large Language Models for Controllable Recommendations (2024.acl-long)
Copied to clipboard
| Challenge: | Existing literature focuses on integrating domain-specific knowledge into LLMs to enhance accuracy using a fixed task template. |
| Approach: | They propose a collection of supervised learning tasks augmented with labels derived from a conventional recommender model to improve LLMs’ proficiency in adhering to recommendation-specific instructions. |
| Outcome: | The proposed approach significantly improves the capability of LLMs to respond to instructions within recommender systems, reducing formatting errors while maintaining a high level of accuracy. |
ViPE: Visual Perception in Parameter Space for Efficient Video-Language Understanding (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing video-language models rely on concatenating visual tokens with textual inputs for joint modeling, but this method suffers from significant inefficiency when scaling to long videos with dense visual inputs. |
| Approach: | They propose a video-to-parameter efficiency paradigm called ViPE that transforms video content into visual perceptual weights, which are directly injected into the LLM’s parameters. |
| Outcome: | The proposed model reduces FLOPs by 85% and inference time by up to 65% while reducing FLOP and FLOP inference times by up-to-65%. |
Cheems: A Practical Guidance for Building and Evaluating Chinese Reward Models from Scratch (2025.acl-long)
Copied to clipboard
Xueru Wen, Jie Lou, Zichao Li, Yaojie Lu, XingYu XingYu, Yuqiu Ji, Guohai Xu, Hongyu Lin, Ben He, Xianpei Han, Le Sun, Debing Zhang
| Challenge: | Existing Chinese resources are small in scale and limited to specific domains, making them insufficient for LLM post-training. |
| Approach: | They propose a Chinese-annotated reward model and a preference dataset to address this gap . they evaluate Chinese RMs on CheemsBench and construct an RM that captures human preferences . |
| Outcome: | The proposed RM achieves state-of-the-art performance on CheemsBench and CheeMePreference. |
CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing code pre-trained models fail to consider inherent characteristics of codes . Existing methods to interpret code pretrained model fail to take into account inherent characteristics . |
| Approach: | They propose a probing method to quantitatively interpret how CodePTMs attend code structure. |
| Outcome: | The proposed method denoises input code sequences and measures commonality between token-level attention scores and pair-wise distances between corresponding AST nodes. |
Decoder-Only LLMs can be Masked Auto-Encoders (2025.acl-short)
Copied to clipboard
Dan Qiao, Yuan Gao, Zheming Yang, Di Yang, Ziheng Wu, Pengcheng Lu, Minghui Qiu, Juntao Li, Min Zhang
| Challenge: | Modern NLP workflows require different models for generation and embedding tasks. |
| Approach: | They propose a method that transforms an LLM into a Uni-Directional Masked Auto-Encoder. |
| Outcome: | The proposed method achieves state-of-the-art under unsupervised conditions with merely 100 training steps. |
Evaluating Large Language Models on Wikipedia-Style Survey Generation (2024.findings-acl)
Copied to clipboard
Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Tianwei She, Yuang Jiang, Irene Li
| Challenge: | Recent studies have shown that large language models can perform well in general tasks, but their effectiveness and limitations in domainspecific tasks remain unclear. |
| Approach: | They examine the proficiency of Large Language Models (LLMs) in generating succinct survey articles specific to the niche field of NLP in computer science. |
| Outcome: | The LLMs perform better in generating succinct survey articles specific to the niche field of NLP in computer science, compared to human-authored surveys, but they exhibit bias in evaluation. |
TEBNER: Domain Specific Named Entity Recognition with Type Expanded Boundary-aware Network (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to label data and identify entities require large amounts of manually annotated texts for training supervised models. |
| Approach: | They propose a dictionary extension method which extracts new entities through the type expanded model. |
| Outcome: | The proposed method outperforms state-of-the-art supervised systems on different types of datasets and surpasses supervised models. |
Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In traditional face-to-face therapy, the assessment of therapeutic alliance is not directly translated to text-based settings. |
| Approach: | They propose an automatic approach to understand the development of therapeutic alliance in text-based counseling by using large language models. |
| Outcome: | The proposed approach demonstrates that the framework is effective in identifying the therapeutic alliance in text-based counseling. |
Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored using large language models to generate synthetic datasets . however, the effectiveness of the LLM-generated synthetic data is inconsistent across different classification tasks. |
| Approach: | They propose to use large language models to generate synthetic datasets to better understand factors that moderate the effectiveness of LLM-generated synthetic data. |
| Outcome: | The results show that subjectivity is negatively associated with the performance of the model trained on synthetic data. |
Towards Mitigating Modality Bias in Vision-Language Models for Temporal Action Localization (2026.acl-long)
Copied to clipboard
| Challenge: | Existing vision-language models overemphasize linguistic priors, leading to modality bias. |
| Approach: | They propose a vision-language aggregation framework that mitigates modality bias in TAL by preserving vision as the dominant signal while adaptively exploiting language only when beneficial. |
| Outcome: | Experiments on THUMOS14 show that the proposed model outperforms state-of-the-art models by up to 3.2% mAP. |
Reconstructing Capsule Networks for Zero-shot Intent Classification (D19-1)
Copied to clipboard
| Challenge: | Existing methods for intent classification are limited due to fast-emerging intents . a recent study shows that existing methods are not effective in recognizing unseen intents. |
| Approach: | They propose to reconstruct capsule networks for zero-shot intent classification by using latent information from labeled utterances. |
| Outcome: | The proposed method outperforms existing methods on two task-oriented dialogue datasets in different languages. |
From Informal to Formal – Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs (2025.acl-long)
Copied to clipboard
Jialun Cao, Yaojie Lu, Meiziniu Li, Haoyang Ma, Haokun Li, Mengda He, Cheng Wen, Le Sun, Hongyu Zhang, Shengchao Qin, Shing-Chi Cheung, Cong Tian
| Challenge: | Recent studies in formal mathematical reasoning have shown an unstoppable growth trend. |
| Approach: | They constructed 18k high-quality instruction-response pairs across five mainstream formal specification languages and evaluated them against ten open-sourced LLMs. |
| Outcome: | The proposed model compared instruction-response pairs across five formal specification languages and found that the LLMs were good at writing proof segments when given either the code, or the detailed description of proof steps. |
ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to building cross-lingual summarization systems on dialogue documents are limited. |
| Approach: | They propose a benchmark dataset for building cross-lingual summarization systems on dialogue documents. |
| Outcome: | The proposed model outperforms pipeline models on ClidSum and mDialBART. |
QA‐LIGN: Aligning LLMs through Constitutionally Decomposed QA (2025.findings-emnlp)
Copied to clipboard
Jacob Dineen, Aswin Rrv, Qin Liu, Zhikun Xu, Xiao Ye, Ming Shen, Zhaonan Li, Shijie Lu, Chitta Baral, Muhao Chen, Ben Zhou
| Challenge: | QA-LIGN decomposes monolithic rewards into interpretable principle-specific evaluations . scalar rewards obscure which objectives drive the training signal . |
| Approach: | a new method decomposes monolithic rewards into interpretable principle-specific evaluations . QA-LIGN reduces attack success rates by up to 68.7% while maintaining a 0.67% false refusal rate . |
| Outcome: | QA-LIGN reduces attack success rates by up to 68.7% while maintaining a 0.67% false refusal rate . the results outperform DPO and GRPO with state-of-the-art reward models given equivalent training . |
SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models only support hundreds of languages, and they are usually limited in English. |
| Approach: | They propose a task to automatically select which dictionary to use to enhance translation . they call it Select Low-frequency Words!, which inherits advantage of dictionary-based methods . |
| Outcome: | The proposed method can save tokens and improve translation performance on 100 languages. |
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)
Copied to clipboard
Yifu Chen, Shengpeng Ji, Qian Chen, Tianle Liang, Yangzhuo Li, Ziqing Wang, Wen Wang, Jingyu Lu, Haoxiao Wang, Xueyi Pu, Fan Zhuo, Zhou Zhao
| Challenge: | End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems. |
| Approach: | They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring. |
| Outcome: | The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures. |
Do we need Label Regularization to Fine-tune Pre-trained Language Models? (2023.eacl-main)
Copied to clipboard
Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Pascal Poupart, Ali Ghodsi
| Challenge: | Knowledge Distillation (KD) is a label regularization technique that can be replaced with lighter teacher-free variants such as the label-smoothing technique. |
| Approach: | They propose to use knowledge distillation to train student models by deploying the teacher network during training. |
| Outcome: | The proposed method can be replaced with lighter teacher-free variants on PLMs with more than 600 distinct trials and ran each configuration five times. |
MADAWSD: Multi-Agent Debate Framework for Adversarial Word Sense Disambiguation (2025.emnlp-main)
Copied to clipboard
Kaiyuan Zhang, Qian Liu, Luyang Zhang, Chaoqun Zheng, Shuaimin Li, Bing Xu, Muyun Yang, Xinxiao Qiao, Wenpeng Lu
| Challenge: | Word sense disambiguation (WSD) is a fundamental yet challenging task in natural language processing. |
| Approach: | a novel multi-agent Debate framework for adversarial word Sense disambiguation is proposed . the framework simulates a real-world debate environment where multiple agents engage in discussions about ambiguous words in the context of adversarials. |
| Outcome: | The proposed framework integrates with existing LLMs and improves models in Chinese language . it shows that it can be used to improve models in the Chinese language and improve performance . |
KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) is a critical task to predict missing facts among entities. |
| Approach: | They propose a knowledge-constrained generative re-ranking method based on generative large language models for KGC that can predict missing facts among entities. |
| Outcome: | The proposed method achieves state-of-the-art performance on four datasets and 9.0% and 11.1% compared to the previous methods. |
Beyond Itinerary Planning—A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on LLM performance on travel planning have shown that existing settings are limited due to limited domain coverage, insufficient modeling of users’ implicit preferences in multi-turn conversations, and a lack of evaluation of agents’ capability boundaries. |
| Approach: | They propose a benchmark to evaluate LLMs' planning and tool-use abilities in real-world settings by collecting user queries, user preferences, and tools from real scenarios. |
| Outcome: | The proposed benchmark evaluates agents' capabilities in real-world settings and shows that even advanced models exhibit imbalanced performance across different capabilities. |
GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for embedding knowledge graphs are difficult due to complicated query structures and incomplete graph data. |
| Approach: | They propose a probabilistic embedding model for encoding entities and queries to answer different types of FOL queries on KGs. |
| Outcome: | The proposed model outperforms state-of-the-art models on public benchmarks on three large logical query datasets. |
Large Language Models for Data Annotation and Synthesis: A Survey (2024.emnlp-main)
Copied to clipboard
Zhen Tan, Dawei Li, Song Wang, Alimohammad Beigi, Bohan Jiang, Amrita Bhattacharjee, Mansooreh Karami, Jundong Li, Lu Cheng, Huan Liu
| Challenge: | Existing surveys focus on LLMs' specific utility for data annotation and synthesis. |
| Approach: | They propose to use large language models to generate annotations from raw data . they also propose to review learning strategies for models utilizing LLM-generated annotations . |
| Outcome: | The proposed models can be used to improve the efficacy of machine learning models by generating and labeling raw data with relevant information. |
In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Search (2024.emnlp-main)
Copied to clipboard
Huihan Li, Yuting Ning, Zeyi Liao, Siyuan Wang, Xiang Li, Ximing Lu, Wenting Zhao, Faeze Brahman, Yejin Choi, Xiang Ren
| Challenge: | Logic-Induced-Knowledge-Search (LINK) is a framework for generating factually-correct yet long-tail inferential knowledge. |
| Approach: | They introduce a framework to obtain factually-correct yet long-tail inferential statements using variable-wise prompting grounded on symbolic rules. |
| Outcome: | The proposed framework is able to obtain factually-correct yet long-tail inferential statements while ensuring factual correctness. |
Detecting Customer Complaint Escalation with Recurrent Neural Networks and Manually-Engineered Features (N19-2)
Copied to clipboard
Wei Yang, Luchen Tan, Chunwei Lu, Anqi Cui, Han Li, Xi Chen, Kun Xiong, Muzi Wang, Ming Li, Jian Pei, Jimmy Lin
| Challenge: | e-commerce companies often have the option of escalating complaints by filing grievances with a government authority . this is detrimental to an ecommerce company, but this problem is challenging to solve by integrating recurrent neural networks with manually-engineered features. |
| Approach: | They propose a model that integrates recurrent neural networks with manually-engineered features to identify cases where the customer expresses such an intent. |
| Outcome: | The proposed model outperforms baseline models and provides better recall and triage for specialized agents. |
DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictograms (2025.findings-emnlp)
Copied to clipboard
Xiaojun Bi, Shuo Li, Junyao Xing, Ziyue Wang, Fuwen Luo, Weizheng Qiao, Lu Han, Ziwei Sun, Peng Li, Yang Liu
| Challenge: | Dongba pictographic is the only pictograph script still in use in the world. |
| Approach: | DongbaMIE is the first dataset focusing on multimodal information extraction of Dongbe pictographs. |
| Outcome: | The dataset contains 23,530 sentence-level and 2,539 paragraph-level high-quality text-image pairs. |
AIMMerging: Adaptive Iterative Model Merging Using Training Trajectories for Language Model Continual Learning (2025.emnlp-main)
Copied to clipboard
Yujie Feng, Jian Li, Xiaoyu Dong, Pengfei Xu, Xiaohui Zhou, Yujia Zhang, Zexin Lu, Yasha Wang, Alan Zhao, Xu Chu, Xiao-Ming Wu
| Challenge: | Recent model merging-based methods struggle to effectively manage the trade-off between learning new knowledge and preventing catastrophic forgetting. |
| Approach: | They propose a model merging framework that utilizes learning and forgetting signals from the training trajectory to dynamically monitor the model’s training status. |
| Outcome: | The proposed framework achieves significant performance improvements over existing state-of-the-art methods on three CL benchmarks with various model sizes (from 770M to 13B). |
Mitigating Object Hallucinations in MLLMs via Multi-Frequency Perturbations (2025.findings-emnlp)
Copied to clipboard
Shuo Li, Jiajun Sun, Guodong Zheng, Xiaoran Fan, Yujiong Shen, Yi Lu, Zhiheng Xi, Yuming Yang, Wenming Tan, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Multimodal large language models have demonstrated remarkable performance in visual-language tasks, but their authenticity is often compromised by object hallucinations. |
| Approach: | They propose a multi-frequency perturbation method that leverages both low-frequency and high-frequency features of images to perturb visual feature representations and explicitly suppress redundant frequency-domain features during inference. |
| Outcome: | The proposed method significantly mitigates object hallucinations across various model architectures. |
MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large-scale visual-language pretraining models have shown remarkable capabilities in understanding both vision and language. |
| Approach: | They propose a multi-teacher cross-modality alignment distillation technique to integrate the advantages of single-stream and dual-stream models. |
| Outcome: | The proposed model is lightweight and has only 100M running memory and 8.0ms search latency. |
Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks (2026.acl-long)
Copied to clipboard
Wenqi Zhang, Mengna Wang, Gangao Liu, Huixin Xu, Yiwei Jiang, Yongliang Shen, Guiyang Hou, Zhe Zheng, Hang Zhang, Xin Li, Jiajun Liu, Weiming Lu, Peng Li, Yueting Zhuang
| Challenge: | Recent advances in reasoning models have demonstrated remarkable capabilities on mathematical and coding tasks, but their effectiveness in embodied domains remains largely unexplored. |
| Approach: | They propose a reasoning model for interactive embodied tasks that synthesizes 9.3k coherent Observation-Thought-Action trajectories containing 64k ego-centric images and 90k diverse reasoning processes. |
| Outcome: | The proposed model outperforms existing visual reasoning models by +9%, 24%, and +13% on long-horizon tasks. |
Enhancing One-Shot Pruned Pre-trained Language Models through Sparse-Dense-Sparse Mechanism (2025.coling-main)
Copied to clipboard
Guanchen Li, Xiandong Zhao, Lian Liu, Zeping Li, Yixing Xu, Dong Li, Lu Tian, Jie He, Ashish Sirasao, Emad Barsoum
| Challenge: | Pre-trained language models (PLMs) are robust in contextual understanding but their considerable size incurs significant computational and storage costs. |
| Approach: | They propose a Sparse-Dense-Sparse pruning framework to prune PLMs . they prune less critical connections using conventional pruning methods . |
| Outcome: | The proposed pruning framework outperforms SparseGPT and Wanda under identical sparsity. |
Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to solve math word problems do not provide explanations for generated expressions. |
| Approach: | They propose a deductive approach that presents explainable deductive reasoning steps to iteratively construct target expressions. |
| Outcome: | The proposed model significantly outperforms existing strong baselines on four benchmark datasets. |
AutoTaskEval: Towards Domain-Specific and Fine-Grained Evaluation for LLMs (2026.acl-long)
Copied to clipboard
Qingqing Lyu, Linjuan Wu, Yongliang Shen, Hengwei Liu, Hao Li, Shengpei Jiang, Yin Zhang, Weiming Lu
| Challenge: | Existing automated approaches operate within fixed task schemas and often fail to autonomously discover new evaluation dimensions. |
| Approach: | They propose an automated framework that constructs domain-specific benchmarks directly from unstructured corpora using Bloom’s Taxonomy. |
| Outcome: | The proposed framework uncovers a broader and more fine-grained task space than expert-curated benchmarks while producing high-quality instances that preserve established model-level evaluation trends. |
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)
Copied to clipboard
Zhanyu Liu, Shiyao Wang, Xingmei Wang, Rongzhou Zhang, Jiaxin Deng, Honghui Bao, Jinghao Zhang, Wuchao Li, PengFei Zheng, Xiangyu Wu, Yifei Hu, Qigen Hu, Xinchen Luo, Lejian Ren, Zhang Zixing, Qianqian Wang, Kuo Cai, Yunfan Wu, Hongtao Cheng, Zexuan Cheng, Lu Ren, Huanjie Wang, Yi Su, Ruiming Tang, Kun Gai, Guorui Zhou
| Challenge: | Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs. |
| Approach: | They propose a framework that integrates dialogue, reasoning, and personalized recommendation. |
| Outcome: | Experiments across public benchmarks show state-of-the-art performance. |
Outlier-weighed Layerwise Sampling for LLM Fine-tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are a powerful tool for processing complex natural language processing tasks. |
| Approach: | They propose an approach to fine-tune LLMs with outliers and a gradient low-rank projection to increase the number of fine-sampled layers without a proportional increase in memory costs. |
| Outcome: | The proposed approach outperforms baseline approaches while being more memory efficient. |
RoDEval: A Robust Word Sense Disambiguation Evaluation Framework for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies rely on single-task evaluations and classification-based metrics that overlook the fundamental differences between generative LLMs and traditional classification models. |
| Approach: | They propose to use four new metrics to evaluate LLM-based word sense disambiguation (WSD) . experimental results reveal significant limitations in LLMs' WSD performance . |
| Outcome: | The proposed evaluation framework is open-source at https://github.com/DayDream405/RoDEval. |
Self-Foveate: Enhancing Diversity and Difficulty of Synthesized Instructions from Unsupervised Text via Multi-Level Foveation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for training large language models rely on human effort for data annotation. |
| Approach: | They propose an unsupervised method that generates unsupervised instruction from unsupervised text using a "Micro-Scatter-Macro" method that excavates fine-grained information embedded in unsupervised texts. |
| Outcome: | The proposed method improves diversity and difficulty of synthesized instructions across multiple unsupervised corpora and diverse model architectures. |
PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning (2025.acl-long)
Copied to clipboard
Zhicong Lu, Changyuan Tian, PeiguangLi PeiguangLi, Li Jin, Sirui Wang, Wei Jia, Ying Shen, Guangluan Xu
| Challenge: | Existing studies on Large Language Models (LLMs) have failed to evaluate their performance in event reasoning with a single event relational type or reasoning format. |
| Approach: | They propose a benchmark to evaluate LLMs' event reasoning capability using a single event relational type or reasoning format. |
| Outcome: | The proposed model improves on 10K diverse instruction-tuning demonstrations to alleviate event reasoning-oriented data scarcity. |
Scaling Laws for Fact Memorization of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Fact knowledge memorization is crucial for Large Language Models (LLMs) to generate factual and reliable responses. |
| Approach: | They analyze scaling laws for LLM’s fact knowledge and LLMs’ behaviors of memorizing different types of facts. |
| Outcome: | The proposed model can generalize on unseen facts and its scaling law is similar to general pre-training. |
CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question Answering (2020.coling-main)
Copied to clipboard
| Challenge: | Existing QA systems deal with factoid questions and assume a simplified setup such as multiple-choice questions, retrieving spans of text from given documents, and filling in the blanks. |
| Approach: | They propose a cross-passage hierarchical memory network for question answering via text generation that extends XLNet by adding an auxiliary memory module to the context memory and answer memory. |
| Outcome: | The proposed architecture outperforms the state-of-the-art generative QA framework with better syntactically well-formed answers and increased precision on the AmazonQA review dataset. |
RAISE: Reinforced Adaptive Instruction Selection For Large Language Models (2025.findings-emnlp)
Copied to clipboard
Qingsong Lv, Yangning Li, Zihua Lan, Zishan Xu, Jiwei Tang, Tingwei Lu, Yinghui Li, Wenhao Jiang, Hong-Gee Kim, Hai-Tao Zheng, Philip S. Yu
| Challenge: | Existing selection methods rely on static, heuristic quality scores and are executed only once before training. |
| Approach: | They propose a dynamic selection framework that integrates selection into every training step. |
| Outcome: | The proposed framework integrates selection into every training step. |
Attention Calibration for Transformer in Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Attention mechanisms have been ubiquitous in neural machine translation (NMT) however, many studies doubt whether highlyattended inputs have a large impact on the model outputs. |
| Approach: | They propose to introduce a mask perturbation model that automatically evaluates each input’s contribution to the model outputs. |
| Outcome: | The proposed model is more uniform at lower layers while more concentrated on the specific inputs at higher layers. |
ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Agents (2026.acl-long)
Copied to clipboard
Zhuofeng Li, Yi Lu, Dongfu Jiang, Haoxiang Zhang, Yuyang Bai, Chuan Li, Yu Wang, Shuiwang Ji, Jianwen Xie, Yu Zhang
| Challenge: | Rapid rise in AI conference submissions has driven increasing exploration of large language models (LLMs) for peer review support. |
| Approach: | They propose a peer review benchmarking tool based on paper-specific rubrics and a rubric-guided framework that decomposes reviewing into drafting and grounding stages. |
| Outcome: | The proposed framework outperforms baselines with stronger/larger backbones in both alignment with human judgments and rubric-based review quality across 8 dimensions. |
Label Drop for Multi-Aspect Relation Modeling in Universal Information Extraction (2025.naacl-long)
Copied to clipboard
| Challenge: | Extractive UIEs can solve model explosion problems using a relatively small model . single-target instruction UIE enables the extraction of only one type of relation at a time . |
| Approach: | They propose a model that assigns different relations to different levels for understanding and decision-making. |
| Outcome: | Experiments show that LDNet outperforms state-of-the-art systems on 9 tasks, 33 datasets . LDnet outperformed state- of-the art systems on single-modal and multi-modal tasks . |
Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios (2026.findings-acl)
Copied to clipboard
Xiaomin Li, Tala Wang, Zichen Zhong, Ying Zhang, Zirui Zheng, Takashi Isobe, Dezhuang Li, Huchuan Lu, You He, Xu Jia
| Challenge: | Existing benchmarks focus on evaluating MLLMs’ pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning. |
| Approach: | They propose a benchmark designed for visual clue-driven reasoning in daily scenarios that combines rigorous grounding in authentic daily activities and challenging query design that necessitates more than surface-level perception. |
| Outcome: | The proposed benchmark identifies visual clues and their ability to provide robust reasoning in daily scenarios. |
Joint Effects of Context and User History for Predicting Online Conversation Re-entries (P19-1)
Copied to clipboard
| Challenge: | Existing methods for predicting online conversation re-entry focus on modeling engagement patterns in ongoing conversations or ignoring the rich information in users' previous chatting history. |
| Approach: | They propose a neural framework with three main layers to model the conversation context and user history and their interactions with Twitter and Reddit to predict whether a user will return to a conversation they once participated in. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on two large-scale Twitter and Reddit conversations, and achieves an F1 score of 61.1 on Twitter conversations. |
Engage the Public: Poll Question Generation for Social Media Posts (2021.acl-long)
Copied to clipboard
| Challenge: | a novel application to generate poll questions for social media posts offers an easy way to hear the public's voice . for the silent majority, they tend to read others' messages instead of voicing their opinions with words . |
| Approach: | They propose to encode user comments and discover latent topics therein as contexts to generate poll questions for social media posts. |
| Outcome: | The proposed model outperforms popular models without exploiting topics from comments . human evaluations show it can generate high-quality polls useful to draw user engagements . |
From Experience to Skill: Multi-Agent Generative Engine Optimization via Reusable Strategy Learning (2026.findings-acl)
Copied to clipboard
Beining Wu, Fuyou Mao, Jiong Lin, Cheng Yang, Jiaxuan Lu, Yifu Guo, Siyu Zhang, Yifan Wu, Ying Huang, Fu Li
| Challenge: | Generative engines (GEs) are replacing ranked links with citation-grounded answers . current methods are unable to accumulate or transfer effective strategies across tasks and engines . |
| Approach: | They propose a multi-agent framework where planning, editing, and fidelity-aware evaluation serve as the execution layer. |
| Outcome: | The proposed framework outperforms heuristic baselines in visibility and citation fidelity on three mainstream engines. |
Structured Optimal Brain Pruning for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing pruning methods for Large Language Models rely on unstructured pruning or require special hardware to accelerate computation. |
| Approach: | They propose a retraining-free structured pruning method called SoBP . they evaluate the effectiveness of SoBP across 14 models from 3 LLM families . |
| Outcome: | The proposed method outperforms current state-of-the-art pruning methods on 8 datasets. |
DEBUG: A Dense Bottom-Up Grounding Approach for Natural Language Video Localization (D19-1)
Copied to clipboard
| Challenge: | Existing models for natural language video localization are top-down and bottom-up . however, both approaches suffer several limitations, leading to performance degradation . |
| Approach: | They propose a top-down approach for localizing a natural language description in a video sequence . they propose 'DEnse Bottom-Up Grounding' which uses the temporal boundaries of each video frame . |
| Outcome: | The proposed framework matches the speed of top-down models while surpassing the state-of-the-art models. |
Profanity-Avoiding Training Framework for Seq2seq Models with Certified Robustness (2021.emnlp-main)
Copied to clipboard
| Challenge: | a recent study shows that inappropriate language can cause models to output profanity . authors propose a training framework to prevent such outputs from hurting the usability of models . |
| Approach: | proposed training framework eliminates the causes that trigger the generation of profanity . authors propose a framework that leverages a short list of profans to prevent this . |
| Outcome: | a proposed training framework can prevent models from generating profanity . the proposed framework leverages a short list of profanities examples . |
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation (2026.acl-long)
Copied to clipboard
Hui Wang, Jinghua Zhao, Yifan Yang, Shujie Liu, Junyang Chen, Yanzhe Zhang, Shiwan Zhao, Jinyu Li, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
| Challenge: | Existing methods for evaluating the perceptual quality of synthetic speech are limited due to the complexity of perceptual quality factors and the diversity of speech generation tasks. |
| Approach: | They propose a new paradigm for enabling large language models to conduct structured speech quality evaluation using a large-scale dataset. |
| Outcome: | The proposed model performs well across tasks and languages. |
MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI Agents (2026.acl-long)
Copied to clipboard
Ruihan Chen, Qiming Li, Xiaocheng Feng, Weihong Zhong, Xiaoliang Yang, Yuxuan Gu, Zekun Zhou, Yunfei Lu, Haoyu Ren, Kun Chen, Dandan Tu, Bing Qin
| Challenge: | Existing GUI benchmarks lack fine-grained diagnostics to identify which capabilities lead to task failures. |
| Approach: | They propose a multilingual P R GUI Benchmark to assess LVLMs' language capabilities . they propose XLI to align non-English hidden states with English ones during inference . |
| Outcome: | The proposed benchmark reveals consistent gaps between English and non-English settings . it reduces the cross-lingual gaps with an average gain of 6.5% in non- English settings compared to static benchmarks . |
The Emperor’s New Reasoning: Format Imitation Overshadows Genuine Mathematical Understanding in SFT (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have yielded impressive gains on mathematical reasoning benchmarks via supervised fine-tuning (SFT). |
| Approach: | They investigate the mechanisms behind SFT improvements in small-scale large language models by examining four key questions: (1) Are performance gains primarily due to format alignment rather than reasoning? (2) Can high-quality supervision encourage genuine reasoning? (4) Are format alignment gains consistent across model sizes and architectures? |
| Outcome: | The proposed models outperform the proprietary models on OlympiadBench and Omni-Math, but lack the brittleness of the models under perturbations to test their reasoning abilities. |
InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can attain professional-level proficiency in specific domains through fine-tuning. |
| Approach: | They propose a multi-modal LLM that aligns molecular structures with natural language via an instruction-tuning approach. |
| Outcome: | InstructMol surpasses existing models and reduces the gap with specialists in drug discovery tasks. |
SoFA: Shielded On-the-fly Alignment via Priority Rule Following (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing alignment methods fail to adapt to the diversity of preferences and regulatory standards. |
| Approach: | They propose a method for prioritizing rules over user instructions to minimize misalignments in Large Language Models. |
| Outcome: | The proposed approach minimizes misalignments and adapts smoothly to various unseen rules, ensuring they are shielded from hijacking and that the model responds appropriately. |