Papers by Hu Wang
ProUIE: A Macro-to-Micro Progressive Learning Method for LLM-based Universal Information Extraction (2026.findings-acl)
Copied to clipboard
Wenda Liu, Song Zhigang, Shuai Nie, Guangyao Liu, Lisung Chen, Binyu Yang, Yaran Chen, Peng Zhou, Hongzhen Wang, Yuchen Liu, Wenyue Hu, Jiaming Xu, Runyu Shi, Ying Huang
| Challenge: | ProUIE improves universal information extraction (UIE) without external information . many LLM-based methods rely on extra schema cues, external resources or complex alignment and verification pipelines . |
| Approach: | They propose a Macro-to-Micro progressive learning approach that improves UIE without external information. |
| Outcome: | ProUIE outperforms instruction-tuned baselines on average for NER and RE while using a smaller backbone. |
CE-RM: A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have shown that rule-based evaluation methods are ineffective for open-ended natural language generation. |
| Approach: | They propose a pointwise generative reward model with a dedicated two-stage rollout method and unified query-based criteria that can be trained with 5.7K high-quality data. |
| Outcome: | The proposed model achieves superior performance on diverse reward model benchmarks, especially in Best-of-N scenarios, and delivers more effective improvements in downstream RL practice. |
Multiview Clickbait Detection via Jointly Modeling Subjective and Objective Preference (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing clickbait detection models rely on analyzing the objective semantics of posts or correlating posts with article content only, but fail to identify and exploit the manipulation intention of clickbaiting from a user’s subjective perspective. |
| Approach: | They propose a multiview clickbait detection model to model subjective and objective preferences simultaneously to capture clickbaiting from a user's subjective perspective. |
| Outcome: | The proposed model outperforms state-of-the-art models on two real-world datasets and shows that it integrates subjective and objective preferences simultaneously. |
Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models (2025.emnlp-main)
Copied to clipboard
Kaiyan Chang, Yonghao Shi, Chenglong Wang, Hang Zhou, Chi Hu, Xiaoqian Liu, Yingfeng Luo, Yuan Ge, Tong Xiao, JingBo Zhu
| Challenge: | Recent training-based TTS methods, such as continued reinforcement learning, have surged in popularity, while training-free TTS approaches are gradually fading from prominence. |
| Approach: | They propose a fine-grained sequential scaling method guided by process verification that integrates training-free TTS methods with other classical parallel scaling methods at the step level. |
| Outcome: | Experiments on five instruction-tuned large language models (LLMs) show that training-free TTS methods can extend reasoning performance boundaries. |
Mechanistic Unveiling of Transformer Circuits: Self-Influence as a Key to Model Reasoning (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown that large language models implicitly embed reasoning trees, but their internal mechanisms remain largely opaque due to the complexity of non-linear interactions and high-dimensional operations. |
| Approach: | They propose to use circuit analysis and self-influence functions to map the reasoning process of large models. |
| Outcome: | The proposed model is able to map human-interpretable reasoning paths and a model's underlying circuits reveal human-mediated reasoning processes. |
Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning (2026.findings-acl)
Copied to clipboard
Yibo Yan, Shen Wang, Jiahao Huo, Jingheng Ye, Zhendong Chu, Xuming Hu, Philip S. Yu, Carla P Gomes, Bart Selman, Qingsong Wen
| Challenge: | Current scientific reasoning models struggle with generalization across domains and fall short of multimodal perception. |
| Approach: | They propose to use multimodal large language models to integrate text, images, and other modalities to enhance scientific reasoning. |
| Outcome: | The proposed models can integrate text, images, and other modalities and improve reasoning across disciplines. |
R2A-TLS: Reflective Retrieval-Augmented Timeline Summarization with Causal-Semantic Integration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture coherent event narratives due to fragmented descriptions . Existing approaches accumulate noise through iterative retrieval strategies that lack relevance evaluation. |
| Approach: | They propose a reflective retrieval-augmented timeline summarization with Causal-Semantic Intergration approach for open-domain timeline summarizing . |
| Outcome: | The proposed approach outperforms the best prior published approaches. |
FISTAPruner: Layer-wise Post-training Pruning for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing pruning methods require inefficient retraining for billion-scale LLMs or rely on heuristicically designed metrics to determine pruning masks, leading to performance degradation. |
| Approach: | They propose a convex optimization model that induces sparsity in large language models by leveraging FISTA. |
| Outcome: | The proposed method can remove 50% of model parameters while retaining 98.6% and 95.6% of the zero-shot performance. |
Safety Sidecar: Reflection-Driven Runtime Control for Safer Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing safety controls fail to provide runtime intervention or cross-architecture portability for autonomous LLM agents. |
| Approach: | They propose a model-agnostic, plug-and-play module to provide arbitrary agent safety control and auditability. |
| Outcome: | The proposed module improves the secure-solution rate by 2.9–11.2 percentage points . it adds only 3.2s to end-to-end latency and a negligible average cost of 5.37 10-4 per scenario . |
CORD: Bridging the Audio–Text Reasoning Gap via Weighted On-policy Cross-modal Distillation (2026.findings-acl)
Copied to clipboard
Hu Jing, Danxiang Zhu, Xianlong Luo, Dan Zhang, Shuwei He, Yishu Lei, Shikun Feng, Hai-Tao Zheng, Jingzhou HE, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Large Audio Language Models (LALMs) exhibit a degradation in knowledge and reasoning capabilities . empirical results show that CORD significantly bridges the audio–text performance gap . |
| Approach: | They propose a framework that performs online cross-modal self-distillation to bridge the acoustic-semantic gap between LALMs and text-based models. |
| Outcome: | The proposed framework bridges the acoustic-semantic gap between LALMs and text-based models . it employs on-policy reverse KL divergence with importance-aware weighting . |
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for Referring Expression Comprehension (REC) lack specific domain abilities for precise local visual perception and visual-language alignment. |
| Approach: | They propose a framework for Parameter-Efficient Transfer Learning to localize a visual region via natural language using a prior-guided prior. |
| Outcome: | The proposed framework achieves the best accuracy compared to the current methods with only 1.41% tunable backbone parameters. |
When Reasoning Meets Information Aggregation: A Case Study with Sports Narratives (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using sports data, an LLM can analyze sports narratives to infer points from actions, identify related entities, attribute points accurately to players and teams, and draw conclusions. |
| Approach: | They propose a method to synthesize NBA basketball game narratives using real NBA basketball data and propose 'SportsGen' they find that most models fail to accurately aggregate basketball scores due to frequent scoring patterns and open-source models suffer from significant score hallucinations. |
| Outcome: | The proposed method can evaluate LLMs’ reasoning capabilities under complex scenarios with varying narrative lengths and density of information. |
CateEA: Enhancing Entity Alignment via Implicit Category Supervision (2025.coling-main)
Copied to clipboard
| Challenge: | Existing Entity Alignment methods neglect the inherent semantic information of entities, limiting alignment precision and robustness. |
| Approach: | They propose to combine implicit category information into multi-modal representations by generating pseudo-category labels from entity embeddings and integrating them into a multi-task learning framework. |
| Outcome: | Experiments on benchmark datasets show that CateEA outperforms state-of-the-art methods in various settings. |
TwiUSD: A Benchmark Dataset and Structure-Aware LLM Framework for User Stance Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for political user-level stance detection rely on noisy heuristics or distant supervision. |
| Approach: | They propose a large-scale, expert-annotated benchmark for political user-level stance detection with explicit social network structure that integrates user content and followee signals. |
| Outcome: | The proposed framework outperforms baselines in terms of quality and reliability. |
Automatic Table Union Search with Tabular Representation Learning (2023.findings-acl)
Copied to clipboard
Xuming Hu, Shen Wang, Xiao Qin, Chuan Lei, Zhengyuan Shen, Christos Faloutsos, Asterios Katsifodimos, George Karypis, Lijie Wen, Philip S. Yu
| Challenge: | Existing methods to identify uniability based on column representations are insufficient to reveal latent relational features to describe column relation between pair of columns. |
| Approach: | They propose a self-supervised table union search framework called AutoTUS to learn column relational representations in a multi-stage manner. |
| Outcome: | The proposed framework improves on the SOTA baseline and on real-world datasets. |
Pierce the Mists, Greet the Sky: Decipher Knowledge Overshadowing via Knowledge Circuit Analysis (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are hampered by hallucinations, a particularly challenging variant, knowledge overshadowing, which can lead to erroneous outputs even with high-quality training data. |
| Approach: | They propose a framework to analyze and detect knowledge overshadowing by using knowledge circuit analysis to dissect the function of key components in the circuit and how attention pattern dynamics contribute to the phenomenon. |
| Outcome: | Extensive experiments show that the framework can detect and analyze knowledge overshadowing and improves on existing models. |
Risk Minimization for Zero-shot Sequence Labeling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to zero-shot sequence labeling are expensive and hard to obtain for lowresource languages/domains. |
| Approach: | They propose a framework for zero-shot sequence labeling with minimum risk training and a decomposable risk function that models the relations between predicted labels from the source models and the true labels. |
| Outcome: | The proposed framework outperforms state-of-the-art systems on 21 datasets. |
Sparse-RL: Breaking the Memory Wall in LLM Reinforcement Learning via Stable Sparse Rollouts (2026.acl-long)
Copied to clipboard
Sijia Luo, Xiaokang Zhang, Yuxuan Hu, Bohan Zhang, Ke Wang, Jinbo Su, Mengshu Sun, Lei Liang, Jing Zhang
| Challenge: | Existing methods for storing key-value caches during long-horizon rollouts cause performance collapses. |
| Approach: | They propose a new training paradigm that empowers stable RL training under sparse rollouts. |
| Outcome: | The proposed model reduces rollout overhead while maintaining the performance. |
EvoSpark: Endogenous Interactive Agent Societies for Unified Long-Horizon Narrative Evolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing systems suffer from social memory stacking and narrative-spatial dissonance . long-horizon narratives suffer from conflicting relational states without resolution . |
| Approach: | They propose a framework to sustain logically coherent long-horizon narratives within endogenous interactive agent societies. |
| Outcome: | Experiments show that the framework outperforms baselines across paradigms. |
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that pre-trained language models have gained rich knowledge during pre-training. |
| Approach: | They propose to tune pre-trained language models with task-specific prompts to improve and stabilize prompttuning. |
| Outcome: | Extensive experiments on zero and few-shot text classification tasks show that prompt-tuning improves and stabilizes prompttun-ing. |
Stylized Knowledge-Grounded Dialogue Generation via Disentangled Template Rewriting (2022.naacl-main)
Copied to clipboard
Qingfeng Sun, Can Xu, Huang Hu, Yujing Wang, Jian Miao, Xiubo Geng, Yining Chen, Fei Xu, Daxin Jiang
| Challenge: | Existing knowledge-grounded dialogue generation models only produce pedantic responses, which lacks emotion and attraction compared with the responses with polite style, positive and negative sentiments. |
| Approach: | They propose a method which generates responses via combing disentangled style templates and content templates. |
| Outcome: | The proposed method improves on evaluation metrics compared with state-of-the-art methods. |
TellWhisper: Tell Whisper Who Speaks When (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches decouple temporal modeling and speaker modeling when addressing 'when' and 'who' . a new framework that couples temporal structure with speaker dynamics is proposed to address these limitations . |
| Approach: | They propose a framework that couples temporal and speaker identity within the speech encoder . they propose TS-RoPE, a time-speaker rotary positional encoding that partitions Query/Key channels into temporal, speaker subspaces and applies region-specific rotations to align "when" and "who" cues in selfattention. |
| Outcome: | The proposed framework couples temporal structure with speaker dynamics in speech encoder . it uses frame-level speaker activity to estimate speaker-activity estimates . |
Personalized Generation In Large Model Era: A Survey (2025.acl-long)
Copied to clipboard
Yiyan Xu, Jinghao Zhang, Alireza Salemi, Xinting Hu, Wenjie Wang, Fuli Feng, Hamed Zamani, Xiangnan He, Tat-Seng Chua
| Challenge: | Recent advances in large generative models have catalyzed a paradigm shift in content generation to Personalized Generation (PGen). |
| Approach: | They propose a multi-level taxonomy that systematically formalizes PGen's key components, core objectives, and abstract workflows. |
| Outcome: | The proposed taxonomy bridging PGen research across multiple modalities highlights open challenges and promising directions for future exploration. |
Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models (2026.acl-long)
Copied to clipboard
Yanbin Yin, Kun Zhou, Zhen Wang, Xiangdong Zhang, Yifei Shao, Shibo Hao, Yi Gu, Jieyuan Liu, Somanshu Singla, Tianyang Liu, Eric P. Xing, Zhengzhong Liu, Haojian Jin, Zhiting Hu
| Challenge: | closed-ended question-based benchmarks struggle with saturation as newer models emerge . crowd-sourced leaderboards rely on costly and slow human judges . |
| Approach: | They propose a framework that leverages collective intelligence from all large language models to evaluate each other. |
| Outcome: | a new framework enables a democratic, pairwise evaluation of all large language models . it achieves 97% correlation with human judgements, while significantly reducing the cost. |
WebInject: Prompt Injection Attack to Web Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Despite advanced capabilities of MLLMs, prompt injection attacks remain vulnerable to emerging security and safety threats. |
| Approach: | They propose a prompt injection attack that manipulates webpage environment to induce web agent to perform attacker-specified action. |
| Outcome: | The proposed attack outperforms baselines on multiple datasets and is highly effective. |
Towards A “Novel” Benchmark: Evaluating Literary Fiction with Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) context windows have enabled them to process inputs over 100K tokens and generate outputs of up to 10K token. |
| Approach: | They propose a multi-level evaluation framework that incorporates ten metrics across the Macro, Meso, and Micro levels and an annotated fiction dataset. |
| Outcome: | The proposed framework incorporates ten metrics across the Macro, Meso, and Micro levels and is based on a human-human-AI dataset. |
HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding (2025.coling-main)
Copied to clipboard
| Challenge: | Object categories are typically organized into a multi-granularity taxonomic hierarchy . traditional uni-modal approaches focus primarily on image features, revealing limitations in complex scenarios. |
| Approach: | They propose a framework that combines vision-language models with a deeper exploitation of the hierarchy. |
| Outcome: | The proposed framework shows significant improvements on 11 diverse visual recognition benchmarks. |
HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches of distantly supervised relation extraction (DSRE) focus on sentence-level or bag-level de-noising, neglecting the explicit interaction with cross levels. |
| Approach: | They propose a hierarchical contrastive learning framework for distantly supervised relation extraction to reduce noisy sentences. |
| Outcome: | The proposed framework outperforms baselines in various mainstream DSRE datasets. |
DecipherPref: Analyzing Influential Factors in Human Preference Judgments via GPT-4 (2023.emnlp-main)
Copied to clipboard
| Challenge: | Human preference judgments are important in large language models to produce outputs that align with human values. |
| Approach: | They conduct an in-depth examination of pairwise human judgments released by OpenAI . they find that most favored factors vary across tasks and genres . |
| Outcome: | The proposed model reveals that most favored factors vary across tasks and genres . the findings have implications on the construction of balanced datasets in human preference evaluations - crucial step in shaping behavior of future LLMs. |
IFlyEA: A Chinese Essay Assessment System with Automated Rating, Review Generation, and Recommendation (2021.acl-demo)
Copied to clipboard
| Challenge: | Automated Essay Assessment (AEA) aims to judge students’ writing proficiency in an automatic way. |
| Approach: | They propose to use Chinese AEA system IFlyEssayAssess to evaluate essays written by native Chinese students from primary and junior schools. |
| Outcome: | The proposed system provides application services for essay scoring, review generation, recommendation, and explainable analytical visualization. |
LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient (2026.acl-long)
Copied to clipboard
Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Yueqi Zhang, Jiayi Shi, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Using generic and efficient benchmark generators, human annotators are limited by inefficiency . current benchmark generator methods rely on seed signals, leading to long cycles and high costs . |
| Approach: | They propose a framework to evaluate LLMs as generic benchmark generators and integrate them as BenchMaker. |
| Outcome: | The proposed framework achieves comparable performance to human-annotated benchmarks on most metrics. |
ChatMap: Mining Human Thought Processes for Customer Service Chatbots via Multi-Agent Collaboration (2025.findings-acl)
Copied to clipboard
Xinyi Jiang, Tianyi Hu, Yuheng Qin, Guoming Wang, Zhou Huan, Kehan Chen, Gang Huang, Rongxing Lu, Siliang Tang
| Challenge: | Existing methods for enhancing dialogue performance rely on summarizing behavior . e-commerce chatbots need to align their dialogue strategies with human behavior to achieve coherent, human-like conversations with customers. |
| Approach: | They propose a method to extract core patterns from dialogue data and integrate them into models by mining service thought processes using a multi-agent aPproach. |
| Outcome: | The proposed method outperforms manual methods and outperfies baselines on Taobao in China. |
Neural Topic Modeling with Cycle-Consistent Adversarial Training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances on deep generative models have attracted significant interest in neural topic modeling. |
| Approach: | They propose an adversarial-neural topic model which uses Dirichlet prior to capture the semantic patterns in latent topics. |
| Outcome: | The proposed models outperform competing models on unsupervised/supervised topic modeling and text classification. |
Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Current sycophancy research has largely overlooked its specific manifestations in the video-language domain. |
| Approach: | They propose a video-LLM sycophancy benchmarking and evaluation to evaluate scophancies in video-LLMs. |
| Outcome: | The proposed benchmark evaluates sycophantic behavior in state-of-the-art Video-LLMs across diverse question formats, prompt biases, and visual reasoning tasks. |
Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance? (2025.naacl-long)
Copied to clipboard
| Challenge: | Fact-checking pipelines adopt the Decompose-Then-Verify paradigm, where texts are broken down into smaller claims for individual verification and subsequently combined for a veracity decision. |
| Approach: | They propose to categorize decomposition errors and to reveal a trade-off between accuracy gains and noise introduced by decomposing. |
| Outcome: | The proposed analysis provides new insights into understanding current system’s instability and offers guidance for future studies toward improving claim decomposition in fact-checking pipelines. |
Log-FGAER: Logic-Guided Fine-Grained Address Entity Recognition from Multi-Turn Spoken Dialogue (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing name entity recognition methods combine pre-trained language models with supervised models such as BiLSTM/LSTM-CRF to perform poorly in a spoken dialogue context. |
| Approach: | They propose a logic-guided fine-grained address recognition method that softly applies the logic rule to improve the accuracy of FGAER. |
| Outcome: | The proposed method improves fine-grained address entity recognition from multi-turn spoken dialogues. |
DRBO: Mitigating Short Board Effect via Dynamic Reward Balancing in Multi-reward LLM Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new framework to optimize large language models (LLMs) for evaluation metrics is needed to balance weaker metrics. |
| Approach: | They propose a Dynamic Reward Balancing Optimization framework to mitigate the "short-board effect" they apply it to single-task and multi-type task scenarios . |
| Outcome: | The proposed framework improves performance and balances performance across multiple metrics. |
Uncovering Scaling Laws for Large Language Models via Inverse Problems (2025.findings-emnlp)
Copied to clipboard
Arun Verma, Zhaoxuan Wu, Zijian Zhou, Xiaoqiang Lin, Zhiliang Chen, Rachael Hwee Ling Sim, Rui Qiao, Jingtan Wang, Nhung Bui, Xinyuan Niu, Wenyang Hu, Gregory Kang Ruey Lau, Zi-Yu Khoo, Zitong Zhao, Xinyi Xu, Apivich Hemachandra, See-Kiong Ng, Bryan Kian Hsiang Low
| Challenge: | Large Language Models (LLMs) have achieved remarkable success across diverse domains. |
| Approach: | inverse problems can efficiently uncover scaling laws that guide the building of LLMs, authors argue . authors propose brute-force approaches to improve LLM training costs due to high costs . |
| Outcome: | This paper advocates that inverse problems can efficiently uncover scaling laws that guide the building of LLMs to achieve the desirable performance with significantly better cost-effectiveness. |
Make Every Penny Count: Difficulty-Adaptive Self-Consistency for Cost-Efficient Reasoning (2025.findings-naacl)
Copied to clipboard
Xinglin Wang, Shaoxiong Feng, Yiwei Li, Peiwen Yuan, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Existing decoding strategies for chain-of-thought reasoning do not exploit prior information about question difficulty. |
| Approach: | They propose a decoding strategy called self-consistency to improve reasoning performance by adjusting the number of samples based on the posterior distribution of a set of pre-samples. |
| Outcome: | The proposed method outperforms baseline methods on arithmetic, commonsense and symbolic reasoning tasks while achieving comparable performance. |
Pre-training and Fine-tuning Neural Topic Model: A Simple yet Effective Approach to Incorporating External Knowledge (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that using external knowledge such as pre-trained word embeddings or pre-train language models only achieved limited performance improvements but with huge computational overhead. |
| Approach: | They propose to incorporate external knowledge into neural topic modeling by pre-trained word embeddings (PWEs) or pre-train language models (PLMs) they propose to fine-tune the neural topic model on the target dataset and reduce the huge size of training data. |
| Outcome: | The proposed approach outperforms current state-of-the-art neural topic models and some topic modeling approaches enhanced with PWEs or PLMs on three datasets and greatly reduces the huge size of training data. |
E-NER: Evidential Deep Learning for Trustworthy Named Entity Recognition (2023.findings-acl)
Copied to clipboard
Zhen Zhang, Mengting Hu, Shiwan Zhao, Minlie Huang, Haotian Wang, Lemao Liu, Zhirui Zhang, Zhe Liu, Bingzhe Wu
| Challenge: | Named entity recognition (NER) systems focus on improving model performance, ignoring the need to quantify model uncertainty. |
| Approach: | They propose to introduce two uncertainty-guided loss terms to the conventional EDL and a series of uncertainty-guiding training strategies to solve these challenges. |
| Outcome: | The proposed method achieves better OOV/OOD detection performance and generalization ability on OOV entities compared to state-of-the-art methods. |
Revisiting Data Reconstruction Attacks on Real-world Dataset for Federated Natural Language Understanding (2024.lrec-main)
Copied to clipboard
Zhuo Zhang, Jintao Huang, Xiangjing Hu, Jingyuan Zhang, Yating Zhang, Hui Wang, Yue Yu, Qifan Wang, Lizhen Qu, Zenglin Xu
| Challenge: | Existing DRA methods fail to accurately recover the original text of real-world privacy data. |
| Approach: | They propose to use a real-world privacy dataset to examine the performance of federated learning (FL) methods. |
| Outcome: | The proposed method improves on a real-world privacy dataset and shows that the tokens within a recovery sentence are disordered and intertwined with tokens from other sentences in the same training batch. |
Rethinking Reading Order: Toward Generalizable Document Understanding with LLM-based Relation Modeling (2026.eacl-long)
Copied to clipboard
| Challenge: | Document understanding requires modeling structural and semantic relationships between layout elements within the document without human supervision. |
| Approach: | They propose a cost-effective paradigm that leverages large language models to infer global RO and inter-element layout relations without human supervision. |
| Outcome: | Experiments on Semantic Entity Recognition, Entity Linking, and Document Question Answering show that the proposed model improves on baseline models while preserving the robustness of existing models. |
DeFine: Decision-Making with Analogical Reasoning over Factor Profiles (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models are ideal for decision-making, but they can be difficult to process when they are verbose and include repetition, hedging, and vagueness. |
| Approach: | They propose a framework that constructs probabilistic factor profiles from complex scenarios and integrates them with analogical reasoning to guide LLMs in making decisions in new situations. |
| Outcome: | The proposed framework separates the tasks of quantifying uncertainty and incorporating it into LLM decision-making. |
Resonating with RoPE: Spectral Quantization for High-Fidelity Key Cache Compression (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to reduce memory footprint of long-context LLMs rely on RoPE-induced oscillations. |
| Approach: | They propose a frequency-domain framework that converts RoPE-induced oscillations into sparse spectral representations. |
| Outcome: | The proposed framework achieves efficient compression with performance comparable to FP16 benchmarks. |
SelfRACG: Enabling LLMs to Self-Express and Retrieve for Code Generation (2025.emnlp-main)
Copied to clipboard
Qian Dong, Jia Chen, Qingyao Ai, Hongning Wang, Haitao Li, null Yiwu, Yao Hu, Yiqun Liu, Shaoping Ma
| Challenge: | Existing retrieval-augmented code generation methods fail to accurately fetch the knowledge required for code generation for consecutive code fragments. |
| Approach: | They propose a paradigm that enables large language models to Self-express their information needs to enhance retrieval-augmented code generation methods. |
| Outcome: | Experiments show that SelfRACG can retrieve external knowledge that better aligns with the LLM’s own information needs, resulting in superior generation performance compared to vanilla RACG. |
Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning (2025.acl-long)
Copied to clipboard
Shaobo Wang, Xiangqi Jin, Ziming Wang, Jize Wang, Jiajun Zhang, Kaixin Li, Zichen Wen, Zhong Li, Conghui He, Xuming Hu, Linfeng Zhang
| Challenge: | Using fine-tuning on task-specific data is essential for large language models to be effective in specialized tasks. |
| Approach: | They propose a method that leverages few-shot in-context learning with the model to be fine-tuned. |
| Outcome: | The proposed method outperforms existing methods with a 3.1-point improvement and a 7.4 speedup on the Llama-3-8B-Instruct model using just 10% of the dataset. |
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots (2022.findings-acl)
Copied to clipboard
| Challenge: | Sub-Slot based task-oriented dialogs provide slot values segment by segment over multiple turns. |
| Approach: | They define a task called Sub-Slot based Task-Oriented Dialog (SSTOD) they build a Chinese dialog dataset SSD for boosting research on SSTOD. |
| Outcome: | The proposed task is called Sub-Slot based Task-Oriented Dialog (SSTOD) it includes 40K dialogs and 500K utterances from Chinese names, phone numbers, ID numbers and license plate numbers . the dataset is well annotated with sub-slot values, slot values, dialog states and actions . |
DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedback (2025.naacl-long)
Copied to clipboard
Jiao Sun, Deqing Fu, Yushi Hu, Su Wang, Royi Rassin, Da-Cheng Juan, Dana Alon, Charles Herrmann, Sjoerd Van Steenkiste, Ranjay Krishna, Cyrus Rashtchian
| Challenge: | Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user’s input text. |
| Approach: | They propose a training algorithm that trains T2I models to be faithful to the input text. |
| Outcome: | The proposed model improves both the semantic alignment and aesthetic appeal of two diffusion-based T2I models, evidenced by multiple benchmarks (+1.7% on TIFA, +2.9% on DSG1K, +3.4% on VILA aesthetic). |
F2RL: Factuality and Faithfulness Reinforcement Learning Framework for Claim-Guided Evidence-Supported Counterspeech Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for generating evidence-supported counterspeech lack clear guidance with a core claim for organizing evidence. |
| Approach: | They propose a Factuality and Faithfulness Reinforcement Learning framework for generating claim-guided and evidence-supported counterspeech (F2RL) they generate counter-claims based on hate speech and design a self-evaluation mechanism to select the most appropriate one. |
| Outcome: | The proposed framework achieves excellent performance on three benchmark datasets with strong factuality and faithfulness. |
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)
Copied to clipboard
Yiqun Hu, Yiyun Zhao, Jiarong Jiang, Wuwei Lan, Henghui Zhu, Anuj Chauhan, Alexander Hanbo Li, Lin Pan, Jun Wang, Chung-Wei Hang, Sheng Zhang, Jiang Guo, Mingwen Dong, Joseph Lilien, Patrick Ng, Zhiguo Wang, Vittorio Castelli, Bing Xiang
| Challenge: | Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data. |
| Approach: | They propose a framework that imposes strong typing constraints and incorporates key relationships from schema. |
| Outcome: | The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider. |
Encouraging Good Processes Without the Need for Good Answers: Reinforcement Learning for LLM Agent Planning (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Currently, the dominant end-to-end reinforcement learning paradigm for agents in Large Language Models (LLMs) employs multi-objective optimization that jointly trains both planning and answer summarization capabilities. |
| Approach: | They propose a framework that decouples the training process to enable a focused, single-objective optimization of the planning module. |
| Outcome: | The proposed framework achieves an 8%–12% improvement in planning performance compared to end-to-end baselines. |
“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models (2024.findings-acl)
Copied to clipboard
Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
| Challenge: | Multiple choice questions are one of the most popular evaluation formats for understanding the capabilities of autoregressive large language models (LLMs). |
| Approach: | They evaluated how aligned first-token evaluation is with the text output along several dimensions, namely final option choice, refusal rate, choice distribution and robustness under prompt perturbation. |
| Outcome: | The proposed evaluation methods are misaligned on all dimensions, reaching mismatch rates over 60%. |
SPARD: Self-Paced Curriculum for RL Alignment via Integrating Reward Dynamics and Data Utility (2026.acl-long)
Copied to clipboard
Xuyang Zhi, Peilun Zhou, Chengqiang Lu, Hang Lv, Yiwei Liang, Rongyang Zhang, Yan Gao, null Yiwu, Yao Hu, Hongchao Gu, Defu Lian, Hao Wang, Enhong Chen
| Challenge: | Large Language Models (LLMs) are shifting the focus from single verifiable tasks toward complex, open-ended real-world scenarios. |
| Approach: | They propose a framework that automatically adjusts reward weights and data importance to synchronize learning intent with data utility for optimal performance. |
| Outcome: | The proposed framework improves model capabilities across all domains and scales. |
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge probing studies focus on evaluating factual knowledge of pre-trained language models (PLMs) but ignore conceptual knowledge. |
| Approach: | They evaluate conceptual knowledge of pre-trained language models by annotating 24k data instances covering 393 concepts. |
| Outcome: | The proposed tasks evaluate pre-trained language models' conceptual knowledge of entities, learn conceptual properties, and conceptualize entities in contexts. |
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)
Copied to clipboard
Junjie Wang, Mingyang Chen, Binbin Hu, Dan Yang, Ziqi Liu, Yue Shen, Peng Wei, Zhiqiang Zhang, Jinjie Gu, Jun Zhou, Jeff Pan, Wen Zhang, Huajun Chen
| Challenge: | Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval. |
| Approach: | They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs). |
| Outcome: | The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models. |
Reasoning with Language Model is Planning with World Model (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown remarkable reasoning capabilities, particularly with Chain-of-Thought-style prompts. |
| Approach: | They propose a framework that repurposes the LLM as both a world model and a reasoning agent and incorporates a principled planning algorithm (based on Monte Carlo Tree Search) |
| Outcome: | The proposed framework repurposes the LLM as both a world model and a reasoning agent and incorporates a principled planning algorithm (based on Monte Carlo Tree Search) it achieves optimum balance between exploration and exploitation, while achieving high-reward reasoning paths efficiently. |
CCTC: A Cross-Sentence Chinese Text Correction Dataset for Native Speakers (2022.coling-1)
Copied to clipboard
| Challenge: | Chinese text correction datasets focus on detecting and correcting Chinese spelling errors and grammatical errors. |
| Approach: | They propose a Chinese text correction dataset for native speakers . they manually annotated 1,500 Chinese texts written by native speakers. |
| Outcome: | The proposed dataset can detect and correct Chinese spelling errors and grammatical errors. |
LyapLock: Bounded Knowledge Preservation in Sequential Large Language Model Editing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for enhancing knowledge updating are prone to performance degradation due to incomplete knowledge preservation mechanisms. |
| Approach: | They propose a model for locate-then-edit that decomposes long-term constrained programming into tractable stepwise subproblems for efficient solving. |
| Outcome: | The proposed framework achieves asymptotic optimal editing performance while meeting the constraints of long-term knowledge preservation. |
Beyond Noise: Characterizing Creative Potential in Unverifiable LLM Hallucinations (2026.acl-long)
Copied to clipboard
Yu Yan, Chunhong Zhang, Haiyu Zhao, Ziyang Zeng, Zihao Liu, Yongkang Wu, Jianzhou Diao, YiJie Chen, Shujie Wang, Zheng Hu
| Challenge: | Large Language Models generate outputs that extend beyond established knowledge . prior work does not characterize the unverifiable space as a whole . |
| Approach: | They propose a novelty-verifiability characterization that distinguishes Creative Synthesis from Groundless Fabrication by a conceptual creation task. |
| Outcome: | The proposed model distinguishes Creative Synthesis (Region A) from Groundless Fabrication (Regium B) it shows that Region A is non-negligible and robust, persisting across generation strategies, models, domains, and embedding choices. |
Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL (2025.coling-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL approaches have overlooked the critical aspect of system robustness. |
| Approach: | They propose a robust text-to-SQL solution that integrates with LLMs . their method achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% . |
| Outcome: | The proposed solution achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% on the general Spider and Bird benchmarks. |
Cross-Lingual Machine Reading Comprehension (D19-1)
Copied to clipboard
| Challenge: | Existing work on machine reading comprehension task is focused on English, but there are few efforts on other languages due to the lack of large-scale training data. |
| Approach: | They propose a cross-lingual machine reading comprehension task for other languages . they propose cloze-style reading comprehension and various neural network approaches . |
| Outcome: | The proposed model improves reading comprehension performance of Chinese datasets over state-of-the-art systems by a large margin over existing systems. |
Tracing and Dissecting How LLMs Recall Factual Knowledge for Real World Questions (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have shown promising ability to perform commonsense reasoning. |
| Approach: | They propose a two-dimensional analysis framework that incorporates token back-tracing and token decoding to uncover how LLMs conduct factual knowledge recall. |
| Outcome: | The proposed framework shows that LLMs lack relevant knowledge but struggle to select the most accurate information based on context during the retrieval and rerank phase. |
VCB Bench: An Evaluation Benchmark for Audio-Grounded Large Language Model Conversational Agents (2026.findings-acl)
Copied to clipboard
Jiliang Hu, Wenfu Wang, Zuchao Li, Chenxing Li, Yiyang Zhao, Hanzhao Li, Liqiang Zhang, Meng Yu, Dong Yu
| Challenge: | despite advances in multimodal conversational systems, current benchmarks lack comprehensive evaluation across key dimensions. |
| Approach: | They propose a Chinese benchmark built exclusively on real human speech to fill this gap . they assess LALMs across three complementary axes: instruction following, knowledge understanding, robustness . |
| Outcome: | VCB Bench assesses LALMs across three complementary axes: instruction following, knowledge understanding, and robustness . VCBM Bench provides reproducible and fine-grained framework for Chinese voice chat bots . results show significant performance disparities and offer tangible insights for future improvements . |
Dynamic Energy-Based Contrastive Learning with Multi-Stage Knowledge Verification for Event Causality Identification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event causal identification rely on rule-based or random sampling strategies, which introduce spurious causal positives. |
| Approach: | They propose an ECI method enhanced by Dynamic Energy-based Contrastive Learning with multi-stage knowledge verification which generates high-quality contrastive samples and effectively suppresses spurious causal disturbances. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two benchmarks. |
Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation (P19-3)
Copied to clipboard
Zhiting Hu, Haoran Shi, Bowen Tan, Wentao Wang, Zichao Yang, Tiancheng Zhao, Junxian He, Lianhui Qin, Di Wang, Xuezhe Ma, Zhengzhong Liu, Xiaodan Liang, Wanrong Zhu, Devendra Sachan, Eric Xing
| Challenge: | Texar is an open-source text generation toolkit that supports a broad set of text generation tasks. |
| Approach: | They introduce Texar, an open-source text generation toolkit that supports text generation tasks. |
| Outcome: | Texar supports machine translation, summarization, dialog, content manipulation, and more. |
More Thinking, Less Talking: Internalizing Deliberative Safety into LLM Parameters (2026.acl-long)
Copied to clipboard
| Challenge: | Existing safety alignment methods leave Large Language Models vulnerable to sophisticated jailbreak attacks. |
| Approach: | They propose a safety reasoning internalization framework that internalizes safety reasoning into an implicit computational pathway using Low-Rank Adaptation (LoRA). |
| Outcome: | The proposed framework achieves a 43% lower Attack Success Rate (ASR) against distinct jailbreak attacks compared to strong baselines. |
Hyperspherical Multi-Prototype with Optimal Transport for Event Argument Extraction (2024.acl-long)
Copied to clipboard
| Challenge: | Event Argument Extraction (EAE) aims to extract arguments for specified events from a text . previous work focused on long-distance dependencies of arguments, modeling co-occurrence relationships . |
| Approach: | They propose a model that takes inductive biases as targets to locate prototypes . they set multiple prototypes to represent each role to capture intra-class differences . |
| Outcome: | The proposed model achieves state-of-the-art on the RAMS and WikiEvents datasets. |
Breaking the "Provable Security": Detecting Finite-Precision Artifacts in LLM-based Steganography via Low-Probability Vanishing (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have fostered a new class of generative linguistic steganography, claim “provably secure” by theoretically aligning the stego distribution with the language model’s natural distribution. |
| Approach: | They propose a framework that transforms the detection task from semantic classification to a statistical audit of the sampling mechanism. |
| Outcome: | The proposed framework breaks the security of AC and Meteor with high detection accuracy, whereas state-of-the-art semantic steganalyzers degrade to random guessing. |
Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data (2023.emnlp-demo)
Copied to clipboard
Ming Zhong, Siru Ouyang, Yizhu Jiao, Priyanka Kargupta, Leo Luo, Yanzhen Shen, Bobby Zhou, Xianrui Zhong, Xuan Liu, Hongxiang Li, Jinfeng Xiao, Minhao Jiang, Vivian Hu, Xuan Wang, Heng Ji, Martin Burke, Huimin Zhao, Jiawei Han
| Challenge: | Reaction Miner is a system designed to extract chemical reactions from raw scientific PDFs. |
| Approach: | They propose a system that extracts chemical reactions directly from raw scientific PDFs. |
| Outcome: | The proposed system can extract chemical reactions from raw scientific PDFs. |
LORE: Continual Logit Rewriting Fosters Faithful Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using aspect-oriented summarization as a case study, we propose **LOgit REwriting**, a new controlled generation paradigm which can be faithful to external knowledge and to the LLM’s intentions. |
| Approach: | They propose a controlled generation paradigm which can be faithful to external knowledge and to the LLM's intentions. |
| Outcome: | The proposed paradigm can be faithful to external knowledge and to the LLM's intentions while balancing that with accuracy. |
Controllable Text Generation with Focused Variation (2020.findings-emnlp)
Copied to clipboard
Lei Shu, Alexandros Papangelis, Yi-Chia Wang, Gokhan Tur, Hu Xu, Zhaleh Feizollahi, Bing Liu, Piero Molino
| Challenge: | Focused-Variation Network (FVN) is a new model to control language generation. |
| Approach: | They propose a model that learns discrete latent spaces for each attribute inside codebooks and uses them to generate fluent text. |
| Outcome: | The proposed model can generate fluent and mostly coherent text on two text generation datasets with annotated content and style, and show state-of-the-art performance as assessed by automatic and human evaluations. |
ComfyUI-R1: Exploring Reasoning Models for Workflow Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | ComfyUI-R1 is the first large reasoning model for automated workflow generation. |
| Approach: | They propose a large reasoning model for automated workflow generation that builds on curated knowledge bases and a two-stage framework to fine-tune models for cold start and reinforcement learning for incentivizing reasoning capability. |
| Outcome: | The proposed model achieves 97% format validity rate, high pass rate, node-level and graph-level F1 scores, surpassing prior state-of-the-art methods that employ leading closed-source models such as GPT-4o and Claude series. |
MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Chia-Yuan Chang, Zhimeng Jiang, Vineeth Rakesh, Menghai Pan, Chin-Chia Michael Yeh, Guanchu Wang, Mingzhi Hu, Zhichao Xu, Yan Zheng, Mahashweta Das, Na Zou
| Challenge: | Existing RAG systems struggle with the quality of retrieval documents, causing performance degradation and reducing performance. |
| Approach: | They propose a training-free RAG framework that leverages multiple LLM agents to collaboratively filter and score retrieved documents. |
| Outcome: | The proposed framework outperforms existing RAG frameworks in QA benchmarks and shows superior answer consistency and answer accuracy over baseline methods. |
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)
Copied to clipboard
Hongzhi Zhang, Yuanze Hu, Tinghai Zhang, Jia Fu, Tao Wang, Junwei Jing, Zhaoxin Fan, Wei Bi, Ruiming Tang, Han Li, Guorui Zhou, Kun Gai
| Challenge: | Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing. |
| Approach: | They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards. |
| Outcome: | The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations . |
Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors (2026.acl-long)
Copied to clipboard
Zhiwei Zhang, Fei Zhao, Rui Wang, Zezhong Wang, Bin Liang, Jiakang Wang, Yao Hu, Shaosheng Cao, Kam-Fai Wong
| Challenge: | Large language models (LLMs) can call tools effectively, but they remain brittle in multi-turn execution. |
| Approach: | They propose a framework that converts execution errors into on-policy corrective supervision within the RL training loop. |
| Outcome: | The proposed framework improves the error recovery rate of Qwen3-8B by 5.7% absolute and overall accuracy by 4.0% on BFCL v4 Multi-Turn. |
MAssistant: A Personal Knowledge Assistant for MOOC Learners (D19-3)
Copied to clipboard
| Challenge: | Massive Open Online Courses (MOOCs) have experienced a rapid development since 2012 . many MOOC platforms have been launched, including Coursera1 , edX2 , and Udacity3 etc. |
| Approach: | They present a personal knowledge assistant system called MAssistant for MOOC learners . MAsistants has a large-scale concept graph built from open data . it also provides a browser extension which interacts with users during video lectures . |
| Outcome: | The proposed system helps users trace the concepts they have learned in MOOCs, and to build their own concept graphs. |
PrinciplismQA: A Philosophy-Grounded Approach to Assessing LLM-Human Clinical Medical Ethics Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks lack systematic approaches to integrate philosophical frameworks and expert validation for ethical reasoning assessment. |
| Approach: | They propose a philosophy-grounded approach to assess medical ethics alignment . PrinciplismQA comprises 3,648 expert-validated questions spanning knowledge assessment and clinical reasoning . |
| Outcome: | PrinciplismQA provides a philosophy-grounded approach to assessing medical ethics alignment. |
Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction (2024.acl-long)
Copied to clipboard
| Challenge: | Aspect Sentiment Quad Prediction (ASQP) aims to predict all quads (aspect term, aspect category, opinion term, sentiment polarity) for a given review. |
| Approach: | They propose a self-training framework with a pseudo-label scorer to assess the match between reviews and their pseudo-labels and train a generative model on it. |
| Outcome: | The proposed framework can predict all quads (aspect term, aspect category, opinion term, sentiment polarity) for a given review, and it can significantly improve self-training. |
Towards Robust Few-Shot Relation Classification: Incorporating Relation Description with Agreement (2025.findings-emnlp)
Copied to clipboard
Mengting Hu, Jianfeng Wu, Ming Jiang, Yalan Xie, Zhunheng Wang, Rui Ying, Xiaoyi Liu, Ruixuan Xu, Hang Gao, Renhong Cheng
| Challenge: | Existing approaches to recognize relational relationships with a few support samples are limited for unlimited queries. |
| Approach: | They propose a simple but effective framework that uses relation descriptions as external knowledge to enhance the model’s comprehension of the relation semantics. |
| Outcome: | The proposed framework outperforms strong baselines while being robust against various NOTA rates. |
Understanding How Value Neurons Shape the Generation of Specified Values in LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to interpret value representations are limited by superficial judgments over mechanistic analysis. |
| Approach: | They propose a mechanistic interpretability framework that uses the Schwartz Values Survey to interpret value . they use a dataset that operationalizes four dimensions of universal value through behavioral contexts . |
| Outcome: | The proposed method bridges psychological value frameworks with neuron analysis in large language models. |
QiMeng-PRepair: Precise Code Repair via Edit-Aware Reward Optimization (2026.acl-long)
Copied to clipboard
Changxin Ke, Rui Zhang, Jiaming Guo, Yuanbo Wen, Li Ding, Shuo Wang, Xuyuan Zhu, Xiong Peng, Di Huang, Zidong Du, Xing Hu, Qi Guo, Yunji Chen
| Challenge: | Existing approaches to program repair are based on correctness alone. |
| Approach: | They propose a framework that mitigates over-editing and improves repair accuracy by generating buggy programs and re-edits. |
| Outcome: | The proposed framework improves repair precision by 31.4% under fix1@1, a metric that considers repair correctness and extent, and significantly increases decoding throughput when combined with speculative editing. |
DisCal: Distribution-Aware Calibration for Mathematical Reasoning Under Character-Level Noisy Inputs (2026.acl-long)
Copied to clipboard
Bo Zhang, Jiawei Zhang, Cong Gao, Bingxu Han, Minghao Hu, Jun Zhang, Yunbo Cao, Zhunchen Luo, Wen Yao, Guotong Geng, Zhong Wang
| Challenge: | Existing methods for calibration of large reasoning models (LRMs) focus on clean inputs, leaving noise unexplored. |
| Approach: | They propose a confidence calibration framework for character-level noisy inputs that extracts uncertainty signals from both the empirical answer distribution and the model’s predictive distribution and integrates them via a learned calibrator. |
| Outcome: | Experiments on multiple mathematical reasoning benchmarks show that DisCal outperforms existing calibration methods under noisy inputs, reducing expected calibration error (ECE) by up to 39.21% and improving Area Under the Receiver Operating Characteristic Curve (AUROC) by 31.44%. |
Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures (2026.acl-long)
Copied to clipboard
Yi Hu, Jiaqi Gu, Ruxin Wang, Zijun Yao, Hao Peng, Xiaobao Wu, Jianhui Chen, Muhan Zhang, Liangming Pan
| Challenge: | Recent research has shown that reinforcement learning can elicit intriguing emergent reasoning behaviors. |
| Approach: | They propose a comprehensive survey of the mechanistic understanding of large reasoning models . they organize findings into three core dimensions: 1) training dynamics, 2) reasoning mechanisms, and 3) unintended behaviors. |
| Outcome: | This paper synthesizes the mechanistic understanding of large reasoning models into three dimensions . authors outline a roadmap for future studies including improved interpretability and methodologies . |
Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models (2026.acl-long)
Copied to clipboard
Runxuan Liu, Xianhao Ou, Xinyan Ma, Jiyuan Wang, Jiafeng Liang, Jiaqi Li, Tao He, Zheng Chu, Rongchuan Mu, Zekun Wang, Baoxin Wang, Dayong Wu, Ming Liu, Shijin Wang, Guoping Hu, Bing Qin
| Challenge: | Existing methods for long chain-of-thought (LCoT) are coarse-grained, reward hacking, and poor generalization. |
| Approach: | They propose a Long Chain-of-Thought (LCoT) model that integrates reinforcement learning with verifiable rewards with a process-aware verification approach. |
| Outcome: | The proposed model improves reasoning and code generation tasks while reducing the cost of training and performance bottlenecks. |
Mitigating the Alignment Tax of RLHF (2024.emnlp-main)
Copied to clipboard
Yong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao, Jianmeng Liu, Jipeng Zhang, Rui Pan, Haoxiang Wang, Wenbin Hu, Hanning Zhang, Hanze Dong, Renjie Pi, Han Zhao, Nan Jiang, Heng Ji, Yuan Yao, Tong Zhang
| Challenge: | Large Language Models (LLMs) acquire a wide range of abilities during pre-training, but aligning LLMs under Reinforcement Learning with Human Feedback (RLHF) can lead to forgetting pretrained abilities, which is also known as the alignment tax. |
| Approach: | They propose to use a model averaging technique to find the most powerful alignment-forging Pareto front among RLHF algorithms. |
| Outcome: | The proposed method achieves the strongest alignment-forging Pareto front among competing methods. |
Exploring Lottery Prompts for Pre-trained Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to optimize pre-trained language models are expensive and slow to scale. |
| Approach: | They propose to search for instance-level lottery prompts and generalize them to unseen data . they validate the assumption that for every instance, there is almost always a lottery prompt that induces the correct prediction from the PLM . |
| Outcome: | The proposed method can achieve comparable results with other gradient-free and optimization-free baselines. |
QSpell 250K: A Large-Scale, Practical Dataset for Chinese Search Query Spell Correction (2025.naacl-industry)
Copied to clipboard
| Challenge: | Chinese Search Query Spell Correction is a task designed to identify and correct typographical errors within queries. |
| Approach: | They propose a large-scale benchmark specifically developed for Chinese Query Spell Correction. |
| Outcome: | The proposed benchmark covers a broad range of topics, including formal entities, everyday colloquialisms and idiomatic expressions. |
2INER: Instructive and In-Context Learning on Few-Shot Named Entity Recognition (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) tasks are a fundamental task of natural language processing (NLP). |
| Approach: | They propose a text-to-text framework for Few-Shot Named Entity Recognition (NER) that employs instruction finetuning and auxiliary tasks to enhance the model's understanding of entity types in the overall semantic context of a sentence. |
| Outcome: | The proposed framework outperforms existing Few-Shot NER methods and remains competitive with state-of-the-art NER algorithms. |
Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for few-shot text classification suffer from overfitting due to the lack of matching between the few amount of samples and complicated models. |
| Approach: | They propose a method to improve model generalization ability to a new task by leveraging a meta-learner via gradient similarity method. |
| Outcome: | The proposed method improves few-shot text classification performance on several benchmarks. |
Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion (2024.emnlp-main)
Copied to clipboard
Guanchu Wang, Yu-Neng Chuang, Ruixiang Tang, Shaochen Zhong, Jiayi Yuan, Hongye Jin, Zirui Liu, Vipin Chaudhary, Shuai Xu, James Caverlee, Xia Hu
| Challenge: | Existing mechanisms compromise ownership rights or raise data privacy concerns . existing mechanisms compromise security of released large language models . |
| Approach: | They propose a TaylorMLP to preserve the ownership of large language models by transforming the weights of LLMs into Taylor-series parameters instead of releasing original weights . |
| Outcome: | The proposed model preserves ownership of large language models and prevents their abuse by adjusting the generation speed and causing low-speed token generation. |
Towards Medical Machine Reading Comprehension with Structural Knowledge and Plain Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | MRC has achieved significant progress on the open domain in recent years due to large-scale pre-trained language models. |
| Approach: | They propose a machine reading comprehension model which exploits structural medical knowledge and reference medical plain text to improve the exam's accuracy. |
| Outcome: | The proposed model outperforms existing models with a large margin and passes the exam with 61.8% accuracy rate on the test set. |
Focused Large Language Models are Stable Many-Shot Learners (2024.emnlp-main)
Copied to clipboard
Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Heda Wang, Yao Hu, Kan Li
| Challenge: | In-Context Learning (ICL) enables large language models to achieve rapid task adaptation by learning from demonstrations. |
| Approach: | They propose a training-free method that disperses model attention from the query . they propose 'focus' search strategy that uses model perplexity to ensure sufficient attention . |
| Outcome: | The proposed method achieves an average performance improvement of 5.2% over vanilla ICL and scales well with many-shot demonstrations. |
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing Language Models lack the power to store all required knowledge, resulting in a lack of ability to infer out-of-context knowledge. |
| Approach: | They propose a Knowledge Interaction Layer that can be flexibly plugged into existing Transformer-based LMs to interact with a differentiable Knowledge Graph Reasoning module collaboratively. |
| Outcome: | The proposed model can be plugged into existing Transformer-based LMs to interact with a differentiable Knowledge Graph Reasoning module collaboratively. |
LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languages (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated strong performance across various natural language processing tasks, but their proficiency in mathematical reasoning remains a key challenge. |
| Approach: | They propose a process-oriented framework to evaluate LLMs' ability to construct mathematical models, using solvers to compare outputs with ground truth. |
| Outcome: | The proposed framework evaluates LLMs' ability to construct mathematical models, using solvers to compare outputs with ground truth. |
Visual Self-Fulfilling Alignment: Shaping Safety-Oriented Personas via Threat-Related Images (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods require explicit safety labels or contrastive data, yet visual inputs enable harmful outputs. |
| Approach: | They propose a visual self-fulfilling alignment mechanism that fine-tunes vision-language models on neutral VQA tasks without any safety labels. |
| Outcome: | The proposed approach reduces attack success rate, improves response quality, and mitigates over-refusal while preserving general capabilities. |
Refine, Align, and Aggregate: Multi-view Linguistic Features Enhancement for Aspect Sentiment Triplet Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Aspect Sentiment Triplet Extraction (ASTE) aims to extract the triplets of aspect terms, their associated sentiment and opinion terms. |
| Approach: | They propose to use multi-view linguistic features enhancement to explore the prior indication effect in the “Refine, Align, and Aggregate” learning process to enhance aspect-opinion relations. |
| Outcome: | The proposed model achieves state-of-the-art on several benchmark datasets and is robust to state- of-the art constraints. |
InsBank: Evolving Instruction Subset for Ongoing Alignment (2025.findings-emnlp)
Copied to clipboard
Jiayi Shi, Yiwei Li, Shaoxiong Feng, Peiwen Yuan, Xinglin Wang, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Huan Ren, Yao Hu, Kan Li
| Challenge: | Recent studies emphasize that quality and diversity of instruction data are more crucial than quantity, highlighting the need to select diverse, high-quality subsets to reduce training costs. |
| Approach: | They propose to use a continuously updated repository to integrate the latest valuable instruction data with a progressive evolution framework to evolve InsBank over time. |
| Outcome: | The proposed framework outperforms baselines in InsBank evolution and extracts budget-specific subsets. |
Self-Ensemble: Mitigating Confidence Distortion for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models exhibit a confidence distortion problem on multichoice question-answering . Self-Ensemble solves this problem by splitting the choices into several groups . |
| Approach: | They propose a method that splits LLM choices into several groups and ensembles them to reach a final decision. |
| Outcome: | The proposed method outperforms standard inference and baseline methods on MCQA. |
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models with stacked layers do not explicitly model hierarchical structure of language understanding. |
| Approach: | They propose a recursive Transformer model based on differentiable CKY style binary trees to emulate hierarchical composition process. |
| Outcome: | The proposed model can predict words given their left and right abstraction nodes. |
Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancement (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for long-form story generation rely on rigid outlines or lack macro-level planning, making it difficult to achieve contextual consistency and coherent plot development. |
| Approach: | They propose a Dynamic Hierarchical Outlining with Memory-Enhancement long-form story generation method to generate long-formed story with coherent content and plot. |
| Outcome: | The proposed method significantly improves the fluency, coherence, and overall quality of generated long stories compared to state-of-the-art methods. |
CLEAN–EVAL: Clean Evaluation on Contaminated Large Language Models (2024.findings-naacl)
Copied to clipboard
Wenhong Zhu, Hongkun Hao, Zhiwei He, Yun-Ze Song, Jiao Yueyang, Yumeng Zhang, Hanxu Hu, Yiran Wei, Rui Wang, Hongyuan Lu
| Challenge: | Existing methods to evaluate large language models are prone to data contamination. |
| Approach: | They propose a method which parses contaminated data and back-translates it into a candidate set. |
| Outcome: | The proposed method reduces data contamination and evaluates the LLMs more cleanly. |
Multi-Granularity Semantic Revision for Large Language Model Distillation (2026.acl-long)
Copied to clipboard
Xiaoyu Liu, Yun Zhang, Wei Li, Simiao Li, Xudong Huang, Hanting Chen, Yehui Tang, Jie Hu, Zhiwei Xiong, Yunhe Wang
| Challenge: | Existing methods for generating large language models rely on student-generated outputs, which introduce generation errors and misguide the distillation process. |
| Approach: | They propose a multi-granularity semantic revision method for LLM distillation that corrects errors using teacher-generated tokens and re-generates the sequence to minimize errors. |
| Outcome: | The proposed method reduces errors and misguides distillation on student models and improves consistency between teacher and student outputs. |
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve output quality without aggregating input tokens are limited by the complexity of aggregation of responses. |
| Approach: | They propose to extract and integrate segment-level commonalities from candidate samples to enhance performance of LLMs in open-ended and reasoning tasks. |
| Outcome: | The proposed method improves performance on reasoning, code generation and mathematical reasoning tasks without requiring additional models and overlooking the knowledge present among the candidates. |
RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Models (2022.aacl-main)
Copied to clipboard
| Challenge: | Existing generative methods to recommend items are shallowly integrated into the model training and have poor chit-chat ability. |
| Approach: | They propose a framework that integrates recommendation into the dialog generation by introducing a vocabulary pointer. |
| Outcome: | The proposed framework outperforms the state-of-the-art models on a benchmark dataset. |
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection (2026.findings-acl)
Copied to clipboard
Yibo Yan, Shen Wang, Jiahao Huo, Hang Li, Boyan Li, Jiamin Su, Xiong Gao, YiFan Zhang, Tianlong Xu, Zhendong Chu, Aoxiao Zhong, Kun Wang, Hui Xiong, Philip S. Yu, Xuming Hu, Qingsong Wen
| Challenge: | Current mathematical benchmarks focus on evaluating MLLMs’ problem-solving ability, yet there is a crucial gap in addressing more complex scenarios such as error detection. |
| Approach: | They propose to evaluate multimodal error detection by evaluating two sub-tasks error step identification and error categorization. |
| Outcome: | The proposed task evaluates MLLMs' ability to handle multimodal questions compared to text-only models. |
Bridging the Granularity Gap for Acoustic Modeling (2023.findings-acl)
Copied to clipboard
Chen Xu, Yuhao Zhang, Chengbo Jiao, Xiaoqian Liu, Chi Hu, Xin Zeng, Tong Xiao, Anxiang Ma, Huizhen Wang, Jingbo Zhu
| Challenge: | Despite the success of speech recognition, how to encode the speech features effectively remains an open problem. |
| Approach: | They propose a Progressive Down-Sampling technique which compresses acoustic features into coarser-grained units containing more complete semantic information, like text-level representation. |
| Outcome: | The proposed method yields comparable or better results on the speech recognition task and inference speedups ranging from 1.20x to 1.47x. |
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Recent work on learning from multiple tasks has shown that adding an extra fusion layer to implement knowledge composition is non-scalable for some applications. |
| Approach: | They propose a two-stage knowledge distillation algorithm to extract task specific knowledge by using local data to train a student adapter. |
| Outcome: | Experiments on frequently asked question retrieval in task-oriented dialog systems validate the efficiency of AdapterDistillation. |
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)
Copied to clipboard
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian McAuley
| Challenge: | Large Language Models (LLMs) have been used for selection and training of data for active learning. |
| Approach: | They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop. |
| Outcome: | The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances. |
Adversarial Training for Machine Reading Comprehension with Virtual Embeddings (2021.starsem-1)
Copied to clipboard
| Challenge: | Neural networks are vulnerable to adversarial examples that have been mixed with certain perturbations. |
| Approach: | They propose a novel adversarial training method that perturbs the embedding matrix instead of word vectors to differentiate the roles of passages and questions. |
| Outcome: | The proposed method is effective universally and further improves the performance of MRC tasks. |
Video-MMMU: Evaluating Knowledge Acquisition from Multidisciplinary Professional Videos (2026.acl-long)
Copied to clipboard
| Challenge: | Existing video benchmarks do not evaluate the knowledge acquisition capabilities of Large Multimodal Models (LMMs) existing video benchmark focuses on static, general visual understanding tasks, without evaluating whether models can acquire knowledge dynamically. |
| Approach: | They propose a multi-modal, multi-discipline, multitrack benchmark that evaluates Large Multimodal Models’ ability to acquire knowledge from college-level, educational videos. |
| Outcome: | The proposed benchmark reveals a substantial gap between human learners and current Large Multimodal Models (LMMs) and focuses on improving their learning efficiency. |
Logical Consistency as a Bridge: Improving LLM Hallucination Detection via Label Constraint Modeling between Responses and Self-Judgments (2026.acl-long)
Copied to clipboard
Hao Mi, Qiang Sheng, Shaofei Wang, Beizhe Hu, Yifan Sun, Zhengjia Wang, Hengqi Zeng, Yang Li, Danding Wang, Juan Cao
| Challenge: | Existing methods for hallucination detection focus on implicit neural uncertainty or explicit symbolic reasoning, ignoring factual hallucinosities. |
| Approach: | They propose a framework that bridges neural features and symbolic judgments for hallucination detection by leveraging a "meta-judgment" process to map symbolic labels back into the feature space. |
| Outcome: | Extensive experiments on 4 public datasets, across 4 LLMs, against 8 baselines demonstrate the superiority of LaaB. |
MEVTR: A Multilingual Model Enhanced with Visual Text Representations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models that generate multilingual text representations perform poorly on low-resource languages due to lack of representation space and model capacity. |
| Approach: | They propose a multilingual model enhanced with visual text representations which complements textual representations and extends multilingual representation space with visual representations. |
| Outcome: | The proposed model outperforms state-of-the-art models on zero-shot cross-lingual transfer tasks without the target language adapter. |
Private Language Models via Truncated Laplacian Mechanism (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for word embedding are prone to privacy leakage, resulting in weaker relaxations of DP that are inferior to the canonical DP in terms of privacy strength. |
| Approach: | They propose a method for private word embedding that uses a non-trivial extension of the truncated Laplacian mechanism and propose to test its effectiveness. |
| Outcome: | The proposed method has lower variance compared to the previous methods. |
MT-Video-Bench: A Holistic Video Understanding Benchmark for Evaluating Multimodal LLMs in Multi-Turn Dialogues (2026.findings-acl)
Copied to clipboard
Yaning Pan, Qianqian Xie, Guohui Zhang, Zekun Moore Wang, Yongqian Wen, Yuanxing Zhang, Haoxuan Hu, Zhiyu Pan, Yibing Huang, Zhidong Gan, Yonghong Lin, An Ping, Shihao Li, Yanghai Wang, Tianhao Peng, Jiaheng Liu
| Challenge: | Existing evaluation benchmarks for Multimodal Large Language Models (MLLMs) focus on single-turn question answering, overlooking the complexity of multi-turn dialogues in real-world scenarios. |
| Approach: | They propose a video understanding benchmark for MLLMs in multi-turn dialogues that assesses six core competencies that focus on perceptivity and interactivity. |
| Outcome: | The MT-Video-Bench evaluates 1,000 multi-turn dialogues from diverse domains and reveals significant performance discrepancies and limitations in handling multi-turned video dialogues. |
MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods for complex multi-shot video are anchored to single-shot paradigms, lacking comprehensive story assets and cross-shot metrics. |
| Approach: | They propose a framework that synergizes the high-level semantic reasoning of Large Multimodal Models with the fine-grained perceptual rigor of domain-specific expert models. |
| Outcome: | The proposed framework synergizes the high-level semantic reasoning of Large Multimodal Models with the fine-grained perceptual rigor of domain-specific expert models. |
MTLS: Making Texts into Linguistic Symbols (2024.emnlp-main)
Copied to clipboard
| Challenge: | In linguistics, all languages can be considered as symbolic systems . most work overlooks the properties of languages as symbol systems - aaron et al., 1989). |
| Approach: | They propose a method to make texts into linguistic symbols to improve multilingual capability . they use a pre-training method to replace pre-trained language models with a vocabulary map . |
| Outcome: | The proposed method improves multilingual capabilities on multilingual tasks using BERT and RoBERTa as the backbone. |
MTP-RL: Acceleration of Reinforcement Learning Rollouts with Policy-Aligned Multi-Token Prediction (2026.findings-acl)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) is widely applied to boost the performance of pretrained models, yet its training efficiency is severely constrained by rollout generation. |
| Approach: | They propose a framework that accelerates the rollout phase for diverse models by equipping a pipeline to equip the multi-layer parameter-sharing MTP for all models and an advantage-aware MTP optimization strategy. |
| Outcome: | The proposed framework achieves stable growth of acceptance length during RL training, and also accelerates RL rollouts, achieving an average 23.1%–55.3% reduction in rollout time compared to baselines. |
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)
Copied to clipboard
Weihua Zheng, Zhengyuan Liu, Tanmoy Chakraborty, Weiwen Xu, Xiaoxue Gao, Bryan Chen Zhengyu Tan, Bowei Zou, Chang Liu, Yujia Hu, Xing Xie, Xiaoyuan Yi, Jing Yao, Chaojun Wang, Long Li, Rui Liu, Huiyao Liu, Koji Inoue, Ryuichi Sumida, Tatsuya Kawahara, Fan Xu, Lingyu Ye, Wei Tian, Dongjun Kim, Jimin Jung, Jaehyung Seo, Nadya Yuki Wangsajaya, Pham Minh Duc, Ojasva Saxena, Palash Nandi, Xiyan Tao, Wiwik Karlina, Tuan Luong, Keertana Arun Vasan, Roy Ka-Wei Lee, Nancy F. Chen
| Challenge: | Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed . |
| Approach: | They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities. |
| Outcome: | The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech . |
AutoMonitor-Bench: Evaluating the Reliability of LLM-Based Misbehavior Monitor (2026.findings-acl)
Copied to clipboard
| Challenge: | AutoMonitor-Bench evaluates the reliability of LLM-based misbehavior monitors across diverse tasks and failure modes. |
| Approach: | They introduce AutoMonitor-Bench, a benchmark designed to evaluate misbehavior monitors across diverse tasks and failure modes. |
| Outcome: | The new benchmark evaluates the reliability of LLM-based misbehavior monitors across tasks and failure modes. |
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)
Copied to clipboard
Zekun Zhou, Xiaocheng Feng, Lei Huang, Xiachong Feng, Ziyun Song, Ruihan Chen, Liang Zhao, Weitao Ma, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin
| Challenge: | rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research. |
| Approach: | They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication. |
| Outcome: | The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication. |
Large Language Models as Source Planner for Personalized Knowledge-grounded Dialogues (2023.findings-emnlp)
Copied to clipboard
Hongru Wang, Minda Hu, Yang Deng, Rui Wang, Fei Mi, Weichao Wang, Yasheng Wang, Wai-Chung Kwan, Irwin King, Kam-Fai Wong
| Challenge: | Existing knowledge-grounded dialogue systems focus on a single knowledge source or ignore the dependency between multiple knowledge sources. |
| Approach: | They propose a framework that integrates multiple knowledge sources and dependencies between them. |
| Outcome: | The proposed framework can produce persona-consistent and knowledge-enhanced responses on a knowledge-grounded dialogue dataset. |
NOVA: An Iterative Planning Framework for Enhancing Scientific Innovation with Large Language Models (2025.findings-acl)
Copied to clipboard
Xiang Hu, Hongyu Fu, Jinge Wang, Yifeng Wang, Zhikun Li, Renjun Xu, Yu Lu, Yaochu Jin, Lili Pan, Zhenzhong Lan
| Challenge: | Existing approaches to generate research ideas rely on retrieval or prompt engineering to generate ideas. |
| Approach: | They propose a method that uses iterative planning and search to boost creative potential of LLMs by integrating external knowledge with broader and deeper insights. |
| Outcome: | The proposed method outperforms the current state-of-the-art in generating 2.5 times more top-rated ideas based on 170 seed papers in a Swiss Tournament evaluation. |
TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models excel in general domains but lack real-world practical capabilities. |
| Approach: | They propose a benchmark for Chinese taxation practice that combines 10 traditional application tasks with 3 pioneering real-world scenarios. |
| Outcome: | The proposed benchmark combines 10 traditional tasks with 3 pioneering real-world scenarios. |
SPIDE: Serial and Parallel Intertwined Speculative Decoding (2026.findings-acl)
Copied to clipboard
Wenru Xu, Peixuan Xu, Ziqi Yang, Ming Hu, Zihui Wang, Jianzhong Qi, Rongshan Yu, Xiaoliang Fan, Cheng Wang
| Challenge: | Speculative decoding (SD) is a training-free SD framework that orchestrates dynamic alternation combining serial dynamic drafting with parallel draft verification. |
| Approach: | They propose a serial and parallel intertwined speculative DEcoding framework that orchestrates dynamic alternation combining serial dynamic drafting and parallel draft verification. |
| Outcome: | The proposed framework accelerates inference while reducing the LLM usage costs. |
COMPKE: Complex Question Answering under Knowledge Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for knowledge editing do not accurately evaluate how well models apply knowledge in real-life situations. |
| Approach: | They propose a benchmark to evaluate how well updated models apply new knowledge in real-life situations. |
| Outcome: | The proposed method achieves 39.47 accuracy on GPT-4o-mini but drops significantly to 3.83 on Qwen2.5-3B. |
Domain-Specific NER via Retrieving Correlated Samples (2022.coling-1)
Copied to clipboard
| Challenge: | Successful Named Entity Recognition models fail on texts from some special domains, for example, Chinese addresses and e-commerce titles. |
| Approach: | They propose to enhance NER models with correlated samples to help the text understanding . they draw correlated texts by the sparse BM25 retriever from large-scale in-domain unlabeled data . |
| Outcome: | Empirical results show that NER models can be enhanced with correlated samples . the proposed model can be used to reason out the correct answer on hard cases . |
ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development (2025.acl-demo)
Copied to clipboard
Zhenran Xu, Yangxue Yangxue, Yiyu Wang, Qingli Hu, Zijiao Wu, Baotian Hu, Longyue Wang, Weihua Luo, Kaifu Zhang
| Challenge: | ComfyUI-Copilot is a large language model-powered plugin for AI-driven art creation. |
| Approach: | They propose a large language model-powered plugin to enhance the usability of ComfyUI. |
| Outcome: | The new plugin improves the usability and efficiency of ComfyUI . it offers intelligent node and model recommendations and automated one-click workflow construction. |
MELA: Multilingual Evaluation of Linguistic Acceptability (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks on linguistic acceptability have been used to evaluate language models' ability to distinguish between acceptable and unacceptable sentences. |
| Approach: | They present the largest benchmark to date on linguistic acceptability: MELA . they establish LLM baselines on this benchmark and investigate cross-lingual transfer in acceptability judgements with XLM-R. |
| Outcome: | The proposed model outperforms open-source models on cross-lingual transfer in acceptability judgements. |
Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods (2026.acl-long)
Copied to clipboard
Chenfei Liao, Wensong Wang, Zichen Wen, Xu Zheng, Yiyu Wang, Haocong He, Yuanhuiyi Lyu, Lutao Jiang, Xin Zou, Yuqian Fu, Bin Ren, Linfeng Zhang, Xuming Hu
| Challenge: | Recent efforts to accelerate inference in Multimodal Large Language Models have focused on visual token compression. |
| Approach: | They propose a framework that leverages downsampling as a discriminator to denoise existing benchmarks. |
| Outcome: | The proposed evaluation framework leverages downsampling as a discriminator to denoise existing benchmarks. |
Neural Response Generation with Meta-words (P19-1)
Copied to clipboard
| Challenge: | Experimental results show that meta-words can be used to generate open domain dialogues . human-machine conversation is a fundamental problem in NLP . |
| Approach: | They propose a goal-tracking memory network that formalizes meta-word expression as a target in response generation and manages the generation process with a state memory panel and a controller. |
| Outcome: | The proposed model outperforms state-of-the-art generation models in response relevance, response diversity, and accuracy. |
Knowledge-Enriched Natural Language Generation (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Knowledge-enriched text generation poses unique challenges in modeling and learning . a roadmap will outline the state-of-the-art methods to tackle these challenges . |
| Approach: | They propose a roadmap to tackle the challenges of knowledge-enriched text generation . they will dive deep into various technical components to illustrate how to represent knowledge . |
| Outcome: | This tutorial outlines the state-of-the-art methods to tackle the problem . it aims to show how to represent knowledge, feed knowledge into a generation model, evaluate results . |
Simple but Effective Compound Geometric Operations for Temporal Knowledge Graph Completion (2024.acl-long)
Copied to clipboard
Rui Ying, Mengting Hu, Jianfeng Wu, Yalan Xie, Xiaoyi Liu, Zhunheng Wang, Ming Jiang, Hang Gao, Linlin Zhang, Renhong Cheng
| Challenge: | Current methods embed factual knowledge into continuous vector space and apply geometric operations to learn potential patterns in temporal knowledge graphs. |
| Approach: | They propose a temporal knowledge graph completion method that uses two geometric operations to learn missing facts in temporal graphs. |
| Outcome: | The proposed method significantly outperforms existing temporal knowledge graph embedding models. |
Continual Event Extraction with Semantic Confusion Rectification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on continual event extraction to extract incessantly emerging information . the semantic confusion on event types stems from the annotations of the same text being updated over time . |
| Approach: | They propose a continual event extraction model with semantic confusion rectification to reduce semantic confusion. |
| Outcome: | The proposed model outperforms state-of-the-art models and is proficient in imbalanced datasets. |
HEALing Entropy Collapse: Enhancing Exploration in Few-Shot RLVR via Hybrid-Domain Entropy Dynamics Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for training reasoning-oriented large language models assume high-resource settings with abundant data. |
| Approach: | They propose a framework that integrates high-value general-domain data to promote more diverse exploration. |
| Outcome: | The proposed framework matches or surpasses RLVR trained with 32 target-domain samples using 32 target domain samples. |
RealBench: A Chinese Multi-image Understanding Benchmark Close to Real-world Scenarios (2025.findings-emnlp)
Copied to clipboard
Fei Zhao, Chengqiang Lu, Yufan Shen, Qimeng Wang, Yicheng Qian, Haoxin Zhang, Yan Gao, null Yiwu, Yao Hu, Zhen Wu, Shangyu Xing, Xinyu Dai
| Challenge: | RealBench is the first Chinese multimodal multi-image dataset . the dataset contains 9393 samples and 69910 images . |
| Approach: | They propose to create a Chinese multimodal multi-image dataset using 21 models . they use closed-source models that support multi-inputs as well as open-source visual and video models a . |
| Outcome: | The first Chinese multimodal multi-image dataset contains 9393 samples and 69910 images. |
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yuxuan Gu, Yangfan Ye, Liang Zhao, Weihong Zhong, Baoxin Wang, Dayong Wu, Guoping Hu, Lingpeng Kong, Tong Xiao, Ting Liu, Bing Qin
| Challenge: | Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage. |
| Approach: | They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
| Outcome: | The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token. |
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)
Copied to clipboard
Kangan Qian, Sicong Jiang, Yang Zhong, Ziang Luo, Zilin Huang, Tianze Zhu, Kun Jiang, Mengmeng Yang, Zheng Fu, Jinyu Miao, Yining Shi, He Zhe Lim, Li Liu, Tianbao Zhou, Hongyi Wang, Huang Yu, Yifei Hu, Guang Li, Guang Chen, Hao Ye, Lijun Sun, Diange Yang
| Challenge: | Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. |
| Approach: | AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks. |
| Outcome: | Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% . |
Dynamic Rewarding with Prompt Optimization Enables Tuning-free Self-Alignment of Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Empirical evaluations on eight recent LLMs reveal that DRPO significantly enhances alignment performance, enabling base models to outperform their SFT/RLHF-tuned counterparts. |
| Approach: | They propose a tuning-free approach to self-alignment called Dynamic Rewarding with Prompt Optimization (DRPO) it leverages a dynamic rewarding mechanism to identify and rectify alignment weaknesses . |
| Outcome: | The proposed approach outperforms existing methods and is highly adaptable to various alignment challenges. |
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)
Copied to clipboard
Wenhao Liu, Zhenyi Lu, Xinyu Hu, Jerry Zhang, Dailin Li, Jiacheng Cen, Huilin Cao, Haiteng Wang, Yuhan Li, Xie Kun, Dandan Li, Pei Zhang, Chengbo Zhang, Yuxiang Ren, Xiaohong Huang, Yan Ma
| Challenge: | Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation. |
| Approach: | They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset. |
| Outcome: | The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations. |
PEPE: Long-context Extension for Large Language Models via Periodic Extrapolation Positional Encodings (2025.findings-emnlp)
Copied to clipboard
Jikun Hu, Dongsheng Guo, Yuli Liu, Qingyao Ai, Lixuan Wang, Xuebing Sun, Qilei Zhang, Quan Zhou, Cheng Luo
| Challenge: | Long-context extension attempts to extend contextual window in pre-trained LLMs . primary method involves expanding initial positional encodings, disrupting positional learning . |
| Approach: | They propose a new extension strategy based on Rotary Position Embedding to extend contextual window in pre-trained large language models. |
| Outcome: | The proposed method can extend the contextual window in pre-trained large language models . expansion disrupts positional encodings learned during pre-training, authors show . |
Beyond Embeddings: The Promise of Visual Table in Visual Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Visual representation learning has been a cornerstone in computer vision for decades. |
| Approach: | They propose a visual representation tailored for visual reasoning that provides instance-level world knowledge and detailed attributes that are essential for visual reason. |
| Outcome: | The proposed visual tables outperform existing models on 11 visual reasoning benchmarks. |
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps (2020.acl-main)
Copied to clipboard
| Challenge: | Existing state-of-the-art VLN agents do not generalize well for long navigation tasks. |
| Approach: | They propose a VLN agent that is learned to navigate by decomposing long instructions into shorter ones and completing them sequentially. |
| Outcome: | The proposed agent can follow long instructions better than existing ones, but it does not generalize well. |
Visually-Guided Policy Optimization for Multimodal Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RLVRs lack visual faithfulness due to text-dominated reasoning . a novel framework to reinforce visual focus during policy optimization is proposed . |
| Approach: | They propose a framework to reinforce visual focus during policy optimization using visual attention compensation mechanism. |
| Outcome: | The proposed framework exhibits better visual activation and superior performance in multimodal reasoning and visual-dependent tasks. |
Multi-matrix Factorization Attention (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing variants for Multi-Head Attention (MHA) fail to maintain strong performance under stringent Key-Value cache (KV cache) constraints. |
| Approach: | They propose to use multi-matrix factorization attention and MFA-Key-reuse attention architectures to increase model capacity under tight KV cache constraints. |
| Outcome: | The proposed architecture outperforms existing methods while reducing KV cache usage by 56% and 93.7% in large-scale experiments. |
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models (2023.emnlp-main)
Copied to clipboard
Zhiqiang Hu, Lei Wang, Yihuai Lan, Wanyu Xu, Ee-Peng Lim, Lidong Bing, Xing Xu, Soujanya Poria, Roy Lee
| Challenge: | Large language models (LLMs) have shown unprecedented performance across various tasks. |
| Approach: | They propose an easy-to-use framework that integrates adapters into LLMs . they evaluate adapters on 14 datasets from two different reasoning tasks . |
| Outcome: | The proposed framework can be used to fine-tune open-access language models with task-specific data and instruction data. |
CharBERT: Character-aware Pre-trained Language Model (2020.coling-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) construct word representations at subword level with Byte-Pair Encoding (BPE) or its variations . but these methods split a word into subword units and make it incomplete and fragile . |
| Approach: | They propose a character-aware pre-trained language model to tackle OOV problems . they construct contextual word embedding for each token from sequential character representations . |
| Outcome: | The proposed model improves on the existing models on multiple NLP benchmarks. |
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Zhen Zhang, Xinyu Wang, Yong Jiang, Zile Qiao, Zhuo Chen, Guangyu Li, Feiteng Mu, Mengting Hu, Pengjun Xie, Fei Huang
| Challenge: | Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question . |
| Approach: | They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance . |
| Outcome: | The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered . |
Enhancing Event Causality Identification with LLM Knowledge and Concept-Level Event Relations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to identify causal relationships between events often overlook the dependencies between similar events. |
| Approach: | They propose an ECI method enhanced by LLM Knowledge and Concept-Level Event Relations (LKCER) the method constructs a conceptual-level heterogeneous event graph by leveraging local contextual information of related event mentions. |
| Outcome: | The proposed method outperforms previous state-of-the-art methods on both benchmarks, EventStoryLine and Causal-TimeBank. |
StreamMeCo: Long-Term Agent Memory Compression for Efficient Streaming Video Understanding (2026.findings-acl)
Copied to clipboard
Junxi Wang, Te Sun, Jiayi Zhu, Junxian Li, Haowen Xu, Zichen Wen, Xuming Hu, Zhiyu li, Linfeng Zhang
| Challenge: | StreamMeCo is an efficient Stream Agent Memory Compression framework for video understanding. |
| Approach: | They propose an efficient Stream Agent Memory Compression framework that evicts redundant memory nodes and introduces a time-decay memory retrieval mechanism to mitigate performance degradation. |
| Outcome: | The proposed framework achieves 1.87 speedup in memory retrieval while delivering an average accuracy improvement of 1.0% on three challenging benchmark datasets. |
Training Language Models to Generate Text with Citations via Fine-grained Rewards (2024.acl-long)
Copied to clipboard
| Challenge: | Recent Large Language Models (LLMs) are prone to hallucination and their outputs often contain incorrect or unverifiable claims. |
| Approach: | They propose a training framework using fine-grained rewards to teach LLMs to generate highly supportive and relevant citations while ensuring the correctness of their responses. |
| Outcome: | The proposed training framework outperforms existing methods on QA datasets and surpasses GPT-3.5-turbo on LLaMA-2-7B. |
Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Achieving consistent high-quality machine translation across diverse domains remains a challenge due to limited and imbalanced parallel training data available in various domains. |
| Approach: | They propose a domain Chain of Thought technique that uses the multi-domain intelligence of LLMs to improve translation performance. |
| Outcome: | The proposed method achieves significant improvements in translation accuracy and domain robustness over traditional fine-tuning on a small dataset of four domains. |
TRUST: Towards Robust Social Bot Detection via Uncertainty-Guided Pseudo-Labeling and Graph Structure Purification (2026.findings-acl)
Copied to clipboard
Ruixuan Xu, Mengting Hu, Zhunheng Wang, Ming Jiang, Rui Ying, Zhen Zhang, Hang Gao, Shuaipeng Liu, Renhong Cheng
| Challenge: | Existing graph-based detection models are vulnerable to deceptive message propagation, where bots deliberately interact with legitimate users. |
| Approach: | They propose a framework to mitigate deceptive message propagation by node-level uncertainty estimation and graph structure purification. |
| Outcome: | The proposed framework improves on three benchmark datasets and six GNN backbones on real-world social bots. |
LLM Agents for Education: Advances and Applications (2025.findings-emnlp)
Copied to clipboard
Zhendong Chu, Shen Wang, Jian Xie, Tinghui Zhu, Yibo Yan, Jingheng Ye, Aoxiao Zhong, Xuming Hu, Jing Liang, Philip S. Yu, Qingsong Wen
| Challenge: | Large Language Model (LLM) agents are transforming education by automating complex tasks and enhancing both teaching and learning processes. |
| Approach: | This survey analyzes recent advances in applying Large Language Model agents to educational settings . it highlights ethical issues, hallucination and overreliance, and integration with existing ecosystems . |
| Outcome: | The authors analyze the technologies enabling LLM agents and highlight key challenges in deploying them in educational settings. |
Structured Episodic Event Memory (2026.acl-long)
Copied to clipboard
| Challenge: | Current approaches to memory in Large Language Models (LLMs) rely on static Retrieval-Augmented Generation (RAG) this lacks the cognitive organization necessary to model the dynamic and associative nature of long-term interaction. |
| Approach: | They propose a hierarchical framework that transforms interaction streams into structured Episodic Event Frames (EEFs) anchored by precise provenance pointers. |
| Outcome: | The proposed framework outperforms baseline approaches on LoCoMo and LongMemEval benchmarks. |
Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Models (2026.acl-long)
Copied to clipboard
Wei Wu, Liyi Chen, Congxi Xiao, Tianfu Wang, Qimeng Wang, Chengqiang Lu, Yan Gao, null Yiwu, Yao Hu, Hui Xiong
| Challenge: | Existing efficient reasoning methods rely on explicit length penalties for excessive verbosity on simple queries. |
| Approach: | They propose a training-time intervention that selectively suppresses redundant tokens . they find length shift occurs when models generate unnecessary reasoning on trivial inputs - a phenomenon that is often unexplored . |
| Outcome: | The proposed method reduces inference token usage by 78% while increasing accuracy compared to the initial policy and surpasses state-of-the-art efficient reasoning methods. |
Leibniz: Theory-of-Mind Driven Neuro-Symbolic Logical Reasoning via Multi-Agent Collaboration (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for logical reasoning with large language models suffer from insufficient rule semantic grounding and weak rule application mechanisms. |
| Approach: | They propose a theory-of-mind driven neuro-symbolic reasoning framework that integrates natural language and symbolic representations throughout the reasoning process. |
| Outcome: | The proposed model surpasses state-of-the-art models in reasoning accuracy and flexibility. |
Revisiting Entropy Regularization: Adaptive Coefficient Unlocks Its Potential for LLM Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Reasoning ability is a defining capability of Large Language Models (LLMs), but RLVR training suffers from policy entropy collapse, hindering exploration and limiting reasoning performance. |
| Approach: | They propose a framework that dynamically balances exploration and exploitation via three components: difficulty-aware coefficient allocation, initial-anchored target entropy, and dynamic global coefficient adjustment. |
| Outcome: | The proposed framework outperforms baselines on multiple mathematical reasoning benchmarks. |
Balanced Joint Adversarial Training for Robust Intent Detection and Slot Filling (2020.coling-main)
Copied to clipboard
| Challenge: | Existing joint models for intent detection and slot filling show insufficient robustness . however, some small changes of inputs can fool the models to produce wrong predictions . |
| Approach: | They propose a joint adversarial training model that generates adversarials to attack the joint model and trains the model to defend against the adversarial examples. |
| Outcome: | The proposed model achieves significantly higher scores and improves robustness on two datasets. |
Automatic Article Commenting: the Task and Dataset (P18-2)
Copied to clipboard
| Challenge: | Existing methods to make comments on articles are based on human-annotated subsets, but they are not suitable for online forums. |
| Approach: | They propose to use a large-scale Chinese corpus with millions of real comments and a human-annotated subset characterizing the comments’ varying quality to generalize a broad set of popular reference-based metrics. |
| Outcome: | The proposed model incorporates human-annotated subset characterizing the comments’ varying quality and shows that it is more accurate than previous models. |
Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses (2026.acl-long)
Copied to clipboard
Chongyuan Dai, Yaling Shen, Zihan Gao, Jia Li, Yishun Jiang, Yaxiong Wang, Liu Liu, Zongyuan Ge, Jinpeng Hu
| Challenge: | Culture is a fundamental determinant of human affective processing and affective perceptions are often limited by declarative knowledge or established societal customs. |
| Approach: | They propose a multimodal benchmark that leverages LLM-generated provisional labels to isolate cross-cultural emotional distinctions. |
| Outcome: | The proposed benchmark captures cross-cultural emotional distinctions and derives reliable ground-truth annotations through human evaluation. |
SAFER: A Controllable Safeguard for LLMs against Backdoor Attacks (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing inference-time defenses lack explicit control over false acceptance rate (FAR) existing inference time defenses aim to mitigate poisoned inputs but lack explicit FAR control . |
| Approach: | They propose a framework that provides explicit control over false acceptance rate without prior knowledge of backdoor samples. |
| Outcome: | The proposed framework outperforms existing inference-time defenses on three benchmark datasets . it provides explicit and provable control over false acceptance rate without prior knowledge of backdoor samples . |
SudokuFill: A Multi-Agent Progressive Filling Framework for Document-Level Scientific Information Extraction (2026.findings-acl)
Copied to clipboard
Yang Li, Yajiao Wang, Yu Zhang, Yuanzhe Zhang, Maodi Hu, Mengting Zhang, Xi Sun, Hua Yue, Zhixiong Zhang
| Challenge: | Scientific information extraction (SciIE) is a key bottleneck for turning unstructured papers into computable knowledge bases. |
| Approach: | They propose a scientific information extraction framework that solves a Sudoku problem as a progressive filling problem. |
| Outcome: | The proposed framework outperforms the GPT-4o model on a document-level adjuvant dataset. |
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)
Copied to clipboard
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, Zhenzhong Lan
| Challenge: | Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages . |
| Approach: | They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models . |
| Outcome: | The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English . |
Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference (2020.emnlp-main)
Copied to clipboard
Bang An, Jie Lyu, Zhenyi Wang, Chunyuan Li, Changwei Hu, Fei Tan, Ruiyi Zhang, Yifan Hu, Changyou Chen
| Challenge: | Existing studies show that multi-head attention is an effective module in deep neural networks, but there are no explicit mechanisms guaranteeing this property. |
| Approach: | They propose a non-parametric approach that explicitly improves the repulsiveness in multi-head attention and consequently strengthens model’s expressiveness. |
| Outcome: | The proposed approach improves the repulsiveness in multi-head attention and strengthens model’s expressiveness. |
ChatSOP: An SOP-Guided MCTS Planning Framework for Controllable LLM Dialogue Agents (2025.acl-long)
Copied to clipboard
Zhigen Li, Jianxiang Peng, Yanmeng Wang, Yong Cao, Tianhao Shen, Minghui Zhang, Linxi Su, Shang Wu, Yihang Wu, YuQian Wang, Ye Wang, Wei Hu, Jianfeng Li, Shaojun Wang, Jing Xiao, Deyi Xiong
| Challenge: | Existing models that use Large Language Models (LLMs) show superior performance in various tasks, but lack of controllability leads to unfocused conversations or task failure. |
| Approach: | They propose a standard operating procedure (SOP) framework to regulate dialogue flow by integrating Chain of Thought reasoning and supervised fine-tuning for SOP prediction. |
| Outcome: | The proposed method achieves a 27.95% improvement in action accuracy compared to baseline models based on GPT-3.5 and also shows notable gains for open-source models. |
Multimodal Invariant Sentiment Representation Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for multimodal sensing ignore significant sentiment distribution imbalances and cross-modal sentiment conflicts, hindering performance improvement. |
| Approach: | They propose a method to learn stable multimodal invariant sentiment representations by incorporating distributional discrepancies and sentiment conflicts into the model training. |
| Outcome: | The proposed method improves MSA performance and achieves new state-of-the-art. |
BanditMTL: Bandit-based Multi-task Learning for Text Classification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to regularize task variance are unexplored in multi-task text classification. |
| Approach: | They propose a multi-task learning method based on adversarial multi-armed bandit to regularize the task variance by means of a mirror gradient ascent-descent algorithm. |
| Outcome: | The proposed method achieves state-of-the-art in multi-task text classification. |
Fine-Grained Data Ordering Improves Fine-Tuning for Large Language Models (2026.findings-acl)
Copied to clipboard
Xiaomeng Hu, Yixuan Tang, Haoze Li, Hao Chen, Qi Zhang, Zhanming Shen, Yiming Zhang, Haobo Wang, Junbo Zhao
| Challenge: | Prior work focused on data preprocessing, focusing on filtering and cleaning data . a study aimed to improve fine-grained scheduling of data order in epochs . |
| Approach: | They propose a fine-grained scheduling method of data order in epochs to fill this gap . they define data difficulty based on relevance between data and model . |
| Outcome: | The proposed method improves on pre-training and small-scale fine-tuning experiments 2.4% over baselines. |
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard. |
| Approach: | They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system. |
| Outcome: | The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De. |
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)
Copied to clipboard
Yingxuan Yang, Bo Huang, Siyuan Qi, Chao Feng, Haoyi Hu, Yuxuan Zhu, Jinbo Hu, Haoran Zhao, Ziyi He, Xiao Liu, ZongYu Wang, Muning Wen, Lin Qiu, Xuezhi Cao, Xunliang Cai, Yong Yu, Weinan Zhang
| Challenge: | Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions? |
| Approach: | They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values. |
| Outcome: | The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure. |
RankNAS: Efficient Neural Architecture Search by Pairwise Ranking (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods require training millions of architectures to estimate the accuracy of the search results. |
| Approach: | They propose a performance ranking method (RankNAS) that uses pairwise ranking and search space pruning to enlarge the search space. |
| Outcome: | The proposed method significantly accelerates NAS through pairwise ranking and search space pruning. |
FaithLM: Towards Faithful Explanations for Large Language Models (2026.eacl-long)
Copied to clipboard
Yu-Neng Chuang, Guanchu Wang, Chia-Yuan Chang, Ruixiang Tang, Shaochen Zhong, Fan Yang, Andrew Wen, Mengnan Du, Xuanting Cai, Vladimir Braverman, Xia Hu
| Challenge: | Large language models (LLMs) produce natural language explanations, but they lack faithfulness and do not reflect the evidence the model uses to decide. |
| Approach: | They propose a model-agnostic framework that evaluates and improves the faithfulness of LLM explanations without token masking or task-specific heuristics. |
| Outcome: | The proposed framework improves faithfulness of large language models without masking or heuristics. |
A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese (2026.tacl-1)
Copied to clipboard
Yikang Liu, Yeting Shen, Hongao Zhu, Lilong Xu, Zhiheng Qian, Siyuan Song, Kejia Zhang, Jialong Tang, Pei Zhang, Baosong Yang, Rui Wang, Hai Hu
| Challenge: | Using sub-linear length normalized log-probabilities (SLLN-LP), we find unequal lengths of sentences in minimal pairs difficult for LMs even up to 32B parameters. |
| Approach: | They propose to use ZhoBLiMP as a linguistic minimal pair benchmark for Chinese language models to mitigate biases. |
| Outcome: | The proposed metric mitigates biases in Chinese language models with over 100 paradigms . Anaphor, Quantifiers, and Ellipsis are difficult for LMs even up to 32B parameters . |
Suggest-Verify-Revise: A Three-Stage Document-Level Event Causality Identification with Narrative Consistency (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document-level Event Causality Identification rely on local semantic similarity for independent event-pair discrimination . Existing approaches ignore the influence of the overall narrative backbone in the propagation of causal dependencies and the role differentiation of events within multi-cause/multi-effect structures. |
| Approach: | They propose a suggest-verify-revise approach for document-level Event Causality Identification with narrative consistency (SVRECI) they integrate heuristic causal suggestions generated by an LLM with structural suggestions derived from hypergraph modeling . |
| Outcome: | The proposed approach outperforms existing methods on event-storylines and Causal-TimeBank datasets. |
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence (2024.findings-acl)
Copied to clipboard
| Challenge: | Emotional Intelligence (EI) is a key concept in the field of human intelligence. |
| Approach: | They propose a method to enhance EI of large language models by naive fine-tuning on EI-related tasks. |
| Outcome: | The proposed method improves EI of two LLM-based assistants without compromising GI. |
Extracting Financial Events from Raw Texts via Matrix Chunking (2024.lrec-main)
Copied to clipboard
| Challenge: | Event Extraction (EE) is widely used in the Chinese financial field to provide valuable structured information. |
| Approach: | They propose a task which extracts financial events from raw texts and an efficient method called MACK. |
| Outcome: | The proposed method is fault-tolerant and can visualize interactions among text components. |
Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios (2025.emnlp-main)
Copied to clipboard
Yunkai Dang, Mengxi Gao, Yibo Yan, Xin Zou, Yanggan Gu, Jungang Li, Jingyu Wang, Peijie Jiang, Aiwei Liu, Jia Liu, Xuming Hu
| Challenge: | Existing studies have focused mainly on visual–textual misalignment, leaving largely unexplored the MLLMs’ ability to preserve an original correct answer when confronted with misleading information. |
| Approach: | They propose a two-stage evaluation pipeline to quantify the response uncertainty phenomenon by eliciting each model’s original response on unperturbed inputs and injecting explicit (false-answer hints) and implicit (contextual contradictions) misleading instructions. |
| Outcome: | The proposed model overturns a correct answer in 65% of cases after receiving a single deceptive cue. |
MovieUN: A Dataset for Movie Understanding and Narrating (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Automatic movie narration generation and narration grounding are important to provide a true movie experience for the blind and visually impaired. |
| Approach: | They propose to use movie clips as a benchmark to support automatic movie narration generation and narration grounding tasks. |
| Outcome: | The proposed methods are effective in supporting two movie-based tasks for the blind and visually impaired. |
SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment (2025.findings-emnlp)
Copied to clipboard
Yuqing Huang, Rongyang Zhang, Qimeng Wang, Chengqiang Lu, Yan Gao, null Yiwu, Yao Hu, Xuyang Zhi, Guiquan Liu, Xin Li, Hao Wang, Enhong Chen
| Challenge: | Existing solutions for supervised fine-tuning often lead to catastrophic forgetting, where models lose their previously acquired knowledge and general capabilities. |
| Approach: | They propose a self-distribution alignment method that aligns input sequence logits to preserve the model’s semantic distribution, thereby mitigating catastrophic forgetting and improving downstream performance. |
| Outcome: | The proposed method achieves a superior balance between downstream learning and general capability retention. |
RaaS: Reasoning-Aware Attention Sparsity for Efficient LLM Reasoning (2025.findings-acl)
Copied to clipboard
Junhao Hu, Wenrui Huang, Weidong Wang, Zhenwen Li, Tiancheng Hu, Zhixia Liu, Xusheng Chen, Tao Xie, Yizhou Shan
| Challenge: | Large Language Models (LLMs) have demonstrated strong capabilities across various domains, but their large-scale deployment faces a major obstacle: the high computational cost of long-sequence inference. |
| Approach: | They propose an algorithm that retains key-value vectors until they are no longer needed to solve reasoning tasks. |
| Outcome: | The proposed algorithm achieves high accuracy with O(L) time but O(N) memory complexities. |
IFlyLegal: A Chinese Legal System for Consultation, Law Searching, and Document Analysis (D19-3)
Copied to clipboard
| Challenge: | Legal Tech is a system that performs legal consulting, multi-way law searching, and legal document analysis using deep contextual representations and various attention mechanisms. |
| Approach: | They propose a Chinese legal system that performs legal consulting, multi-way law searching, and legal document analysis using deep contextual representations and various attention mechanisms. |
| Outcome: | The proposed system performs legal consulting, multi-way law searching, and legal document analysis by exploiting techniques such as deep contextual representations and various attention mechanisms. |
Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has shown that structural supervision helps English language models learn generalizations about syntactic phenomena such as subject-verb agreement. |
| Approach: | They train LSTMs, Recurrent Neural Network Grammars, Transformer language models, and Transformer-parameterized generative parsing models on Mandarin Chinese datasets. |
| Outcome: | The proposed models learn aspects of Mandarin Chinese grammar that assess syntactic and semantic relationships. |
Exploring Multimodal Challenges in Toxic Chinese Detection: Taxonomy, Benchmark, and Findings (2025.findings-acl)
Copied to clipboard
Shujian Yang, Shiyao Cui, Chuanrui Hu, Haicheng Wang, Tianwei Zhang, Minlie Huang, Jialiang Lu, Han Qiu
| Challenge: | Recent studies show that character substitutions in toxic Chinese text can confuse state-of-the-art LLMs. |
| Approach: | They propose a taxonomy of 3 perturbation strategies and 8 specific approaches in Chinese text to assess if they can detect perturbed Chinese toxic contents. |
| Outcome: | The proposed model can detect perturbed Chinese text with 8 different approaches . the proposed model is compared with 9 other LLMs from the US and China . |
Beyond One-Size-Fits-All: Tailored Benchmarks for Efficient Evaluation (2025.acl-long)
Copied to clipboard
Peiwen Yuan, Yueqi Zhang, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Jiayi Shi, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Existing efficient methods estimate performance of models on large benchmarks, but these methods rely on the assumption that target models have high prediction consistency with source models. |
| Approach: | They propose a method that conducts customized evaluation tailored to each target model. |
| Outcome: | The proposed method reduces the MAE of estimates by 31.4% on benchmarks across 300 models. |
LitVISTA: A Benchmark for Narrative Orchestration in Literary Text (2026.acl-long)
Copied to clipboard
Mingzhe Lu, Yiwen Wang, Yanbing Liu, Qi You, Chong Liu, Ruize Qin, Haoyu Dong, Wenyu Zhang, JiaRui Zhang, Yue Hu, Yunpeng Li
| Challenge: | Existing large language models focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives. |
| Approach: | They propose a high-dimensional framework for narrative orchestration that unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. |
| Outcome: | The proposed framework unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. |
Dataset for the First Evaluation on Chinese Machine Reading Comprehension (L18-1)
Copied to clipboard
| Challenge: | Existing reading comprehension datasets are mostly in English . |
| Approach: | They propose a Chinese reading comprehension dataset to add diversity to existing reading comprehension data . proposed dataset contains cloze-style reading comprehension and user query reading comprehension . |
| Outcome: | The proposed dataset is based on a Chinese reading comprehension dataset . it includes two types of cloze-style and user query reading comprehension . the proposed dataset hosted the 1st Evaluation on Chinese Machine Reading Comprehension (CMRC-2017) |
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models (2024.findings-emnlp)
Copied to clipboard
Bolei Ma, Xinpeng Wang, Tiancheng Hu, Anna-Carolina Haensch, Michael Hedderich, Barbara Plank, Frauke Kreuter
| Challenge: | Recent advances in Large Language Models have sparked interest in validating human-like cognitive-behavioral traits. |
| Approach: | They examine whether LLM outputs reflect human-like cognitive-behavioral traits . they find that measuring AOVs embedded within LLMs remains opaque . |
| Outcome: | The proposed model can be used to evaluate human-like cognitive-behavioral traits . the proposed model could be used in writing assistants and other applications . |
MultiPL-MoE: Multi-Programming-Lingual Extension of Large Language Models through Hybrid Mixture-of-Experts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MultiPL is a special case of multiple natural languages and requires limited computational resources to generate multilingual code. |
| Approach: | They propose to extend LLMs by combining two paired experts to optimize expert selection at token and segment levels. |
| Outcome: | The proposed extension improves the performance of the base LLMs while retaining the most popular ones using limited computational resources. |
MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning (2026.acl-long)
Copied to clipboard
Weikang Shi, Aldrich Yu, Rongyao Fang, Houxing Ren, Ke Wang, Aojun Zhou, Changyao Tian, Xinyu Fu, Yuxuan Hu, Zimu Lu, Linjiang Huang, Si Liu, Rui Liu, Hongsheng Li
| Challenge: | Existing approaches to visual chain-of-thought are limited by external tools or fail to generate high-fidelity diagrams. |
| Approach: | They propose a framework to enable large multimodal models with VCoT capabilities . they pre-train a model on a 15.2M-pair corpus and teach it how to leverage visual aids . |
| Outcome: | The proposed framework unlocks complex, human-like visual reasoning in large language models . it pre-trains the model on a 15.2M-pair corpus and fine-tunes it on MathCanvas-Instruct . |
Neural Topic Modeling by Incorporating Document Relationship Graph (2020.emnlp-main)
Copied to clipboard
| Challenge: | Graph Topic Models (GNNs) capture relationships between graph nodes via message passing . recent research has focused on topic modeling using latent Dirichlet Allocation . |
| Approach: | They propose a Graph Topic Model (GTM) that captures relationships between graph nodes via message passing. |
| Outcome: | The proposed model captures the relationships between nodes via message passing . the results demonstrate that the proposed model is effective in generating documents . |
Reasoning with Ontology Graph: Toward Type-Constrained Knowledge Graph Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing knowledge graph question answering methods rely on LLM-induced type systems with inconsistent granularity or perform multi-hop reasoning without explicit target-type constraints. |
| Approach: | They propose a type-constrained knowledge graph question answering framework that reasons over a relation-centric ontology graph. |
| Outcome: | The proposed framework achieves state-of-the-art and produces ontology-grounded reasoning chains with substantial Hit@1 gains. |
ChemNER: Fine-Grained Chemistry Named Entity Recognition with Ontology-Guided Distant Supervision (2021.emnlp-main)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a fundamental step in scientific literature analysis to build AI-driven systems for molecular discovery, synthetic strategy designing, and manufacturing. |
| Approach: | They propose an ontology-guided method for fine-grained named entity recognition (NER) it leverages the chemistry type ontologies to generate distant labels with flexible KB-matching . |
| Outcome: | The proposed method significantly outperforms the state-of-the-art methods with a .25 absolute F1 improvement. |
Federated Model Decomposition with Private Vocabulary for Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to train federated learning (FL) for natural language processing require sensitive data to leave local devices. |
| Approach: | They propose a fedrated model decomposition method that protects the privacy of vocabularies . they propose an adaptive updating technique to improve the performance of local models . |
| Outcome: | The proposed method protects the privacy of vocabularies in federated learning tasks . it maintains competitive performance and provides better privacy-preserving capacity compared to status quo methods. |
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Using cloze-style reading comprehension, Chinese machine reading comprehension datasets are becoming more and more popular . a new task is proposed to fill the right candidate sentence into the passage with several blanks . |
| Approach: | They propose a Chinese task to fill the right candidate sentence into a passage with blanks . they build a dataset to evaluate the difficulty of the task and make fake candidates . |
| Outcome: | The proposed task fills the right candidate sentence into the passage with blanks . the proposed dataset contains over 100K blanks within over 10K passages based on Chinese narrative stories . |
CODEMENV: Benchmarking Large Language Models on Code Migration (2025.findings-acl)
Copied to clipboard
Keyuan Cheng, Xudong Shen, Yihao Yang, TengyueWang TengyueWang, Yang Cao, Muhammad Asif Ali, Hanbin Wang, Lijie Hu, Di Wang
| Challenge: | Large language models (LLMs) have demonstrated remarkable proficiency in handling a wide range of tasks within the software engineering domain, but their ability to perform code migration—adapting code to different environments—remains underexplored. |
| Approach: | They propose a benchmark to evaluate large language models’ performance in handling code migration tasks. |
| Outcome: | The proposed benchmark comprises 922 data points across 19 Python and Java packages and offers three tasks to systematically evaluate code migration: identifying version-incompatible functions, determining function changes, and adapting code to target environments. |
Ensembling Prompting Strategies for Zero-Shot Hierarchical Text Classification with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification is a challenging task in natural language processing. |
| Approach: | They propose a method which integrates the results of diverse prompting strategies to promote LLMs’ reliability. |
| Outcome: | The proposed method boosts the performance of single prompting strategies and achieves SOTA results on three benchmark datasets. |
Improving Knowledge Graph Completion with Structure-Aware Supervised Contrastive Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing contrastive methods focus on individual triples, overlooking the broader structural connectivities and topologies of KGs. |
| Approach: | They propose a new contrastive learning framework that incorporates four tasks specifically tailored to KG data: Vertex-level CL, Neighbor-level Cl, Path-levelCL, and Relation composition level CL. |
| Outcome: | The proposed framework achieves SOTA performance under standard supervised and low-resource settings. |
LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay (2024.emnlp-main)
Copied to clipboard
Yihuai Lan, Zhiqiang Hu, Lei Wang, Yang Wang, Deheng Ye, Peilin Zhao, Ee-Peng Lim, Hui Xiong, Hao Wang
| Challenge: | Existing studies on LLM agents' social behaviors are lacking . previous studies focused on positive social behaviors, leaving research on negative social behaviors relatively scarce. |
| Approach: | They propose a framework that features a multi-agent system facilitating efficient communication and interaction with LLM agents. |
| Outcome: | The proposed framework is based on Avalon and evaluates on game success and analyzes agents’ social behaviors. |
Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to adapt Mixture-of-Experts models to multiple domains are prohibitive computation, cross-domain interference or require separate runs per domain. |
| Approach: | They propose a dynamic expert specialization framework for multi-domain adaptation of Mixture-of-Experts models. |
| Outcome: | The proposed framework reduces forgetting by 89% compared to full fine-tuning as domains scale from 2 to 6 and achieves faster convergence than conventional methods. |
On Diversified Preferences of Large Language Model Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) can be fine tuned with human feedback, but human preferences can be diversified due to annotators’ different tastes, which hinders the effectiveness of LLM alignment methods. |
| Approach: | They propose a calibration error metric to evaluate large language models (LLMs) and a multi-objective reward learning method to enhance the calibration performance of RMs on shared preferences. |
| Outcome: | The proposed model can be adopted as a key calibration error and MORE can achieve superior alignment performance. |
Causal Intervention for Abstractive Related Work Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models ignore the inherent causality during related work generation, leading to spurious correlations which downgrade the models’ generation quality and generalizability. |
| Approach: | They propose a Causal Intervention Module for Related Work Generation (CaM) that captures causal relationships in related work generation and implements causal interventions to mitigate the negative impact of spurious correlations. |
| Outcome: | The proposed framework improves the quality and coherence of generated related work by capturing causalities in the generation process. |
Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs (2024.findings-acl)
Copied to clipboard
| Challenge: | Controlled Text Generation (CTG) aims to produce texts that exhibit specific desired attributes. |
| Approach: | They propose a pluggable CTG framework for Large Language Models to control text . they use attribute scorers to evaluate attributes of sentences and construct dynamic attribute graphs . |
| Outcome: | The proposed framework achieves a peak improvement of 19.29% over baseline methods in two tasks. |
Advancing Fine-Grained Visual Understanding with Multi-Scale Alignment in Multi-Modal Models (2025.emnlp-main)
Copied to clipboard
Wei Wang, Zhaowei Li, Qi Xu, Linfeng Li, YiQing Cai, Botian Jiang, Hang Song, Xingcan Hu, Pengyu Wang, Li Xiao
| Challenge: | Recent advances in multi-modal large language models have demonstrated remarkable capabilities in multimodal understanding, reasoning, and interaction. |
| Approach: | They propose a method that effectively aligns and integrates multi-scale knowledge of objects . they use a pipeline that provides over 300K essential training data to enhance alignment . |
| Outcome: | The proposed method effectively aligns and integrates multi-scale knowledge of objects, including texts, coordinates, and images. |
Exploiting Abstract Meaning Representation for Open-Domain Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work attempts to address these challenges using Pretrained Language Models (PLMs) but the diversity of surface form expressions can hinder the model’s ability to capture accurate correlations, especially when the context is lengthy and complex. |
| Approach: | They propose a method known as Graph-as-Token (GST) to incorporate AMRs into PLMs to assist the model in understanding complex semantic information. |
| Outcome: | The proposed method outperforms existing methods and significantly improves performance on both Natural Questions and TriviaQA. |
Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism (2025.findings-emnlp)
Copied to clipboard
Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu
| Challenge: | Large language models struggle with complex reasoning tasks, such as mathematical problem-solving. |
| Approach: | They constructed a symbolic multi-step reasoning task to investigate the information propagation mechanisms in Transformer models when solving the task through direct answering and Chain-of-Thought (CoT) reasoning. |
| Outcome: | The proposed algorithm improves on 7 multi-step reasoning datasets, while introducing only 132 trainable parameters. |
Diagnosing Hidden Instabilities in Model Editing via Uncertainty Quantification (2026.acl-long)
Copied to clipboard
Zihan Gu, TianYi Zhang, Xinyan Zhang, Zhiyuan Wang, Han Zhang, Yuhao Wei, Jiacheng Lu, Tianyi Ma, Xingsheng Zhang, Hua Zhang, Yue Hu
| Challenge: | Existing methods to update large language models (LLMs) without expensive retraining are fragile under single-edit evaluation protocols. |
| Approach: | They propose a framework that characterizes activation-based editing as a constrained intervention on intermediate representations. |
| Outcome: | The proposed method reveals local knowledge conflicts invisible to existing benchmarks. |
“Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for model extraction attacks on large language models are inadequate . existing methods neglect the inconsistency between training tasks and LLM alignment . |
| Approach: | They propose a model extraction algorithm that uses a policy-gradient-style training task to guide the crafting of preference for the local model. |
| Outcome: | The proposed algorithm reduces query complexity while mitigating watermark protection . it can extract various state-of-the-art commercial LLMs while minimizing query complexity . |
ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervision (2023.findings-acl)
Copied to clipboard
| Challenge: | Structured chemical reaction information is a vital tool for chemists engaged in laboratory work and advanced endeavors such as computer-aided drug design. |
| Approach: | They propose a method which utilizes frequent patterns within the text as linguistic cues to identify specific characteristics of chemical reactions. |
| Outcome: | The proposed model outperforms baselines and outperformed existing models. |
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches (2024.findings-emnlp)
Copied to clipboard
Jiayi Yuan, Hongyi Liu, Shaochen Zhong, Yu-Neng Chuang, Songchen Li, Guanchu Wang, Duy Le, Hongye Jin, Vipin Chaudhary, Zhaozhuo Xu, Zirui Liu, Xia Hu
| Challenge: | Long context capability is a crucial competency for large language models as it mitigates the human struggle to digest long-form texts. |
| Approach: | They propose to evaluate 10+ state-of-the-art approaches for long context-capable LLMs. |
| Outcome: | The proposed methods are compared against 10+ state-of-the-art approaches across seven categories of long context tasks. |
Don’t Miss the Potential Customers! Retrieving Similar Ads to Improve User Targeting (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a method for user targeting is developed to identify online users to whom an ad should be targeted. |
| Approach: | They propose a method for automatic augmentation of positive and negative clickthrough data for user targeting models. |
| Outcome: | The proposed method can increase positive and negative instances of positive training instances on two datasets. |
Dynamic Personality in LLM Agents: A Framework for Evolutionary Modeling and Behavioral Analysis in the Prisoner’s Dilemma (2025.findings-acl)
Copied to clipboard
| Challenge: | Current models rely on static personality traits but lack natural selection processes and direct psychological metrics, failing to accurately capture authentic dynamic personality variations. |
| Approach: | They propose a framework that uses game payoffs as environmental feedback to drive adaptive personality evolution and analyze correlations between personality metrics and behavior. |
| Outcome: | The proposed framework reveals new behavioral patterns of agents and evaluates personality-behavior relationships, advancing agent-based social simulations and human-AI symbiosis research. |
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing (2020.acl-demos)
Copied to clipboard
| Challenge: | Large pre-trained language models have hundreds of millions of parameters and take several gigabytes of memory to train and inference. |
| Approach: | They propose an open-source knowledge distillation toolkit designed for natural language processing that provides a set of predefined distillation methods and can be extended with custom code. |
| Outcome: | The proposed method is comparable with or even higher than the public distilled BERT models with similar numbers of parameters. |
Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization (2026.findings-acl)
Copied to clipboard
Yuxiang Ji, Yong Wang, Ziyu Ma, Yiming Hu, Hailang Huang, Xuecai Hu, Guanhua Chen, Liaoni Wu, Xiangxiang Chu
| Challenge: | Existing large vision-language model (LVLM) approaches overlook a common strategy used by humans — using maps. |
| Approach: | They propose a method to equip a vision-language model with the ability to think with maps and optimize it using agentic reinforcement learning and parallel test-time scaling. |
| Outcome: | The proposed method outperforms open- and closed-source models on most metrics. |
PsychEthicsBench: Evaluating Large Language Models Against Australian Mental Health Ethics (2026.findings-acl)
Copied to clipboard
Yaling Shen, Stephanie Fong, Yiwen Jiang, Zimu Wang, Feilong Tang, Qingyang Xu, Xiangyu Zhao, Zhongxing Xu, Jiahe Liu, Jinpeng Hu, Dominic Dwyer, Zongyuan Ge
| Challenge: | Mental disorders affect nearly one in seven people worldwide, yet the vast majority do not receive adequate care. |
| Approach: | They propose a framework to evaluate LLMs' ethical knowledge and behavioral responses through multiple-choice and open-ended tasks with fine-grained ethicality annotations. |
| Outcome: | Empirical results across 14 models reveal that refusal rates are poor indicators of ethical behavior, revealing a significant divergence between safety triggers and clinical appropriateness. |
GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to generate data using LLMs are limited by sampling from the center of original content distribution. |
| Approach: | They propose a task-agnostic data generation and knowledge distillation framework for LLMs that employs an iterative out-of-distribution-guided feedback mechanism to generate data. |
| Outcome: | The proposed framework outperforms prior arts and the LLM on 10 different classification tasks and noisey generated data. |
MedWriter: Knowledge-Aware Medical Text Generation (2020.coling-main)
Copied to clipboard
Youcheng Pan, Qingcai Chen, Weihua Peng, Xiaolong Wang, Baotian Hu, Xin Liu, Junying Chen, Wenxiu Zhou
| Challenge: | Recent studies focus on the information of unstructured text rather than structured information of the knowledge graph. |
| Approach: | They propose a knowledge-aware text generation model for medical domains that incorporates knowledge graphs into the model to improve the quality of generated text. |
| Outcome: | The proposed model improves the quality of generated text and has robust superiority over other methods. |
Does Visual Grounding Enhance the Understanding of Embodied Knowledge in Large Language Models? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Despite significant progress in multimodal language models, it remains unclear whether visual grounding enhances their understanding of embodied knowledge compared to text-only models. |
| Approach: | They propose to assess vision-language models’ perceptual abilities across different sensory modalities through vector comparison and question-answering tasks with over 1,700 questions. |
| Outcome: | The proposed benchmark assesses the models’ perceptual abilities across different sensory modalities through vector comparison and question-answering tasks with over 1,700 questions. |
Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection (2023.acl-industry)
Copied to clipboard
| Challenge: | Existing work on fake news detection does not consider the temporal shift issue caused by the rapidly-evolving nature of news data. |
| Approach: | They propose a framework to forecast temporal patterns of news data and guide detector to fast adapt to future distributions. |
| Outcome: | The proposed framework forecasts temporal distribution patterns and guides detector to fast adapt to future distribution. |
Global-to-Local Neural Networks for Document-Level Relation Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Relation extraction (RE) aims to identify the semantic relations between named entities in text. |
| Approach: | They propose a novel relation extraction model that encodes document information in terms of entity global and local representations and context relation representations. |
| Outcome: | The proposed model achieves superior performance on two public datasets for document-level RE. |
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. |
| Approach: | They propose a plan-and-solve (PS) prompting that includes a few manual steps to generate reasoning steps and improves the quality of generated reasoning steps. |
| Outcome: | The proposed strategy outperforms Zero-shot-CoT on ten reasoning problems and has comparable performance to 8-shot CoT prompting on the math reasoning problem. |
Multimodal Dialogue Response Generation (2022.acl-long)
Copied to clipboard
Qingfeng Sun, Yujing Wang, Can Xu, Kai Zheng, Yaming Yang, Huang Hu, Fei Xu, Jessica Zhang, Xiubo Geng, Daxin Jiang
| Challenge: | Existing studies focus on multimodal dialogue models but neglect generation methods. |
| Approach: | They propose a multimodal dialogue response generation task which requires multimodal dialogs containing both texts and images which are difficult to obtain. |
| Outcome: | Experiments show that the proposed model can generate informative text and high-resolution image responses. |
Cautious Next Token Prediction (2025.findings-acl)
Copied to clipboard
Yizhou Wang, Lingzhi Zhang, Yue Bai, Mang Tik Chiu, Zhengmian Hu, Mingyuan Zhang, Qihua Dong, Yu Yin, Sohrab Amirghodsi, Yun Fu
| Challenge: | Existing methods for decoding autoregressive models are temperature scaling and nucleus sampling to balance diversity and coherence. |
| Approach: | They propose a training-free decoding strategy that uses a model with a low perplexity score to select the trial with the lowest perplexities as the most probable and reliable path. |
| Outcome: | The proposed approach outperforms existing standard decoding strategies consistently by a clear margin. |
CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databases (2025.naacl-long)
Copied to clipboard
Xiangyan Liu, Bo Lan, Zhiyuan Hu, Yang Liu, Zhicheng Zhang, Fei Wang, Michael Qizhe Shieh, Wenmeng Zhou
| Challenge: | Large Language Models excel in stand-alone code tasks but struggle with handling entire code repositories. |
| Approach: | They propose a system that integrates LLM agents with graph database interfaces extracted from code repositories. |
| Outcome: | The proposed system integrates LLM agents with graph database interfaces extracted from code repositories. |
Model Unlearning via Sparse Autoencoder Subspace Guided Projections (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing unlearning strategies lack interpretability or fail to provide robust defense against adversarial prompts. |
| Approach: | They propose a framework that leverages SAE features to drive targeted updates in the model’s parameter space. |
| Outcome: | The proposed framework reduces harmful knowledge accuracy by 3.22% compared to baselines and improves adversarial robustness under jailbreak prompts. |
ComfyFlow: Benchmarking LLMs for AIGC Workflow Generation (2026.findings-acl)
Copied to clipboard
Zhenran Xu, Yiyu Wang, Yunxin li, Muyang Ye, null Yangxue, Kai Chen, Longyue Wang, Weihua Luo, Baotian Hu, Min Zhang
| Challenge: | Large language models (LLMs) have shown promising advances in tackling human-level tasks, but generating workflows for collaborative AI systems remains a critical and challenging step. |
| Approach: | They propose a benchmark to evaluate LLMs’ ability to generate executable and instruction-following AIGC workflows in ComfyUI. |
| Outcome: | The proposed benchmarks show that LLMs can generate executable and instruction-following AIGC workflows in ComfyUI. |
Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction (2025.findings-emnlp)
Copied to clipboard
Maya Kruse, Shiyue Hu, Nicholas Derby, Yifu Wu, Samantha Stonbraker, Bingsheng Yao, Dakuo Wang, Elizabeth M. Goldberg, Yanjun Gao
| Challenge: | Recent advances in large language models have shown potential in clinical text summarization, but their ability to handle long patient trajectories with multi-modal data spread across time remains underexplored. |
| Approach: | They evaluate open-source large language models, their Retrieval Augmented Generation variants and chain-of-thought prompting on long-context clinical summarization and prediction. |
| Outcome: | The proposed models can synthesize structured and unstructured EHR data while reasoning over temporal coherence. |
What Factors Affect LLMs and RLLMs in Financial Question Answering? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on large language models and reasoning large language model (RLLMs) however, there are few studies that explore what methods can fully unlock the performance of LLMs and RLLM in the financial domain. |
| Approach: | They examine the effects of prompting methods, agentic frameworks, and multilingual alignment methods on financial question-answering tasks. |
| Outcome: | The results show that prompting methods and agent frameworks improve LLMs' performance . the authors suggest that these frameworks can be used to enhance LLM performance if they are implemented in financial domains. |
Towards Robust Evidence-Aware Fake News Detection via Improving Semantic Perception (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods lack sufficient semantic perception and are easily blinded by textual expressions. |
| Approach: | They propose a model-agnostic training framework to improve the semantic perception of evidence-aware fake news detection by combining two kinds of data augmentations with synthetic data. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on the extended test set while achieving competitive performance on the original one. |
WebUncertainty: Dual-Level Uncertainty Driven Planning and Reasoning For Autonomous Web Agent (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing web agents struggle with complex tasks due to rigid planning strategies and hallucination-prone reasoning. |
| Approach: | They propose a task-uncertainty-driven Adaptive Planning Mechanism that adaptively selects planning modes to navigate unknown environments. |
| Outcome: | The proposed framework performs better on the WebArena and WebVoyager benchmarks than existing frameworks. |
UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions (2025.findings-acl)
Copied to clipboard
Xunzhi Wang, Zhuowei Zhang, Gaonan Chen, Qiongyu Li, Bitong Luo, Zhixin Han, Haotian Wang, Zhiyu Li, Hang Gao, Mengting Hu
| Challenge: | Existing methods for benchmarking the uncertainty of large language models face challenges . existing methods require internal model access, additional training, or high computational costs . |
| Approach: | They propose a new benchmark for evaluating the uncertainty of large language models based on confidence intervals . UBench encompasses 11,978 multiple choice questions spanning knowledge, language, understanding, and reasoning capabilities. |
| Outcome: | The proposed method outperforms existing methods for benchmarking the uncertainty of large language models. |
SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models can handle text and data, but blending text and numerical data presents significant challenges. |
| Approach: | They propose four tasks to evaluate the numerical reasoning and information fusion capabilities of large language models in sports data analytics. |
| Outcome: | The proposed tasks evaluate the numerical reasoning and information fusion capabilities of large language models in sports data analytics. |
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)
Copied to clipboard
Hao Li, Yiqun Zhang, Zhaoyan Guo, Chenxu Wang, Shengji Tang, Qiaosheng Zhang, Yang Chen, Biqing Qi, Peng Ye, Lei Bai, Zhen Wang, Shuyue Hu
| Challenge: | Large language model (LLM) routing assigns each query to the best suitable model from an ensemble. |
| Approach: | They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation . |
| Outcome: | The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing. |
SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing retrieval-augmented generation methods overlook citation graph structure, adapt poorly to complex queries, and yield fragmented, hard-to-verify syntheses. |
| Approach: | They propose a retrieval-augmented generation framework that addresses these gaps by combining adaptive retrieval and symbolic reasoning. |
| Outcome: | Extensive experiments show that SciRAG outperforms prior systems in factual accuracy and synthesis quality. |
PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Low-rank adaptation and its variants have been popular due to their ability to avoid excessive inference costs. |
| Approach: | They propose a low-rank adaptation method that enables high-rank updates with low costs while leveraging semantic and linguistic information inherent in pre-trained weight. |
| Outcome: | The proposed method outperforms LoRA and other fine-tuning methods across tasks with less trainable parameters. |
CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments (2026.acl-long)
Copied to clipboard
Haotian Xu, Yue Hu, Zhengqiu Zhu, Chen Gao, Ziyou Wang, Junreng Rao, Wenhao Lu, Weishi Li, Quanjun Yin, Yong Li
| Challenge: | Existing benchmarks focus on indoor or street settings, overlooking challenges of open-ended urban spaces. |
| Approach: | They propose a benchmark to probe cross-view spatial reasoning capabilities of current VLMs in urban settings. |
| Outcome: | The citycube benchmark examines the performance of current vision-language models in urban environments. |
SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model (2024.emnlp-demo)
Copied to clipboard
Dayong Wu, Jiaqi Li, Baoxin Wang, Honghong Zhao, Siyuan Xue, Yanjie Yang, Zhijun Chang, Rui Zhang, Li Qian, Bo Wang, Shijin Wang, Zhixiong Zhang, Guoping Hu
| Challenge: | Large language models (LLMs) have shown remarkable achievements across various language tasks. |
| Approach: | They propose a scientific literature LLM and a knowledge service system based on it . they collect scientific literature and then pre-train it using autoregressive training . |
| Outcome: | The proposed system provides literature investigation, paper reading, and academic writing functions. |
ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models (2025.findings-acl)
Copied to clipboard
Hao Chen, Haoze Li, Zhiqing Xiao, Lirong Gao, Qi Zhang, Xiaomeng Hu, Ningtao Wang, Xing Fu, Junbo Zhao
| Challenge: | Prior research has focused on optimizing general-purpose large language models to downstream tasks . however, these approaches inherently introduce data dependency, which hinders generalization and reusability. |
| Approach: | They propose an algorithm that localizes the most task-sensitive attention heads and prunes by restricting attention training updates to these heads, thereby reducing alignment costs. |
| Outcome: | The proposed algorithm achieves 2% performance improvement over baselines on three tasks while localizing the most task-sensitive attention heads. |
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)
Copied to clipboard
Xukai Wang, Xuanbo Liu, Mingrui Chen, Haitian Zhong, Xuanlin Yang, Bohan Zeng, Jinbo Hu, Hao Liang, Junbo Niu, Xuchen Li, Ruitao Wu, Ruichuan An, Yang Shi, Liu Liu, Qiang Liu, Zhouchen Lin, Xu-Yao Zhang, Wentao Zhang, Bin Dong
| Challenge: | Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models. |
| Approach: | They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. |
| Outcome: | The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. |
Tailoring Rumor Debunking to You: Diversifying Chinese Rumor-Debunking Passages with an LLM-Driven Simulated Feedback-Enhanced Framework (2026.eacl-industry)
Copied to clipboard
| Challenge: | Existing methods for fact-checking lack coherence and context, whereas abstractive methods lack cohesion and context. |
| Approach: | They propose a framework that generates Chinese user-specific debunking passages . they propose to use a generative AI framework to generate context-sensitive responses . |
| Outcome: | The proposed framework generates Chinese user-specific debunking passages by iteratively refining outputs based on simulated user feedback. |
Momentum Contrastive Pre-training for Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for extractive Question Answering generate cloze-like queries different from natural questions in syntax structure, which could overfit pre-trained models to simple keyword matching. |
| Approach: | They propose a method to align the answer probability between cloze-like and natural query-passage sample pairs. |
| Outcome: | The proposed method improves on three benchmarking QA datasets on supervised and zero-shot scenarios. |
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)
Copied to clipboard
Hu Yiwen, Huatong Song, Jie Chen, Jia Deng, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Zican Dong, Yang Lu, Xu Miao, Xin Zhao, Ji-Rong Wen
| Challenge: | prevailing pre-training approaches for large language models involve several complexities. |
| Approach: | They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data . |
| Outcome: | The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data . |
Constructing High Quality Sense-specific Corpus and Word Embedding via Unsupervised Elimination of Pseudo Multi-sense (L18-1)
Copied to clipboard
| Challenge: | Existing word embedding frameworks distinguish different senses of words by their contexts. |
| Approach: | They propose a framework for unsupervised corpus sense tagging which trains multi-sense word embeddings on a given corpus. |
| Outcome: | The proposed framework detects pseudo multi-senses without extra language resources without additional language resources. |
CoEvo: Coevolution of LLM and Retrieval Model for Domain-Specific Information Retrieval (2025.emnlp-main)
Copied to clipboard
Ang Li, Yiquan Wu, Yinghao Hu, Lizhi Qing, Shihang Wang, Chengyuan Liu, Tao Wu, Adam Jatowt, Ming Cai, Fei Wu, Kun Kuang
| Challenge: | Recent methods to enhance queries by generating intermediary elements can degrade retrieval performance . combining LLMs and retrievers can be difficult, resulting in unreliable or irrelevant intermediaries . |
| Approach: | They propose a framework that facilitates the coevolution of large language models and retrieval models. |
| Outcome: | The proposed framework facilitates the coevolution of LLMs and retrieval models. |
Transformation of Dense and Sparse Text Representations (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to NLP to leverage sparsity have been limited due to the gap with dense representations. |
| Approach: | They propose a Semantic Transformation method to bridge dense and sparse spaces and propose supervised NLP tasks to use both spaces. |
| Outcome: | Experiments with classification tasks and natural language inference tasks show that the proposed method is effective. |
TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Industry Systems (2024.emnlp-industry)
Copied to clipboard
Yilun Kong, Jingqing Ruan, YiHong Chen, Bin Zhang, Tianpeng Bao, Shi Shiwei, Du Qing, Xiaoru Hu, Hangyu Mao, Ziyue Li, Xingyu Zeng, Rui Zhao, Xueqian Wang
| Challenge: | Large language models have demonstrated proficiency in addressing tasks that necessitate a combination of task planning and the usage of external tools. |
| Approach: | They propose a framework to enhance the task planning and tool usage abilities of LLMs in industrial systems. |
| Outcome: | The proposed framework enhances the task planning and tool usage abilities of LLM-based agents in industrial systems. |
Data Contamination Calibration for Black-box LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Despite the rapid advancements of Large Language Models, the unchecked ultra-large-scale training sets introduce a series of potential risks like data contamination. |
| Approach: | They propose a method to detect contaminated training data and diminish the contamination effect by using a to-be-released dataset. |
| Outcome: | The proposed method outperforms existing methods by at least 4.5% on more 4 dataset formats, with more than 10 base LLMs. |
Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducements (2025.findings-acl)
Copied to clipboard
Shu Yang, Shenzhe Zhu, Zeyu Wu, Keyu Wang, Junchi Yao, Junchao Wu, Lijie Hu, Mengdi Li, Derek F. Wong, Di Wang
| Challenge: | Existing fraud detection benchmarks focus on single-turn classification tasks, failing to capture dynamic nature of real-world fraud attempts. |
| Approach: | They propose a bilingual benchmark to assess LLMs' ability to resist fraud and phishing attacks across five key fraud categories: Fraudulent Services, Impersonation, Phishing Scams, Fake Job Postings, and Online Relationships. |
| Outcome: | The proposed model improves in role-play settings and in e-commerce and recommendation systems. |
Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression (2026.acl-long)
Copied to clipboard
Liang Zhao, Xiaocheng Feng, Weihong Zhong, Lei Huang, Kun Zhu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin
| Challenge: | Recent methods to reduce the KV cache size fail to identify crucial KVs for generation while excluding others accurately, resulting in severe information loss. |
| Approach: | They propose an intention-aware KV cache eviction method that identifies and retains crucial KVs according to the attention distribution of intention, which semantically reflects the user’s goal and determines which part of the context is relevant. |
| Outcome: | The proposed method can maintain the model performance while reducing the KV cache size from 128K to 2K, leading to a 6.3x increase in decoding speed and 7.8x enhancement in memory efficiency compared to the default setting. |
AudioStealer: Extracting Audio Prompts via Shapley Value-Guided Query Search (2026.findings-acl)
Copied to clipboard
| Challenge: | prompt stealing is a new form of attack that aims to reconstruct high-value prompts that guide music generation. |
| Approach: | They propose a method to steal music prompts from audio domains using a black-box attack framework. |
| Outcome: | The proposed method recovers prompts with high textual consistency to the ground truth while maintaining strong perceptual similarity to the target recordings. |
Hybrid-Regressive Paradigm for Accurate and Speed-Robust Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive translation (NAT) is less robust in decoding batch size and hardware settings than NAT. |
| Approach: | They propose a two-stage translation prototype that prompts a small number of AT predictions and fills in previously skipped tokens at once. |
| Outcome: | The proposed translation prototype achieves comparable translation quality with AT while having 1.5x faster inference speed regardless of batch size and device. |
Rethinking Semantic Parsing for Large Language Models: Enhancing LLM Performance with Semantic Hints (2025.acl-short)
Copied to clipboard
| Challenge: | Semantic Parsing improves performance of smaller models, but it is unclear whether it extends similarly to large language models. |
| Approach: | They propose a prompting approach that embeds semantic hints within the prompt to improve LLM performance. |
| Outcome: | The proposed approach improves LLMs’ performance across various tasks, highlighting the potential of integrating semantic information to improve LLM capabilities. |
A Span-Extraction Dataset for Chinese Machine Reading Comprehension (D19-1)
Copied to clipboard
| Challenge: | Existing reading comprehension datasets are mostly in English . MRC is a new field of research that aims to comprehend the context of articles and answer the questions based on them. |
| Approach: | They propose a Span-Extraction dataset for Chinese machine reading comprehension to add language diversities to existing reading comprehension datasets. |
| Outcome: | The proposed dataset is composed of 20,000 real questions annotated on Wikipedia paragraphs by human experts. |
PUPPET: Neural-Symbolic Standardized Patients for Mental Health (2026.acl-long)
Copied to clipboard
Chen Xu, Yu ji, Zhenyu Lv, Yang Yi, Yizhe Yang, Luyao Ji, Chaoyi Chen, Xianyang Wang, Tian Lan, Zhihua Wang, Juan Wang, Xunde Dong, Fuze Tian, Qunxi Dong, Bin Hu
| Challenge: | Existing LLM-based training approaches lack faithful responses to clinical errors and explainable feedback. |
| Approach: | They propose a neural-symbolic virtual standardized patient governed by an OBSERVE-THINK-BEHAVE architecture that embeds LLM reasoning into a symbolic system where experts implant causal associations between intervention logic and patient mental states. |
| Outcome: | The proposed model outperforms baselines in faithfulness and pedagogical value. |
Soft Orthogonal Low-Rank Adaptation for Knowledge Sharing in Large Language Model Continual Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for continual learning (CL) are designed to mitigate catastrophic forgetting while neglecting knowledge sharing across tasks. |
| Approach: | They propose a framework that facilitates knowledge transfer while mitigating catastrophic forgetting by assigning task-specific parameter subspaces to new tasks . they then leverage attribution scores to evaluate task similarity and employ soft orthogonality between task- specific subspace . |
| Outcome: | The proposed framework facilitates knowledge transfer while mitigating catastrophic forgetting. |
Guided by the Plan: Enhancing Faithful Autoregressive Text-to-Audio Generation with Guided Decoding (2026.eacl-long)
Copied to clipboard
| Challenge: | Autoregressive (AR) models excel at generating temporally coherent audio by producing tokens sequentially, yet they often falter in faithfully following complex textual prompts. |
| Approach: | They propose a lightweight auxiliary model trained with a GAE-inspired objective to predict final instruction-following quality from partial generations. |
| Outcome: | The proposed model achieves 10 points improvement in CLAP score over baseline AR models while maintaining computational parity with best-of-N decoding. |
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding (2025.emnlp-main)
Copied to clipboard
Yuxuan Hu, Jihao Liu, Ke Wang, Jinliang Zheng, Weikang Shi, Manyuan Zhang, Qi Dou, Rui Liu, Aojun Zhou, Hongsheng Li
| Challenge: | Recent advances in Large Language Models have opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS). |
| Approach: | They propose a framework that leverages LLMs for cross-domain neural architecture optimization without extensive domain-specific tuning. |
| Outcome: | The proposed framework achieves competitive performance in both in-domain and out-of-domain tasks. |
Domain Differential Adaptation for Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Neural networks are data hungry and domain sensitive, so it is difficult to obtain labeled data for every domain. |
| Approach: | They propose a framework for domain adaptation where we model the difference between domains instead of smoothing over them. |
| Outcome: | The proposed framework improves on domain adaptation in multiple experimental settings. |
PromDA: Prompt-based Data Augmentation for Low-Resource NLU Tasks (2022.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to build labeled training data from domain-specific data are expensive to obtain. |
| Approach: | They propose a Prompt-based Data Augmentation model which only trains small-scale Soft Promptes in frozen Pre-trained Language Models. |
| Outcome: | The proposed model outperforms several baseline models on four benchmarks and is complementary with unlabeled in-domain data. |
FEDLEGAL: The First Real-World Federated Learning Benchmark for Legal NLP (2023.acl-long)
Copied to clipboard
| Challenge: | federated learning (FL) is a promising technique for preserving data privacy . however, there is no work on applying FL to legal NLP . |
| Approach: | They propose to use federated learning to train models in a collaborative way without sharing data . they propose to test the FL benchmark on real-world legal data from Chinese courts . |
| Outcome: | The proposed benchmark combines five legal NLP tasks and one privacy task on Chinese courts. |
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)
Copied to clipboard
Yue Chen, Yifei Sun, Lu Wang, Fangkai Yang, Pu Zhao, Minjie Hong, Yifei Dong, Minghua He, Nan Hu, Jianjin Zhang, Zhiwei Dai, Yuefeng Zhan, Weihao Han, Hao Sun, Qingwei Lin, Weiwei Deng, Feng Sun, Qi Zhang, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability. |
| Approach: | They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence. |
| Outcome: | The proposed model outperforms baselines on three real-world datasets. |
MoDification: Mixture of Depths Made Easy (2025.naacl-long)
Copied to clipboard
Chen Zhang, Meizhi Zhong, Qimeng Wang, Xuantao Lu, Zheyu Ye, Chengqiang Lu, Yan Gao, Yao Hu, Kehai Chen, Min Zhang, Dawei Song
| Challenge: | Long-context efficiency is a trending topic in large language model (LLM) serving. |
| Approach: | They propose a method to combine long-context efficiency and mixture of depths to bring down both latency and memory. |
| Outcome: | The proposed method achieves 1.2 speedup in latency and 1.8 reduction in memory compared to original LLMs especially in long-context applications. |
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026.acl-long)
Copied to clipboard
Xi Xiao, Chenrui Ma, Yunbei Zhang, Chen Liu, Zhuxuanzi Wang, Yanshu Li, Lin Zhao, Guosheng Hu, Tianyang Wang, Hao Xu
| Challenge: | Low-Rank Adaptation (LoRA) is a key parameter-efficient fine-tuning method . however, its effectiveness is hampered by semantic drift and structural incoherence . |
| Approach: | They propose a low-rank Adaptation framework that tackles semantic drift and structural incoherence by pruning task-irrelevant directions. |
| Outcome: | Experiments on large language models, vision models, and vision models show that the proposed framework outperforms LoRA and advanced dynamic rank allocation and sparsity-based methods. |
GRAFF: GRaph-Augmented Fine-grained Fusion for Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to integrate graphs into LLMs compress the graph's structural information into a single token, restricting their ability to capture deep semantic and structural information. |
| Approach: | They propose a method that integrates fine-grained node-level structural information with corresponding text entities to LLMs via a lightweight, structure adapter module. |
| Outcome: | The proposed method outperforms baseline models in graph-based question answering by 10.24%. |
RECAL: Sample-Relation Guided Confidence Calibration over Tabular Data (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Various machine learning methods for tabular data lack accurate confidence estimation, which is needed for high-risk sensitive applications such as credit modeling and financial fraud detection. |
| Approach: | They propose a general post-training confidence calibration framework to calibrate the confidence of current machine learning models by employing graph neural networks to model the relationships between different samples. |
| Outcome: | The proposed framework improves the confidence estimation on tabular datasets by using graph neural networks to model the relationships between different samples. |
Adaptive Zooming via Relevance-Informed Positional Resource Allocation for Training-free LLM Context Extension (2026.findings-acl)
Copied to clipboard
Hongbo Zhao, Huibin Wang, Bin Tang, Xianming Hu, Yihong Huang, Yijun Shen, Nuoyi Chen, Ping Li, Kai Zhang
| Challenge: | Existing training-free methods for extrapolating beyond training context lengths are semantics-agnostic . Existing methods that focus on relative token distances can indiscriminately blur semantically relevant and irrelevant tokens . |
| Approach: | They propose an adaptive positional zooming method that uses semantic relevance to extrapolate beyond training context lengths. |
| Outcome: | Experiments show that RiPRA outperforms existing training-free extrapolation methods . relevant tokens get higher positional resolution, while irrelevant tokens are compressed . |
Multi-View Cross-Lingual Structured Prediction with Minimum Supervision (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work on cross-lingual transfer learning focuses on transferring knowledge from high-resource languages to low-resourced ones. |
| Approach: | They propose a multi-view framework that integrates multiple source models into an aggregated source view and transfers it to a target view based on a task-specific model. |
| Outcome: | The proposed framework improves on three structured prediction tasks on 16 datasets. |
Reducing Token Redundancy in LVLMs: A Systematic Review of Token Pruning Methods (2026.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) excel at visual understanding but face severe computational bottlenecks when processing high-resolution images and long videos due to massive visual token counts. |
| Approach: | They propose a taxonomy categorizing methods into vision-side, LLM-side and hybrid paradigms and analyze token selection mechanisms and pruning strategy. |
| Outcome: | The proposed method selectively removes less informative tokens while maintaining performance. |
A Unified Generative Framework for Bilingual Euphemism Detection and Identification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing euphemism datasets are only domain-specific or language-specific. |
| Approach: | They propose a unified model to jointly conduct bilingual euphemism detection and identification tasks. |
| Outcome: | The proposed model is effective and provides a new reference standard for euphemism detection and identification. |
MoE Adapter for Large Audio Language Models: Sparsity, Disentanglement, and Gradient-Conflict-Free (2026.findings-acl)
Copied to clipboard
Yishu Lei, Shuwei He, Hu Jing, Dan Zhang, Xianlong Luo, Danxiang Zhu, Shikun Feng, Rui Liu, Jingzhou HE, Yu Sun, Hua Wu, Haifeng Wang
| Challenge: | Existing research on Large Language Models (LLMs) limited to textual input modality . acoustic information is intrinsically heterogeneous, entangling attributes such as speech, music, and environmental context. |
| Approach: | They propose a sparse Mixture-of-Experts architecture to decouple acoustic information by routing audio tokens to specialized experts. |
| Outcome: | The proposed architecture outperforms existing models on audio semantic and paralinguistic tasks while retaining shared experts for global context. |
compare-mt: A Tool for Holistic Comparison of Language Generation Systems (N19-4)
Copied to clipboard
| Challenge: | Unlike machine translation, natural language outputs are nuanced and there are no clear yes/no distinctions about whether they are correct or not. |
| Approach: | They describe compare-mt, a tool for holistic analysis and comparison of the results of systems for language generation tasks such as machine translation. |
| Outcome: | The compare-mt tool is an open-source pure-python package that has already proven useful to generate analyses that have been used in our papers. |
Beyond the Surface: Measuring Self-Preference in LLM Judgments (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods measure self-preference bias by comparing the scores a judge model assigns to its own responses with those assigned to other models. |
| Approach: | They propose to use gold judgments as proxies for the actual quality of responses . they propose to measure self-preference bias as the difference between the judge model's own and other models' scores . |
| Outcome: | The proposed method can assess self-preference bias across large language models . it uses gold judgments as proxies for the ground truth scores of the judge model . |
Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains (2026.acl-long)
Copied to clipboard
Zhonghang Yuan, Zhefan Wang, Fang Hu, Zihong Chen, Jinzhe Li, Gang Li, Jie Ying, Huanjun Kong, Songyang Zhang, Nanqing Dong
| Challenge: | Recent large language models (LLMs) have demonstrated remarkable progress in reasoning, but their applications on knowledge-intensive domains have not been explored due to the scarcity of high-quality verifiable data. |
| Approach: | They propose a framework that extends reinforcement learning with verifiable rewards (RLVR) to knowledge-intensive domains through automated verififiability data synthesis while enabling verification of the LLM's reasoning process. |
| Outcome: | Extensive experiments show that the proposed framework enhances the reasoning of large language models in knowledge-intensive domains without significantly compromising the model’s general capabilities. |
Is Graph Structure Necessary for Multi-hop Question Answering? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on multi-hop question answering across multiple documents or paragraphs. |
| Approach: | They propose a graph neural network to deal with graph structure in textual multi-hop reasoning . they propose 'self-attention' and propose removing entire graph structure may not hurt the final results . |
| Outcome: | The proposed model shows that graph-attention or the entire graph structure can be replaced by self-attention . hotpotQA is a widely used benchmark for multi-hop question answering . |
Gamma-Guard: Lightweight Residual Adapters for Robust Guardrails in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are widely deployed as zero-shot evaluators for answer grading, content moderation, and document ranking. |
| Approach: | They propose a system that trains LLMs with adapters to denoise embeddings and refocus attention. |
| Outcome: | The proposed model lifts adversarial accuracy from 5% to 95% a 90 percentage-point gain while reducing clean-data accuracy by just 8 percentage points. |
Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal retrieval-augmented generation rely on semantic relevance or surface-level similarity, which are often misaligned with the actual utility of visual evidence for downstream reasoning. |
| Approach: | They propose a latent notion of evidence usefulness and propose 'surrogate-accelerated' framework that efficiently estimates evidence utility using lightweight multimodal models. |
| Outcome: | The proposed framework outperforms state-of-the-art models while achieving substantial reductions in computational cost. |
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on knowledge distillation have shown that not all knowledge is necessary for learning a good student model. |
| Approach: | They propose an actor-critic approach to selecting appropriate knowledge to transfer during the process of knowledge distillation. |
| Outcome: | The proposed method outperforms several strong knowledge distillation baselines significantly on the GLUE datasets. |
GenDis: Generative-Discriminative Dual-View Co-Training for Generalized Category Discovery (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods rely on one-hot discriminative supervision, leading to overfitting on seen classes and poor generalization to unseen ones. |
| Approach: | They propose a Generative–Discriminative Dual-View Co-Training framework that unifies discriminative classification and semantic label generation within an LLM. |
| Outcome: | The proposed framework outperforms existing methods on five benchmarks on the generalized category discovery (GCD) task. |
EDSD: Entropy-Driven Design for Faster Speculative Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for speculative decoding incur substantial training overhead to mitigate information misalignment between autoregressive draft model training and decoding. |
| Approach: | They propose an Entropy-Driven Speculative Decoding framework that uses entropy as a unified, interpretable signal for both draft model training and architectural design. |
| Outcome: | Experiments on seven large language models show that EDSD improves training efficiency by 24.8% and increases acceptance length by 4.0% compared to state-of-the-art methods. |
SeRTS: Self-Rewarding Tree Search for Biomedical Retrieval-Augmented Generation (2024.findings-emnlp)
Copied to clipboard
Minda Hu, Licheng Zong, Hongru Wang, Jingyan Zhou, Jingjing Li, Yichen Gao, Kam-Fai Wong, Yu Li, Irwin King
| Challenge: | Existing retrieval-augmented approaches to large language models face performance limitations due to the lack of publicly available training data. |
| Approach: | They propose a plug-and-play LLM-based retrieval method called Self-Rewarding Tree Search based on Monte Carlo Tree Search and a self-rewarding paradigm to address these limitations. |
| Outcome: | The proposed method improves the performance of the BM25 retriever and surpasses the baseline of self-reflection in both efficiency and scalability. |
Learning Mutually Informed Representations for Characters and Subwords (2024.findings-naacl)
Copied to clipboard
| Challenge: | Pretrained language models rely on subword tokenization to process text as a sequence of subwords. |
| Approach: | They propose a character-subword language model that integrates character and subword modalities into one model. |
| Outcome: | The proposed model outperforms its backbone language models on English sequence labeling and classification tasks. |
One Embedder, Any Task: Instruction-Finetuned Text Embeddings (2023.findings-acl)
Copied to clipboard
Hongjin Su, Weijia Shi, Jungo Kasai, Yizhong Wang, Yushi Hu, Mari Ostendorf, Wen-tau Yih, Noah A. Smith, Luke Zettlemoyer, Tao Yu
| Challenge: | a new method for embedding text is developed for tasks that require specialized encoders . INSTRUCTOR is a single embedder that can generate text embeddables tailored to different tasks and domains based on instruction finetuning . |
| Approach: | They introduce a new method for computing text embeddings given task instructions . they first annotate instructions for 330 diverse tasks and train INSTRUCTOR on this multitask mixture . |
| Outcome: | The proposed method improves on 70 embedding evaluation tasks with fewer parameters than the previous best model. |
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding (2022.coling-1)
Copied to clipboard
| Challenge: | a new method for learning unsupervised sentence embeddings is proposed . unsup-SimCSE is biased because of the length information encoded into the sentence embeds . |
| Approach: | They propose a new unsupervised sentence embedding method that uses dropout to obtain positive pairs from a pre-trained Transformer encoder. |
| Outcome: | The proposed method outperforms the state-of-the-art unsup-SimCSE on a STS task. |
Adversarial Preference Learning for Robust LLM Alignment (2025.findings-acl)
Copied to clipboard
Yuanfu Wang, Pengyu Wang, Chenyang Xi, Bo Tang, Junyi Zhu, Wenqiang Wei, Chen Chen, Chao Yang, Jingfeng Zhang, Chaochao Lu, Yijun Niu, Keming Mao, Zhiyu Li, Feiyu Xiong, Jie Hu, Mingchuan Yang
| Challenge: | Modern language models rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors, but they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of human annotation; (2) the vast diversity of potential adversarials; and (3) the risk of feedback bias and reward hacking. |
| Approach: | They propose an iterative adversarial training method that incorporates three key innovations to address these challenges. |
| Outcome: | Experiments on Mistral-7B-Instruct-v0.3 show that the proposed method significantly enhances robustness and reduces harmful outputs from 5.88% to 0.43%. |
A Decoupled Multi-Agent Framework for Complex Text Style Transfer (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for text style transfer struggle with complex styles . existing models perform well on simple styles like sentiment and formality . |
| Approach: | They propose a multi-agent self-check framework that includes a large language model as a planner for disentangling subtasks and expert agents for executing the subtask. |
| Outcome: | The proposed framework significantly improves style strength and content preservation on simple and complex style datasets. |
Differentially Private Natural Language Models: Recent Advances and Future Directions (2024.findings-eacl)
Copied to clipboard
| Challenge: | Recent advances in deep learning have led to great success in various natural language processing tasks. |
| Approach: | They propose a systematic review of recent advances in DP deep learning models . they discuss some differences and additional challenges of DP-NLP . |
| Outcome: | The proposed method can prevent reconstruction attacks and protect against potential side knowledge while maintaining the privacy of sensitive data. |
InFoBench: Evaluating Instruction Following Ability in Large Language Models (2024.findings-acl)
Copied to clipboard
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, Dong Yu
| Challenge: | Existing methods for evaluating Large Language Models (LLMs) ability to follow instructions have not been able to provide a detailed analysis of their compliance with instructions. |
| Approach: | They propose a new metric for evaluating Large Language Models' ability to follow instructions and a benchmark for DRFR. |
| Outcome: | The proposed metric and benchmark compared with traditional scoring methods and explores annotation sources including human experts, crowd-sourced workers, and GPT-4. |
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)
Copied to clipboard
Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen
| Challenge: | Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks. |
| Approach: | They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
| Outcome: | The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
CogLM: Tracking Cognitive Development of Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have recently shown remarkable abilities across a wide variety of tasks, but few studies have explored the reasons behind the evolutionary relationship among various abilities. |
| Approach: | They construct a benchmark CogLM based on Piaget's Theory of Cognitive Development (PTC) which measures the cognitive levels of Large Language Models (LLMs) using 1,220 questions spanning 10 cognitive abilities crafted by more than 20 human experts. |
| Outcome: | The proposed framework provides a comprehensive testbed for the cognitive levels of LLMs. |
Revisiting Pre-Trained Models for Chinese Natural Language Processing (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing pre-trained language models have shown tremendous improvements across various NLP tasks. |
| Approach: | They propose to revisit Chinese pre-trained language models to examine their effectiveness in a non-English language and release the Chinese pretrained model series to the community. |
| Outcome: | The proposed model improves on RoBERTa in several ways, especially the masking strategy that adopts MLM as correction (Mac). |
Does Memory Need Graphs? A Unified Framework and Empirical Analysis for Long-Term Dialog Memory (2026.acl-long)
Copied to clipboard
| Challenge: | Existing literature on dialog memory systems is inconsistent on their effectiveness . empirical findings on graph structures are difficult to attribute to specific design choices . |
| Approach: | They propose a framework that decomposes dialog memory systems into core components . they conduct stage-wise experiments on LongMemEval and HaluMeM, and compare implementation details . |
| Outcome: | The proposed framework compares graph-based and non-graph memory architectures on long-term dialog memory systems. |
AELC: Adaptive Entity Linking with LLM-Driven Contextualization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Entity linking (EL) focuses on associating ambiguous mentions in text with corresponding entities in a knowledge graph. |
| Approach: | Entity linking (EL) focuses on associating ambiguous mentions in text with corresponding entities in a knowledge graph. |
| Outcome: | Experiments on four public benchmark datasets show that AELC achieves state-of-the-art performance. |
DataSciBench: An LLM Agent Benchmark for Data Science (2026.findings-acl)
Copied to clipboard
Dan Zhang, Sining Zhoubian, Min Cai, Fengzu Li, Lekang Yang, Wei Wang, Tianjiao Dong, Ziniu Hu, Jie Tang, Yisong Yue
| Challenge: | Existing benchmarks focus on single task, simple evaluation metrics, and readily available ground truth (GT) DataSciBench is built on curated, natural, and challenging prompts with complex evaluation criteria and uncertain GT. |
| Approach: | They propose a benchmark for evaluating Large Language Models in data science that integrates LLM-based self-consistency and human verification to ensure accuracy. |
| Outcome: | The proposed framework outperforms open-source models in all metrics and offers rigorous insights into LLM strengths and weaknesses. |
Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter (2025.findings-emnlp)
Copied to clipboard
Weixiang Zhao, Xingyu Sui, Xinyang Han, Yang Deng, Yulin Hu, Jiahe Guo, Libo Qin, Qianyun Du, Shijin Wang, Yanyan Zhao, Bing Qin, Ting Liu
| Challenge: | Existing supervised fine-tuning (SFT) fails to address these issues, as it trains models on single gold-standard responses without modeling nuanced strategy trade-offs. |
| Approach: | They propose a two-stage framework that optimizes strategy selection preferences at each dialogue turn. |
| Outcome: | The proposed framework improves strategy selection preferences at each dialogue turn. |
Coordinating Search-Informed Reasoning and Reasoning-Guided Search in Claim Verification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multi-hop claim verification require multi-step reasoning to construct verification chains while iterating for information to uncover hidden bridging facts. |
| Approach: | They propose a hierarchical agent reasoning and information search model that integrates reasoning and search-informed reasoning. |
| Outcome: | Experimental results show that HARIS improves multi-hop claim verification accuracy and interpretability. |
GUICourse: From General Vision Language Model to Versatile GUI Agent (2025.acl-long)
Copied to clipboard
Wentong Chen, Junbo Cui, Jinyi Hu, Yujia Qin, Junjie Fang, Yue Zhao, Chongyi Wang, Jun Liu, Guirong Chen, Yupeng Huo, Yuan Yao, Yankai Lin, Zhiyuan Liu, Maosong Sun
| Challenge: | Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction. |
| Approach: | They propose a series of datasets for training visual-based GUI agents using general VLMs. |
| Outcome: | The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks. |
DEGAP: Dual Event-Guided Adaptive Prefixes for Templated-Based Event Argument Extraction with Slot Querying (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in event argument extraction (EAE) involve incorporating useful auxiliary information into models during training and inference. |
| Approach: | They propose a method that uses two prefixes to learn from different events and templates. |
| Outcome: | The proposed method achieves state-of-the-art performance on four datasets . it can leverage possible connections between different events and capture relevant information from the prefix . |
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning (2022.emnlp-main)
Copied to clipboard
Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric Xing, Zhiting Hu
| Challenge: | Existing methods for finding the optimal prompt for a task are difficult to optimize. |
| Approach: | They propose an efficient discrete prompt optimization approach with reinforcement learning that generates the optimal discrete stimulus after training with reward. |
| Outcome: | The proposed approach is based on a parameter-efficient policy network that generates the optimal discrete prompt after training with reward. |
Inductive Relation Prediction with Logical Reasoning Using Contrastive Representations (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for relation prediction in knowledge graphs (KGs) are limited by the inductive setting because entities in training process are finite. |
| Approach: | They propose a graph convolutional network-based model LogCo with logical reasoning by contrastive representations that extracts subgraphs and relational paths between two entities to supply the entity-independence. |
| Outcome: | The proposed model outperforms existing methods on twelve inductive datasets. |
Tackling Long Code Search with Splitting, Encoding, and Aggregating (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing pretraining models take the first 256 tokens of code snippets by default, limiting the input length to 512. |
| Approach: | They propose a baseline SEA model which splits long code into code blocks and aggregates them to obtain a comprehensive long code representation. |
| Outcome: | The proposed model can model long code without changing their internal structure and re-pretraining. |
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on hallucination detection for LLMs focus on how to identify possible factrelated errors in outputs. |
| Approach: | They propose an unsupervised training framework that leverages the internal states of LLMs for real-time hallucination detection without requiring manual annotations. |
| Outcome: | The proposed framework outperforms existing state-of-the-art methods in hallucination detection. |
Skill-Aware Data Selection and Fine-Tuning for Data-Efficient Reasoning Distillation (2026.acl-short)
Copied to clipboard
| Challenge: | Large reasoning models such as DeepSeek-R1 and their distilled variants achieve impressive performance on complex reasoning tasks, yet their costs remain substantial. |
| Approach: | They propose a skill-centric distillation framework that efficiently transfers reasoning ability to weaker models with two components: (1) Skill-based data selection, which prioritizes examples targeting the student model’s weaker skills, and (2) Skillaware fine-tuning, which encourages explicit skill decomposition during problem solving. |
| Outcome: | The proposed framework surpasses baselines on Qwen3-4B and Qwend3-8B and focuses on skills emphasized during training. |
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)
Copied to clipboard
Yuzhe Yang, Yifei Zhang, Yan Hu, Yilin Guo, Ruoli Gan, Yueru He, Mingcong Lei, Xiao Zhang, Haining Wang, Qianqian Xie, Jimin Huang, Honghai Yu, Benyou Wang
| Challenge: | Recent advances in large language models (LLMs) have expanded their potential applications in finance. |
| Approach: | They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions. |
| Outcome: | The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios. |
Language Model Based Text-to-Audio Generation: Anti-Causally Aligned Collaborative Residual Transformers (2025.emnlp-main)
Copied to clipboard
| Challenge: | Autoregressive language models excel in text-to-audio generation, but lag behind diffusion models by a non-trivial margin. |
| Approach: | They propose a framework that integrates multiple isolated transformers with causal conditioning and anti-causal alignment via reinforcement learning. |
| Outcome: | The proposed framework outperforms existing LM-based and diffusion-based systems in audio synthesis. |
CoEvolve: Training LLM Agents via Agent-Data Mutual Evolution (2026.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments on AppWorld and BFCL demonstrate consistent and significant improvements over strong base models, yielding absolute gains of 19.43%, 15.58%, and 18.14%, respectively. |
| Approach: | They propose a framework that extracts feedback signals such as forgetting and uncertainty from rollout trajectories and utilizes them to guide LLM-based task synthesis. |
| Outcome: | Extensive experiments on AppWorld and BFCL show that the proposed framework improves over strong base models. |
GCRC: A New Challenging MRC Dataset from Gaokao Chinese for Explainable Evaluation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing machine reading comprehension datasets lack an explainable evaluation of systems' reasoning capabilities. |
| Approach: | They propose a dataset with multi-choice questions that evaluates MRC systems' reasoning process . they use sentence-level relevant supporting facts, error reason of distractors to evaluate MRC . |
| Outcome: | The proposed dataset is more challenging and useful for identifying limitations of existing MRC systems in an explainable way. |
M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database (2022.acl-long)
Copied to clipboard
| Challenge: | Existing data resources to support multimodal affective analysis in dialogues are limited in scale and diversity. |
| Approach: | They propose a multimodal multi-scene multi-label Emotional Dialogue dataset, M3ED, which contains 990 dyadic emotional dialogues from 56 different TV series. |
| Outcome: | The proposed dataset contains 990 dyadic emotional dialogues from 56 different TV series, a total of 9,082 turns and 24,449 utterances. |
Argument Generation with Retrieval, Planning, and Realization (P19-1)
Copied to clipboard
| Challenge: | a novel argument generation framework is used to generate counter-arguments . CANDELA uses a text planning decoder to retrieve arguments of different perspectives . |
| Approach: | They propose a powerful retrieval system and a novel two-step argument generation framework . they use a retrieval-based retrieval platform indexed with 12 million articles from Wikipedia . |
| Outcome: | The proposed framework yields higher BLEU, ROUGE, and METEOR scores than state-of-the-art models. |
Movie101: A New Movie Understanding Benchmark (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to narrate movies with no actors are difficult to implement in real situations . a new metric is proposed to provide the best correlation with human evaluation . |
| Approach: | They propose a large-scale Chinese movie benchmark to help visually impaired enjoy movies . they propose metric called Movie Narration Score (MNScore) which achieves best correlation with human evaluation. |
| Outcome: | The proposed method outperforms baselines and the existing methods. |
AscendKernelGen: LLM-Driven Kernel Generation for NPUs (2026.findings-acl)
Copied to clipboard
Xinzi Cao, Jianyang Zhai, Pengfei Li, Zhiheng Hu, Cen Yan, null Mubingxu, Guanghuan Fang, Bin She, Jiayu Li, Yihan Su, Dongyang Tao, Feidiao Yang, Chang-Dong Wang, Yutong Lu, Weicheng Xue, Bin Zhou, Yonghong Tian
| Challenge: | Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs). |
| Approach: | They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say . |
| Outcome: | The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels. |
LegalAgentBench: Evaluating LLM Agents in Legal Domain (2025.acl-long)
Copied to clipboard
Haitao Li, Junjie Chen, Jingli Yang, Qingyao Ai, Wei Jia, Youfeng Liu, Kai Lin, Yueyue Wu, Guozhi Yuan, Yiran Hu, Wuyue Wang, Yiqun Liu, Minlie Huang
| Challenge: | Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making. |
| Approach: | They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain. |
| Outcome: | The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge. |
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning (2025.findings-emnlp)
Copied to clipboard
Xiaotian Han, Yiren Jian, Xuefeng Hu, Haogeng Liu, Yiqi Wang, Qihang Fan, Yuang Ai, Huaibo Huang, Ran He, Zhenheng Yang, Quanzeng You
| Challenge: | InfiMM-WebMath-40B is a dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
| Approach: | InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it contains 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
| Outcome: | InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens . |
GrandGuard: Taxonomy, Benchmark, and Safeguards for Elderly-Chatbot Interaction Safety (2026.findings-acl)
Copied to clipboard
Changxuan Fan, Xi Yang, Yueyuan Zheng, Bin Zhou, Yuanping Wang, Wenbin Hu, Huihao Jing, Ki Sen Hung, Dazhao Du, Haoran Li, Janet Hui-wen Hsiao, Yangqiu Song
| Challenge: | a survey of older adults shows that many LLMs mishandle elderly-specific contextual risks. |
| Approach: | They propose a framework to assess elderly-specific contextual risks in LLM interactions . they use a taxonomy to identify 50 fine-grained risk types across mental well-being, financial, medical, toxicity, and privacy domains . |
| Outcome: | a new framework assesses elderly-specific contextual risks in LLM interactions . it achieves 96.2% and 90.9% unsafe-prompt detection accuracy, respectively . |
Dynamic Multi-granularity Attribution Network for Aspect-based Sentiment Analysis (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for predicting sentiment polarity of aspects are susceptible to interference caused by irrelevant contexts and lack sentiment knowledge at a data-specific level. |
| Approach: | They propose a novel Aspect-based sentiment analysis method that leverages attention scores to model the relationships between aspects and contexts. |
| Outcome: | The proposed method is able to predict sentiments from a set of five benchmark datasets. |
FanChuan: A Multilingual and Graph-Structured Benchmark For Parody Detection and Analysis (2025.findings-acl)
Copied to clipboard
Yilun Zheng, Sha Li, Fangkun Wu, Yang Ziyi, Lin Hongchao, Zhichao Hu, Cai Xinjun, Ziming Wang, Jinxuan Chen, Sitao Luan, Jiahao Xu, Lihui Chen
| Challenge: | Parody is an emerging phenomenon on social media, where individuals imitate a role or position opposite to their own . limited available data and deficient diversity in current datasets hinder study of parody . |
| Approach: | They build a dataset of parody users and annotated comments from both English and Chinese corpora to test parody detection and comment sentiment analysis. |
| Outcome: | The proposed datasets provide richer contextual information, which is lacking in existing datasets. |
Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis (2025.acl-long)
Copied to clipboard
| Challenge: | Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE architectures. |
| Approach: | They propose to analyze sparse MoE architectures against dense models to capture dynamic routing-expert interactions. |
| Outcome: | The proposed algorithm shows that sparse models achieve higher efficiency per layer . it also shows that deep Qwen-MoE mitigates expert failures while minimizing complexity . |
Beyond Modality Collapse: Taming Guided Modality Entropy for Omni-modal Emotion Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | EmoOmni is a data paradigm for omni-modal large language models that can be used for emotion reasoning. |
| Approach: | They propose a data paradigm that interleaves guided tokens into reasoning traces to enforce structured evidence extraction. |
| Outcome: | The proposed paradigm over-relys on a dominant modality while neglecting complementary cues. |
Dissecting Fine-Tuning Unlearning in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning-based unlearning are ineffective at completely erasing model-embedded knowledge, but their true effectiveness remains unclear. |
| Approach: | They propose to use activation patching and parameter restoration experiments to examine the limitations of fine-tuning-based unlearning methods for erasing harmful, sensitive, or copyrighted information within large language models. |
| Outcome: | The proposed methods alter the model’s knowledge retrieval process rather than genuinely erasing the problematic knowledge embedded in the model parameters. |
GRI: Graph-based Relative Isomorphism of Word Embedding Spaces (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing attempts to control relative isomorphism of different spaces fail to consider lexical variations of semantically similar words . Existing methods for building bilingual dictionaries rely on geometric similarity of individual spaces . |
| Approach: | They propose a method that incorporates the impact of lexical variations of semantically similar words into the training objective. |
| Outcome: | The proposed method outperforms existing research by improving the average P@1 by 63.6%. |
Antonym vs Synonym Distinction using InterlaCed Encoder NETworks (ICE-NET) (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing research on antonym-synonym distinction is limited by the sparsity of the feature space. |
| Approach: | They propose to capture and model relation-specific properties of antonyms and synonyms pairs . ICE-NET outperforms existing research by a relative score of upto 1.8% in F1-measure . |
| Outcome: | The proposed model outperforms existing models by 1.8% in the F1-measure. |
MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Jiahang Lin, Kai Hu, Binghai Wang, Yuhao Zhou, Zhiheng Xi, Honglin Guo, Shichun Liu, Junzhe Wang, Shihan Dou, Enyu Zhou, Hang Yan, Zhenhua Han, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing work on long document visual question answering is based on Retrieval-Augmented Generation (RAG) where textual or visual content is encoded into embeddings and relevance is determined by similarity scores with respect to the original query. |
| Approach: | They propose a framework that employs an agentic, vision-aware workflow to address long document visual question answering through iterative information discovery and synthesis. |
| Outcome: | The proposed framework outperforms existing RL systems by 10.4% on the MMLongbench-Doc benchmark and demonstrates superior training performance over GRPO. |
DHP Benchmark: Are LLMs Good NLG Evaluators? (2025.findings-naacl)
Copied to clipboard
Yicheng Wang, Jiayi Yuan, Yu-Neng Chuang, Zhuoer Wang, Yingchi Liu, Mark Cusick, Param Kulkarni, Zhengping Ji, Yasser Ibrahim, Xia Hu
| Challenge: | Large Language Models (LLMs) are increasingly serving as evaluators in Natural Language Generation (NLG) tasks. |
| Approach: | They propose a framework that measures the discernment of Large Language Models (LLMs) across diverse NLG tasks. |
| Outcome: | The proposed framework provides quantitative discernment scores for LLMs across four NLG tasks. |
Understanding the Repeat Curse in Large Language Models from a Feature Perspective (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models suffer from repetitive text generation, a phenomenon we refer to as the ”Repeat Curse”. |
| Approach: | They propose a method to induce and analyze the Repeat Curse in large language models by using mechanistic interpretability. |
| Outcome: | The proposed method induces and analyzes the Repeat Curse in large language models using mechanistic interpretability. |
Universal Information Extraction with Meta-Pretrained Self-Retrieval (2023.findings-acl)
Copied to clipboard
Xin Cong, Bowen Yu, Mengcheng Fang, Tingwen Liu, Haiyang Yu, Zhongkai Hu, Fei Huang, Yongbin Li, Bin Wang
| Challenge: | Existing methods for IE are task-specific, resulting in specialized and isolated approaches for different tasks. |
| Approach: | They propose a method to retrieve task-specific knowledge from pretrained language models to enhance universal IE by using a Meta-Pretraining Algorithm. |
| Outcome: | The proposed method achieves the new state-of-the-art on 4 IE tasks, 12 datasets under fully-supervised, low-resource and few-shot scenarios. |
LoRaDA: Low-Rank Direct Attention Adaptation for Efficient LLM Fine-tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in parameter-efficient fine-tuning techniques allow for adjustments to only a minor fraction of the parameters of language models. |
| Approach: | They propose a low-rank direct attention adapted method for efficient LLM fine-tuning . they propose LMAM, which can bring negative attention to self-attention modules . |
| Outcome: | The proposed method outperforms the full fine-tuning method by 2.1% on GLUE benchmark. |
LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)
Copied to clipboard
Ming Zhang, Yujiong Shen, Zelin Li, Huayu Sha, Binze Hu, Yuhui Wang, Chenhao Huang, Shichun Liu, Jingqi Tong, Changhao Jiang, Mingxu Chai, Zhiheng Xi, Shihan Dou, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Current medical benchmarks have limitations in question design, data sources and evaluation methods. |
| Approach: | They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records . |
| Outcome: | The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios. |
Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterization (2025.findings-emnlp)
Copied to clipboard
Zhengzhao Lai, Youbin Zheng, Zhenyang Cai, Haonan Lyu, Jingpu Yang, Hong-Qing Liang, Yan Hu, Benyou Wang
| Challenge: | characterization imaging data is fundamental to acquiring materials information. |
| Approach: | a team of researchers develop a benchmark for materials characterization imaging data . the goal is to bridge this gap by addressing 1,500 questions that require expert-level expertise. |
| Outcome: | a new benchmark for materials characterization imaging data is presented . the benchmark reveals that MLLMs perform poorly when addressing higher-level questions . |
Enhancing Temporal Modeling of Video LLMs via Time Gating (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Video Large Language Models neglect temporal information in video data, leading to struggles with temporal-aware video understanding. |
| Approach: | They propose a Time Gating Video LLM (TG-Vid) that employs a time gating module to enhance temporal modeling. |
| Outcome: | The proposed model outperforms existing Large Language Models on video-and-language tasks and ablation studies show that the model outpersforms the existing models. |
Let Modalities Teach Each Other: Modal-Collaborative Knowledge Extraction and Fusion for Multimodal Knowledge Graph Completion (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies have focused on missing triples in knowledge graphs, but lack correlation between modalities. |
| Approach: | They propose a framework to foster mutual guidance and collaboration in unimodal knowledge extraction and multimodal knowledge fusion. |
| Outcome: | Extensive experiments on three real-world datasets demonstrate advantages of Moodle over state-of-the-art methods. |
MMAPG: A Training-Free Framework for Multimodal Multi-hop Question Answering via Adaptive Planning Graphs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing multimodal question answering models rely on sequential retrieval and reasoning, but this single-path paradigm makes them vulnerable to errors due to misleading intermediate steps. |
| Approach: | They propose a multimodal multi-hop question answering framework guided by an Adaptive Planning Graph . they propose modality-specific strategies that dynamically adapt to distinct data types . |
| Outcome: | The proposed framework outperforms existing models that rely on training. |
Proxy-Driven Robust Multimodal Sentiment Analysis with Incomplete Data (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on optimizing model structures to handle uncertain missingness, but models still face challenges when dealing with uncertain missing data. |
| Approach: | They propose a data-centric robust multimodal sentiment analysis method, Proxy-Driven Robust Multimodal Fusion, which maps unimodal data to the latent space of Gaussian distributions to capture core features and structure. |
| Outcome: | The proposed method outperforms existing models in noise resistance and achieves state-of-the-art performance on multiple benchmark datasets. |
Mitigating Lost-in-Retrieval Problems in Retrieval Augmented Multi-Hop Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Empirical results show that ChainRAG consistently outperforms baselines in both effectiveness and efficiency. |
| Approach: | They propose a method which sequentially handles each sub-question by completing missing key entities and retrieving relevant sentences from a sentence graph for answer generation. |
| Outcome: | The proposed method outperforms baselines on three multi-hop QA datasets. |
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs (2026.findings-acl)
Copied to clipboard
Meixiu Long, Duolin Sun, Dan Yang, Yihan Jiao, Lei Liu, Jiahai Wang, Binbin Hu, Yue Shen, Jie Feng, Zhehao Tan, Junjie Wang, Lianzhen Zhong, Jian Wang, Peng Wei, Jinjie Gu
| Challenge: | Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning. |
| Approach: | They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking. |
| Outcome: | The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup. |
CMT-Eval: A Novel Chinese Multi-turn Dialogue Evaluation Dataset Addressing Real-world Conversational Challenges (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks fail to capture users’ evolving needs and how their diverse conversation styles affect the dialogue flow. |
| Approach: | They propose to use CMT-Eval to evaluate Chinese multi-turn dialogue systems. |
| Outcome: | The proposed dataset is the first dedicated dataset for fine-grained evaluation of Chinese multi-turn dialogue systems. |
Mixture of LoRA Experts for Continual Information Extraction with LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to continual information extraction are either task-specialized for a single task or suffer from catastrophic forgetting and insufficient knowledge transfer in continual IE. |
| Approach: | They propose a continual IE model that uses token-level mixture of LoRA experts with LLMs to extract emerging information across diverse IE tasks incessantly while avoiding forgetting. |
| Outcome: | The proposed model achieves state-of-the-art performance, effectively mitigating catastrophic forgetting and enhancing knowledge transfer in continual IE. |
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating a entailment tree exhibit the reasoning chains from knowledge facts to predicted answers, but they have large fact search spaces and error accumulation problems resulting in the generation of invalid steps. |
| Approach: | They propose a Fact-Retrieval and Verification Augmented bidirectional entailment tree generation method that contains two systems. |
| Outcome: | The proposed method outperforms existing models and achieves state-of-the-art performance in fact selection and structural correctness. |
From Heads to Neurons: Causal Attribution and Steering in Multi-Task Vision–Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing models focus on single tasks, limiting comparability of neuron importance . ranking strategies overlook how task-dependent information pathways shape write-in effects of feed-forward network (FFN) neurons. |
| Approach: | They propose a gradient-free framework for task-aware neuron attribution and steering in multi-task vision-language models. |
| Outcome: | The proposed framework outperforms existing methods in identifying task-critical neurons and improves model performance after steering. |
RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval (2022.findings-emnlp)
Copied to clipboard
| Challenge: | sparse sampling of videos suffers from inter-modal redundancy and visual redundancies . et al., 2021) proposes to sparsestly sample frames from videos to alleviate temporal redundance . |
| Approach: | They propose to use sparse sampling to alleviate temporal redundancy in videos . they propose to penalize high-redundant video patches and text tokens . |
| Outcome: | The proposed method improves on four benchmark datasets. |
Debate to Align: Reliable Entity Alignment through Two-Stage Multi-Agent Debate (2026.findings-acl)
Copied to clipboard
| Challenge: | Entity alignment (EA) aims to identify entities referring to the same real-world object across different knowledge graphs (KGs). |
| Approach: | They propose a reliable EA framework based on multi-agent debate that improves embedding quality and introduces a two-stage multi-role debate mechanism to enhance reliability. |
| Outcome: | The proposed framework improves embedding quality and the reasoning capability of LLMs while enabling more efficient debate-based reasoning. |
Language Agnostic Multilingual Information Retrieval with Contrastive Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Annotated training data is costly to obtain in many languages . |
| Approach: | They propose a semantic contrastive loss to align parallel sentences that share the same semantics in different languages and a language contrastive gain to leverage parallel sentence pairs to remove language-specific information from non-parallel corpora. |
| Outcome: | The proposed model improves retrieval performance while requiring less computational effort. |
NILE: Internal Consistency Alignment in Large Language Models (2025.emnlp-main)
Copied to clipboard
Minda Hu, Qiyuan Zhang, Yufei Wang, Bowei He, Hongru Wang, Jingyan Zhou, Liangyou Li, Yasheng Wang, Chen Ma, Irwin King
| Challenge: | Recent advances show that the world knowledge in the Instruction Fine-Tuning (IFT) dataset, which is incompatible with LLMs’ internal knowledge, can greatly hurt the IFT performance. |
| Approach: | They propose a framework to optimize the effectiveness of IFT by carefully aligning the world and internal knowledge of LLMs. |
| Outcome: | The proposed framework can significantly improve performance across multiple LLM ability evaluation datasets. |
Beyond ’Aha!’: Toward Systematic Meta-Abilities Alignment in Large Reasoning Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior work has shown that outcome-based reinforcement learning (RL) can incidentally elicit advanced reasoning behaviors such as self-correction, backtracking, and verification. |
| Approach: | They explicitly align large reasoning models with three meta-abilities: deduction, induction, and abduction, using automatically generated, self-verifiable tasks. |
| Outcome: | The proposed model aligns models with deduction, induction, and abduction meta-abilities using automatically generated, self-verifiable tasks. |
A Unified Positive-Unlabeled Learning Framework for Document-Level Relation Extraction with Different Levels of Labeling (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods focus on fully supervised scenarios but in real-world, incomplete labeling is a common problem because the number of entity pairs grows quadratically with the number. |
| Approach: | They propose a positive-unlabeled learning framework for document-level relation extraction (RE) that uses shift and squared ranking loss positive- unlabeles (SSR-PU) learning to solve incomplete labeling problem. |
| Outcome: | The proposed framework outperforms state-of-the-art methods under fully supervised and extremely unlabeled conditions and achieves 14 F1 points over the baseline with incomplete labeling. |
Is Compound Aspect-Based Sentiment Analysis Addressed by LLMs? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) aims to predict aspect-based elements from text . large language models (LLMs) have impressive abilities in handling human instructions . |
| Approach: | They propose a framework to evaluate LLMs' ability to handle complex ABSA tasks . they use constrained prompts to automatically organize the returned predictions . |
| Outcome: | The proposed framework outperforms supervised methods in some cases, but it is still lacking in other areas. |
Speculative Decoding for Multi-Sample Inference (2025.findings-emnlp)
Copied to clipboard
Yiwei Li, Jiayi Shi, Shaoxiong Feng, Peiwen Yuan, Xinglin Wang, Yueqi Zhang, Ji Zhang, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Speculative decoding method exploits consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or external databases. |
| Approach: | They propose a speculative decoding method that exploits the consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or external databases. |
| Outcome: | The proposed method exploits the intrinsic consensus of parallel reasoning paths to synthesize high-quality draft tokens without auxiliary models or databases. |
VAPO: End-to-end Slide-Enhanced Speech Recognition with Omni-modal Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Current Automatic Speech Recognition models, such as Whisper, have demonstrated impressive performance in general domains, but their accuracy often deteriorates significantly in specialized scenarios. |
| Approach: | They propose a visually-anchored policy optimization approach to decouple visual perception from auditory processing to optimize the model's inference process. |
| Outcome: | The proposed model eliminates visual interference and achieves state-of-the-art performance on SlideASR-Bench and public datasets. |
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models (2025.acl-long)
Copied to clipboard
Zhiyuan Hu, Yuliang Liu, Jinman Zhao, Suyuchen Wang, WangYan WangYan, Wei Shen, Qing Gu, Anh Tuan Luu, See-Kiong Ng, Zhiwei Jiang, Bryan Hooi
| Challenge: | Large language models face significant challenges in handling long-context tasks because of their limited effective context window size during pretraining, which restricts their ability to generalize over extended sequences. |
| Approach: | They propose a training strategy for extending the context window of LLMs including impactful token analysis, position index transformation, and training optimization strategies. |
| Outcome: | Experiments on three types of LLMs show that LongRecipe can utilize long sequences while requiring only 30% of the target context window size. |
MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholds (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods neglect stylistic modeling and rely on static thresholds, which greatly limits the detection performance. |
| Approach: | They propose a framework that enables stylistics-aware uncertainty quantification through conditional threshold estimation. |
| Outcome: | The proposed framework achieves an average improvement 11.34% in detection performance compared to baselines. |
Translationese-index: Using Likelihood Ratios for Graded and Generalizable Measurement of Translationese (2025.emnlp-main)
Copied to clipboard
Yikang Liu, Wanyang Zhang, Yiming Wang, Jialong Tang, Pei Zhang, Baosong Yang, Fei Huang, Rui Wang, Hai Hu
| Challenge: | Translationese is a linguistic property that is often introduced in the translation process that is different from those of original texts. |
| Approach: | They propose to use synthesized translations and translations in the wild to evaluate T-index's generalizability in cross-domain settings and its validity against human judgments. |
| Outcome: | The proposed measure can generalize to unseen genres, authors, and language pairs. |
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)
Copied to clipboard
Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu, Yuan Zeng, Hanchao Yu, Yinan Zhu, Sumedha Singla, Brian Vanover, Huijun Qian, Zihao Wang, Fujun Liu, Aashu Singh, Jianyu Wang, Xuewen Zhang
| Challenge: | Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations. |
| Approach: | They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation. |
| Outcome: | The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement. |
Resolving the Security-Auditability Dilemma with Auditable Latent Chain-of-Thought Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Extensive experiments show that ALCA reduces the success rate of adaptive jailbreak attacks by over 40% compared to strong baselines, while preserving performance. |
| Approach: | They propose a framework that decouples internal reasoning from external output and allows the model to reconstruct its latent reasoning into human-readable text for supervision under specific guidance. |
| Outcome: | The proposed framework reduces the success rate of adaptive jailbreak attacks by over 40% compared to baselines while preserving performance. |
Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism (2020.coling-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive models generate target words in parallel, but with a large latency due to the left-to-right dependency. |
| Approach: | They propose to train a conditional masked translation model and refine results within several iterations to remedy a flawed translation by non-autoregressive models. |
| Outcome: | The proposed model outperforms state-of-the-art models by over 1 BLEU while using less training computations. |
OTExtSum: Extractive Text Summarisation with Optimal Transport (2022.findings-naacl)
Copied to clipboard
| Challenge: | Extractive text summarisation aims to select salient sentences from a document to form a short yet informative summary. |
| Approach: | They propose to formulate extractive text summarisation as an Optimal Transport (OT) problem and use it to obtain an optimal summary that minimises the transportation cost to a given document. |
| Outcome: | The proposed method outperforms state-of-the-art methods and learning-based methods on multiNews, PubMed, BillSum, and CNN/DM datasets. |
SaCa: A Highly Compatible Reinforcing Framework for Knowledge Graph Embedding via Structural Pattern Contrast (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge Graph Embedding approaches lack structural semantics of knowledge graphs . structure-aware calibration (SaCa) is a framework designed to calibrate KGEs based on global structural patterns. |
| Approach: | a new framework is designed to calibrate knowledge graphs using global structural patterns. |
| Outcome: | a new framework can calibrate KGE models using global structural patterns . the framework consistently boosts performance across ten models on link prediction and entity classification tasks . |
Let’s Ask GNN: Empowering Large Language Model for Graph In-Context Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured data. |
| Approach: | They propose a novel approach that leverages In-Context Learning to integrate graph data and task-specific information into large language models (LLMs) they employ a Graph Neural Network-powered structure-enhanced retriever to select labeled nodes across graphs, incorporating complex graph structures and their supervision signals. |
| Outcome: | Experiments on three tasks and seven LLMs show that AskGNN performs better than existing methods. |
CloneMem: Benchmarking Long-Term Memory for AI Clones (2026.acl-long)
Copied to clipboard
| Challenge: | Existing memory benchmarks rely on user–agent conversational histories, which are temporally fragmented and insufficient for capturing continuous life trajectories. |
| Approach: | They propose a benchmark for evaluating long-term memory in AI Clone scenarios grounded in non-conversational digital traces, including diaries, social media posts, and emails, spanning one to three years. |
| Outcome: | Experiments show that existing memory benchmarks struggle in this setting, highlighting open challenges for life-grounded personalized AI. |
Medico: Towards Hallucination Detection and Correction with Multi-source Evidence Fusion (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing studies show that LLMs can confidently state non-existent facts rather than answering "I don't know". |
| Approach: | They propose a multi-source evidence fusion enhanced hallucination detection and correction framework that fuses evidence from multiple sources and iteratively revises the hallucinous content. |
| Outcome: | The proposed framework detects whether the generated content contains factual errors, provides the rationale behind the judgment, and iteratively revises the hallucinated content. |
LLMs Deceive Unintentionally: Emergent Misalignment in Dishonesty from Misaligned Samples to Biased Human-AI Interactions (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have shown that LLMs finetuned on incorrect completions can exhibit harmful behaviors, which is called emergent misalignment. |
| Approach: | They investigate whether LLMs finetuned on incorrect completions can exhibit harmful behaviors . they find that 1% of misalignment data is sufficient to decrease honest behavior . |
| Outcome: | The proposed model can be misaligned on errors within narrow domains to exhibit harmful behaviors . the proposed model is able to exhibit dishonest behavior with only 10% biased user population . |
V-SEAM: Visual Semantic Editing and Attention Modulating for Causal Interpretability of Vision-Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on causal interpretability focuses on large language models (LLMs) but internal mechanisms of vision-language models remain underexplored, authors say . |
| Approach: | They introduce a framework that combines visual and semantic manipulations for causal interpretation of vision-language models. |
| Outcome: | The proposed framework shows improved performance for LLAVA and InstructBLIP on three diverse benchmarks. |
Dynamic Heterogeneous-Graph Reasoning with Language Models and Knowledge Representation Learning for Commonsense Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for QA use knowledge graphs, but they ignore subgraph optimization and subgraph deepening. |
| Approach: | They propose a dynamic heterogeneous-graph reasoning method with LMs and knowledge representation learning that optimizes the structure and knowledge representing of the HKG using a two-stage pruning strategy and knowledge-representation learning. |
| Outcome: | The proposed method improves on existing methods at CommonsenseQA and OpenBookQA. |
Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt (2024.naacl-long)
Copied to clipboard
Yongqi Wang, Ruofan Hu, Rongjie Huang, Zhiqing Hong, Ruiqi Li, Wenrui Liu, Fuming You, Tao Jin, Zhou Zhao
| Challenge: | Recent singing-voice-synthesis methods lack ability to control style attributes of synthesized singing. |
| Approach: | They propose a singing-voice-synthesis method that enables attribute controlling on singer gender, vocal range and volume with natural language. |
| Outcome: | The proposed method achieves favorable control ability and audio quality. |
A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges (2025.findings-acl)
Copied to clipboard
Yibo Yan, Jiamin Su, Jianxiang He, Fangteng Fu, Xu Zheng, Yuanhuiyi Lyu, Kun Wang, Shen Wang, Qingsong Wen, Xuming Hu
| Challenge: | This survey provides **the first comprehensive analysis of mathematical reasoning in the era of multimodal large language models** . integrating large language model with mathematical reasoning tasks is becoming significant as AI advances . |
| Approach: | They review over 200 studies published since 2021 and examine the state-of-the-art developments in Math-LLMs . they identify five major challenges hindering the realization of AGI in this domain . |
| Outcome: | The authors examine the state-of-the-art developments in Math-LLMs with a focus on multimodal settings. |
Can Large Language Models Identify Implicit Suicidal Ideation? An Empirical Evaluation (2025.findings-emnlp)
Copied to clipboard
Tong Li, Shu Yang, Junchao Wu, Jiyao Wei, Lijie Hu, Mengdi Li, Derek F. Wong, Joshua R. Oltmanns, Di Wang
| Challenge: | Existing data on suicidal ideation in private conversations are limited . a new dataset of 1,200 test cases is presented to address this gap . |
| Approach: | They propose a dataset of 1,200 test cases simulating implicit suicidal ideation in private contexts. |
| Outcome: | The proposed dataset includes 1,200 test cases simulating implicit suicidal ideation in dialogue scenarios. |
FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference (2025.findings-emnlp)
Copied to clipboard
Dongwei Wang, Zijie Liu, Song Wang, Yuxin Ren, Jianing Deng, Jingtong Hu, Tianlong Chen, Huanrui Yang
| Challenge: | Key-Value (KV) cache reading latency increases with context lengths hindering LLM inference . important tokens are sparsely distributed across the long context, making existing retrieval inaccurate . |
| Approach: | They propose a method to retain a small fraction of KV cache based on token importance . important tokens are often sparsely distributed across the long context . |
| Outcome: | The proposed method reduces decoding latency by 1.2 to 1.5. |
DaNet: Dual-Aware Enhanced Alignment Network for Multimodal Aspect-Based Sentiment Analysis (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods assume a direct alignment between images and aspects, matching the entire image with a corresponding aspect. Existing algorithms assume 'direct alignment' between images, introducing noise. |
| Approach: | They propose a Dual-Aware Enhanced Alignment Network (DaNet) that can enhance fine-grained multimodal aspect-image alignment and denoising. |
| Outcome: | The proposed system outperforms existing methods in three subtasks and is available on https://github.com/***/DaNet. |
HVGuard: Utilizing Multimodal Large Language Models for Hateful Video Detection (2025.emnlp-main)
Copied to clipboard
Yiheng Jing, Mingming Zhang, Yong Zhuang, Jiacheng Guo, Juan Wang, Xiaoyang Xu, Wenzhe Yi, Keyan Guo, Hongxin Hu
| Challenge: | Existing methods for hateful video detection rely on unimodal analysis or feature fusion . Existing tools struggle to capture cross-modal interactions and reason through implicit hate in sarcasm and metaphor . |
| Approach: | They propose a reasoning-based hateful video detection framework with multimodal large language models . they integrate Chain-of-Thought reasoning to enhance multimodal interaction modeling . |
| Outcome: | The proposed framework outperforms existing tools on two public datasets covering English and Chinese. |
Won’t Get Fooled Again: Answering Questions with False Premises (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are often easily deceived by tricky questions such as “How many eyes does the sun have?” . |
| Approach: | They annotate a FalseQA dataset containing 2365 human-written FPQs and find that PLMs are capable of discriminating FPqs by fine-tuning on moderate numbers. |
| Outcome: | The proposed model can discriminate on FPQs by fine-tuning on moderate numbers of examples and generate reasonable explanations for false premise questions. |
SeaLLMs - Large Language Models for Southeast Asia (2024.acl-demos)
Copied to clipboard
Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, Mahani Aljunied, Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, Hang Zhang, Lidong Bing
| Challenge: | Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages. |
| Approach: | They propose a series of language models that specifically focuses on Southeast Asian languages. |
| Outcome: | SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations . |
WXImpactBench: A Disruptive Weather Impact Understanding Benchmark for Evaluating Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Climate change adaptation requires the understanding of disruptive weather impacts on society. |
| Approach: | They propose a large language model to evaluate the capacity of LLMs on disruptive weather impacts by using a four-stage construction pipeline. |
| Outcome: | The proposed model is based on a four-stage well-crafted construction pipeline and requires two evaluation tasks, multi-label classification and ranking-based question answering. |
MathAgent: Leveraging a Mixture-of-Math-Agent Framework for Real-World Multimodal Mathematical Error Detection (2025.acl-industry)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) struggle with identifying and categorizing student errors in multimodal mathematical contexts. |
| Approach: | They propose a new framework that decomposes error detection into three phases with specialized agents. |
| Outcome: | The proposed framework shows higher accuracy in error step identification and 3% improvement in error categorization on real-world educational data. |
Debate-of-Thoughts: Resolving Knowledge Conflicts in LLMs Through Internal Deliberation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval augmented generation are based on a simplistic binary choice of relying on external contexts or memory. |
| Approach: | They propose a framework that transforms conflict resolution into an active deliberation process by incorporating contradictions as opportunities for deeper reasoning. |
| Outcome: | Experiments show that DoT outperforms state-of-the-art methods while generating transparent debate transcripts that explain its decisions. |
Data-to-Text Generation with Style Imitation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent approaches to data-to-text generation focus on improving content fidelity, but lack explicit control over writing styles. |
| Approach: | They propose a way to control writing styles by using existing sentences as "soft" templates . they conduct experiments in restaurants and sports domains to test their approach . |
| Outcome: | The proposed approach achieves stronger performance than a range of comparison methods. |
Explicit and Implicit Data Augmentation for Social Event Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Social event detection relies on labeled data, but annotation is costly and labor-intensive. |
| Approach: | They propose a plug-and-play dual augmentation framework that combines explicit text-based and implicit feature-space augmentation to enhance data diversity and model robustness. |
| Outcome: | The proposed framework outperforms the best baseline model by 17.67% on the Twitter2012 dataset and 15.57% on the twitter2018 dataset in terms of the average F1 score. |
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)
Copied to clipboard
Tianrui Wang, Ziyang Ma, Yizhou Peng, Haoyu Wang, Zhikang Niu, Zikang Huang, Yihao Wu, Yi-Wen Chao, Yu Jiang, Yuheng Lu, Guanrou Yang, Xuanchen Li, Hexin Liu, Chunyu Qiang, Cheng Gong, Yifan Yang, Tianchi Liu, Junyu Wang, Nana Hou, Meng Ge, Fuming You, Yang Wei, Zhongqian Sun, Hu Haifeng, Xiaobao Wang, Eng Siong Chng, Xie Chen, Longbiao Wang, Jianwu Dang
| Challenge: | Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level. |
| Approach: | They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context. |
| Outcome: | The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set. |
DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Models (2024.naacl-demo)
Copied to clipboard
| Challenge: | DIALIGHT is a toolkit for developing and evaluating multilingual Task-Oriented Dialogue systems. |
| Approach: | They propose a toolkit for developing and evaluating multilingual Task-Oriented Dialogue systems which facilitates systematic evaluations and comparisons between ToD systems using pretrained language models and those utilising the zero-shot and in-context learning capabilities of Large Language Models. |
| Outcome: | The toolkit enables systematic evaluations between ToD systems using pretrained language models and those utilising the zero-shot and in-context learning capabilities of Large Language Models (LLMs). |
FAIRGAMER: Evaluating Social Biases in LLM-Based Video Game NPCs (2026.acl-long)
Copied to clipboard
Bingkang Shi, Jen-tse Huang, Luo Long, Tianyu Zong, Hongzhu Yi, Yuanxiang Wang, Songlin Hu, Xiaodan Zhang, Zhongjiang Yao
| Challenge: | Large Language Models (LLMs) have enhanced or replaced traditional non-player characters in video games. |
| Approach: | They propose a benchmark to evaluate social biases across three interaction patterns: transaction, cooperation, and competition. |
| Outcome: | The proposed benchmark assesses four bias types across transaction, cooperation, and competition using a novel metric, FairMCV. |
CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolution (2026.acl-long)
Copied to clipboard
Xiangxi Zheng, Kuang He, Jiayi Hu, Ping Yu, Rui Yan, Yuan Yao, Peng Hou, Anxiang Zeng, Alex Jinpeng Wang
| Challenge: | Existing approaches to chart-to-code generation are constrained by data-centric limitations . authors present a new framework that redesigns both training and alignment data . |
| Approach: | They propose a data-centric framework that redesigns both training and alignment data for chart-to-code generation. |
| Outcome: | The proposed framework outperforms open-source baselines and is competitive with GPT-5. |
X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System (2025.findings-acl)
Copied to clipboard
| Challenge: | X-WebAgentBench evaluates the planning and interaction performance of language agents across multiple languages. |
| Approach: | They propose a multilingual agent benchmark that evaluates the interaction performance of language agents across multiple languages. |
| Outcome: | The proposed benchmark evaluates the planning and interaction performance of language agents across multiple languages. |
Cognitive Alpha Mining via LLM-Driven Code-Based Evolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to finding effective predictive signals from financial data are limited by their complexity and low signal-to-noise ratio. |
| Approach: | They propose a framework that combines code-level alpha representation with LLM-driven reasoning and evolutionary search. |
| Outcome: | The proposed framework combines code-level alpha representation with LLM-driven reasoning and evolutionary search. |
Tree-CoT-RT: An Explainable Multi-Path Tree-Guided Chain-of-Thought and Reinforcement Learning Framework for Aspect Sentiment Quad Prediction (2026.findings-acl)
Copied to clipboard
Hao Zhang, Jiahao Wang, Zhenke Duan, Xin Yin, Haichuan Hu, Hualong Chen, null Suyi, Congqing He, Yike Tan, Yu-N Cheah
| Challenge: | Existing methods lack explainability and generalization, making it difficult to justify inference decisions and detect implicit sentiment across domains and varied expression patterns. |
| Approach: | They propose an explainable multi-path tree-guided chain-of-thought framework specifically designed for ASQP. |
| Outcome: | Experiments on benchmark datasets show that Tree-CoT-RT outperforms baselines. |
LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understanding (2026.acl-long)
Copied to clipboard
Zhivar Sourati, Zheng Wang, Marianne Menglin Liu, Yazhe Hu, Mengqing Guo, Sujeeth Bharadwaj, Kyu J. Han, Tao Sheng, Sujith Ravi, Morteza Dehghani, Dan Roth
| Challenge: | Conventional retrieval-augmented generation (RAG) methods encode content in isolated chunks during ingestion, losing structural and cross-page dependencies, and retrieve a fixed number of pages at inference. |
| Approach: | They propose a Layout-Aware Dynamic RAG framework that encodes content in isolated chunks during ingestion and retrieves a fixed number of pages at inference. |
| Outcome: | Experiments on MMLongBench-Doc, LongDocURL, DUDE, and MP-DoxVQA show that LAD-RAG improves retrieval, achieving over 90% perfect recall on average without any top-k tuning, and outperforming baseline retrievers by up to 20% in recall at comparable noise levels. |
PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queries (2025.naacl-long)
Copied to clipboard
Mingwen Dong, Nischal Ashok Kumar, Yiqun Hu, Anuj Chauhan, Chung-Wei Hang, Shuaichen Chang, Lin Pan, Wuwei Lan, Henghui Zhu, Jiarong Jiang, Patrick Ng, Zhiguo Wang
| Challenge: | Existing text-to-SQL systems focus on user questions with clear intentions that can be answered, but real user questions can be ambiguous with multiple interpretations or unanswerable due to a lack of relevant data. |
| Approach: | They construct a conversational text-to-SQL dataset called PRACTIQ, consisting of ambiguous and unanswerable questions inspired by real-world user questions. |
| Outcome: | The proposed system generates conversations with four turns, generating the user’s question, an assistant response seeking clarification, and the user's clarified SQL response with the natural language explanation of the execution results. |
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)
Copied to clipboard
Xinming Wang, Jian Xu, Bin Yu, Sheng Lian, yi Chen, Boran Wang, Yingjian Zhu, Hongzhu Yi, Hong-Ming Yang, Han Hu, Cheng-Lin Liu, Xu-Yao Zhang
| Challenge: | Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited. |
| Approach: | They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments. |
| Outcome: | Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning. |
SafeConf: A Confidence-Calibrated Safety Self-Evaluation Method for Large Language Models (2025.findings-emnlp)
Copied to clipboard
Bo Zhang, Cong Gao, Linkang Yang, Bingxu Han, Minghao Hu, Zhunchen Luo, Guotong Geng, Xiaoying Bai, Jun Zhang, Wen Yao, Zhong Wang
| Challenge: | Large language models (LLMs) have many advantages but they also pose significant safety risks. |
| Approach: | They propose a method to enhance the safety self-evaluation capability of LLMs . they perform semantic mutations on the original safety evaluation questions . |
| Outcome: | The proposed method improves safety self-evaluation accuracy by 5.86% and 7.79% over baseline methods on Chinese and English datasets. |
Structure Trumps Size: Rethinking Data Quality for LLM Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning Large Language Models rely on heuristic strategies and lack systematic, quantitative frameworks for evaluating data quality. |
| Approach: | They propose a multi-dimensional quantitative framework for reasoning data management . they rigorously evaluate and optimize datasets along six orthogonal dimensions . |
| Outcome: | The proposed framework rigorously evaluates and optimizes datasets along six orthogonal dimensions. |
LRBench and Judge-R1: Principled Evaluation and Training of LLM-Based Judges for Long-Context Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for evaluating large language models (LLMs) under long contexts are underexplored. |
| Approach: | They propose a large-scale benchmark for evaluating large language models (LLMs) that combines reinforcement learning with multi-turn search to enable grounded and principle-aware evaluation. |
| Outcome: | The proposed model outperforms single-turn baselines across domains and principles. |
Evaluating Robustness of Generative Search Engine on Adversarial Factoid Questions (2024.findings-acl)
Copied to clipboard
Xuming Hu, Xiaochuan Li, Junzhe Chen, Yinghui Li, Yangning Li, Xiaoguang Li, Yasheng Wang, Qun Liu, Lijie Wen, Philip Yu, Zhijiang Guo
| Challenge: | Existing large language models (LLMs)-backed generative search engines may not always be accurate. |
| Approach: | They propose to evaluate the robustness of retrieval-augmented generation in a realistic and high-risk setting where adversaries have only black-box system access. |
| Outcome: | The proposed model exhibits higher susceptibility to factual errors compared to LLMs without retrieval. |
Relevant or Random: Can LLMs Truly Perform Analogical Reasoning? (2025.findings-acl)
Copied to clipboard
| Challenge: | Analogical reasoning is a unique ability of humans to address unfamiliar challenges by transferring strategies from relevant past experiences. |
| Approach: | They propose to use self-generated random examples to improve performance on a variety of reasoning tasks by incorporating relevant examples from relevant past experiences. |
| Outcome: | The proposed methods achieve comparable or even better performance on GSM8K with random biological examples. |
Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for few-shot relation extraction (RE) are not suitable for continual few-sshot RE. |
| Approach: | They propose a new model to train a model for new relations with few labeled training data. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets. |
From General Reward to Targeted Reward: Improving Open-ended Long-context Generation Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current research on long-form context in Large Language Models (LLMs) focuses on understanding of long-contexts, but the open-ended Long Text Generation (Open-LTG) remains underexplored. |
| Approach: | They propose a method that uses data synthesis and a reward signal to enhance model performance. |
| Outcome: | The proposed method outperforms GPT-4-Turbo and improves performance by 20% on the Open-LTG task. |
RedCoast: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs (2024.naacl-demo)
Copied to clipboard
| Challenge: | Recent advances in machine learning (ML) are attributed to large language models (LLMs), but their escalating memory requirements require developers to partition a large model to distribute it across multiple GPUs or TPUs. |
| Approach: | They propose a lightweight and user-friendly tool to automate distributed training and inference for LLMs and to simplify ML pipeline development. |
| Outcome: | The proposed tool automates distributed training and inference for LLMs, and simplifies ML pipeline development. |
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) evolve into agentic systems capable of autonomous tool invocation and complex reasoning. |
| Approach: | They propose a trajectory-level preference benchmark to evaluate judges' ability to distinguish preferred versus distractor agent trajectories in tool-integrated environments. |
| Outcome: | The proposed benchmark evaluates how well judges distinguish preferred versus distractor agent trajectories in complex tool-using scenarios. |
GUI Agents: A Survey (2025.findings-acl)
Copied to clipboard
Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Dac Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt
| Challenge: | Large Foundation Models (LFMs) have transformed the landscape of AI research and day-to-day life. |
| Approach: | They propose a framework that delineates GUI agents' perception, reasoning, planning, and acting capabilities. |
| Outcome: | The proposed framework delineates their perception, reasoning, planning, and acting capabilities. |
TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks (2026.findings-acl)
Copied to clipboard
Yuanze Hu, Xinyu Wang, Zhichao Yang, Gen Li, Ye Qiu, Zhaoxin Fan, Yifan Sun, Wenjun wu, Jin Dong, Xiaotie Deng
| Challenge: | Lightweight Vision-Language Models (VLMs) are indispensable for resource-constrained applications. |
| Approach: | They propose a framework that retrieves context from a memory bank to enhance alignment . they propose EMI-based approach to align vision and language models . |
| Outcome: | The proposed framework reduces training loss, accelerates convergence, and enhances task performance with negligible computational overhead. |
WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem (2026.findings-acl)
Copied to clipboard
Chengyou Wang, Mingchen Shao, Jingbin Hu, Zeyu Zhu, Hongfei Xue, Bingshen Mu, Xin Xu, Xingyi Duan, Binbin Zhang, Zhu Pengcheng, Chuang Ding, Xiaojun Zhang, Hui Bu, Lei Xie
| Challenge: | despite its linguistic significance, the Wu dialect of Chinese has long been hindered by the lack of large-scale speech data, standardized evaluation benchmarks, and publicly available models. |
| Approach: | They propose to use WenetSpeech-Wu as a large-scale, multi-dimensionally annotated open-source speech corpus for the Wu dialect of Chinese. |
| Outcome: | The proposed dataset includes 8,000 hours of speech data and strong open-source models . the proposed dataset is competitive and empirically validated . |
Re-entry Prediction for Online Conversations via Self-Supervised Learning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on re-entry prediction ignores conversation thread patterns and repeated engagement of target users. |
| Approach: | They propose to use conversation thread patterns to predict whether a user will come back to a conversation they once participated in to train a model on labels that are automatically derived from the data. |
| Outcome: | The proposed task outperforms the state-of-the-art models on two social media datasets with fewer parameters and faster convergence. |
FABLE: Fine-grained Fact Anchoring for Unstructured Model Editing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for model editing memorize text holistically without reliable fine-grained fact access. |
| Approach: | They propose a hierarchical framework that decouples fine-grained fact injection from holistic text generation. |
| Outcome: | The proposed framework significantly improves fine-grained question answering while maintaining state-of-the-art holistic editing performance. |
From Sub-Ability Diagnosis to Human-Aligned Generation: Bridging the Gap for Text Length Control via MarkerGen (2025.acl-long)
Copied to clipboard
Peiwen Yuan, Chuyi Tan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Yueqi Zhang, Jiayi Shi, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Existing methods to control text length are lacking in LCTG, posing a major limitation for practical applications. |
| Approach: | They propose a plug-and-play approach that decomposes LCTG sub-abilities with human patterns as reference and performs detailed error analysis. |
| Outcome: | The proposed method significantly improves LCTG across various settings, exhibiting outstanding effectiveness and generalizability. |
An Entity-Driven Framework for Abstractive Summarization (D19-1)
Copied to clipboard
| Challenge: | Popular neural summarization models produce incoherent and unfaithful summaries . however, their outputs are often incohérent and incoerent . |
| Approach: | They propose a system for ENtity-drivEn Coherent Abstractive summarization framework that leverages entity information to generate informative and coherent abstracts. |
| Outcome: | The proposed framework outperforms existing state-of-the-art models on New York Times and CNN/Daily Mail datasets. |
Knowledgeable Parameter Efficient Tuning Network for Commonsense Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Existing commonsense question answering models incur prohibitive computation costs and poor interpretability . |
| Approach: | They propose a parameter efficient tuning network to pair PLMs with external knowledge for commonsense question answering. |
| Outcome: | The proposed adapter integrates entity- and query-related knowledge at a small cost. |
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)
Copied to clipboard
Yancheng He, Shilong Li, Jiaheng Liu, Yingshui Tan, Weixun Wang, Hui Huang, Xingyuan Bu, Hangyu Guo, Chengwei Hu, Boren Zheng, Zhuoran Lin, Dekai Sun, Zhicheng Zheng, Wenbo Su, Bo Zheng
| Challenge: | Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence. |
| Approach: | They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics . |
| Outcome: | The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate . |
Unlocking General Long Chain-of-Thought Reasoning Capabilities of Large Language Models via Representation Engineering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work finds that long CoT reasoning can be efficiently elicited by tuning on only a few examples and can easily transfer to other tasks. |
| Approach: | They propose a representation engineering method to unleash the general long CoT reasoning capabilities of LLMs. |
| Outcome: | The proposed method is effective in in-domain and cross-domain scenarios. |
Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challenges (2025.findings-acl)
Copied to clipboard
Hongru Wang, Wenyu Huang, Yufei Wang, Yuanhao Xi, Jianqiao Lu, Huan Zhang, Nan Hu, Zeming Liu, Jeff Z. Pan, Kam-Fai Wong
| Challenge: | Existing benchmarks that assess Language Models (LMs) as Language Agents (LAs) for tool use focus on stateless, single-turn interactions or partial evaluations, overlooking the inherent stateful nature of interactions in multi-turn applications. |
| Approach: | They propose a multi-turn dialogue dataset with stateful tool interactions considering the whole life cycle of tool use across six key tasks in three stages . they also build VirtualMobile – an embodied virtual mobile evaluation environment to simulate API calls and assess the robustness of the created APIs. |
| Outcome: | The proposed dataset evaluates 13 open- and closed-source LLMs and provides detailed analysis at each stage. |
RealMem: Benchmarking LLMs in Real-World Memory-Driven Interaction (2026.findings-acl)
Copied to clipboard
Haonan Bian, Zhiyuan Yao, Sen Hu, Zishan Xu, Shaolei Zhang, Yifu Guo, Ziliang Yang, Xueran Han, Huacan Wang, Ronghao Chen
| Challenge: | Existing benchmarks focus on casual conversation or task-oriented dialogue, failing to capture “long-term project-oriented” interactions where agents must track evolving goals. |
| Approach: | They propose a benchmark that simulates the dynamic evolution of memory in real-world projects. |
| Outcome: | The proposed benchmarks simulate the dynamic evolution of memory in real-world projects. |
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)
Copied to clipboard
Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen
| Challenge: | a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented. |
| Approach: | They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs). |
| Outcome: | The proposed library is based on extensive experiments in a variety of evaluation settings. |
VHASR: A Multimodal Speech Recognition System With Vision Hotwords (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that incorporate audio-related image information do not improve speech recognition performance. |
| Approach: | They propose a novel approach utilizing audio-related image information and set up a multimodal speech recognition system that uses vision as hotwords to enhance the model’s speech recognition capability. |
| Outcome: | The proposed model outperforms unimodal ASR model and achieves SOTA among existing image-based multimodal ASL models. |
AutoL2S: Auto Long-Short Reasoning for Efficient Large Language Models (2026.findings-acl)
Copied to clipboard
Feng Luo, Yu-Neng Chuang, Guanchu Wang, Hoang Anh Duy Le, Shaochen Zhong, Hongyi Liu, Jiayi Yuan, Yang Sui, Vladimir Braverman, Vipin Chaudhary, Xia Hu
| Challenge: | Existing approaches to distilling large language models (LLMs) are inefficient and generate excessively long chain-of-thought reasoning even for inputs that admit concise solutions. |
| Approach: | They propose a distillation framework that empowers non-reasoning LLMs to think only when necessary. |
| Outcome: | The proposed framework reduces reasoning length up to 71% with minimal accuracy loss while preserving accuracy. |
LEDOM: Reverse Language Model (2026.acl-long)
Copied to clipboard
Xunjian Yin, Sitao Cheng, Yuxi Xie, Xinyu Hu, Li Lin, Xinyi Wang, Liangming Pan, William Yang Wang, Xiaojun Wan
| Challenge: | Autoregressive language models are trained exclusively left-to-right, yet they are limited in their ability to factorize text. |
| Approach: | They propose a purely reverse autoregressive language model that factorizes text as a product of left-to-right conditionals. |
| Outcome: | The proposed model can be used to score forward outputs using reverse posterior estimates. |
Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge Graphs (2025.acl-long)
Copied to clipboard
Nan Hu, Jiaoyan Chen, Yike Wu, Guilin Qi, Hongru Wang, Sheng Bi, Yongrui Chen, Tongtong Wu, Jeff Z. Pan
| Challenge: | Attributed Question Answering (AQA) has attracted wide attention, but there are several limitations in evaluating the attributions. |
| Approach: | They propose a large-scale benchmark containing comprehensive attribution categories . they compare 25 automatic evaluators with human evaluers and tested LLM evalators . |
| Outcome: | The proposed method can compare attributions with subtle differences and provide feedback to improve them. |
Getting More Juice Out of Your Data: Hard Pair Refinement Enhances Visual-Language Models Without Extra Data (2025.naacl-long)
Copied to clipboard
Haonan Wang, Minbin Huang, Runhui Huang, Lanqing Hong, Hang Xu, Tianyang Hu, Xiaodan Liang, Zhenguo Li, Hong Cheng, Kenji Kawaguchi
| Challenge: | Contrastive Language-Image Pre-training (CLIP) is a standard for cross-modal image-text representation learning. |
| Approach: | They propose a framework that enhances pre-trained CLIP models by exploiting challenging text-image pairs within existing datasets. |
| Outcome: | The proposed framework improves CLIP models by exploiting text-image pairs in training. |
An Investigation of Potential Function Designs for Neural CRF (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to sequence labeling are based on the neural linear-chain CRF model. |
| Approach: | They propose a series of increasingly expressive potential functions for neural CRF models that integrate emission and transition functions and explicitly take contextual words as input. |
| Outcome: | The proposed model consistently achieves the best performance on the decomposed quadrilinear potential function based on the representations of two neighboring labels and two neighbored words. |
OSCR-Attack: One-Shot Character Level Attacks through Self-Optimizing Continuous Relaxation (2026.findings-acl)
Copied to clipboard
Lingyi Kong, Zhuo Liu, Zhanghao Hu, Qilong Qiu, Yutao Yang, Jingjing Xue, Zheng Wang, Lin Gui, Feiping Nie
| Challenge: | Character-level adversarial attacks preserve semantics but are costly and inefficient . generative LLMs are gaining popularity due to their uncertainty and vulnerability to textual adversarials . |
| Approach: | They propose an end-to-end framework that transforms discrete choices into continuous representations and a conflict resolution strategy that maps them back into discrete insertion operations. |
| Outcome: | The proposed framework improves ASR by 21.45% points and accelerates the attack by 3.66 times compared to baselines. |
MultiSkill: Evaluating Large Multimodal Models for Fine-grained Alignment Skills (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation settings for large multimodal models focus on coarse-grained evaluation without considering skill composition required by specific instructions. |
| Approach: | They propose an evaluation protocol that assesses large multimodal models across multiple fine-grained skills for alignment with human values. |
| Outcome: | The proposed evaluation protocol decomposes coarse-level scoring to fine-grained skill set-level score tailored to each instruction. |
Revisiting Self-Consistency from Dynamic Distributional Alignment Perspective on Answer Aggregation (2025.findings-acl)
Copied to clipboard
Yiwei Li, Ji Zhang, Shaoxiong Feng, Peiwen Yuan, Xinglin Wang, Jiayi Shi, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Existing studies on self-consistency show that it improves reasoning abilities by aggregating diverse stochastic samples. |
| Approach: | They propose a confidence-driven mechanism that dynamically calibrates temperature to align with high probability modes. |
| Outcome: | The proposed method outperforms fixed-diversity baselines on reasoning tasks and improves both average and best-case performance. |
Surprise Calibration for Better In-Context Learning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for in-context learning apply fixed class priors across all inputs . existing methods rely on retraining and retrain models . |
| Approach: | They propose a Bayesian-based method to capture the temporal dynamics of class priors . they identify "surprise" as an informative signal for class prior shift . |
| Outcome: | The proposed method outperforms existing methods on a range of benchmark tasks. |
Automatic Marketing Theme and Commodity Construction System for E-commerce (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing recommendation system invites experts to write marketing themes and select relevant commodities, which suffer from difficulty in mass production, poor timeliness and low online indicators. |
| Approach: | They propose to use pretrained language model to generate marketing themes and commodity consistency module to select relevant commodities for the generative theme. |
| Outcome: | The proposed system can generate popular marketing themes and select relevant commodities automatically and improve theme online effectiveness compared with state-of-the-art methods. |
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) often struggle to accurately express factual knowledge, especially in cases where the knowledge boundaries are ambiguous. |
| Approach: | They propose a framework that leverages Uncertainty estimations to represent knowledge boundaries and incorporates these representations into prompts for LLMs to Align with factual knowledge. |
| Outcome: | The proposed framework significantly improves the LLMs’ capacities to confidently answer known questions and refuse unknown questions on both in-domain and out-of-domain tasks. |
Re-Align: Aligning Vision Language Models via Retrieval-Augmented Direct Preference Optimization (2025.emnlp-main)
Copied to clipboard
Shuo Xing, Peiran Li, Yuping Wang, Ruizheng Bai, Yueqi Wang, Chan-Wei Hu, Chengxuan Qian, Huaxiu Yao, Zhengzhong Tu
| Challenge: | emergence of large Vision Language Models (VLMs) has broadened the capabilities of single-modal Large Language Model (LLM) but VLMs are prone to significant hallucinations, especially in the form of cross-modal inconsistencies. |
| Approach: | They propose a new alignment framework that leverages image retrieval to integrate both textual and visual preference signals. |
| Outcome: | The proposed framework mitigates hallucinations more effectively than previous methods . it maintains robustness and scalability across a wide range of VLM sizes and architectures . |
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice. |
| Approach: | They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation. |
| Outcome: | The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
FlowMalTrans: Unsupervised Binary Code Translation for Malware Detection Using Flow-Adapter Architecture (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using deep learning to detect malware has attracted great attention due to its notable performance. |
| Approach: | a new approach uses Neural Machine Translation and Normalizing Flows to apply deep learning to malware detection. |
| Outcome: | The proposed approach reduces the burden of data collection by enabling malware detection across multiple ISAs. |
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)
Copied to clipboard
Qi Zhang, Shouqing Yang, Lirong Gao, Hao Chen, Xiaomeng Hu, Jinglei Chen, Jiexiang Wang, Sheng Guo, Bo Zheng, Haobo Wang, Junbo Zhao
| Challenge: | Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL). |
| Approach: | They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation. |
| Outcome: | The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation. |
K-GIP: Diagnosing Logical Fractures in Large Vision-Language Models via Verification Scene Graphs and Sequential Pruning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks that treat hallucinations as isolated errors neglect causal dependencies between visual perception and textual reasoning. |
| Approach: | They propose a Knowledge-Guided In-Context Probing framework that constructs a dual-perception ground truth to transform abstract priors into multi-granularity queries. |
| Outcome: | The proposed framework isolates deep reasoning failures from simple perceptual misses. |
Conversational Word Embedding for Retrieval-Based Dialog System (2020.acl-main)
Copied to clipboard
| Challenge: | Existing word embedding methods for retrieval-based dialog systems are based on co-occurrence statistics and train them based upon the same co-existence statistics. |
| Approach: | They propose a conversational word embedding method which uses the conversation pairs post, reply, and 'reply' they introduce a word alignment model from statistical machine translation and train it on word-level and sentence-level. |
| Outcome: | The proposed method improves the quality of the selected response on retrieval-based dialog systems. |
KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) is a critical task to predict missing facts among entities. |
| Approach: | They propose a knowledge-constrained generative re-ranking method based on generative large language models for KGC that can predict missing facts among entities. |
| Outcome: | The proposed method achieves state-of-the-art performance on four datasets and 9.0% and 11.1% compared to the previous methods. |
Do Code Semantics Help? A Comprehensive Study on Execution Trace-Based Information for Code Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Code Large Language Models have limited ability to reason about runtime behavior and understand functionality . authors present a generic framework to support integrating semantic information to code task-relevant prompts . |
| Approach: | a study examines the role of trace-based semantic information in boosting supervised fine-tuning and post-phase inference of Code LLMs. |
| Outcome: | a new framework integrates semantic information to code task-relevant prompts . the proposed framework shows that trace-based semantic information boosts reasoning ability . |
Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to producing presentation slides rely on fixed templates or executable code . Existing methods rely only on predefined templates and emit executable codes . |
| Approach: | They propose a hierarchical slides generation workflow DeepSlides that organizes slide design tasks without any predefined template or style. |
| Outcome: | The proposed framework outperforms baseline methods on evaluated metrics and achieves superior performance in human preference evaluations. |
Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialogues (2025.emnlp-main)
Copied to clipboard
Jinfeng Zhou, Yuxuan Chen, Jianing Yin, Yongkang Huang, Yihan Shi, Xikun Zhang, Libiao Peng, Rongsheng Zhang, Tangjie Lv, Zhipeng Hu, Hongning Wang, Minlie Huang
| Challenge: | Existing approaches to cognitive restructuring (CR) are limited by entrenched cognitive distortions, emotional resistance, and individual differences. |
| Approach: | They propose a framework that structures CR as theory-grounded multi-stage multi-turn dialogue and a multi-channel loop mechanism to account for diverse individual distortions. |
| Outcome: | The proposed framework integrates supportive strategies for emotional management and a multi-channel loop mechanism to account for diverse individual distortions. |
Mutual Reinforcement of LLM Dialogue Synthesis and Summarization Capabilities for Few-Shot Dialogue Summarization (2025.findings-naacl)
Copied to clipboard
Yen-Ju Lu, Ting-Yao Hu, Hema Swetha Koppula, Hadi Pouransari, Jen-Hao Rick Chang, Yin Xia, Xiang Kong, Qi Zhu, Xiaoming Simon Wang, Oncel Tuzel, Raviteja Vemulapalli
| Challenge: | Empirical results demonstrate that our method improves dialogue summarization, achieving a 1.5% increase in ROUGE scores and a 0.3% improvement in BERT scores in few-shot settings. |
| Approach: | They propose Mutual Reinforcing Data Synthesis (MRDS) within large language models to enhance few-shot dialogue summarization task. |
| Outcome: | Empirical results show that the proposed method improves dialogue summarization, achieving a 1.5% increase in ROUGE scores and a 0.3% improvement in BERT scores in few-shot settings. |
Bridging the Temporal Gap in Multimodal LLMs: Deeply Stacking Temporal Tokens for Audio-Visual Speech Recognition (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing audio-visual speech recognition systems suffer from a temporal gap . visual speech patterns captured from lip movements provide complementary information that remains inherently robust to acoustic noise. |
| Approach: | They propose a framework that deeply stacks temporal tokens across both encoding and decoding stages to bridge this temporal gap. |
| Outcome: | The proposed framework outperforms existing supervised, self-supervised, and LLM-based methods by 6.1% on LRS2 and 7.8% on LLS3. |
SecDecoding: Steerable Decoding for Safer LLM Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing decoding-time defense methods suffer from limited generalization, high computational overhead, or significant utility degradation. |
| Approach: | They propose a decoding-time defense framework that leverages a pair of small contrastive models to estimate token-level safety signals by measuring divergence in their output distributions. |
| Outcome: | The proposed framework achieves near-zero attack success rates against a wide spectrum of advanced jailbreak attacks while maintaining the model’s helpfulness with minimal degradation. |
MTRouter: Cost-Aware Multi-Turn LLM Routing with History–Model Joint Embeddings (2026.acl-long)
Copied to clipboard
| Challenge: | Multi-turn, long-horizon tasks require dozens of sequential model calls per episode. |
| Approach: | They propose a cost-aware multi-turn LLM routing tool which encodes interaction history and candidate models into joint history–model embeddings and learns an outcome estimator from logged trajectories to predict turn-level model utility. |
| Outcome: | The proposed model reduces cost and performance by 58.7% on ScienceWorld and on Humanity’s Last Exam (HLE) and even reduces costs for held-out tasks. |
SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning (2026.acl-long)
Copied to clipboard
Peidong Wang, Zhiming Ma, Xin Dai, YongKang Liu, Shi Feng, Xiaocui Yang, Wenxing Hu, Zhihao Wang, Mingjun Pan, Li Yuan, Daling Wang
| Challenge: | Existing methods for fraud detection rely on transcribed text, lacking acoustic cues . a proposed framework for audio-based slow-thinking fraud detection eliminates transcription errors . |
| Approach: | They propose a framework for audio-based slow-thinking fraud detection that eliminates transcription errors and rewards slow-thought reasoning by capturing fine-grained audio details. |
| Outcome: | The proposed method improves accuracy, inference efficiency, and real-time processing capabilities. |
SAM Decoding: Speculative Decoding via Suffix Automaton (2025.acl-long)
Copied to clipboard
| Challenge: | Speculative decoding (SD) methods are inefficient and rely on single retrieval resources. |
| Approach: | They propose a retrieval-based speculative decoding method that adapts the suffix automaton for efficient draft generation by utilizing the generating text sequence and static text corpus. |
| Outcome: | The proposed method can find the longest suffix match and can be integrated with existing methods to generalize to broader domains. |
VideoVista-CulturalLingo: 360° Horizons-Bridging Cultures, Languages, and Domains in Video Comprehension (2025.acl-long)
Copied to clipboard
| Challenge: | Existing video evaluation benchmarks focus on a single language, typically English, and feature videos rooted in Western cultural contexts. |
| Approach: | They propose a video evaluation benchmark designed to bridge cultural, linguistic, and domain divide in video comprehension. |
| Outcome: | The proposed video evaluation benchmark bridges cultural, linguistic, and domain divides . existing benchmarks only feature videos from YouTube, Shutterstock, or established video datasets based on cultural diversity . |
Smoothed Contrastive Learning for Unsupervised Sentence Embedding (2022.coling-1)
Copied to clipboard
| Challenge: | Unsupervised contrastive sentence embedding models use InfoNCE loss function . increasing batch size leads to performance degradation when it exceeds threshold . |
| Approach: | They propose a simple smoothing strategy upon the InfoNCE loss function to reduce the number of false-negative pairs in a batch without increasing the batch size. |
| Outcome: | The proposed smoothing strategy improves unsupervised SimCSE on semantic similarity tasks. |
Policy-Guided Stepwise Action Planning for Controllable LLM Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to steering large language model reasoning via high-level reasoning actions fail to outperform standard generation because planners tend to degenerate into repetitive loops or fixed patterns. |
| Approach: | They propose a planner-executor framework that learns to select reasoning actions dynamically while keeping the executor LLM fully frozen. |
| Outcome: | The proposed framework outperforms existing paradigms by preserving the executor LLM frozen . PG-HAP improves accuracy over strong baselines while producing less redundant, more adaptive trajectories. |
Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent years have witnessed significant advancements in large language models (LLMs) but still struggle with integrating vision and audio. |
| Approach: | They propose a self-knowledge distillation method to improve vision-audio capabilities of OLLMs by learning from the vision-text components. |
| Outcome: | The proposed method improves vision-audio capabilities of OLLMs by learning from vision-text components, which improves interaction between audio and images and results in improved performance on multimodal tasks. |
MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan Generation (2025.acl-industry)
Copied to clipboard
Hsin-Ling Hsu, Cong-Tinh Dao, Luning Wang, Zitao Shuai, Thao Nguyen Minh Phan, Jun-En Ding, Chun-Chieh Liao, Pengfei Hu, Xiaoxue Han, Chih-Ho Hsu, Dongsheng Luo, Wen-Chih Peng, Feng Liu, Fang-Ming Hung, Chenwei Wu
| Challenge: | Existing systems focus primarily on assessment rather than treatment planning. |
| Approach: | They propose a framework that structures LLM reasoning to align with real-life workflows. |
| Outcome: | The proposed framework outperforms baseline approaches in assessment accuracy and treatment plan quality. |
FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data (2025.naacl-long)
Copied to clipboard
| Challenge: | Prior research on training grounded factuality classification models to detect hallucinations in large language models (LLMs) has relied on public natural language inference (NLI) data and synthetic data. |
| Approach: | They propose a method that leverages multi-hop reasoning on context graphs extracted from documents to generate complex multi-level claims without relying on LLMs to decide data labels. |
| Outcome: | The proposed model outperforms GPT-4-o on the LLM-Aggrefact benchmark with much smaller model size. |
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)
Copied to clipboard
Zhanyu Liu, Shiyao Wang, Xingmei Wang, Rongzhou Zhang, Jiaxin Deng, Honghui Bao, Jinghao Zhang, Wuchao Li, PengFei Zheng, Xiangyu Wu, Yifei Hu, Qigen Hu, Xinchen Luo, Lejian Ren, Zhang Zixing, Qianqian Wang, Kuo Cai, Yunfan Wu, Hongtao Cheng, Zexuan Cheng, Lu Ren, Huanjie Wang, Yi Su, Ruiming Tang, Kun Gai, Guorui Zhou
| Challenge: | Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs. |
| Approach: | They propose a framework that integrates dialogue, reasoning, and personalized recommendation. |
| Outcome: | Experiments across public benchmarks show state-of-the-art performance. |
InterIDEAS: Philosophical Intertextuality via LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | a new dataset aims to bridge philosophy, literary studies, and natural language processing (NLP) by integrating theories of intertextuality with bibliometric techniques. |
| Approach: | They propose a dataset that bridges philosophy, literary studies, and natural language processing (NLP) it combines theories of intertextuality from literary studies with bibliometric techniques and recent LLMs . |
| Outcome: | a new dataset bridges philosophy, literary studies, and natural language processing (NLP) to analyze intertextuality . the proposed method helps scholars understand the intellectual, social, and historical relations embedded in texts . it also contributes to the development of language models, authors say . |
Rewarding the Rare: Uniqueness-Aware RL for Creative Problem Solving in LLMs (2026.findings-acl)
Copied to clipboard
Zhiyuan Hu, Yucheng Wang, Yufei He, Jiaying Wu, Yilun Zhao, See-Kiong Ng, Cynthia Breazeal, Anh Tuan Luu, Hae Won Park, Bryan Hooi
| Challenge: | Reinforcement learning (RL) is a paradigm for post-training large language models, but it suffers from exploration collapse . a new study finds that RL fails to reward correct solutions that exhibit rare high-level strategies . |
| Approach: | They propose a method that rewards correct solutions that exhibit rare high-level strategies by clustering rollouts according to their high- level solution strategies. |
| Outcome: | The proposed approach improves pass@k across large sampling budgets and increases area under the pass@K curve (AUC@K) without sacrificing pass@1. |
CO3: Low-resource Contrastive Co-training for Generative Conversational Query Rewrite (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in conversational IR systems have seen a resurgent interest in conversation . generative query rewrite generates reconstructed query based on the conversation history . |
| Approach: | They propose to use unlabeled data to make further improvements using contrastive co-training paradigm. |
| Outcome: | The proposed model is robust to noise and language style shift under few-shot and zero-shot scenarios. |
Interactive Question Clarification in Dialogue via Reinforcement Learning (2020.coling-industry)
Copied to clipboard
| Challenge: | ambiguous questions are a perennial problem in real-world dialogue systems. |
| Approach: | They propose a reinforcement model to clarify ambiguous questions by suggesting refinements of the original query. |
| Outcome: | The proposed model improves on real-world user clicks and shows significant improvements . it suggests that the original query is refined to clarify ambiguous questions . |
Knowledge Association with Hyperbolic Knowledge Graph Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graphs (KGs) depend on high embedding dimensions and hierarchical structures to achieve expressiveness. |
| Approach: | They propose a hyperbolic relational graph neural network for KG embedding and capture knowledge associations with a high-dimensional transformation. |
| Outcome: | Experiments on entity alignment and type inference show the proposed method is effective and efficient. |
Harnessing and Evaluating the Intrinsic Extrapolation Ability of Large Language Models for Vehicle Trajectory Prediction (2025.naacl-long)
Copied to clipboard
| Challenge: | Emergent abilities of large language models (LLMs) have advanced their application in autonomous vehicle research. |
| Approach: | They propose a framework that leverages LLMs’ built-in extrapolation capabilities for vehicle trajectory prediction, enabling them to understand traffic agents' behavior and interactions over time. |
| Outcome: | The proposed framework enables off-the-shelf, frozen LLMs to achieve competitive trajectory prediction performance with qualitative analyses revealing their enhanced understanding of complex, multi-agent traffic scenarios. |
TeCES: Collaborative Geometric Knowledge Representation Framework under Evolving Fact Snapshots (2026.acl-long)
Copied to clipboard
Jiujiang Guo, Zhengliang Guo, Kai Wang, Meiyang Wang, Dehua Peng, Shaozu Yuan, Chengyin Hu, Shuan Ai, Yiwei Wei
| Challenge: | Existing knowledge graphs represent static facts but lack collaborative modeling of both . e.g., existing knowledge graph models lack a framework for integrating snapshots into knowledge graph. |
| Approach: | They propose a framework for high-fidelity modeling of evolving snapshots using concept of snapshots. |
| Outcome: | The proposed framework outperforms existing models on six benchmarks. |
Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation (2026.findings-acl)
Copied to clipboard
Zhen Bi, Zhenlin Hu, Xueshu Chen, Mingyang Chen, Cheng Deng, Yida Xue, Zhen Wang, Qing Shen, Ningyu Zhang, Jungang Lou
| Challenge: | Existing data-centric paradigms equate quality with factuality or diversity and ignore the internal logical complexity of training samples. |
| Approach: | They propose a density-aware re-cognizing optimization strategy that prioritizes high-density logical samples to align training with the model's reasoning boundary. |
| Outcome: | The proposed metric outperforms existing methods and improves reasoning performance without increasing total data volume. |
Bi-Tuning with Collaborative Information for Controllable LLM-based Sequential Recommendation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to optimize sequential recommendation systems rely on item ID sequences, but they lack collaborative knowledge and limited controllability. |
| Approach: | They propose a simple bi-tuning framework with collaborative information for controllable Large Language Model-based Sequential Recommendation (Laser) they incorporate learnable virtual tokens at prefix and suffix of input text to adapt LLMs with collaborative knowledge . |
| Outcome: | The proposed framework outperforms state-of-the-art recommendations on real-world datasets. |
Do LLMs Understand Wine Descriptors Across Cultures? A Benchmark for Cultural Adaptations of Wine Reviews (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models have opened the door to culture-aware language tasks. |
| Approach: | They propose to integrate regional taste preferences and culture-specific flavor descriptors into wine reviews across Chinese and English. |
| Outcome: | The proposed model incorporates regional taste preferences and culture-specific flavor descriptors into the translation process. |
SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | SALAD-Bench is a safety benchmark specifically designed for LLMs . it provides a robust source for evaluating both attack and defense algorithms . |
| Approach: | They propose a hierarchical safety benchmark specifically designed for LLMs . it uses a taxonomy of questions spanning three levels and a robust taxonomies based on a QA pair . |
| Outcome: | The proposed safety benchmark shows that LLMs are resilient against emerging threats and the effectiveness of contemporary defense methods. |
STARE at the Structure: Steering ICL Exemplar Selection with Structural Alignment (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for incontext learning often overlook structural alignment, leading to poor generalization and suboptimal performance. |
| Approach: | They propose a two-stage exemplar selection strategy that achieves a strong balance between efficiency, generalizability and performance. |
| Outcome: | The proposed method outperforms baselines on semantic parsing tasks on four benchmarks. |
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)
Copied to clipboard
Xiao Wang, Qin Liu, Tao Gui, Qi Zhang, Yicheng Zou, Xin Zhou, Jiacheng Ye, Yongxin Zhang, Rui Zheng, Zexiong Pang, Qinzhuo Wu, Zhengyan Li, Chong Zhang, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xingwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Shan Qin, Bolin Zhu, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang
| Challenge: | Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction. |
| Approach: | They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack. |
| Outcome: | The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses. |
OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework (2025.emnlp-demos)
Copied to clipboard
Jian Hu, Xibin Wu, Wei Shen, Jason Klein Liu, Weixun Wang, Songlin Jiang, Haoran Wang, Hao Chen, Bin Chen, Wenkai Fang, null Xianyu, Yu Cao, Haotian Xu, Yiming Liu
| Challenge: | Existing RLHF frameworks face inference bottlenecks and complexity barriers restricting their accessibility for newcomers. |
| Approach: | They propose an open-source RLHF framework that can be used to train large language models. |
| Outcome: | The proposed framework achieves superior training efficiency with speedups ranging from 1.22 to 1.68 across different model sizes compared to state-of-the-art frameworks, while requiring significantly fewer lines of code for implementation. |
Poor-Supervised Evaluation for SuperLLM via Mutual Consistency (2024.findings-acl)
Copied to clipboard
| Challenge: | evaluating superLLMs is especially difficult because of their intelligence-intensive nature. |
| Approach: | They propose an evaluation benchmark with accurate labels for SuperLLMs whose capabilities surpass those of humans . they first prove that consistency between model under evaluation and reference model can equalize the true capabilities of the model to be evaluated . |
| Outcome: | The proposed evaluation benchmarks can assess the true capabilities of the model to be evaluated without accurate labels. |
A Unified Agentic Framework for Evaluating Conditional Image Generation (2025.acl-long)
Copied to clipboard
Jifang Wang, Yangxue Yangxue, Longyue Wang, Zhenran Xu, Yiyu Wang, Yaowei Wang, Weihua Luo, Kaifu Zhang, Baotian Hu, Min Zhang
| Challenge: | Conditional image generation is a popular and personalization-oriented task, but there are challenges in developing task-agnostic, reliable, and explainable evaluation metrics. |
| Approach: | They propose a unified agentic framework for comprehensive evaluation of conditional image generation tasks. |
| Outcome: | The proposed framework achieves a high correlation with human assessments on seven prominent image generation tasks. |
Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent reasoning-augmented LLMs have demonstrated impressive capabilities across a wide range of domains owing to their exceptional text understanding capabilities. |
| Approach: | They propose a Chinese psychological LLM that integrates empathy, psychological expertise, and reasoning. |
| Outcome: | The proposed model produces over 75k high-quality psychological questions paired with detailed rationales, generated through and iterative prompt-rationale optimization procedure, along with 73k empathetic dialogues. |
Transferable Direct Prompt Injection via Activation-Guided MCMC Sampling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show superior cross-model transferability . Prompt injection attacks are among the most critical threats . |
| Approach: | They propose an activations-guided prompt injection attack framework to address the impracticality of existing white-box/gray-box methods and the poor transferability of black-box approaches. |
| Outcome: | The proposed framework achieves 49.6% success rate and 34.6% improvement over human-crafted prompts on five mainstream LLMs. |
Dynamic Connected Networks for Chinese Spelling Check (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese spelling check (CSC) is a task to detect and correct spelling errors in Chinese text. |
| Approach: | They propose a new architecture which generates Chinese characters via a Pinyin Enhanced Candidate Generator and then utilizes an attention-based network to model the dependencies between two adjacent Chinese characters. |
| Outcome: | The proposed method achieves state-of-the-art performance on three human-annotated datasets. |
KnowMe-Bench: Benchmarking Person Understanding for Lifelong Digital Companions (2026.acl-long)
Copied to clipboard
Tingyu Wu, Zhisheng Chen, Ziyan Weng, Shuhe Wang, Shuo Zhang, Sen Hu, Silin Wu, Qizhen Lan, Huacan Wang, Ronghao Chen
| Challenge: | Existing long-horizon memory benchmarks use multi-turn dialogues or synthetic user histories . despite rapid progress on long-term memory evaluation, there are gaps in existing benchmarks . |
| Approach: | They propose a long-form autobiographical narrative benchmark that reconstructs each narrative into a flashback-aware, time-anchored stream and evaluates models with evidence-linked questions. |
| Outcome: | The proposed benchmarks build from long-form autobiographical narratives . they show that retrieval-augmented systems improve factual accuracy while errors persist on temporally grounded explanations and higher-level inferences. |
CORES: Code-Oriented Reasoning for Complex Text-to-SQL and Generalizable TableQA (2026.findings-acl)
Copied to clipboard
Meng Zhang, Ruochun Jin, Yuanxi Peng, Wenjing Yang, Haotian Wang, Liting Sun, Kun Hu, Silin Yang, Zhang Ke-di
| Challenge: | Text-to-SQL models struggle with complex analytical tasks such as generating simple SQL queries. |
| Approach: | They propose a text-to-sql model that leverages Python as a procedural reasoning pivot to enhance both complex SQL generation and tabular reasoning. |
| Outcome: | The proposed model outperforms baseline models on six text-to-SQL benchmarks by 6.44% on average while maintaining good capability on three tableQA benchmarks. |
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models (2024.acl-long)
Copied to clipboard
Weixiang Zhao, Shilong Wang, Yulin Hu, Yanyan Zhao, Bing Qin, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che
| Challenge: | Existing methods to address catastrophic forgetting and knowledge transfer in large language models (LLMs) ignore potential of aligning the two modules to effectively address catastrophic forgetting and knowledge transfers simultaneously. |
| Approach: | They propose a Shared Attentive Learning & Selection module to align the PET learning and selection modules to address catastrophic forgetting and knowledge transfer simultaneously. |
| Outcome: | Experiments on two CL benchmarks show that the proposed framework is superior when scaled to different model sizes, different model architectures and unseen tasks. |
P2 Law: Scaling Law for Post-Training After Model Pruning (2025.acl-long)
Copied to clipboard
| Challenge: | Pruning has become a widely adopted technique for reducing the hardware requirements of large language models (LLMs). |
| Approach: | They propose to use model pruning techniques to maintain high performance while reducing hardware requirements for large language models (LLMs). |
| Outcome: | The proposed model pruning law can be generalized to larger dataset sizes, larger model sizes, and higher pruning rates, offering valuable insights for resource allocation in pruned LLMs. |
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
YiFan Zhang, Tao Yu, Feng Li, Chaoyou Fu, Yibo Hu, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin
| Challenge: | supervised fine-tuning (SFT) is crucial for multimodal large language models, yet a comprehensive scaling law is lacking . et al.: scaling laws focus on model size, pre-training tokens, and MLLM SFT data volumes . |
| Approach: | They propose two scaling laws to guide optimal model-data configuration . they propose one applicable when training data volumes are well defined by researchers . |
| Outcome: | The proposed scaling laws provide valuable recommendations for optimal resource allocation . they show that the proposed laws are more accurate than existing models . |
Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization (2025.acl-long)
Copied to clipboard
Lei Huang, Xiaocheng Feng, Weitao Ma, Yuchun Fan, Xiachong Feng, Yangfan Ye, Weihong Zhong, Yuxuan Gu, Baoxin Wang, Dayong Wu, Guoping Hu, Bing Qin
| Challenge: | Existing frameworks for retrieval-augmented large language models (LLMs) are lacking in LFQA faithfulness testing. |
| Approach: | They propose a framework to teach retrieval-augmented large language models to explicitly discriminate between faithful and unfaithful generations. |
| Outcome: | The proposed framework outperforms GPT-4o in LFQA scenarios and outperformed existing benchmarks. |
Position Paper: Data-Centric AI in the Age of Large Language Models (2024.findings-emnlp)
Copied to clipboard
Xinyi Xu, Zhaoxuan Wu, Rui Qiao, Arun Verma, Yao Shu, Jingtan Wang, Xinyuan Niu, Zhenfeng He, Jiangwei Chen, Zijian Zhou, Gregory Kang Ruey Lau, Hieu Dao, Lucas Agussurja, Rachael Hwee Ling Sim, Xiaoqiang Lin, Wenyang Hu, Zhongxiang Dai, Pang Wei Koh, Bryan Kian Hsiang Low
| Challenge: | a paper proposes a data-centric perspective of AI research, focusing on large language models. |
| Approach: | They propose a data-centric viewpoint of AI research, focusing on large language models . they propose four scenarios centered around data, including data curation, attribution, knowledge transfer . |
| Outcome: | The proposed research focuses on large language models with data centric benchmarks . the proposed benchmarks can be used to develop new data curation methods . |
MetaBench: A Multi-task Benchmark for Assessing LLMs in Metabolomics (2026.acl-long)
Copied to clipboard
Yuxing Lu, Xukai Zhao, J. Ben Tamo, Micky C. Nnamdi, Rui Peng, Shuang Zeng, Xingyu Hu, Jinzhuo Wang, May Dongmei Wang
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities on general text, but their proficiency in specialized scientific domains remains uncharacterized. |
| Approach: | They evaluate the capabilities of large language models in metabolomics research using MetaBench . they found that models perform well on text generation tasks, but cross-database identifier grounding remains challenging . |
| Outcome: | The evaluation of 25 open- and closed-source LLMs reveals distinct performance patterns across metabolomics tasks. |
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)
Copied to clipboard
Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan
| Challenge: | Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP). |
| Approach: | They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses. |
| Outcome: | The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets. |
Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking (2026.findings-acl)
Copied to clipboard
Songbo Hu, Yinhong Liu, Ej Zhou, Evgeniia Razumovskaia, Xiaobin Wang, Alexander Fraser, Ivan Vulić, Anna Korhonen
| Challenge: | Creating spoken dialogue datasets is methodologically challenging due to the personally identifiable nature of speech signals. |
| Approach: | They propose a large-scale, multilingual, and multi-parallel dataset for developing and evaluating retrieval-augmented generation-based spoken dialogue systems. |
| Outcome: | The proposed dataset includes 6,000 information-seeking dialogues and 163 hours of user speech recorded from native speakers of four official WHO languages. |
Explaining Length Bias in LLM-Based Preference Evaluations (2025.findings-emnlp)
Copied to clipboard
Zhengyu Hu, Linxin Song, Jieyu Zhang, Zheyuan Xiao, Tianfu Wang, Zhengyu Chen, Nicholas Jing Yuan, Jianxun Lian, Kaize Ding, Hui Xiong
| Challenge: | a preference evaluation metric is often biased towards longer responses, revealing a reliability problem . a decomposition of the preference evaluation into two components is needed to understand this bias. |
| Approach: | They propose to decompose the preference evaluation metric into two key components . the first component is length-dependent and related to trustworthiness . |
| Outcome: | The proposed evaluation metric is based on two components: desirability and information mass. |
CLEVA: Chinese Language Models EVAluation Platform (2023.emnlp-demo)
Copied to clipboard
Yanyang Li, Jianqiao Zhao, Duo Zheng, Zi-Yuan Hu, Zhi Chen, Xiaohui Su, Yongfeng Huang, Shijia Huang, Dahua Lin, Michael Lyu, Liwei Wang
| Challenge: | Large language models (LLMs) have revolutionized natural language processing. |
| Approach: | They propose a Chinese-based platform that assesses Chinese LLMs using a standardized workflow and a unique sampling strategy. |
| Outcome: | CLEVA evaluates Chinese LLMs on a standardized workflow and a competitive leaderboard with minimal coding. |
Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Early approaches focus on text-based reasoning, but they often follow a single task-specific reasoning pattern. |
| Approach: | They propose a generative multimodal reasoning paradigm that unifies diverse reasoning skills by generating intermediate images during the reasoning process. |
| Outcome: | The proposed model unifies diverse multimodal reasoning skills by generating intermediate images during the reasoning process. |
ECoK: Emotional Commonsense Knowledge Graph for Mining Emotional Gold (2024.findings-acl)
Copied to clipboard
Zhunheng Wang, Xiaoyi Liu, Mengting Hu, Rui Ying, Ming Jiang, Jianfeng Wu, Yalan Xie, Hang Gao, Renhong Cheng
| Challenge: | Existing knowledge graphs focus on the representation and reasoning of general factual knowledge, while there are significant deficiencies in the understanding and reasoning for emotional knowledge. |
| Approach: | They propose a commonsense knowledge graph that can be used to represent emotional knowledge by combining theories from psychology, cognitive science, and linguistics. |
| Outcome: | The proposed model surpasses GPT-4-Turbo in the emotion-related tasks. |
Beyond Agreement: Diagnosing the Rationale Alignment of Automated Essay Scoring Methods based on Linguistically-informed Counterfactuals (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Automated Essay Scoring (AES) methods focus on sentence-level features, whereas Large Language Models (LLMs) are sensitive to conventions & accuracy, language complexity, and organization. |
| Approach: | They propose to use large language models to aid in decision-making . they propose to analyze the reasoning of neural models by analyzing sentence-level features. |
| Outcome: | The proposed method improves understanding of neural approaches to Automated Essay Scoring (AES) and can also apply to other domains seeking transparency in model-driven decisions. |
Partial Order-centered Hyperbolic Representation Learning for Few-shot Relation Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for few-shot relation extraction are limited to labeled instances and rely on data labeling. |
| Approach: | They propose a partial order-centered hyperbolic representation learning framework which imposes constraints on relations on instances by modeling partial order in hyperbolical space. |
| Outcome: | The proposed framework outperforms baseline methods on three benchmark datasets on 1-shot settings lacking relation descriptions. |
Neural Topic Modeling with Bidirectional Adversarial Training (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that neural topic models for automatic topic extraction avoid complicated mathematical derivations for model inference. |
| Approach: | They propose a bidirectional adversarial topic model which uses a generator and an encoder to infer topic distribution. |
| Outcome: | The proposed model outperforms baselines and competitive models in three benchmark corpora. |
InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on contrastive learning for sentence embeddings are weak . researchers have started to use contrastive training to learn better unsupervised sentences. |
| Approach: | They propose an information-aggregated contrastive learning framework for learning unsupervised sentence embeddings. |
| Outcome: | The proposed framework outperforms SimCSE on several benchmark datasets w.r.t the semantic text similarity task. |
Efficient Table Retrieval and Understanding with Multimodal Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Tabular data is often captured in image form across a wide range of real-world scenarios. |
| Approach: | They propose a framework that enables MLLMs to answer queries over large tables. |
| Outcome: | The proposed framework outperforms existing methods by 7.0% in retrieval recall and 6.1% in answer accuracy on a newly constructed dataset with 48,504 unique tables. |
NeKo: Cross-Modality Post-Recognition Error Correction with Tasks-Guided Mixture-of-Experts Language Model (2025.acl-industry)
Copied to clipboard
Yen-Ting Lin, Zhehuai Chen, Piotr Zelasko, Zhen Wan, Xuesong Yang, Zih-Ching Chen, Krishna C Puvvada, Ke Hu, Szu-Wei Fu, Jun Wei Chiu, Jagadeesh Balam, Boris Ginsburg, Yu-Chiang Frank Wang, Chao-Han Huck Yang
| Challenge: | Existing methods to train a model on a mixture of domain datasets require separate correction language models. |
| Approach: | They propose a multi-task correction MoE that trains experts to become an "expert" of speech-to-text, language-totext and vision-to text datasets by learning to route each dataset’s tokens to its mapped expert. |
| Outcome: | The proposed model outperforms GPT-3.5 and Claude-3.5-Sonnet on the Open ASR Leaderboard and reaches an average relative 5.0% WER reduction and substantial improvements in BLEU scores. |
IntelliCockpitBench: A Comprehensive Benchmark to Evaluate VLMs for Intelligent Cockpit (2025.findings-acl)
Copied to clipboard
| Challenge: | Visual Question Answering (VQA) is a key task in vehicular systems. |
| Approach: | They propose a benchmark that encompasses diverse automotive scenarios . they use images from front, side, and rear cameras, various road types, weather conditions, and interior views . |
| Outcome: | The proposed benchmark includes images from front, side, and rear cameras, various road types, weather conditions, and interior views. |
LEGENT: Open Platform for Embodied Agents (2024.acl-demos)
Copied to clipboard
Zhili Cheng, Zhitong Wang, Jinyi Hu, Shengding Hu, An Liu, Yuge Tu, Pengkai Li, Lei Shi, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing integrations of large language models and large multimodal models are limited . Existing platforms for developing embodied agents are limited and limited based on open-source software. |
| Approach: | They propose an open platform for developing embodied agents using LLMs and LMMs. |
| Outcome: | The proposed platform surpasses GPT-4V in embodied tasks with its model training on LEGENT data. |
CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency (2025.emnlp-main)
Copied to clipboard
Zhanming Shen, Hao Chen, Yulei Tang, Shaolin Zhu, Wentao Ye, Xiaomeng Hu, Haobo Wang, Gang Chen, Junbo Zhao
| Challenge: | Existing methods for instruction tuning rely on expensive human-annotated seed data or powerful external teacher models. |
| Approach: | They propose a framework that achieves fully seed-free instruction tuning by employing a dual self-training loop where two models are bootstrapped solely from raw, unlabeled text. |
| Outcome: | The proposed framework outperforms seed-driven back-translation baselines and achieves comparable performance to strongly supervised methods. |
Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Clarity (2025.findings-emnlp)
Copied to clipboard
Ping Chen, Xiang Liu, Zhaoxiang Liu, Zezhou Chen, Xingpeng Zhang, Huan Hu, Zipeng Wang, Kai Wang, Shuming Shi, Shiguo Lian
| Challenge: | ambiguity, polysemy, or uncertainty remain significant challenges in natural language processing. |
| Approach: | They introduce a framework that integrates LLM semantic priors with continuous fuzzy membership degrees to create an explicit interaction between probability-based reasoning and fuzzy membership reasoning. |
| Outcome: | The proposed framework integrates semantic priors with continuous fuzzy membership degrees . it allows ambiguous inputs to be gradually transformed into clear and interpretable decisions . |