Papers by Wang Bin
RETAIL: Towards Real-world Travel Planning for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing travel planning systems assume users provide explicit queries, limiting their practical utility. |
| Approach: | They propose a dataset RETAIL which supports decision-making for implicit queries while covering explicit queries. |
| Outcome: | The proposed model achieves a 1.0% pass rate, suggesting real-world travel planning remains challenging. |
ParaSuite: Boosting LLM Reasoning via Paradox Resolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for paradox research focus on checking basic logical consistency and not reflective reasoning. |
| Approach: | They propose a pipeline dedicated to paradox research that automates data synthesis, evaluation, and training. |
| Outcome: | The proposed pipeline improves paradoxical and general STEM reasoning. |
R2A-TLS: Reflective Retrieval-Augmented Timeline Summarization with Causal-Semantic Integration (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods struggle to capture coherent event narratives due to fragmented descriptions . Existing approaches accumulate noise through iterative retrieval strategies that lack relevance evaluation. |
| Approach: | They propose a reflective retrieval-augmented timeline summarization with Causal-Semantic Intergration approach for open-domain timeline summarizing . |
| Outcome: | The proposed approach outperforms the best prior published approaches. |
Safety Sidecar: Reflection-Driven Runtime Control for Safer Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing safety controls fail to provide runtime intervention or cross-architecture portability for autonomous LLM agents. |
| Approach: | They propose a model-agnostic, plug-and-play module to provide arbitrary agent safety control and auditability. |
| Outcome: | The proposed module improves the secure-solution rate by 2.9–11.2 percentage points . it adds only 3.2s to end-to-end latency and a negligible average cost of 5.37 10-4 per scenario . |
Mixture of Diverse Size Experts (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Recent large language models (LLMs) have shown superior performance in a variety of tasks due to the sub-linearly increasing computational costs. |
| Approach: | They propose a new MoE architecture with designed layers where experts have different sizes to mitigate this defect. |
| Outcome: | The proposed architecture surpasses existing MoEs by adaptively assigning the parameter budget to experts while maintaining the same total parameter size and number of experts. |
HiCoLoRA: Addressing Context-Prompt Misalignment via Hierarchical Collaborative LoRA for Zero-Shot DST (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to zero-shot Dialog State Tracking (zs-DST) are inadequate to generalize to new domains without extensive training. |
| Approach: | They propose a framework that enhances zero-shot slot inference through robust prompt alignment. |
| Outcome: | Experiments on multi-domain datasets show that HiCoLoRA outperforms baselines, achieving SOTA in zs-DST. |
InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training (2026.acl-long)
Copied to clipboard
| Challenge: | Existing GUI agent benchmarks are manually constructed and lack scale and diversity as training environments. |
| Approach: | They propose a GUI agent training system that automatically generates web environments at scale. |
| Outcome: | The proposed system outperforms commercial GUI agents at realistic website construction and improves on OSWorld and Online-Mind2Web. |
MERaLiON-AudioLLM: Advancing Speech and Language Understanding for Singapore (2025.acl-demo)
Copied to clipboard
Yingxu He, Zhuohan Liu, Geyu Lin, Shuo Sun, Bin Wang, Wenyu Zhang, Xunlong Zou, Nancy F. Chen, AiTi Aw
| Challenge: | MERaLiON-AudioLLM is the first general-purpose audio-based large language model for multitask learning. |
| Approach: | They introduce MERaLiON-AudioLLM, a general-purpose audio-based large language model for multitask learning with a focus on Singlish understanding. |
| Outcome: | The proposed model exhibits strong generalization across a diverse set of tasks . it is a leading solution for region-specific AI applications. |
EmpathyEar: An Open-source Avatar Multimodal Empathetic Chatbot (2024.acl-demos)
Copied to clipboard
| Challenge: | EmpathyEar is an open-source, avatar-based multimodal empathetic chatbot . currently, ERG systems rely on text, sound, and vision . |
| Approach: | They propose an open-source, avatar-based multimodal empathetic chatbot to fill the gap in traditional text-only ERG systems. |
| Outcome: | The proposed system enables users to generate emotional responses to user queries . it can also generate avatars with talking faces and synchronized speeches . |
Transition-Based Chinese AMR Parsing (N18-2)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation where the meaning of a sentence is encoded as a rooted, directed and acyclic graph. |
| Approach: | They propose a transition-based AMR parsing framework for Chinese to be used in the next generation of AMR. |
| Outcome: | The proposed parser is based on the Chinese AMR bank. |
EvoSpark: Endogenous Interactive Agent Societies for Unified Long-Horizon Narrative Evolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing systems suffer from social memory stacking and narrative-spatial dissonance . long-horizon narratives suffer from conflicting relational states without resolution . |
| Approach: | They propose a framework to sustain logically coherent long-horizon narratives within endogenous interactive agent societies. |
| Outcome: | Experiments show that the framework outperforms baselines across paradigms. |
Your Language Model Can Secretly Write Like Humans: Contrastive Paraphrase Attacks on LLM-Generated Text Detectors (2025.emnlp-main)
Copied to clipboard
Hao Fang, Jiawei Kong, Tianqu Zhuang, Yixiang Qiu, Kuofeng Gao, Bin Chen, Shu-Tao Xia, Yaowei Wang, Min Zhang
| Challenge: | Existing methods to detect large language models (LLMs) generated for plagiarism use paraphrases to rewrite them to evade detection. |
| Approach: | They propose a training-free method that effectively fools text detectors using off-the-shelf LLMs by rewriting them to evade detection. |
| Outcome: | The proposed method deceives text detectors using off-the-shelf LLMs by rewriting them to produce human-like sentences that are less discernible by detectors. |
Improving Event Detection via Open-domain Trigger Knowledge (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for event detecting are prone to overfitting densely labeled trigger words due to the small scale of training data. |
| Approach: | They propose a novel Enrichment Knowledge Distillation model to leverage external open-domain trigger knowledge to reduce in-built biases to frequent trigger words in annotations. |
| Outcome: | The proposed model outperforms nine strong baselines and is especially effective for unseen/sparsely labeled trigger words. |
Reducing Spurious Correlations in Aspect-based Sentiment Analysis with Explanation from Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis models are susceptible to learning spurious correlations between words . a recent study shows that feature engineering is time-consuming and costly . |
| Approach: | They propose to use a template to prompt LLMs to generate an appropriate explanation for the sentiment polarity of each aspect to reduce spurious correlations. |
| Outcome: | The proposed methods improve ABSA models and their generalization ability. |
Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Framework (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing supervised sentence embedding techniques rely on expensive human-annotated sentence pairs as the supervised signals. |
| Approach: | They propose a semi-supervised sentence embedding framework that leverages large-scale unlabeled data. |
| Outcome: | The proposed framework surpasses state-of-the-art methods on four domain adaptation tasks. |
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)
Copied to clipboard
Zheng Liu, Honglin Lin, Xiaoyang Wang, Xin Gao, Yu Li, Mengzhang Cai, Yun Zhu, Zhanping Zhong, Qizhi Pei, Zhuoshi Pan, Xiaoran Shang, Conghui He, Bin Cui, Wentao Zhang, Lijun Wu
| Challenge: | Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations . |
| Approach: | They propose a framework to synthesize complex charts and reliable reasoning data from scratch. |
| Outcome: | Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models . |
Towards Robust Neural Machine Translation with Iterative Scheduled Data-Switch Training (2022.coling-1)
Copied to clipboard
Zhongjian Miao, Xiang Li, Liyan Kang, Wen Zhang, Chulun Zhou, Yidong Chen, Bin Wang, Min Zhang, Jinsong Su
| Challenge: | Existing methods on robust neural machine translation (NMT) construct adversarial examples by injecting noise into authentic examples and indiscriminately exploit two types of examples. |
| Approach: | They propose an iterative scheduled data-switch training framework to mitigate this problem by injecting noise into authentic examples and indiscriminately exploiting two types of examples. |
| Outcome: | The proposed model outperforms several competitive benchmarks on four translation benchmarks. |
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)
Copied to clipboard
Jia Li, Ge Li, Yunfei Zhao, Yongmin Li, Huanyu Liu, Hao Zhu, Lecheng Wang, Kaibo Liu, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yuqi Zhu, Yihong Dong, Zhi Jin, Binhua Li, Fei Huang, Yongbin Li, Bin Gu, Mengfei Yang
| Challenge: | Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs). |
| Approach: | They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories. |
| Outcome: | The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks. |
In2Core: Leveraging Influence Functions for Coreset Selection in Instruction Finetuning of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit surprising abilities across a variety of language tasks. |
| Approach: | They propose an algorithm which selects a coreset by analyzing correlation between training and evaluation samples with a trained model. |
| Outcome: | The proposed algorithm can achieve similar performance with just 50% of the training data while preserving the accuracy of the existing model. |
Improving Knowledge Graph Embedding Using Simple Constraints (P18-1)
Copied to clipboard
| Challenge: | Recent efforts focused on designing more complicated models or incorporating extra information beyond triples. |
| Approach: | They propose to use non-negativity constraints on entity representations and approximate entailment constraints on relation representations to improve KG embedding. |
| Outcome: | The proposed model outperforms baseline models on WordNet, Freebase, and DBpedia. |
Interesting Culture: Social Relation Recognition from Videos via Culture De-confounding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a culturally-specific cultural context can be used to train relationship recognition models . cultural confounding factors can be learned, limiting ability to recognize social relationships in different cultures. |
| Approach: | They propose a culturally-based model that mitigates the influence of culture . they also construct a video social relation recognition dataset to facilitate discussion . |
| Outcome: | The proposed model surpasses state-of-the-art methods on several datasets. |
Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations models struggle due to lack of Common Sense Knowledge (CSK). |
| Approach: | They propose a multimodal approach to integrate multiple knowledge into the edge representations by integrating textual and visual CSK. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two popular datasets. |
Learning distributed sentence vectors with bi-directional 3D convolutions (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods that render words or characters into images separately, but instead use text's visual features as input, we use 3-dimensional convolutions to learn distributed sentence representation. |
| Approach: | They propose to use text's visual features as input to learn distributed sentence representation using 3-dimensional sentence tensors and multiple 3-dimensional convolutions with different lengths are applied to the sentence . |
| Outcome: | The proposed model performs well on several downstream natural language processing tasks. |
F2RL: Factuality and Faithfulness Reinforcement Learning Framework for Claim-Guided Evidence-Supported Counterspeech Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for generating evidence-supported counterspeech lack clear guidance with a core claim for organizing evidence. |
| Approach: | They propose a Factuality and Faithfulness Reinforcement Learning framework for generating claim-guided and evidence-supported counterspeech (F2RL) they generate counter-claims based on hate speech and design a self-evaluation mechanism to select the most appropriate one. |
| Outcome: | The proposed framework achieves excellent performance on three benchmark datasets with strong factuality and faithfulness. |
AudioBench: A Universal Benchmark for Audio Large Language Models (2025.naacl-long)
Copied to clipboard
Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu, Wenyu Zhang, Zhengyuan Liu, AiTi Aw, Nancy F. Chen
| Challenge: | Existing evaluation regimes for audio large language models do not cover the breadth of their possible use cases. |
| Approach: | They propose to use AudioBench to evaluate audio large language models . they found that no single model excels consistently across all tasks . |
| Outcome: | The proposed evaluation targets speech understanding, audio scene understanding, and voice understanding (paralinguistic) . no single model excels consistently across all tasks, the paper found . |
MISC: A Mixed Strategy-Aware Model integrating COMET for Emotional Support Conversation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for emotional support conversation are too coarse-grained to capture user’s instant mental state and focus on expressing empathy in the response rather than gradually reducing user’ s distress. |
| Approach: | They propose a model which firstly infers the user’s fine-grained emotional status and then responds skillfully using a mixture of strategy. |
| Outcome: | The proposed model infers the user’s fine-grained emotional status and responds skillfully using mixed-up strategy modeling. |
HiPrune: Hierarchical Attention for Efficient Token Pruning in Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for visual token pruning lack insight into the intrinsic property of the vision encoder . et al., 2017: 99.3% of task accuracy with only 1/3 of the tokens. |
| Approach: | They propose a model-agnostic token pruning method that trains without training . they propose 'HiPrune' method which prunes visual tokens according to their attention . |
| Outcome: | The proposed method achieves 99.3% of task accuracy with only 1/3 of the tokens . it reduces inference FLOPs by 58.7% and maintains 99.99% accuracy with 2/9 tokens. |
Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks focus on pairwise matching, ignoring robustness . current models exhibit frustrating degradation, with a maximum drop of 23.43 F1 score . |
| Approach: | They propose a benchmark that simulates the evaluation of open information extraction models in the real world . they perform experiments on typical models published in the last decade and a representative large language model . |
| Outcome: | The proposed model is rated robust on a knowledge-invariant clique with different syntactic and expressive forms. |
MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsing (2026.acl-industry)
Copied to clipboard
Junbo Niu, Zheng Liu, Zhuangcheng Gu, Bin Wang, Linke Ouyang, Zhiyuan Zhao, Tao Chu, Tianyao He, Fan Wu, Qintong Zhang, Zhenjiang Jin, Guang Liang, Rui Zhang, Wenzheng Zhang, Yuan Qu, Zhifei Ren, Yuefeng Sun, Zirui Tang, Boyu Niu, Yuanhong Zheng, Dongsheng Ma, Ziyang Miao, Hejun Dong, Siyi Qian, Junyuan Zhang, Fangdong Wang, Jingzhou Chen, Xiaomeng Zhao, Liqun Wei, Wei Li, Shasha Wang, RuiLiang Xu, Yuanyuan Cao, Lu Chen, Qianqian Wu, Huaiyu Gu, Lindong Lu, Dechen Lin, null Shenguanlin, Xuanhe Zhou, Linfeng Zhang, Yuhang Zang, Xiaoyi Dong, Jiaqi Wang, Bo Zhang, Lei Bai, Pei Chu, Weijia Li, Jiang Wu, Lijun Wu, Zhenxiang Li, Guangyu Wang, Zhongying Tu, Chao Xu, Kai Chen, Bowen Zhou, Dahua Lin, Wentao Zhang, Conghui He
| Challenge: | Document images are characterized by higher resolutions, denser content, and more complex structural layouts. |
| Approach: | They propose a 1.2B-parameter document parsing vision-language model that decouples layout analysis from local content recognition. |
| Outcome: | The proposed model surpasses general-purpose and domain-specific models on multiple benchmarks while maintaining significantly lower computational overhead. |
BeSimulator: A Large Language Model Powered Text-based Behavior Simulator (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing robot simulators focus on physical process modeling and realistic rendering, resulting in high computational costs and limited adaptability. |
| Approach: | They propose a modular and novel LLM-powered framework to analyze and validate robot behaviors in text-based environments. |
| Outcome: | The proposed framework can generalize across scenarios and achieve long-horizon complex simulation. |
A Multi-persona Framework for Argument Quality Assessment (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for argument quality assessment do not consider multi-perspective evaluation due to subjective nature of arguments. |
| Approach: | They propose a multi-persona framework for argument quality assessment that simulates diverse evaluator perspectives through large language models. |
| Outcome: | The proposed framework outperforms baselines while providing comprehensive multi-perspective rationales on IBM-Rank-30k and IBM-ArgQ-5.3kArgs datasets. |
CoinMath: Harnessing the Power of Coding Instruction for Math LLM (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown strong performance in solving mathematical problems, with code-based solutions proving particularly effective. |
| Approach: | They propose a learning strategy to enhance mathematical reasoning by diversifying the coding styles of code-based rationales. |
| Outcome: | The proposed learning strategy outperforms its baseline model, MAmmoTH, which uses code-based solutions. |
MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models (2025.findings-acl)
Copied to clipboard
Boyang Xue, Hongru Wang, Rui Wang, Sheng Wang, Zezhong Wang, Yiming Du, Bin Liang, Wenxuan Zhang, Kam-Fai Wong
| Challenge: | Existing studies on LLM confidence estimations in languages other than English have been limited to English. |
| Approach: | They propose to use question-related language to prompt LLMs to assess their confidence in large language models. |
| Outcome: | The proposed model improves on question-related language prompts for LS tasks, while English exhibits notable linguistic dominance in confidence estimations. |
Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors (2026.acl-long)
Copied to clipboard
Zhiwei Zhang, Fei Zhao, Rui Wang, Zezhong Wang, Bin Liang, Jiakang Wang, Yao Hu, Shaosheng Cao, Kam-Fai Wong
| Challenge: | Large language models (LLMs) can call tools effectively, but they remain brittle in multi-turn execution. |
| Approach: | They propose a framework that converts execution errors into on-policy corrective supervision within the RL training loop. |
| Outcome: | The proposed framework improves the error recovery rate of Qwen3-8B by 5.7% absolute and overall accuracy by 4.0% on BFCL v4 Multi-Turn. |
Resilience of Large Language Models for Noisy Instructions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are powerful tools for interpreting human commands and generating text. |
| Approach: | They examine the resilience of large language models against five common types of disruptions including ASR, OCR, grammatical errors, typographical errors and distractive content. |
| Outcome: | The models show resistance to noise, but their performance suffers . authors evaluated the models against five common types of disruptions based on their results . |
LoSiA: Efficient High-Rank Fine-Tuning via Subnet Localization and Optimization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods perform extensive matrix multiplications in domain specialization tasks, resulting in computational inefficiency and sub-optimal fine-tuning performance. |
| Approach: | They propose a method that localizes and optimizes critical parameters during training . they propose 'LoSiA-Pro' which reduces training latency by 27% . |
| Outcome: | The proposed method achieves minimal performance drop compared to full fine-tuning while requiring the least training time across domain specialization and common-sense reasoning tasks. |
Joint Goal Segmentation and Goal Success Prediction on Multi-Domain Conversations (2022.coling-1)
Copied to clipboard
| Challenge: | Existing metrics to measure the performance of conversational AI assistants are difficult to establish due to their slow nature. |
| Approach: | They propose an automatic dialogue evaluation framework that performs goal segmentation and success prediction by adding multi-task learning heads. |
| Outcome: | The proposed model achieves on-par with human annotation compared to a gold annotation benchmark. |
DarwinTOD: LLM-Driven Lifelong Self-evolution for Task-oriented Dialog Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Continual learning approaches fail to achieve autonomy lifelong improvement in dynamic environments . current task-oriented dialog systems are static, unable to learn from ongoing interactions . |
| Approach: | They propose a lifelong self-evolving dialog framework that integrates evolutionary computation and LLM driven self-improvement into a single framework. |
| Outcome: | The proposed framework surpasses state-of-the-art methods and exhibits continuous performance gains throughout evolution. |
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing techniques for natural language understanding and generation use autoencoding and/or autoregressive objectives to train models. |
| Approach: | They propose a self-supervised pre-training scheme that pre-trains an autoencoding and autoregressive language model on a large unlabeled corpus for generating new text conditioned on context. |
| Outcome: | The proposed scheme achieves state-of-the-art results on a variety of language generation benchmarks covering generative question answering, abstractive summarization and conversational response generation. |
Arabic Dataset for LLM Safeguard Evaluation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on large language models have focused on English, but the safety of LLMs in Arabic remains under-explored. |
| Approach: | They propose to use Arabic-region-specific questions to evaluate LLMs' safety . they use a dual-perspective evaluation framework to examine differences between LLM responses . |
| Outcome: | The proposed framework assesses the LLM responses from both governmental and opposition viewpoints. |
Table-as-Search: Agentic Information Seeking is Table Completion (2026.findings-acl)
Copied to clipboard
Tian Lan, Felix Henry, Bin Zhu, Qianghuai Jia, Junyang Ren, Qihang PU, Haijun Li, Longyue Wang, Zhao Xu, Weihua Luo
| Challenge: | Current Information Seeking (InfoSeeking) agents struggle to maintain focus and coherence during long-horizon exploration, as tracking search states within one plain-text context is inherently fragile. |
| Approach: | They propose a structured planning framework that reformulates the InfoSeeking task as a Table Completion task. |
| Outcome: | The proposed framework outperforms state-of-the-art frameworks across three kinds of benchmarks, including multi-agent framework and commercial systems. |
Distilling Large Embeddings via Hyperspherical Householder Quantization (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for quantizing large embeddings rely on Euclidean quantization, which is poorly aligned with the angular geometry induced by contrastive embeddment training. |
| Approach: | They propose a geometry-aware distillation method that compresses large embeddings into short discrete representations via iterative Householder transformations on the unit hypersphere. |
| Outcome: | The proposed method reduces decoding cost and maintains strong semantic retrieval accuracy. |
Intent-Aware and Hate-Mitigating Counterspeech Generation via Dual-Discriminator Guided LLMs (2024.lrec-main)
Copied to clipboard
| Challenge: | Hate speech is an aggressive expression that incites hatred towards specific groups based on their group identity. |
| Approach: | They propose an LLMs-based framework for counterspeech generation that uses intent-aware discriminators to decode intents of LLM models. |
| Outcome: | The proposed framework matches intents with hate mitigation intents and performs well. |
MusKGC: A Flexible Multi-source Knowledge Enhancement Framework for Open-World Knowledge Graph Completion (2025.emnlp-main)
Copied to clipboard
| Challenge: | Open-world knowledge graph completion (KGC) aims to infer novel facts by enriching existing graphs with external knowledge sources while maintaining semantic consistency under the open-world assumption (OWA). |
| Approach: | They propose a multi-source knowledge enhancement framework based on an open-world assumption (OWA) that integrates external knowledge sources and a new evaluation strategy to validate new facts. |
| Outcome: | The proposed model achieves SOTA performance across benchmarks and the evaluation strategy effectively assesses new facts under OWA. |
Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations (2024.findings-acl)
Copied to clipboard
| Challenge: | Structured pruning is a feasible solution for end-side LLM deployment . however, achieving a high compression ratio for scaled-up LLMs remains a challenge . |
| Approach: | They propose a task-agnostic structured pruning approach coupled with a compact Transformer architecture to prune LLMs into an intra-module low-rank architecture. |
| Outcome: | The proposed approach reduces transitional activations inside multi-head attention (MHA) and multi-layer perceptron (MLP) modules while preserving inter-module activations sensitive to perturbations. |
Incorporating External Knowledge into Machine Reading for Generative Question Answering (D19-1)
Copied to clipboard
| Challenge: | Existing knowledge-aware QA models do not have commonsense and background knowledge to answer nontrivial questions. |
| Approach: | They propose a new neural model which exploits external knowledge to generate answers in natural language for a given question with context. |
| Outcome: | The proposed model improves answer quality over existing models without knowledge and knowledge-aware models, a study shows . state officials in Hawaii confirmed that president Barack Obama was born in the U.S. |
PITA: Prompting Task Interaction for Argumentation Mining (2024.acl-long)
Copied to clipboard
| Challenge: | Argumentation mining (AM) aims to detect arguments and their inherent relations from textual compositions. |
| Approach: | They propose a method to model the inter-relationships among three subtasks within a generative framework. |
| Outcome: | The proposed method achieves state-of-the-art performance on two AM benchmarks. |
MemeReaCon: Probing Contextual Meme Understanding in Large Vision-Language Models (2025.emnlp-main)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Yuxi Zhang, Yanxi Zhao, Yifan Zhang, Zezhong Wang, Huimin Wang, Yutian Zhao, Bin Liang, Yefeng Zheng, Binyang Li, Kam-Fai Wong, Xian Wu
| Challenge: | Current approaches focus on isolated meme analysis, either for harmful content detection or standalone interpretation, overlooking a fundamental challenge: the same meme can express different intents depending on its conversational context. |
| Approach: | They propose a benchmark to evaluate how large vision language models understand memes in their original context. |
| Outcome: | The proposed benchmark evaluates how large vision language models understand meme intent in their original context. |
SEMGraph: Incorporating Sentiment Knowledge and Eye Movement into Graph Model for Sentiment Analysis (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on sentiment analysis based on eye movement signals has been attributed importance. |
| Approach: | They propose a linguistic probing eye movement paradigm to extract eye movement features based on the relationship between linguistic features and human reading behavior. |
| Outcome: | The proposed graph architecture achieves state-of-the-art performance on two sentiment analysis datasets with eye movement signals and three sentiment analysis data without eye movement signal. |
YNU-junyi in BioNLP-OST 2019: Using CNN-LSTM Model with Embeddings for SeeDev Binary Event Extraction (D19-57)
Copied to clipboard
| Challenge: | BioNLP 2019 Shared Tasks: binary relation extraction of SeeDev task . Biological information extraction (Bio-IE) is a new field of research . |
| Approach: | They propose to use convolutional neural networks and long short term memory networks to construct a binary relation extraction model. |
| Outcome: | The proposed method performed well in the binary relation extraction task. |
Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understanding (2026.acl-long)
Copied to clipboard
Ke Ma, Jiaqi Tang, Bin Guo, Xueting Han, Ruonan Xu, Qingfeng He, Ziheng Wang, Xu Wang, Qifeng Chen, Zhiwen Yu, Yunhao Liu
| Challenge: | Existing methods for streaming video understanding are query-agnostic and implicitly model video evidence. |
| Approach: | They propose a framework that establishes explicit, structured alignment between the accumulated video evidence and the query’s expected response conditions via scene graphs. |
| Outcome: | The proposed model achieves more interpretable and accurate response timing decisions on both proactive and reactive tasks. |
Beyond Single-View Detection: A Dual-Space Reasoning Framework for Interpretable Harmful Meme Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying harmful memes rely on modal alignment or black-box classifiers . BPDMoE-Hate provides visual explanations for viewpoint selection and hierarchical structuring . |
| Approach: | They propose a framework that conceptualizes harmful meme detection as a process of "viewpoint decoupling and hierarchical fusion" they propose BPDMoE-Hate, which generates adversarial binary perspectives via VLMs and incorporates an adaptive viewpoint gating to facilitate viewpoint selection. |
| Outcome: | The proposed framework surpasses existing methods in performance and provides visual explanations for viewpoint selection and hierarchical structuring. |
A Comprehensive Evaluation of Quantization Strategies for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Quantization studies have focused on instruction-tuned LLMs, leaving their performance on other benchmarks unclear. |
| Approach: | They propose a framework to evaluate quantized large language models using four dimensions . they propose to reduce the bits needed for model weights or activations with minimal performance loss . |
| Outcome: | The proposed framework can retain comparable performance to non-quantized LLMs on most benchmarks. |
AFMRL: Attribute-Enhanced Fine-Grained Multi-Modal Representation Learning in E-commerce (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal representation is crucial for E-commerce tasks such as identical product retrieval. |
| Approach: | They propose an approach which leverages the generative power of Multimodal Large Language Models to extract key attributes from product images and text and enhances representation learning through a two-stage training framework. |
| Outcome: | The proposed model achieves state-of-the-art on multiple downstream retrieval tasks, validating the effectiveness of harnessing generative models to advance fine-grained representation learning. |
Improving Robustness of Language Models from a Geometry-aware Perspective (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness. |
| Approach: | They propose friendly adversarial data augmentation and geometry-aware adversarial training to achieve stronger robustness using fewer search steps. |
| Outcome: | The proposed method can obtain stronger robustness using fewer steps than existing methods. |
Focus-Constrained Attention Mechanism for CVAE-based Response Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models generate high-frequency but trivial responses such as "I don't know" or "I'm ok" due to the discrepancy in discourse-level information, standard models generate one-to-many relationships. |
| Approach: | They propose to transform coarse-grained discourse-level information into fine-grounded word-level knowledge by introducing a fine-grain focus signal and a focus-constrained attention mechanism to take full advantage of focus. |
| Outcome: | The proposed model can generate more diverse and informative responses compared with state-of-the-art models. |
Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing efforts to identify and avoid CDM to facilitate dialogue learning failed to solve the problem. |
| Approach: | They propose a Sentence Semantic Segmentation guided Conditional Variational Auto-Encoder which can model and take advantage of the CDM data. |
| Outcome: | The proposed method can model and take advantages of the CDM data. |
ADEPT-SQL: A High-performance Text-to-SQL Application for Real-World Enterprise-Level Databases (2025.acl-demo)
Copied to clipboard
Yongnan Chen, Zhuo Chang, Shijia Gu, Yuanhang Zong, Zhang Mei, Shiyu Wang, Hezixiang Hezixiang, Hongzhi Chen, Jin Wei, Bin Cui
| Challenge: | et al., 2017) address domain-specific knowledge barriers, schemas complexity, and computational costs of large LLMs. |
| Approach: | They propose a domain-adapted Text2SQL system that addresses critical deployment challenges in professional fields. |
| Outcome: | The proposed system achieves 97% execution accuracy on real-world databases . it is faster than existing systems and has a higher performance than existing ones. |
Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents (2024.acl-long)
Copied to clipboard
Shihan Deng, Weikai Xu, Hongda Sun, Wei Liu, Tao Tan, Liujianfeng Liujianfeng, Ang Li, Jian Luan, Bin Wang, Rui Yan, Shuo Shang
| Challenge: | Existing benchmarks for LLM-based mobile agents are insufficient to evaluate their capabilities. |
| Approach: | They propose a benchmark to evaluate LLM-based mobile agents' planning capabilities . they expand UI operations by incorporating 103 APIs to accelerate task completion . |
| Outcome: | The proposed benchmarks are based on 103 collected APIs and real user queries . the data is categorized into three distinct groups: SAST, SAMT, and MAMT . |
Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods (2026.acl-long)
Copied to clipboard
Chenfei Liao, Wensong Wang, Zichen Wen, Xu Zheng, Yiyu Wang, Haocong He, Yuanhuiyi Lyu, Lutao Jiang, Xin Zou, Yuqian Fu, Bin Ren, Linfeng Zhang, Xuming Hu
| Challenge: | Recent efforts to accelerate inference in Multimodal Large Language Models have focused on visual token compression. |
| Approach: | They propose a framework that leverages downsampling as a discriminator to denoise existing benchmarks. |
| Outcome: | The proposed evaluation framework leverages downsampling as a discriminator to denoise existing benchmarks. |
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models (2024.lrec-main)
Copied to clipboard
Boxi Cao, Qiaoyu Tang, Hongyu Lin, Shanshan Jiang, Bin Dong, Xianpei Han, Jiawei Chen, Tianshu Wang, Le Sun
| Challenge: | Pre-trained language models have shown remarkable memory formation, but vanilla networks without pre-training suffer catastrophic forgetting problem. |
| Approach: | They conduct experiments to investigate the retentive-forgetful contradiction between vanilla and pre-trained language models by controlling the target knowledge types, learning strategies and learning schedules. |
| Outcome: | The results show that pre-trained language models are forgetful and pre-training leads to retentive models . |
AIPO: Adaptive Information Guided Token-Level Reinforcement Learning for Large Language Model Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RLVR methods focus on all generated tokens rather than on which tokens contribute to reasoning. |
| Approach: | They propose to use a Random–Fourier approximation of the Hilbert–Schmidt Independence Criterion to focus updates on decisive tokens discovered on the fly to improve the efficiency of mutual-information estimation. |
| Outcome: | The proposed approach yields +20% accuracy over strong RLVR baselines while updating merely 10% of tokens, demonstrating superior efficiency and effectiveness. |
Global Eye: Breaking the “Fixed Thinking Pattern” during the Instruction Expansion Process (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods focus on constructing multi-perspective prompts to expand instructions, overlooking the “Fixed Thinking Pattern” issue of Large Language Models. |
| Approach: | They propose a method that analyzes the statistical characteristics of newly generated instructions and updates the prompts after a fixed number of instruction expansions. |
| Outcome: | The proposed method surpasses open-source LLMs and GPT3.5 in several metrics. |
Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLMs generate responses based on the dialogue context, overlooking the underlying linguistic cues about the user status exhibited in the context. |
| Approach: | They propose a linguistic cue-based chain-of-thoughts method which enhances the LLMs inference with an intermediate reasoning step to find cues exhibited in the dialogue. |
| Outcome: | The proposed method outperforms standard prompting methods on in-depth dialogue questions and linguistic cues exhibited in the context. |
Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown continuously improving multilingual capabilities. |
| Approach: | They evaluate the ability of open LLMs to handle multilingual machine translation tasks using a parallel-first monolingual-second data mixing strategy. |
| Outcome: | The proposed model outperforms state-of-the-art models and achieves competitive performance with Google Translate and GPT-4-turbo. |
Joint Knowledge Base Completion and Question Answering by Combining Large Language Models and Small Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies rely on the small language model (SLM) to enhance them jointly, and the large language model’s strong reasoning ability is ignored. |
| Approach: | They propose a framework which can make knowledge base completion and knowledge base question answering enhance each other in an iterative manner by combining the strengths of the small language model and the large language model. |
| Outcome: | The proposed framework surpasses baselines for both KBC and KBQA tasks over two public benchmark data sets. |
Structure-Unified M-Tree Coding Solver for Math Word Problem (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that take into account the binary tree structure of mathematical expressions have achieved better performance, but the output space is non-deterministic. |
| Approach: | They propose a Structure-Unified M-Tree Coding Solver which applies a tree with any M branches to unify the output structures. |
| Outcome: | The proposed model outperforms several state-of-the-art models under similar experimental conditions and performs much better under low-resource conditions. |
Inducing Argument Facets for Faithful Opinion Summarization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Faithful opinion summarization task involves generating a summary that covers the majority and minority opinions in documents. |
| Approach: | They propose a facets-guided opinion summarization method that induces facets and partitions documents into multiple facet-specific sets. |
| Outcome: | The proposed method outperforms state-of-the-art methods and multiple LLMs on two representative datasets and shows it can be used in specialty domains. |
TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing work mitigates memory overhead by offloading or compressing the Key-Value cache. |
| Approach: | They propose a method that integrates quantization and offloading into a generative large language model by using a hybrid compression method. |
| Outcome: | The proposed method outperforms the state-of-the-art in long-context evaluations. |
VersaTune: An Efficient Data Composition Framework for Training Multi-Capability LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work focuses on domain-specific enhancements during fine-tuning, the challenge of which lies in catastrophic forgetting of knowledge across other domains. |
| Approach: | They propose a data composition framework that allows LLMs to enhance their multi-domain capabilities during supervised fine-tuning. |
| Outcome: | The proposed framework improves multi-domain fostering performance by 29.77% compared to uniform weights. |
Mitigating Context Interference for Reliable and Efficient Search Agents (2026.acl-long)
Copied to clipboard
Boyang Xue, Bin Wu, Shuofei Qiao, Sheng Wang, Rui Wang, Yiming Du, Hongru Wang, Jeff Z. Pan, Emine Yilmaz, Kam-Fai Wong, Aldo Lipani
| Challenge: | Recent research empowers Large Language Models (LLMs) as multi-turn search agents to iteratively retrieve and generate outputs until complex tasks are solved. |
| Approach: | They propose a distill-based context refiner to dynamically mitigate context interference . they also propose RLs that refine contexts to generate outputs . |
| Outcome: | The proposed refiner can mitigate context interference in multi-turn search agents. |
Pay More Attention to Relation Exploration for Knowledge Base Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches focus on entity representation and final answer reasoning, which results in limited supervision for this task. |
| Approach: | They propose a framework that utilizes relations to enhance entity representation and introduce additional supervision. |
| Outcome: | The proposed framework improves the F1 score on two benchmark datasets by 5.8% . it improves by 6.7% on WebQSP, better than state-of-the-art methods . |
COPR: Continual Human Preference Learning via Optimal Policy Regularization (2025.findings-acl)
Copied to clipboard
Han Zhang, Lin Gui, Yu Lei, Yuanzhao Zhai, Yehong Zhang, Zhuo Zhang, Yulan He, Hui Wang, Yue Yu, Kam-Fai Wong, Bin Liang, Ruifeng Xu
| Challenge: | Reinforcement Learning from Human Feedback (RLHF) is effective for aligning Large Language Models with human preferences, but its complex process limits its ability to continually learn human feedback. |
| Approach: | They propose a non-RL offline method to convert historical optimal policies into optimization constraints when continually learning new preferences. |
| Outcome: | The proposed method outperforms strong CL baselines in terms of reward-based evaluations and human assessment. |
Guiding the Flowing of Semantics: Interpretable Video Captioning via POS Tag (D19-1)
Copied to clipboard
| Challenge: | Existing models of video captioning use a network and semantics are mixed into one feature. |
| Approach: | They propose an Adaptive Semantic Guidance Network which instantiates whole video semantics to different POS-aware semantics with supervision of part of speech (POS) tag. |
| Outcome: | Extensive experiments show that the proposed model is more efficient than state-of-the-art models. |
Coarse-to-Fine Pre-training for Named Entity Recognition (2020.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a task of discovering information entities and identifying their corresponding categories. |
| Approach: | They propose a NER-specific framework to inject coarse-to-fine named entity knowledge into pre-trained models by using a remote supervision strategy. |
| Outcome: | The proposed framework achieves significant improvements against several pre-trained base-lines, demonstrating its effectiveness in label-few and low-resource scenarios. |
VerIF: Verification Engineering for Reinforcement Learning in Instruction Following (2025.emnlp-main)
Copied to clipboard
| Challenge: | Best practices for RL in instruction following remain underexplored. |
| Approach: | They propose a verification method that combines rule-based code verification with LLM-based verification from a large reasoning model. |
| Outcome: | The proposed method achieves state-of-the-art performance among models of comparable size and generalizes well to unseen constraints. |
GreenKGC: A Lightweight Knowledge Graph Completion Method (2023.acl-long)
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) aims to discover missing relationships in knowledge graphs (KGs). |
| Approach: | They propose a modularized knowledge graph completion solution that learns embeddings for entities and relations through a score function. |
| Outcome: | Experimental results show that GreenKGC outperforms SOTA methods in low dimensions and even better against high-dimensional models with a much smaller model size. |
Learning to Prune Dependency Trees with Rethinking for Neural Relation Extraction (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to remove noise from dependency trees are not optimal due to complexity and variability of natural language. |
| Approach: | They propose a dynamically pruned Graph Convolutional Network (DP-GCN) that prunes the dependency tree with rethinking in an end-to-end scheme. |
| Outcome: | The proposed model achieves impressive results compared to strong competitors. |
SimPBL: A Multi-Agent Framework for Project-Based Learning (2026.acl-long)
Copied to clipboard
Daniel Zhang-Li, Joy Jia Yin Lim, Binglin Liu, Shangqing Tu, Zijun Yao, Hao Peng, Jifan Yu, Haoxuan Li, Zhanxin Hao, Ye He, Zekun Li, Jiangyi Wang, Lei Hou, Bin Xu, Xin Cong, Zhiyuan Liu, Huiqin Liu, Yu Zhang, Juanzi Li
| Challenge: | Existing LLMs provide partial assistance without modeling these roles, and overly comprehensive help can reduce learner autonomy. |
| Approach: | They propose a multi-agent framework with an orchestrator agent that provides adaptive scaffolding from interaction logs and collaborator agents that support project work through boundary-aware collaboration. |
| Outcome: | The proposed framework improves learner examination scores by 14% . it is based on a multi-agent framework with an orchestrator agent . |
Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to sequence labeling are limited due to the scarcity of domain-specific data and semantic distribution biases in domain-based contexts. |
| Approach: | They propose a framework that integrates an LLM-based knowledge enhancement workflow with a span-based Knowledge Fusion for Rich and Efficient Extraction model. |
| Outcome: | The proposed model achieves state-of-the-art performance on multiple domain-specific sequence labeling datasets and is highly efficient. |
Don’t Miss the Potential Customers! Retrieving Similar Ads to Improve User Targeting (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a method for user targeting is developed to identify online users to whom an ad should be targeted. |
| Approach: | They propose a method for automatic augmentation of positive and negative clickthrough data for user targeting models. |
| Outcome: | The proposed method can increase positive and negative instances of positive training instances on two datasets. |
ETRQA: A Comprehensive Benchmark for Evaluating Event Temporal Reasoning Abilities of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Event temporal reasoning (ETR) is a significant indicator that a large language model understands the physical world. |
| Approach: | They propose a unified taxonomy for event temporal questions and construct a benchmark based on this taxonomies. |
| Outcome: | The proposed taxonomy inherits and expands existing datasets and contains multiple categories of compound questions. |
Addressing Semantic Drift in Generative Question Answering with Auxiliary Extraction (2021.acl-short)
Copied to clipboard
| Challenge: | Recent work focuses on question answering based on machine reading comprehension . current approaches treat QA as extracting a consecutive piece of text to a given question. |
| Approach: | They propose a generative QA model that incorporates an extractive mechanism into a model. |
| Outcome: | The proposed model improves quality and semantic accuracy over baseline models. |
DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have revolutionized the landscape of reasoning tasks. |
| Approach: | They propose a new approach that rethinks the reasoning process as an evolution from indeterminacy to determinacy. |
| Outcome: | The proposed model surpasses all baselines on various logical reasoning benchmarks. |
C3KG: A Chinese Commonsense Conversation Knowledge Graph (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing commonsense knowledge bases organize tuples in an isolated manner, causing problems for chatbots . |
| Approach: | They create a Chinese commonsense conversation knowledge graph which integrates social commonsensm and dialog flow information. |
| Outcome: | The proposed graph incorporates social commonsense knowledge and dialog flow information. |
Task-Aware LLM Routing with Multi-Level Task-Profile-Guided Data Synthesis for Cold-Start Scenarios (2026.acl-long)
Copied to clipboard
| Challenge: | Existing routers generalize poorly in cold-start scenarios where in-domain training data is unavailable. |
| Approach: | They propose a task-type–aware router approach that models query-conditioned cost and performance via latent task-like variables with prior regularization derived from the synthesized task taxonomy. |
| Outcome: | The proposed framework improves performance and cost under cold-start and in-domain settings and enables efficient routing. |
The Linguistic Connectivities Within Large Language Models (2025.findings-acl)
Copied to clipboard
Dan Wang, Boxi Cao, Ning Bian, Xuanang Chen, Yaojie Lu, Hongyu Lin, Jia Zheng, Le Sun, Shanshan Jiang, Bin Dong, Xianpei Han
| Challenge: | Recent studies have discovered notable disparities in their performance across different languages. |
| Approach: | They conduct a systematic investigation into the behaviors of large language models across 27 different languages on 3 different scenarios and reveals a Linguistic Map correlates with the richness of available resources and linguistic family relations. |
| Outcome: | The proposed model demonstrates that there are significant disparities in performance across languages across 27 different languages on 3 different scenarios. |
SURVEYFORGE : On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writing (2025.acl-long)
Copied to clipboard
| Challenge: | SURVEYFORGE automates survey paper writing, but quality gap between LLM-generated and human-written surveys remains significant. |
| Approach: | They propose a survey tool that automatically generates and refines human-written surveys. |
| Outcome: | Experiments show that SURVEYFORGE outperforms previous work such as AutoSurvey in outline quality and content quality. |
PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Low-rank adaptation and its variants have been popular due to their ability to avoid excessive inference costs. |
| Approach: | They propose a low-rank adaptation method that enables high-rank updates with low costs while leveraging semantic and linguistic information inherent in pre-trained weight. |
| Outcome: | The proposed method outperforms LoRA and other fine-tuning methods across tasks with less trainable parameters. |
AHVE-CNER: Aligned Hanzi Visual Encoding Enhance Chinese Named Entity Recognition with Multi-Information (2025.coling-main)
Copied to clipboard
| Challenge: | Existing glyph-based models neglect the relationship between pictorial elements and radicals for Named Entity Recognition (NER) tasks. |
| Approach: | They propose a model that integrates multi-source visual and phonetic information of Hanzi . they propose combining pictographic features with radicals to facilitate integration . |
| Outcome: | The proposed model improves performance on benchmark datasets. |
Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Dataset (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluations on the population task are either not accurate (automatic evaluation with randomly sampled negative examples) or of small scale (human annotation). |
| Approach: | They propose a reasoning over commonsense knowledge bases (CSKBs) that are free-text and have a human annotation set to probe commonsensical reasoning. |
| Outcome: | The proposed model is based on a human-annotated evaluation set and is compared with existing models on the population task. |
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)
Copied to clipboard
Xukai Wang, Xuanbo Liu, Mingrui Chen, Haitian Zhong, Xuanlin Yang, Bohan Zeng, Jinbo Hu, Hao Liang, Junbo Niu, Xuchen Li, Ruitao Wu, Ruichuan An, Yang Shi, Liu Liu, Qiang Liu, Zhouchen Lin, Xu-Yao Zhang, Wentao Zhang, Bin Dong
| Challenge: | Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models. |
| Approach: | They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. |
| Outcome: | The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models. |
WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Knowledge-Based Visual Question Answering rely on images as the retrieval key, and often overlook or misplace the role of Vision-Language Models (VLMs) |
| Approach: | They propose a multi-modal RAG framework that assigns VLMs two specialized agents: a Refiner and an Inspector. |
| Outcome: | Experiments on EVQA, InfoSeek, and M2KR show that the proposed framework achieves state-of-the-art performance with significant improvements in both retrieval accuracy and answer quality. |
ReachAgent: Enhancing Mobile Agent via Page Reaching and Operation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing mobile AI agents focus on most task-relevant elements at each step, leading to local optimal solutions and ignoring the overall GUI flow. |
| Approach: | They propose a mobile AI agent that breaks tasks into page reaching and operation subtasks and a framework that focuses on improving its task-completion abilities. |
| Outcome: | The proposed framework improves IoU accuracy and text accuracy by 7.12% and 7.69% on step-level and 4.72% and 4.63% on task-level compared to the SOTA agent. |
TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Industry Systems (2024.emnlp-industry)
Copied to clipboard
Yilun Kong, Jingqing Ruan, YiHong Chen, Bin Zhang, Tianpeng Bao, Shi Shiwei, Du Qing, Xiaoru Hu, Hangyu Mao, Ziyue Li, Xingyu Zeng, Rui Zhao, Xueqian Wang
| Challenge: | Large language models have demonstrated proficiency in addressing tasks that necessitate a combination of task planning and the usage of external tools. |
| Approach: | They propose a framework to enhance the task planning and tool usage abilities of LLMs in industrial systems. |
| Outcome: | The proposed framework enhances the task planning and tool usage abilities of LLM-based agents in industrial systems. |
Program Translation via Code Distillation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Software version migration and program translation are costly parts of the lifecycle of large codebases. |
| Approach: | They propose a model that captures semantic and structural equivalence of code in a language agnostic intermediate representation. |
| Outcome: | The proposed model achieves state-of-the-art performance on CodeXGLUE and TransCoder GeeksForGeeks translation benchmarks. |
MIND Your Reasoning: A Meta-Cognitive Intuitive-Reflective Network for Dual-Reasoning in Multimodal Stance Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods operate by learning to fuse modalities, leading to frequent misjudgments. |
| Approach: | They propose a paradigm shift from *learning to fuse* to *learning the reason's process' inspired by the dual-process theory of human cognition, MIND operationalizes a self-improving loop. |
| Outcome: | The proposed model significantly outperforms baseline models and exhibits strong generalization. |
Just Rank: Rethinking Evaluation with Word and Sentence Similarities (2022.acl-long)
Copied to clipboard
| Challenge: | Word and sentence similarity tasks are the de facto evaluation method for embeddings. |
| Approach: | They propose a new intrinsic evaluation method called EvalRank which shows a much stronger correlation with downstream tasks. |
| Outcome: | The proposed method shows a much stronger correlation with downstream tasks and is released for future benchmarking purposes. |
MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding (2024.findings-emnlp)
Copied to clipboard
Qinzhuo Wu, Weikai Xu, Wei Liu, Tao Tan, Liujian Liujianfeng, Ang Li, Jian Luan, Bin Wang, Shuo Shang
| Challenge: | Recent mobile AI agents based on VLMs lack basic mobile capabilities due to their pre-trained nature. |
| Approach: | They propose a mobile AI agent based on VLMs that includes additional pre-training stages to enhance both intra- and inter-UI understanding. |
| Outcome: | The proposed model outperforms existing VLMs on the Chinese mobile dataset Mobile3M . |
In-Image Neural Machine Translation with Segmented Pixel Sequence-to-Sequence Model (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In-Image Machine Translation (IIMT) aims to convert images containing texts from one language to another. |
| Approach: | They propose an end-to-end model instead of the traditional cascade methods which use optical character recognition followed by neural machine translation and text rendering. |
| Outcome: | The proposed model outperforms both cascade methods and current model in translation quality and robustness across various dimensions. |
PUPPET: Neural-Symbolic Standardized Patients for Mental Health (2026.acl-long)
Copied to clipboard
Chen Xu, Yu ji, Zhenyu Lv, Yang Yi, Yizhe Yang, Luyao Ji, Chaoyi Chen, Xianyang Wang, Tian Lan, Zhihua Wang, Juan Wang, Xunde Dong, Fuze Tian, Qunxi Dong, Bin Hu
| Challenge: | Existing LLM-based training approaches lack faithful responses to clinical errors and explainable feedback. |
| Approach: | They propose a neural-symbolic virtual standardized patient governed by an OBSERVE-THINK-BEHAVE architecture that embeds LLM reasoning into a symbolic system where experts implant causal associations between intervention logic and patient mental states. |
| Outcome: | The proposed model outperforms baselines in faithfulness and pedagogical value. |
ADELIE: Aligning Large Language Models on Information Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) struggle to follow complex instructions of IE tasks due to not being aligned with humans. |
| Approach: | They propose an aligned large language moDEL that effectively solves various IE tasks including closed IE, open IE and on-demand IE. |
| Outcome: | The proposed model achieves state-of-the-art (SoTA) performance among open-source models. |
Adaptive Zooming via Relevance-Informed Positional Resource Allocation for Training-free LLM Context Extension (2026.findings-acl)
Copied to clipboard
Hongbo Zhao, Huibin Wang, Bin Tang, Xianming Hu, Yihong Huang, Yijun Shen, Nuoyi Chen, Ping Li, Kai Zhang
| Challenge: | Existing training-free methods for extrapolating beyond training context lengths are semantics-agnostic . Existing methods that focus on relative token distances can indiscriminately blur semantically relevant and irrelevant tokens . |
| Approach: | They propose an adaptive positional zooming method that uses semantic relevance to extrapolate beyond training context lengths. |
| Outcome: | Experiments show that RiPRA outperforms existing training-free extrapolation methods . relevant tokens get higher positional resolution, while irrelevant tokens are compressed . |
EventWeave: A Dynamic Framework for Capturing Core and Supporting Events in Dialogue Systems (2026.acl-long)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Yiming Du, Bin Liang, Baojun Wang, Zhongyang Li, Binyang Li, Kam-Fai Wong
| Challenge: | Existing dialogue systems process conversational turns in isolation, overlooking event structures that guide natural interactions. |
| Approach: | They propose a framework that explicitly models relationships between conversational events to generate more contextually appropriate dialogue responses. |
| Outcome: | Experiments on three dialogue datasets show that the proposed approach produces more natural responses while requiring less computational overhead. |
PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents (2026.acl-long)
Copied to clipboard
Lei Wei, Xiao Peng, null Tt, Guannan Zhang, Chenhao Jiang, Hongyu Li, Lanbo Lin, Yuanwu Xu, Jiayao Liu, Kesu Wang, Bin Wang
| Challenge: | Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps. |
| Approach: | They propose a framework that reconceptualizes context management as a Next Step Prediction problem. |
| Outcome: | The proposed framework improves task success rates and robust cross-lingual performance. |
Non-Autoregressive Math Word Problem Solver with Unified Tree Structure (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing MWP solvers do not handle variants that can be derived via mathematical manipulation. |
| Approach: | They propose a non-autoregressive solver to present a solution expression and decode it from a given problem description. |
| Outcome: | The proposed solver is able to decode multiple expression variants and correct them . it is based on a unified tree structure and is available on Math23K and MAWPS. |
ProActor: Timing-Aware Reinforcement Learning for Proactive Task Scheduling Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to measuring and optimizing proactive task-oriented agents lack generalizable end-to-end solutions. |
| Approach: | They propose a framework for conversational task scheduling that integrates proactiveness reinforcement learning with a domain-agnostic annotation methodology. |
| Outcome: | The proposed framework enables scalable proactiveness reinforcement learning (RL) Experiments on two newly auto-annotated datasets demonstrate significant improvements in proactive timing while maintaining action consistency comparable to state-of-the-art baselines. |
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge distillation methods only obtain one lightweight student each time . this could be resource-intensive and resulting in multiple students not being optimally utilized . |
| Approach: | They propose a knowledge distillation framework which generates multiple satisfactory students at once. |
| Outcome: | The proposed framework generates multiple satisfactory students at once. |
Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia (2025.acl-long)
Copied to clipboard
Samuel Cahyawijaya, Holy Lovenia, Joel Ruben Antony Moniz, Tack Hwa Wong, Mohammad Rifqi Farhansyah, Thant Thiri Maung, Frederikus Hudi, David Anugraha, Muhammad Ravi Shulthan Habibi, Muhammad Reza Qorib, Amit Agarwal, Joseph Marvin Imperial, Hitesh Laxmichand Patel, Vicky Feliren, Bahrul Ilmi Nasution, Manuel Antonio Rufino, Genta Indra Winata, Rian Adam Rajagede, Carlos Rafael Catalan, Mohamed Fazli Mohamed Imam, Priyaranjan Pattnayak, Salsabila Zahirah Pranida, Kevin Pratama, Yeshil Bangera, Adisai Na-Thalang, Patricia Nicole Monderin, Yueqi Song, Christian Simon, Lynnette Hui Xian Ng, Richardy Lobo Sapan, Taki Hasan Rafi, Bin Wang, null Supryadi, Kanyakorn Veerakanjana, Piyalitt Ittichaiwong, Matthew Theodore Roque, Karissa Vincentio, Takdanai Kreangphet, Phakphum Artkaew, Kadek Hendrawan Palgunadi, Yanzhi Yu, Rochana Prih Hastuti, William Nixon, Mithil Bangera, Adrian Xuan Wei Lim, Aye Hninn Khine, Hanif Muhammad Zhafran, Teddy Ferdinan, Audra Aurora Izzani, Ayushman Singh, Evan Evan, Jauza Akbar Krito, Michael Anugraha, Fenal Ashokbhai Ilasariya, Haochen Li, John Amadeo Daniswara, Filbert Aurelian Tjiaranata, Eryawan Presma Yulianrifat, Can Udomcharoenchaikit, Fadil Risdian Ansori, Mahardika Krisna Ihsani, Giang Nguyen, Anab Maulana Barik, Dan John Velasco, Rifo Ahmad Genadi, Saptarshi Saha, Chengwei Wei, Isaiah Edri W. Flores, Kenneth Chen Ko Han, Anjela Gail D. Santos, Wan Shen Lim, Kaung Si Phyo, Tim Santos, Meisyarah Dwiastuti, Jiayun Luo, Jan Christian Blaise Cruz, Ming Shan Hee, Ikhlasul Akmal Hanif, M.Alif Al Hakim, Muhammad Rizky Sya’ban, Kun Kerdthaisong, Lester James Validad Miranda, Fajri Koto, Tirana Noor Fatyanosa, Alham Fikri Aji, Jostin Jerico Rosal, Jun Kevin, Robert Wijaya, Onno P. Kampman, Ruochen Zhang, Börje F. Karlsson, Peerat Limkonchotiwat
| Challenge: | Southeast Asia is underrepresented in vision-language research . SEA-VL is an open-source initiative dedicated to developing culturally relevant datasets for SEA languages. |
| Approach: | They propose to use crowdsourced, automated image crawling and synthetic image generation to develop culturally relevant datasets for SEA languages. |
| Outcome: | The proposed datasets capture SEA cultural nuances and contexts better than existing datasets. |
Adaptive Convolution for Multi-Relational Learning (N19-1)
Copied to clipboard
| Challenge: | Existing convolutional neural networks fail to model full interactions between entities and relations, which limits the performance of link prediction. |
| Approach: | They propose a convolutional network that maximizes entity-relation interactions in a convergent fashion. |
| Outcome: | The proposed convolutional network performs better than baseline models on multiple datasets. |
T2: An Adaptive Test-Time Scaling Strategy for Contextual Question Answering (2025.emnlp-main)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Zezhong Wang, Huimin Wang, Yutian Zhao, Bin Liang, Yefeng Zheng, Binyang Li, Kam-Fai Wong, Xian Wu
| Challenge: | Existing efficient test-time scaling methods introduce budget constraints or early stop mechanisms to avoid overthinking for straightforward questions but add human bias to the reasoning process. |
| Approach: | They propose a framework that dynamically adapts reasoning depth based on question complexity. |
| Outcome: | Experimental results show that the proposed framework achieves higher accuracy than baseline methods and reduces computational overhead by up to 25.2%. |
Recognizing Everything from All Modalities at Once: Grounded Multimodal Universal Information Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on IE tasks have focused on recognizing and analyzing cross-modal information . a multimodal large language model (MLLM) is developed to analyze IE across modalities . |
| Approach: | They propose a multimodal large language model (MLLM) capable of grounding information from all modalities. |
| Outcome: | The proposed framework provides a framework to analyze IE tasks over various modalities and their fine-grained groundings. |
GRAPHIA: Harnessing Social Graph Data to Enhance LLM-Based Social Simulation (2026.acl-long)
Copied to clipboard
| Challenge: | Social graphs provide high-quality supervision signals that encode local interactions and global network structure, yet they remain underutilized for LLM training. |
| Approach: | They propose a general LLM-based social graph simulation framework that leverages graph data as supervision for LLM training. |
| Outcome: | The proposed framework improves micro-level alignment by 6.1% on three real-world networks compared to the strongest baseline. |
DocEE: A Large-Scale and Fine-grained Benchmark for Document-level Event Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing datasets focus on sentence-level event extraction, but document-level EE is limited due to the lack of large-scale and practical training and evaluation datasets. |
| Approach: | They propose a document-level event extraction dataset with 27,000+ events and 180,000+ arguments. |
| Outcome: | The proposed dataset includes 27,000+ events, 180,000+ arguments and large-scale manual annotations, fine-grained argument types and application-oriented settings. |
EvoCoT: Overcoming the Exploration Bottleneck in Reinforcement Learning for LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to reinforcement learning with verifiable reward (RLVR) are limited by difficulty or lack of exploration. |
| Approach: | They propose a self-evolving curriculum learning framework based on chain-of-thought reasoning optimization that constrains exploration space by self-generating and verifying CoT trajectories. |
| Outcome: | The proposed framework enables LLMs to solve previously unsolved problems without external supervision and is compatible with various RL fine-tuning methods. |
Pre-training with Meta Learning for Chinese Word Segmentation (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that pre-trained models are beneficial to Chinese Word Segmentation (CWS). However, these models lack task-specific prior segmentation knowledge. |
| Approach: | They propose a pre-trained Chinese word segmentation model MetaSeg which incorporates meta learning into a multi-criteria pre-training task. |
| Outcome: | Empirical results show that MetaSeg can achieve new state-of-the-art performance on twelve widely-used CWS datasets and significantly improve model performance in low-resource settings. |
DyBBT: Dynamic Balance via Bandit-inspired Targeting for Dialog Policy with Cognitive Dual Systems (2026.acl-long)
Copied to clipboard
| Challenge: | Task oriented dialog systems often rely on static exploration strategies that do not adapt to dynamic dialog contexts. |
| Approach: | They propose a dialog policy learning framework that formalizes the exploration challenge through a structured cognitive state space C. |
| Outcome: | The proposed framework achieves SOTA performance in success rate, efficiency, and generalization. |
Compounding Geometric Operations for Knowledge Graph Completion (2023.acl-long)
Copied to clipboard
| Challenge: | Knowledge graph embedding (KGE) is one of the most fundamental problems in AI research. |
| Approach: | They propose a new knowledge graph embedding model by leveraging translation, rotation, and scaling operations to form a composite one. |
| Outcome: | The proposed model outperforms existing models on three KG prediction tasks. |
Towards Generalized Open Information Extraction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Open Information Extraction (OpenIE) models are evaluated on in-domain test sets aside from the training corpus, which violates the initial task principle of domain-independence. |
| Approach: | They propose to generalize OpenIE over unseen target domains with different data distributions from source training domains. |
| Outcome: | The proposed method beats the previous methods in both in- and out-of-domain settings by 6.0% in F1 score absolutely. |
AscendKernelGen: LLM-Driven Kernel Generation for NPUs (2026.findings-acl)
Copied to clipboard
Xinzi Cao, Jianyang Zhai, Pengfei Li, Zhiheng Hu, Cen Yan, null Mubingxu, Guanghuan Fang, Bin She, Jiayu Li, Yihan Su, Dongyang Tao, Feidiao Yang, Chang-Dong Wang, Yutong Lu, Weicheng Xue, Bin Zhou, Yonghong Tian
| Challenge: | Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs). |
| Approach: | They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say . |
| Outcome: | The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels. |
Learning Discriminative Representations for Open Relation Extraction with Instance Ranking and Label Calibration (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to extract relational facts without pre-defined relation types cluster hard or semi-hard instances into the same relation type. |
| Approach: | They propose a method to learn discriminative representations for open relation extraction by using instance ranking and label calibration strategies. |
| Outcome: | The proposed method outperforms existing methods on two public datasets. |
GrandGuard: Taxonomy, Benchmark, and Safeguards for Elderly-Chatbot Interaction Safety (2026.findings-acl)
Copied to clipboard
Changxuan Fan, Xi Yang, Yueyuan Zheng, Bin Zhou, Yuanping Wang, Wenbin Hu, Huihao Jing, Ki Sen Hung, Dazhao Du, Haoran Li, Janet Hui-wen Hsiao, Yangqiu Song
| Challenge: | a survey of older adults shows that many LLMs mishandle elderly-specific contextual risks. |
| Approach: | They propose a framework to assess elderly-specific contextual risks in LLM interactions . they use a taxonomy to identify 50 fine-grained risk types across mental well-being, financial, medical, toxicity, and privacy domains . |
| Outcome: | a new framework assesses elderly-specific contextual risks in LLM interactions . it achieves 96.2% and 90.9% unsafe-prompt detection accuracy, respectively . |
Porous Lattice Transformer Encoder for Chinese NER (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to integrate word boundary information into character-level Chinese NER are inefficient and lack semantic interaction. |
| Approach: | They propose an extension of transformer encoder that is tailored for ChineseNER to incorporate lexicons into character-level Chinese NER by lattices. |
| Outcome: | The proposed extension performs 11.4 times faster than state-of-the-art methods while retaining the rich long-term dependencies. |
MoQAE: Mixed-Precision Quantization for Long-Context LLM Inference via Mixture of Quantization-Aware Experts (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to optimize large language models for long-context inference are inefficient and consume memory. |
| Approach: | They propose a mixed-precision quantization method via mixture of experts that inputs tokens into router chunk by chunk to reduce inference overhead. |
| Outcome: | The proposed method outperforms state-of-the-art KV cache quantization methods on multiple benchmark datasets. |
Universal Information Extraction with Meta-Pretrained Self-Retrieval (2023.findings-acl)
Copied to clipboard
Xin Cong, Bowen Yu, Mengcheng Fang, Tingwen Liu, Haiyang Yu, Zhongkai Hu, Fei Huang, Yongbin Li, Bin Wang
| Challenge: | Existing methods for IE are task-specific, resulting in specialized and isolated approaches for different tasks. |
| Approach: | They propose a method to retrieve task-specific knowledge from pretrained language models to enhance universal IE by using a Meta-Pretraining Algorithm. |
| Outcome: | The proposed method achieves the new state-of-the-art on 4 IE tasks, 12 datasets under fully-supervised, low-resource and few-shot scenarios. |
HyperMR: Hyperbolic Hypergraph Multi-hop Reasoning for Knowledge-based Visual Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on knowledge-based visual question answering (KBVQA) describe the semantic distance using the actual Euclidean distance between two nodes, which leads to distortion in modeling knowledge graphs with hierarchical and scale-free structure. |
| Approach: | They propose to use the actual Euclidean distance between two nodes to solve a problem of hierarchical and free-scale knowledge graphs. |
| Outcome: | Extensive experiments on the KVQA, PQ and PQL datasets demonstrate the effectiveness of HyperMR for strong-hierarchy knowledge graphs. |
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice (2026.acl-long)
Copied to clipboard
Ziang Chen, Guannan Li, Fanlin Ji, Yipeng Kang, Jiaqi Li, Muhan Zhang, Yangtao Zhang, Li Tianjiao, Jiannan Wang, Xin Guo, Song-Chun Zhu, Bin Ling
| Challenge: | Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice. |
| Approach: | They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation. |
| Outcome: | The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability . |
SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model (2025.naacl-long)
Copied to clipboard
| Challenge: | Fine-tuning requires substantial computational resources and is prone to overfitting when applied to small datasets. |
| Approach: | They propose a parameter-efficient fine-tuning method that integrates a State Space Model (SSM) to interconnect low-rank matrices. |
| Outcome: | The proposed method achieves comparable performance to LoRA on the general language understanding evaluation (GLUE) benchmark while using only half the parameters. |
Few-Shot Event Detection with Prototypical Amortized Conditional Random Field (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to event detection ignore the trigger discrepancy and cause errors. |
| Approach: | They propose a unified model which converts a few-shot tagging problem into a single-shot model by using a Gaussian distribution. |
| Outcome: | The proposed model performs better than existing identifythen-classify models on a few-shot tagging problem with a double-part taging scheme. |
MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussions (2023.acl-long)
Copied to clipboard
| Challenge: | A moral dialogue system aligned with users’ values could enhance conversation engagement and user connections. |
| Approach: | They propose a framework to train and evaluate moral dialogue systems based on communication mechanisms of morality and a method to construct moral discussions between simulated users and the dialogue system. |
| Outcome: | The proposed framework can train and evaluate moral dialogue systems based on simulated users and their values . |
METNet: A Mutual Enhanced Transformation Network for Aspect-based Sentiment Analysis (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for learning complex sentences with multiple aspects are ill-equipped to learn complex sentences . |
| Approach: | They propose a mutual enhanced transformation network for the ABSA task . it improves representation learning of the aspect with contextual semantic features . |
| Outcome: | The proposed model improves representation learning of the aspect with contextual semantic features, giving the aspect more abundant information. |
SUT: Active Defects Probing for Transcompiler Models (2023.emnlp-main)
Copied to clipboard
Mengnan Qi, Yufan Huang, Maoquan Wang, Yongqiang Yao, Zihan Liu, Bin Gu, Colin Clement, Neel Sundaresan
| Challenge: | Existing datasets are often criticized for their lack of granularity, which can mask deficiencies in basic syntactic elements that humans care about. |
| Approach: | They propose a new program translation metrics that address basic syntax errors . they propose BLUE, CodeBLUE and computation accuracy metrics which address these errors based on a highly interpretable evaluation harness. |
| Outcome: | The proposed model passes the unit tests with a 26.15% pass rate compared to previous models . |
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data (2024.findings-acl)
Copied to clipboard
Yanda Li, Chi Zhang, Gang Yu, Wanqi Yang, Zhibin Wang, Bin Fu, Guosheng Lin, Chunhua Shen, Ling Chen, Yunchao Wei
| Challenge: | OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown. |
| Approach: | They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning. |
| Outcome: | The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods. |
MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholds (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods neglect stylistic modeling and rely on static thresholds, which greatly limits the detection performance. |
| Approach: | They propose a framework that enables stylistics-aware uncertainty quantification through conditional threshold estimation. |
| Outcome: | The proposed framework achieves an average improvement 11.34% in detection performance compared to baselines. |
Graph-to-Tree Learning for Solving Math Word Problems (2020.acl-main)
Copied to clipboard
| Challenge: | Existing tree-based neural models do not capture the relationships and order information among the quantities well. |
| Approach: | They propose a novel deep learning architecture that combines the merits of the graph-based encoder and tree-based decoder to generate better solution expressions. |
| Outcome: | The proposed framework outperforms the state-of-the-art on two available datasets significantly. |
Battling against Tough Resister: Strategy Planning with Adversarial Game for Non-collaborative Dialogues (2025.acl-long)
Copied to clipboard
| Challenge: | Non-collaborative dialogue involves two participants with conflicting interests engaging in multiround dialogue to achieve their own goals. |
| Approach: | They propose a Game-based Adversarial self-play InterActive training paradigm which constructs an adversarial two-player (a persuader and a resister) zero-sum game and guides the game to approximate Nash Equilibrium (NE) via reinforcement learning. |
| Outcome: | The proposed model achieves state-of-the-art performance on three datasets. |
Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism (2020.coling-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive models generate target words in parallel, but with a large latency due to the left-to-right dependency. |
| Approach: | They propose to train a conditional masked translation model and refine results within several iterations to remedy a flawed translation by non-autoregressive models. |
| Outcome: | The proposed model outperforms state-of-the-art models by over 1 BLEU while using less training computations. |
Synergizing Multimodal Temporal Knowledge Graphs and Large Language Models for Social Relation Recognition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have limited capacity to model complex graph-structured relationships. |
| Approach: | They propose a low-coupling method synergizing multimodal temporal Knowledge Graphs and Large Language Models for social relation reasoning. |
| Outcome: | The proposed method exhibits state-of-the-art performance in social relation recognition . it bridges the gap between KGs and LLMs and will be released after acceptance . |
Towards Objectively Benchmarking Social Intelligence of Language Agents at the Action Level (2024.findings-acl)
Copied to clipboard
| Challenge: | evaluative findings highlight that the STSS benchmark is challenging for state-of-the-art language agents. |
| Approach: | They propose a social task in sandbox simulation benchmark that assesses language agents objectively at the action level by scrutinizing goal achievements within the multi-agent simulation. |
| Outcome: | The proposed social task-in-sandbox simulation is a language-level benchmark . the proposed benchmark effectively discriminates between distinct language agents . |
Analyzing and Evaluating Faithfulness in Dialogue Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on faithfulness of text summarization have not been conducted on abstractive summarizing. |
| Approach: | They propose a method to evaluate faithfulness of dialogue summarization models by multi-choice questions. |
| Outcome: | The proposed method can facilitate the development of dialogue summarization systems. |
ToolPlanner: A Tool Augmented LLM for Multi Granularity Instructions with Path Planning and Feedback (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that tool-augmented large language models can interact with external tools in multiple rounds and provide a final answer. |
| Approach: | They propose a tool-augmented large language model that can interact with external tools in multiple rounds and provide a final answer to an instruction. |
| Outcome: | The proposed framework significantly improves Match Rate, Pass Rate and Win Rate by 26.8%, 20.2%, and 5.6% compared to the SOTA model. |
HoPE: A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing positional encodings exhibit long-term decay, based on an entrenched and long-standing opinion that tokens farther away from the current position carry less relevant information. |
| Approach: | They propose a high-frequency rotary position encoding (HoPE) that replaces specific components in RoPE with position-independent ones, retaining only high- frequency signals. |
| Outcome: | The proposed method exhibits greater robustness to the out-of-distribution behavior in attention patterns during extrapolation. |
PEDNet: A Persona Enhanced Dual Alternating Learning Network for Conversational Response Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing persona-based dialogue models generate personalized responses using predefined persona information, but they lack personality. |
| Approach: | They propose a persona-based dual Alternating Learning Network that generates personalized responses using predefined persona information. |
| Outcome: | The proposed method produces more personalized responses than baseline methods. |
Flexibly Utilize Memory for Long-Term Conversation via a Fragment-then-Compose Framework (2025.emnlp-main)
Copied to clipboard
Cai Ke, Yiming Du, Bin Liang, Yifan Xiang, Lin Gui, Zhongyang Li, Baojun Wang, Yue Yu, Hui Wang, Kam-Fai Wong, Ruifeng Xu
| Challenge: | Large language models extract useful information from conversation history to enhance the response in long-term conversations. |
| Approach: | They propose a Fragment-then-Compose framework to optimize memory utilization for long-term open-domain conversation. |
| Outcome: | The proposed framework can be used to extract useful information from conversation history . it can be adapted to different situations and improve response generation . |
Exploring Better Text Image Translation with Multimodal Codebook (2023.acl-long)
Copied to clipboard
| Challenge: | Current studies on text image translation face bottlenecks due to lack of a publicly available dataset and poor optical character recognition. |
| Approach: | They propose a text image translation model with a multimodal codebook and an OCR dataset for Chinese-English translation. |
| Outcome: | The proposed model can associate the image with relevant texts, providing useful supplementary information for translation. |
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)
Copied to clipboard
Xinming Wang, Jian Xu, Bin Yu, Sheng Lian, yi Chen, Boran Wang, Yingjian Zhu, Hongzhu Yi, Hong-Ming Yang, Han Hu, Cheng-Lin Liu, Xu-Yao Zhang
| Challenge: | Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited. |
| Approach: | They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments. |
| Outcome: | Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning. |
Bridging the Gap between Synthetic and Natural Questions via Sentence Decomposition for Semantic Parsing (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing methods to train a parser to perform zero-shot learning are limited by the lack of training data. |
| Approach: | They propose a decomposition-based method to unify the sentence structures of questions . their method can generalize to natural questions with novel text expressions . |
| Outcome: | The proposed method improves on synthetic data and on complex web questions with novel expressions. |
StructuralLM: Structural Pre-training for Form Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models focus on text-only representation, neglecting cell-level layout information. |
| Approach: | They propose a pre-training approach to leverage cell and layout information from scanned documents. |
| Outcome: | The proposed model achieves state-of-the-art in various downstream tasks . it uses 2Dposition embeddings to model word-level layout information . |
JoTR: A Joint Transformer and Reinforcement Learning Framework for Dialogue Policy Learning (2024.lrec-main)
Copied to clipboard
Wai-Chung Kwan, Huimin Wang, Hongru Wang, Zezhong Wang, Bin Liang, Xian Wu, Yefeng Zheng, Kam-Fai Wong
| Challenge: | Dialogue policy learning (DPL) aims to determine an abstract representation (also known as action) to guide what the response should be. |
| Approach: | They propose a joint Transformer-based model that generates a token-grained policy that allows more dynamic dialogue action generation without the need for predefined action candidates. |
| Outcome: | The proposed model outperforms existing models showing improvements of 9% and 13% in success rate and 34% and 37% in diversity of dialogue actions across two benchmark dialogue modeling tasks. |
In-Context Example Retrieval from Multi-Perspectives for Few-Shot Aspect-Based Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to solve few-shot aspect-based sentiment analysis (ABSA) are suboptimal for this task because of in-context examples . |
| Approach: | They propose to retrieve in-context examples for few-shot aspect-based sentiment analysis . they construct positive and negative pairs from three perspectives and train the retriever . |
| Outcome: | The proposed retrieval framework outperforms baselines on four ABSA datasets. |
In-context Learning for Few-shot Multimodal Named Entity Recognition (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition are time-consuming and laborintensive. |
| Approach: | They propose a few-shot multimodal named entity recognition task that uses few examples to locate and identify named entities for a text-image pair. |
| Outcome: | The proposed framework outperforms baselines under several few-shot settings. |
Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to classify named entity mentions with fewshots fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario. |
| Approach: | They propose a model that can automatically induce different unde- fined classes from the other class to improve few-shot Named Entity Recognition (NER) . |
| Outcome: | The proposed model outperforms five state-of-the-art models in 1- shot and 5-shots settings on four NER bench marks. |
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections (2022.emnlp-main)
Copied to clipboard
Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, He Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si
| Challenge: | Existing pre-trained vision-language models suffer from inefficiency and linguistic signal overwhelmed by long visual sequences in cross-modal alignment. |
| Approach: | They propose a vision-language foundation model with cross-modal skip-connections that can be pre-trained end-to-end on large-scale image-text pairs with both discriminative and generative objectives. |
| Outcome: | The proposed model achieves state-of-the-art results on a wide range of vision-language downstream tasks, including image captioning, image-text retrieval, visual grounding and visual question answering. |
Maximal Clique Based Non-Autoregressive Open Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Open Information Extraction (OpenIE) aims to discover textual facts from a given sentence. |
| Approach: | They propose a non-autoregressive framework that generates a fact graph and a graph with an edge linking two nodes that belong to the same fact. |
| Outcome: | The proposed framework outperforms current state-of-the-art methods on two benchmark datasets and significantly outperformed the existing ones. |
CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | Publicly available datasets can be used to evaluate performance of large language models . however, contamination of test data can artificially inflate model performance . |
| Approach: | They propose a Contamination-resilient Evaluation strategy that updates data with real-world knowledge. |
| Outcome: | The proposed evaluation strategy can be used to update datasets with real-world knowledge. |
From Knowing to Teaching: Scaffolding Pedagogical Decisions for LLM Agent (2026.acl-long)
Copied to clipboard
Yucheng Wang, Shen Yang, Jifan Yu, Haoxuan Li, Joy Jia Yin Lim, Daniel Zhang-Li, Huiqin Liu, Lei Hou, Juanzi Li, Bin Xu
| Challenge: | Large language models produce content lacking pedagogical depth when asked to generate lessons . |
| Approach: | They propose a framework that allows teachers to select content according to pedagogical intent and sequence topics so foundations precede applications. |
| Outcome: | The framework achieves 67.8% win rate in human evaluation and 79.6% in LLM-based evaluation against eight baselines. |
MAVEN-FACT: A Large-scale Event Factuality Detection Dataset (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Event factuality detection is under-explored due to the lack of high-quality large-scale data . efd is a subfield of event understanding, which aims to determine the factuity of textual events. |
| Approach: | They propose a large-scale EFD dataset with factuality annotations of 112,276 events . they find that adopting event arguments and relations helps in event factuity detection . |
| Outcome: | The proposed dataset includes factuality annotations of 112,276 events . it is the largest EFD dataset and is challenging for fine-tuned models and large language models . |
Cluster-aware Pseudo-Labeling for Supervised Open Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to extract novel relations do not achieve effective knowledge transfer . experimental results show that the proposed method is state-of-the-arts . |
| Approach: | They propose a Cluster-aware Pseudo-Labeling method to improve pseudo-labels quality . they firstly pre-trained the relation models with pre-defined relations to learn them . |
| Outcome: | The proposed method improves the pseudo-labels quality and transfer more knowledge for discovering novel relations. |
Stand on The Shoulders of Giants: Building JailExpert from Previous Attack Experience (2025.emnlp-main)
Copied to clipboard
Xi Wang, Songlei Jian, Shasha Li, Xiaopeng Li, Bin Ji, Ma Jun, Xiaodong Liu, Jing Wang, Jianfeng Zhang, Jie Yu, Feilong Bao, null Wangbaosheng
| Challenge: | Existing methods to generate human-aligned content with a “jailbreak prompt” are inefficient and repetitive, causing inefficiency and a lack of experience. |
| Approach: | They propose a framework that integrates past attack experiences to aid current jailbreak attempts. |
| Outcome: | The proposed framework improves both attack effectiveness and efficiency compared to the current black-box jailbreak method. |
Do Language Models Mirror Human Confidence? Exploring Psychological Insights to Address Overconfidence in LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Psychology research has shown that humans are poor at estimating their performance on tasks, tending towards underconfidence on easy tasks and overconfidence on difficult tasks. |
| Approach: | They propose to use a self-assessment method to assess confidence in large language models (LLMs) they propose to ask for the answer separately and then use them to improve their accuracy. |
| Outcome: | The proposed method improves confidence calibration and interpretability in QA tasks with different personas. |
ToolRerank: Adaptive and Hierarchy-Aware Reranking for Tool Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies have proposed tool learning, which augments LLMs with external tools. |
| Approach: | They propose an adaptive and hierarchy-aware reranking method to refine retrieval results by truncating the retrieval result related to seen and unseen tools at different positions. |
| Outcome: | The proposed method improves retrieval results, leading to better execution results generated by the LLM. |
Instructive Dialogue Summarization with Query Aggregations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Conventional dialogue summarization methods generate summaries without considering user’s specific interests. |
| Approach: | They propose a three-step approach to synthesize high-quality query-based summarization triples by training a unified model on three summarizing datasets with multi-purpose instructive triples. |
| Outcome: | The proposed model outperforms state-of-the-art models and even models with larger sizes on four datasets including dialogue summarization and dialogue reading comprehension. |
CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine Translation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks for Continual Language Learning (CLL) are limited due to the complexity of the task and the lack of unified benchmarks. |
| Approach: | They propose a Continual Language Learning Evaluation benchmark CLLE in multilingual translation. |
| Outcome: | The proposed method is effective when compared with other strong benchmarks. |
Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems (2025.acl-long)
Copied to clipboard
| Challenge: | Existing reward models focus on human preferences, neglecting verifiable correctness signals. |
| Approach: | They propose a reward system that combines human preference rewards with verifiable correctness signals to provide reliable rewards. |
| Outcome: | The proposed reward agent significantly outperforms vanilla reward models on benchmarks and inference-time best-of-n searches on real-world tasks. |
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs (2024.lrec-main)
Copied to clipboard
Chenxi Sun, Hongzhi Zhang, Zijia Lin, Jingyuan Zhang, Fuzheng Zhang, Zhongyuan Wang, Bin Chen, Chengru Song, Di Zhang, Kun Gai, Deyi Xiong
| Challenge: | Large language models have demonstrated exceptional capability in natural language understanding and generation, but their generation speed is limited by the inherently sequential nature of their decoding process. |
| Approach: | They propose a method that accelerates decoding process without sacrificing quality . they propose lexical unit decoding, which can be integrated with other methods . |
| Outcome: | The proposed method significantly reduces decoding time while maintaining quality while maintaining output quality. |
From Verbatim to Gist: Distilling Pyramidal Multimodal Memory via Semantic Information Bottleneck for Long-Horizon Video Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multimodal large language models struggle with long-horizon video understanding due to limited context windows and static memory mechanisms that fail to mirror human cognitive efficiency. |
| Approach: | They propose a pyramidal multimodal memory architecture grounded in Fuzzy-Trace Theory that structures memory hierarchically into a *Sensory Buffer*, *Episodic Stream*, and *Symbolic Schema*. |
| Outcome: | The proposed architecture achieves state-of-the-art on both offline and streaming tasks, demonstrating robust generalization and validating the effectiveness of cognition-inspired memory organization. |
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages (2024.emnlp-main)
Copied to clipboard
Holy Lovenia, Rahmad Mahendra, Salsabil Akbar, Lester James Miranda, Jennifer Santoso, Elyanah Aco, Akhdan Fadhilah, Jonibek Mansurov, Joseph Marvin Imperial, Onno Kampman, Joel Moniz, Muhammad Habibi, Frederikus Hudi, Jann Montalan, Ryan Hadiwijaya, Joanito Lopo, William Nixon, Börje Karlsson, James Jaya, Ryandito Diandaru, Yuze Gao, Patrick Irawan, Bin Wang, Jan Christian Blaise Cruz, Chenxi Whitehouse, Ivan Parmonangan, Maria Khelli, Wenyu Zhang, Lucky Susanto, Reynard Ryanda, Sonny Hermawan, Dan Velasco, Muhammad Kautsar, Willy Hendria, Yasmin Moslem, Noah Flynn, Muhammad Adilazuarda, Haochen Li, Johanes Lee, R. Damanhuri, Shuo Sun, Muhammad Qorib, Amirbek Djanibekov, Wei Qi Leong, Quyet V. Do, Niklas Muennighoff, Tanrada Pansuwan, Ilham Firdausi Putra, Yan Xu, Tai Chia, Ayu Purwarianti, Sebastian Ruder, William Tjhi, Peerat Limkonchotiwat, Alham Aji, Sedrick Keh, Genta Winata, Ruochen Zhang, Fajri Koto, Zheng Xin Yong, Samuel Cahyawijaya
| Challenge: | Southeast Asia (SEA) is home to over 1,300 indigenous languages and 671 million people . prevailing AI models suffer from a significant lack of representation of texts, images, and audio datasets from SEA . |
| Approach: | They propose to provide a resource center that provides standardized corpora in nearly 1,000 SEA languages across three modalities. |
| Outcome: | a new benchmark assesses the quality of AI models on 36 SEA languages across 13 tasks . the results highlight the importance of SEA as a culturally diverse region . |
Modeling Uncertainty in Composed Image Retrieval via Probabilistic Embeddings (2025.acl-long)
Copied to clipboard
Haomiao Tang, Jinpeng Wang, Yuang Peng, GuangHao Meng, Ruisheng Luo, Bin Chen, Long Chen, Yaowei Wang, Shu-Tao Xia
| Challenge: | Composed Image Retrieval (CIR) combines text and reference images to search for images . metric learning methods that focus on point embeddings fail to capture uncertainty in input data . |
| Approach: | They propose a framework that captures uncertainty in images and queries by Gaussian distributions in latent space rather than fixed points. |
| Outcome: | Experiments show that the proposed framework quantifies quality and semantic uncertainties . it can handle polysemy and ambiguity in search intentions, authors say . |
SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning (2024.naacl-long)
Copied to clipboard
| Challenge: | a new benchmark for multilingual foundation models is being developed . brittleness of foundation models in the dimensions of semantics and multilinguality is a key limitation . |
| Approach: | They propose a benchmark for multilingual foundation models, SeaEval . they examine how well these models comprehend cultural practices, nuances, and values . |
| Outcome: | The proposed model can be used to evaluate multilingual and multicultural scenarios. |
Bridging Kernel Drivers and Virtual Device Models with LLM-Powered Automation (2026.acl-demo)
Copied to clipboard
| Challenge: | Linux kernel device drivers are tightly coupled with hardware, making them difficult to execute and test without physical devices. |
| Approach: | They present a tool that generates QEMU-based virtual devices directly from Linux driver source code. |
| Outcome: | The proposed tool generates QEMU-based virtual devices directly from Linux driver source code. |
Exploration-Exploitation Reshaping towards Efficient Reasoning for Large Language Models (2026.findings-acl)
Copied to clipboard
Yufeng Shi, Weilin Luo, Yuxiang Zhang, Zongmeng Zhang, Haoyang Liu, Yubing Wang, Bin Wang, Wengang Zhou, Houqiang Li
| Challenge: | Large Reasoning Models (LRMs) are constrained by the overthinking issue. |
| Approach: | They propose a policy optimization framework that reshapes the exploration and exploitation through two core components: self-imitation and self-guidance exploration. |
| Outcome: | The proposed model achieves superior reasoning efficiency without compromising overall accuracy. |
Dynamic Guided and Domain Applicable Safeguards for Enhanced Security in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing defense methods struggle with two key issues: inadequate defense capabilities and over-defensiveness. |
| Approach: | They propose a multi-agents-based framework that leverages accurate external information to provide an unbiased summary of user intentions and safety response guidance. |
| Outcome: | Experiments on popular jailbreak attacks and benign datasets show that the proposed framework can enhance LLM's robustness against jailbreaks without compromising its general functionality. |
JPU: Bridging Jailbreak Defense and Unlearning via On-Policy Path Rectification (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are vulnerable to diverse jailbreak attacks despite extensive safety alignment . |
| Approach: | They propose a method to rectify dynamic jailbreak paths towards safety anchors by dynamically mining on-policy adversarial samples to expose vulnerabilities and identify jailbreak path. |
| Outcome: | The proposed model significantly improves jailbreak resistance against dynamic attacks while maintaining its utility. |
OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework (2025.emnlp-demos)
Copied to clipboard
Jian Hu, Xibin Wu, Wei Shen, Jason Klein Liu, Weixun Wang, Songlin Jiang, Haoran Wang, Hao Chen, Bin Chen, Wenkai Fang, null Xianyu, Yu Cao, Haotian Xu, Yiming Liu
| Challenge: | Existing RLHF frameworks face inference bottlenecks and complexity barriers restricting their accessibility for newcomers. |
| Approach: | They propose an open-source RLHF framework that can be used to train large language models. |
| Outcome: | The proposed framework achieves superior training efficiency with speedups ranging from 1.22 to 1.68 across different model sizes compared to state-of-the-art frameworks, while requiring significantly fewer lines of code for implementation. |
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)
Copied to clipboard
Keke Lian, Wang Bin, Lei Zhang, Libo Chen, Junjie Wang, Ziming Zhao, Yujiu Yang, Miaoqian Lin, Haotong Duan, Haoran Zhao, Shuang Liao, Mingda Guo, Quan Jiazheng, Yilu Zhong, Chenhao He, Chen Zichuan, Jie Wu, Haoling Li, Zhaoxuan Li, Jiongchi Yu, Hui LI, Dong Zhang
| Challenge: | Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows . |
| Approach: | They propose a repository-level evaluation benchmark to assess security of AI-generated code. |
| Outcome: | The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation. |
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding (2022.findings-emnlp)
Copied to clipboard
Qiming Peng, Yinxu Pan, Wenjin Wang, Bin Luo, Zhenyu Zhang, Zhengjie Huang, Yuhui Cao, Weichong Yin, Yongfeng Chen, Yin Zhang, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
| Challenge: | Existing methods for visually rich document understanding lack layout-centered knowledge . experimental results show that ERNIE-Layout improves layout awareness . |
| Approach: | They propose a document pre-training solution with layout knowledge enhancement in the whole workflow to learn better representations that combine the features from text, layout, and image. |
| Outcome: | The proposed model outperforms existing models on key downstream tasks. |
VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work in multilingual pretraining relies on the shared vocabulary and bilingual contexts to encourage the correlation across languages. |
| Approach: | They propose to plug a cross-attention module into a Transformer encoder to explicitly build the interdependence between languages. |
| Outcome: | The proposed model outperforms existing models on XTREME and English-to-French translation datasets. |
Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Stochastic sampling strategies are not widely used in open-domain dialogue systems. |
| Approach: | They propose a dynamic decoding strategy which can adjust the decoding space w.r.t. different contexts. |
| Outcome: | The proposed decoding strategy can improve the performance of pre-trained models when coupled with four well-used stochastic decoding algorithms. |
Mitigating Biases of Large Language Models in Stance Detection with Counterfactual Augmented Calibration (2025.naacl-long)
Copied to clipboard
Ang Li, Jingqian Zhao, Bin Liang, Lin Gui, Hui Wang, Xi Zeng, Xingwei Liang, Kam-Fai Wong, Ruifeng Xu
| Challenge: | Large language models generate biased stances due to spurious correlations and preference towards certain individuals and topics. |
| Approach: | They propose a counterfactual Augmented Calibration Network to calibrate potential bias in stance detection of large language models. |
| Outcome: | The proposed calibration network can mitigate biases of large language models, achieving state-of-the-art results. |