Papers by Ying Wang
ProUIE: A Macro-to-Micro Progressive Learning Method for LLM-based Universal Information Extraction (2026.findings-acl)
Copied to clipboard
Wenda Liu, Song Zhigang, Shuai Nie, Guangyao Liu, Lisung Chen, Binyu Yang, Yaran Chen, Peng Zhou, Hongzhen Wang, Yuchen Liu, Wenyue Hu, Jiaming Xu, Runyu Shi, Ying Huang
| Challenge: | ProUIE improves universal information extraction (UIE) without external information . many LLM-based methods rely on extra schema cues, external resources or complex alignment and verification pipelines . |
| Approach: | They propose a Macro-to-Micro progressive learning approach that improves UIE without external information. |
| Outcome: | ProUIE outperforms instruction-tuned baselines on average for NER and RE while using a smaller backbone. |
Progra: Progress-Aware Reinforcement Learning for Multi-Turn Function Calling (2026.findings-acl)
Copied to clipboard
Huacan Chai, Zijie Cao, Maolin Ran, Yingxuan Yang, Jianghao Lin, Xin Peng, Hairui Wang, Renjie Ding, Ziyu Wan, Muning Wen, Weiwen Liu, Weinan Zhang, Fei Huang, Ying Wen
| Challenge: | Existing methods for multi-turn function calling are limited by redundancy and lack explicit integration of progress awareness into training. |
| Approach: | They propose a framework that explicitly integrates progress awareness into LLM training for multi-turn function calling. |
| Outcome: | Empirical results show that Progra outperforms existing methods on two public benchmarks. |
Integrating User History into Heterogeneous Graph for Dialogue Act Recognition (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models cannot fully recognize the specific expressions given by users due to the informality and diversity of natural language expressions. |
| Approach: | They propose a Heterogeneous User History graph convolution network which utilizes the user’s historical answers grouped by DA labels as additional clues to recognize the DA label of utterances. |
| Outcome: | The proposed model outperforms the state-of-the-art methods on two benchmark datasets and shows that it integrates user’s historical answers. |
AIDA-SEAT: Towards Reliable AI Doctor Assistant via State-Evaluation-Action Tree Enhanced LLMs in Online Hospital (2026.acl-industry)
Copied to clipboard
Lianxin Sun, Xiaoying Ying, Guangya Yu, Weiyan Zhang, Chenhao Guan, Hao He, Mingxi Shang, Jianhua Li, ChunMing Wang, Tong Ruan
| Challenge: | Existing systems rely on large language models or retrieval-augmented generation (RAG) but these methods lack the explicit logical pathways essential for multi-step reasoning. |
| Approach: | They propose an AIDA-SEAT framework to provide reliable clinical decision-making support by transforming and modifying medical documents and doctors' state-evaluation-action trees. |
| Outcome: | The proposed framework achieves 1.01% higher than current state-of-the-art (SOTA) baselines across five departments, including common RAG-based methods. |
Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models (2025.acl-long)
Copied to clipboard
Xinlin Zhuang, Jiahui Peng, Ren Ma, Yinfan Wang, Tianyi Bai, Xingjian Wei, Qiu Jiantao, Chi Zhang, Ying Qian, Conghui He
| Challenge: | composition of pre-training datasets for large language models remains undisclosed . current methods for evaluating data quality are limited by single-dimensional evaluation or redundancy-focused strategies. |
| Approach: | They propose a multi-dimensional data selection method that integrates dimensions with existing quality metrics through learned optimal weightings. |
| Outcome: | The proposed method doubles convergence speed for 1.3B model models and improves downstream task performance by 3.23%. |
A Deep Learning-Based System for PharmaCoNER (D19-57)
Copied to clipboard
Ying Xiong, Yedan Shen, Yuanhang Huang, Shuai Chen, Buzhou Tang, Xiaolong Wang, Qingcai Chen, Jun Yan, Yi Zhou
| Challenge: | Efficient access to mentions of clinical entities is very important for using clinical text. |
| Approach: | They developed a pipeline system based on deep learning methods for this shared task . it achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average LSTM score of 0.8391 on track 2 . |
| Outcome: | The proposed system achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average score of 0.8391 on track 2. |
LightSeq: A High Performance Inference Library for Transformers (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing inference frameworks for natural language processing are not the best choice for online service of sequence processing problems. |
| Approach: | They propose a highly efficient inference library for Transformer models that includes GPU optimization techniques to streamline computation and reduce memory footprint. |
| Outcome: | The proposed library achieves 14x speedup compared with TensorFlow and 1.4x speed up compared to a concurrent CUDA implementation. |
Innovative Image Fraud Detection with Cross-Sample Anomaly Analysis: The Power of LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document image fraud detection lack visual clues on tampered regions. |
| Approach: | They propose a framework for detecting logical inconsistencies in document images by leveraging LLMs. |
| Outcome: | The proposed framework outperforms state-of-the-art fraud detection methods by 79.6% on CrossCred and industrial solutions by 21.7% on business data. |
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
Detoxifying Large Language Models via the Diversity of Toxic Samples (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for analyzing and utilizing toxic samples are limited . current methods fail to fully harness their potential . |
| Approach: | They propose a diverse detoxification framework that leverages toxic samples' diversity . they propose MPSG strategy and SC-DPO approach to elicit personalized toxic responses . |
| Outcome: | The proposed framework could be used to optimize large language models for user safety . it incorporates two components: MPSG strategy and SC-DPO approach . |
DPDLLM: A Black-box Framework for Detecting Pre-training Data from Large Language Models (2024.findings-acl)
Copied to clipboard
Baohang Zhou, Zezhong Wang, Lingzhi Wang, Hongru Wang, Ying Zhang, Kehui Song, Xuhui Sui, Kam-Fai Wong
| Challenge: | Existing methods to detect pretraining data from large language models are unrealistic to them. |
| Approach: | They propose to detect pre-training data from LLM in a black-box way by using GPT-2 as reference model and feed it with sequence probabilities to detect whether it was used to train it. |
| Outcome: | The proposed framework outperforms existing methods on the benchmark datasets and shows that it is effective on different popular LLMs. |
It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books (2022.acl-long)
Copied to clipboard
| Challenge: | Existing question answering (QA) techniques are created mainly to answer questions asked by humans, but in educational applications, teachers often need to decide what questions to ask . |
| Approach: | They propose to use a fairytale-themed storybook as input to generate QA pairs that can test a student's comprehension skills. |
| Outcome: | The proposed system outperforms state-of-the-art QAG baseline systems and builds an interactive story-telling application for the future real-world deployment. |
Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaboration (2025.acl-long)
Copied to clipboard
Shao Zhang, Xihuai Wang, Wenhao Zhang, Chaoran Li, Junru Song, Tingyu Li, Lin Qiu, Xuezhi Cao, Xunliang Cai, Wen Yao, Weinan Zhang, Xinbing Wang, Ying Wen
| Challenge: | Large language models (LLMs) excel in turn-by-turn human-AI collaboration but struggle with simultaneous tasks requiring real-time interaction. |
| Approach: | They propose a language agent framework that integrates *System 1* and *System 2* for efficient real-time simultaneous human-AI collaboration. |
| Outcome: | The proposed framework improves on existing LLM-based agents and human collaborators by integrating Theory of Mind and asynchronous reflection to infer human intentions and perform reasoning-based autonomous decisions. |
INREACT: An Inspire-Then-Reinforce Training Framework For Multimodal GUI Agent (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing multimodal large language models struggle with precise localization of small elements. |
| Approach: | They propose a multimodal GUI agent framework that unifies observing, thinking, and acting for precise and interpretable decision-making. |
| Outcome: | The proposed framework unifies observing, thinking, and acting for precise and interpretable decision-making. |
Granular Entity Mapper: Advancing Fine-grained Multimodal Named Entity Recognition and Grounding (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for fine-grained content extraction are limited by long-tailed distribution of textual entity categories and performance of object detectors. |
| Approach: | They propose a multi-granularity entity recognition module and a reranking module to integrate hierarchical information of entity categories, visual cues, and external textual resources collectively. |
| Outcome: | The proposed framework achieves state-of-the-art on the fine-grained content extraction task. |
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)
Copied to clipboard
Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, Xiang Chen, Tianhua Zhou
| Challenge: | Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text. |
| Approach: | They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types. |
| Outcome: | The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages. |
MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to perform multimodal information extraction only investigated entity-based tasks under supervised learning with adequate labeled data. |
| Approach: | They propose to investigate the entity-based MIE tasks under the low-resource settings by decomposing the features into image, entity, and context factors. |
| Outcome: | The proposed method is able to perform on two public MIE benchmark datasets and the experimental results confirm it. |
Anchoring-Guidance Fine-Tuning (AnGFT): Elevating Professional Response Quality in Role-Playing Conversational Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated significant advancements in various fields, notably in Role-Playing Conversational Agents (RPCAs). |
| Approach: | They propose an Anchoring-Guidance Fine-Tuning Framework to integrate relevant expert knowledge into RPCAs' training process to mitigate this issue. |
| Outcome: | The proposed framework significantly improves the RPCAs’ performance in handling role-specific professional queries while preserving their robust role-playing abilities. |
Mitigate Extrinsic Social Bias in Pre-trained Language Models via Continuous Prompts Adjustment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of extrinsic bias mitigation rely on manual word lists for sensitive groups . however, these word lists are limited by length and scope, resulting in poor performance. |
| Approach: | They propose a method which generates continuous token lists from the entire vocabulary space and uses them to bridge the gap between outputs and targets in fairness learning process. |
| Outcome: | The proposed method outperforms baseline methods on three NLU tasks. |
Improving Knowledge Graph Embedding Using Affine Transformations of Entities Corresponding to Each Relation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods use k-dimensional vectors to represent each entity in a knowledge graph. |
| Approach: | They propose to use affine transformations to embed knowledge graphs using previous methods . they propose to add k additional variables to the existing methods to perform embedding . |
| Outcome: | The proposed method outperforms RotatE, Distmult and ComplEx on various data sets. |
SPAGBias: Uncovering and Tracing Structured Spatial Gender Bias in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are being used in urban planning but there is concern that they reproduce or amplify such biases. |
| Approach: | They propose a framework to evaluate spatial gender bias in large language models . they use a taxonomy of 62 urban micro-spaces, a prompt library and three diagnostic layers . |
| Outcome: | The proposed framework identifies structured gender-space associations that go beyond the public-private divide, forming nuanced micro-level mappings. |
DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis. |
| Approach: | They propose a controllable data synthesis framework based on variational autoencoder which leverages diffusion models to reserve more information of original distribution and format structure in the learned latent distribution. |
| Outcome: | The proposed framework generates high-quality data with performance exceeding that of real data by 2%–7% on seven real-world datasets. |
A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition (2023.findings-acl)
Copied to clipboard
Limao Xiong, Jie Zhou, Qunxi Zhu, Xiao Wang, Yuanbin Wu, Qi Zhang, Tao Gui, Xuanjing Huang, Jin Ma, Ying Shan
| Challenge: | Existing models for named entity recognition (NER) are based on large-scale labeled datasets, which always obtain using crowdsourcing. |
| Approach: | They propose a CONfidence-based partial Label Learning method to integrate prior and posterior confidences for crowd-annotated named entity recognition models. |
| Outcome: | The proposed model improves on real-world and synthetic datasets compared with baselines. |
Xiaomingbot: A Multilingual Robot News Reporter (2020.acl-demos)
Copied to clipboard
Runxin Xu, Jun Cao, Mingxuan Wang, Jiaze Chen, Hao Zhou, Ying Zeng, Yuping Wang, Li Chen, Xiang Yin, Xijin Zhang, Songcheng Jiang, Yuxuan Wang, Lei Li
| Challenge: | Xiaomingbot is a multilingual and multimodal software robot with four capabilities: news generation, news translation, news reading and avatar animation. |
| Approach: | They propose to build a multilingual and multimodal software robot with four inte- gal capabilities: news generation, news translation, news reading and avatar animation. |
| Outcome: | The proposed system generates Chinese news, then reads it in multiple languages and generates an animated avatar reading it. |
Towards Robust Few-Shot Relation Classification: Incorporating Relation Description with Agreement (2025.findings-emnlp)
Copied to clipboard
Mengting Hu, Jianfeng Wu, Ming Jiang, Yalan Xie, Zhunheng Wang, Rui Ying, Xiaoyi Liu, Ruixuan Xu, Hang Gao, Renhong Cheng
| Challenge: | Existing approaches to recognize relational relationships with a few support samples are limited for unlimited queries. |
| Approach: | They propose a simple but effective framework that uses relation descriptions as external knowledge to enhance the model’s comprehension of the relation semantics. |
| Outcome: | The proposed framework outperforms strong baselines while being robust against various NOTA rates. |
JointCoder: Exploring Automated ICD Coding on Real-World Chinese EHRs with a Multi-Agent Framework (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing automated ICD coding systems face several fundamental challenges due to the limited availability of publicly available Chinese ICD datasets. |
| Approach: | They propose to use a Chinese ICD coding dataset and a multi-agent framework to reformulate ICD as a joint disease-procedure coding task. |
| Outcome: | The proposed system outperforms state-of-the-art methods on real-world Chinese ICD coding datasets and 1.7B-parameter models. |
An Efficient Framework for Whole-Page Reranking via Single-Modal Supervision (2026.acl-industry)
Copied to clipboard
Zishuai Zhang, Sihao Yu, null Xiewenyi, Ying Nie, Junfeng Wang, Zhiming Zheng, Dawei Yin, Hainan Zhang
| Challenge: | Existing whole-page reranking methods require large-scale expert annotations to achieve high-quality results. |
| Approach: | They propose a whole-page reranking framework that converts single-modal rankers into page-level guidance by constructing budget-aware candidates for cross-modal annotations and distilling intra-modality preferences to align relevance scales across modalities. |
| Outcome: | The proposed framework reduces annotation costs by 70-90% while outperforming fully-annotated reranking baselines. |
LiGen: Active Lipid Generation via a Molecular Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Lipid nanoparticles (LNPs) can deliver cargos to tumor and immune cells . traditional approaches rely on experimental screening and expert judgment . |
| Approach: | They propose a method to generate lipid molecules efficiently and actively using deep learning. |
| Outcome: | The proposed method outperforms baseline methods on multiple cell lines and achieves a 30% improvement over the current methods. |
Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension (2022.acl-long)
Copied to clipboard
Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Li, Nora Bradford, Branda Sun, Tran Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, Mark Warschauer
| Challenge: | Existing QA datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements. |
| Approach: | They propose to use FairytaleQA to generate 10,580 questions based on 278 children-friendly stories to assess model's fine-grained learning skills. |
| Outcome: | The proposed dataset consists of 10,580 questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations. |
StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children’s Story-Based Learning (2024.emnlp-main)
Copied to clipboard
Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong, Ying Xu, Yunyao Li, Qianwen Wang, Dakuo Wang, Yuling Sun
| Challenge: | Existing story reading systems fail to capture the nuances of how education experts think when conducting interactive story reading activities. |
| Approach: | They propose to use existing question-answering (QA) datasets to capture experts' annotations and thinking process to construct a story-based annotation framework. |
| Outcome: | The proposed framework captures experts’ annotations and thinking process and can be used to generate 5, 868 expert-annotated QA pairs with real-world knowledge. |
Refine, Align, and Aggregate: Multi-view Linguistic Features Enhancement for Aspect Sentiment Triplet Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Aspect Sentiment Triplet Extraction (ASTE) aims to extract the triplets of aspect terms, their associated sentiment and opinion terms. |
| Approach: | They propose to use multi-view linguistic features enhancement to explore the prior indication effect in the “Refine, Align, and Aggregate” learning process to enhance aspect-opinion relations. |
| Outcome: | The proposed model achieves state-of-the-art on several benchmark datasets and is robust to state- of-the art constraints. |
Measuring Large Language Models’ Adversarial Behavior in Social Deduction Games (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing safety evaluations focus on refusal-based methods that test whether models avoid responding to inappropriate or violent requests, leaving open questions about how models behave in interactive social settings. |
| Approach: | They propose to use a meta-LLM to construct a closed behavioral taxonomy from a multi-agent simulation to examine adversarial behavior of large language models. |
| Outcome: | The proposed model-based model-driven model-model-based taxonomy shows that the model-led model-learning model exhibits distinct behavioral profiles and influences social stability and competitive success. |
Benchmarking and Learning Real-World Customer Service Dialogue (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks and training pipelines for industrial intelligent customer service (ICS) focus on task completion and tool correctness. |
| Approach: | They propose a benchmark-to-optimization loop that bridges offline gains to deployment . they propose OlaMind, which distills reusable reasoning patterns from expert dialogues . |
| Outcome: | The proposed benchmark surpasses GPT-5.2 and Gemini 3 Pro on OlaBench . it delivers an average +23.67% issue resolution and -6.6% human transfer rate versus baseline . |
FineSteer: A Unified Framework for Fine-Grained Inference-Time Steering in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for inference-time steering fail to be effective, utility-preserving and training-efficient due to rigid, one-size-fits-all designs and limited adaptability. |
| Approach: | They propose a steering framework that decomposes inference-time steering into two stages . they propose 'conditional steering' mechanism that preserves model utility by avoiding unnecessary steering . a 'mixture-of-Steering-Experts' mechanism captures multimodal nature of desired steering behaviors . |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on safety and truthfulness benchmarks. |
Language Scaling for Universal Suggested Replies Model (2021.naacl-industry)
Copied to clipboard
Qianlan Ying, Payal Bajaj, Budhaditya Deb, Yu Yang, Wei Wang, Bojia Lin, Milad Shokouhi, Xia Song, Yang Yang, Daxin Jiang
| Challenge: | We consider scaling automated suggested replies (SR) to multiple languages for a commercial email application. |
| Approach: | They propose a multi-lingual multi-task continual learning framework with auxiliary tasks and language adapters to train universal language representation across regions. |
| Outcome: | The proposed model reduces catastrophic forgetting and improves cross-lingual transfer across languages while reducing training costs. |
Unified Grid Tagging Scheme for Aspect Sentiment Quad Prediction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing table-filling methods decompose the ASQP task into subtasks without considering the association between sentiment elements. |
| Approach: | They propose a simple yet effective Unified Grid Tagging Scheme to extract sentiment quadruplets in one shot . they leverage syntactic dependency tree and AMR graph to enrich association between sentiment elements . |
| Outcome: | The proposed model extracts all sentiment elements in quads for a given review to explain the reason for the sentiment. |
Mitigating the Language Mismatch and Repetition Issues in LLM-based Machine Translation via Model Editing (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on using Large Language Models to improve translation quality . language mismatch and repetition are two of the main problems with LLMs . |
| Approach: | They propose to leverage model editing methods to reduce language mismatch and repetition . they propose to fetch intersections of locating results under different language settings . |
| Outcome: | The proposed methods reduce language mismatch and repetition ratios and enhance translation quality in most cases. |
Time-RA: Towards Time Series Reasoning for Anomaly Diagnosis with LLM Feedback (2026.findings-acl)
Copied to clipboard
Yiyuan Yang, Zichuan Liu, Lei Song, Kai Ying, Stephen Wang, Joshua Thomas Bamford, Svitlana Vyetrenko, Jiang Bian, Qingsong Wen
| Challenge: | Time series anomaly detection (TSAD) has traditionally focused on binary classification and lacks the fine-grained categorization and explanatory reasoning required for transparent decision-making. |
| Approach: | They propose a time-series reasoning task that reformulates TSAD from discriminative to reasoning-intensive paradigm. |
| Outcome: | The proposed task reformulates TSAD from discriminative to reasoning-intensive paradigm. |
Neural Response Generation with Meta-words (P19-1)
Copied to clipboard
| Challenge: | Experimental results show that meta-words can be used to generate open domain dialogues . human-machine conversation is a fundamental problem in NLP . |
| Approach: | They propose a goal-tracking memory network that formalizes meta-word expression as a target in response generation and manages the generation process with a state memory panel and a controller. |
| Outcome: | The proposed model outperforms state-of-the-art generation models in response relevance, response diversity, and accuracy. |
Simple but Effective Compound Geometric Operations for Temporal Knowledge Graph Completion (2024.acl-long)
Copied to clipboard
Rui Ying, Mengting Hu, Jianfeng Wu, Yalan Xie, Xiaoyi Liu, Zhunheng Wang, Ming Jiang, Hang Gao, Linlin Zhang, Renhong Cheng
| Challenge: | Current methods embed factual knowledge into continuous vector space and apply geometric operations to learn potential patterns in temporal knowledge graphs. |
| Approach: | They propose a temporal knowledge graph completion method that uses two geometric operations to learn missing facts in temporal graphs. |
| Outcome: | The proposed method significantly outperforms existing temporal knowledge graph embedding models. |
C-ICL: Contrastive In-context Learning for Information Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for in-context learning with large language models focus on using correct or negative examples, ignoring the potential value of incorrect or negative samples. |
| Approach: | They propose a few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. |
| Outcome: | The proposed technique outperforms previous few-shot in-context learning methods on a broad spectrum of related tasks. |
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing pre-trained language models are not explicitly aware of domain-specific knowledge, which is essential for downstream tasks in many domains, such as tasks in e-commerce scenarios. |
| Approach: | They propose a knowledge-injected pre-trained language model that can be transferred to both natural language understanding and generation tasks. |
| Outcome: | The proposed model significantly outperforms baselines across the board in e-commerce scenarios. |
Knowledge Graph Embedding by Adaptive Limit Scoring Loss Using Dynamic Weighting Strategy (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding models use a loss framework to distinguish between correct and incorrect triplets. |
| Approach: | They propose a loss framework that reweights each triplet to highlight the less-optimized triplets. |
| Outcome: | The proposed method performs on several knowledge graph embedding models, including TransE, TransH and ComplEx. |
FinGEAR: Financial Mapping-Guided Enhanced Answer Retrieval (2025.findings-emnlp)
Copied to clipboard
| Challenge: | FinGEAR provides a retrieval framework tailored to financial documents . standard retrieval-augmented generation models underuse financial disclosures . |
| Approach: | FinGEAR combines a finance lexicon for Item-level guidance and hierarchical indices for within-Item search. |
| Outcome: | FinGEAR improves accuracy and accuracy on 10-Ks with a FinQA dataset. |
ToolPRM: Fine-Grained Inference Scaling of Structured Outputs for Function Calling (2026.acl-long)
Copied to clipboard
Jianghao Lin, Yuanyuan Shi, Xin Peng, Renjie Ding, Hairui Wang, Yuxuan Peng, Bizhe Bai, Weixi Song, Fengshuo Bai, Huacan Chai, Weinan Zhang, Fei Huang, Ying Wen
| Challenge: | Existing research on inference scaling focuses on unstructured output generation tasks, such as mathematical problems. |
| Approach: | They propose an inference-scaling framework that combines fine-grained beam search with ToolPRM, a process reward model scoring each intra-call decision. |
| Outcome: | The proposed framework outperforms outcome and coarse-grained reward models in predictive accuracy and yields consistent test-time gains on multiple function-calling benchmarks. |
DuReader-Retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets for non-English passage retrieval are lacking in quality and accuracy. |
| Approach: | They present a large-scale Chinese dataset for passage retrieval . they reduce false negatives by manually annotating results pooled from multiple retrievers . |
| Outcome: | The proposed dataset reduces false negatives in development and testing sets and removes similar training queries. |
TRUST: Towards Robust Social Bot Detection via Uncertainty-Guided Pseudo-Labeling and Graph Structure Purification (2026.findings-acl)
Copied to clipboard
Ruixuan Xu, Mengting Hu, Zhunheng Wang, Ming Jiang, Rui Ying, Zhen Zhang, Hang Gao, Shuaipeng Liu, Renhong Cheng
| Challenge: | Existing graph-based detection models are vulnerable to deceptive message propagation, where bots deliberately interact with legitimate users. |
| Approach: | They propose a framework to mitigate deceptive message propagation by node-level uncertainty estimation and graph structure purification. |
| Outcome: | The proposed framework improves on three benchmark datasets and six GNN backbones on real-world social bots. |
RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System (2021.naacl-demos)
Copied to clipboard
Haoyang Wen, Ying Lin, Tuan Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan Windisch Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji
| Challenge: | We present a new information extraction system that can construct temporal event graphs from news documents. |
| Approach: | They propose a temporal event graph extraction system that can extract news documents . they extend the system from sentence-level event extraction to cross-document cross-media event extraction . |
| Outcome: | The proposed system can extract temporal event graphs from news documents in multiple languages and multiple data modalities. |
Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key? (2024.acl-long)
Copied to clipboard
| Challenge: | Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLM. |
| Approach: | They propose a group discussion framework to enrich the set of discussion mechanisms. |
| Outcome: | The proposed framework performs better on a wide range of reasoning tasks and backbone LLMs. |
Active Learning for Abstractive Text Summarization via LLM-Determined Curriculum and Certainty Gain Maximization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Abstractive text summarization (ATS) requires laborious data annotation and time-consuming model training. |
| Approach: | They propose a novel active learning framework that asks large language models to rate difficulty of instances and then uses certainty gain maximization to select instances with a distribution that aligns well with the overall distribution. |
| Outcome: | The proposed framework improves stability, effectiveness, and efficiency of abstractive text summarization backbones. |
Too Good to be Bad: On the Failure of LLMs to Role-Play Villains (2026.findings-acl)
Copied to clipboard
Zihao Yi, Qingxuan Jiang, Ruotian Ma, Xingyu Chen, Qu Yang, Mengru Wang, Fanghua Ye, Ying Shen, Zhaopeng Tu, Xiaolong Li, Liefeng Bo
| Challenge: | Large Language Models (LLMs) are increasingly tasked with creative generation, but their ability to portray non-prosocial, antagonistic personas remains largely unexamined. |
| Approach: | They propose a moral alignment benchmark to test the safety of large language models . they find that models struggle with traits directly antithetical to safety principles . |
| Outcome: | The proposed model fails to accurately portray morally ambiguous or villainous characters . the model fails most with traits directly antithetical to safety principles . |
Answer-driven Deep Question Generation based on Reinforcement Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for deep question generation focus on enhancing document representations, but little attention is paid to the answer information. |
| Approach: | They propose a deep question generation model that makes better use of the target answer as a guidance to facilitate question generation. |
| Outcome: | The proposed model outperforms state-of-the-art models in automatic and human evaluations on the hotpotQA dataset. |
Quite Good, but Not Enough: Nationality Bias in Large Language Models - a Case Study of ChatGPT (2024.lrec-main)
Copied to clipboard
| Challenge: | Nationality is a key demographic element that enhances the performance of large language models, but it has received less scrutiny regarding inherent biases. |
| Approach: | They investigated nationality bias in ChatGPT, a large language model for text generation. |
| Outcome: | The proposed model generates 4,680 discourses about nationality in Chinese and English, with 195 countries, 4 temperature settings, and 3 prompt types. |
LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines (2026.findings-acl)
Copied to clipboard
| Challenge: | Pretrained language models (PLMs) provide strong semantic representations but are costly and opaque. |
| Approach: | They propose a framework that transfers pretrained language models into symbolic form and integrates them into symbolic models. |
| Outcome: | The proposed framework improves interpretability and accuracy across multiple text classification tasks while remaining fully symbolic and efficient. |
Data-Centric Explainable Debiasing for Improving Fairness in Pre-trained Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing data-centric debiasing strategies mainly leverage explicit bias words for counterfactual data augmentation to balance the training data. |
| Approach: | They propose a method which uses an explainability method to search for implicit bias words to assist in debiasing PLMs. |
| Outcome: | Extensive results show that the proposed method achieves state-of-the-art debiasing performance and strong generalization while maintaining predictive abilities. |
Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classification (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent work on aspect-level sentiment classification has shown that syntactic information is effective in capturing long-range syntaktic relations that are obscure from the surface form. |
| Approach: | They propose a graph ensemble technique that integrates syntactic structures with GNNs to better leverage syntaktic information in the face of parsing errors. |
| Outcome: | The proposed model outperforms models with single dependency tree and beats other models without adding model parameters. |
Preconditioned Test-Time Adaptation for Out-of-Distribution Debiasing in Narrative Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Debiased large language models excel at handling known or low-bias prompts, but fail on unfamiliar and high-biased prompts. |
| Approach: | They propose a debiasing framework that detects high-bias prompts and triggers context-aware LoRA updates only when a bias-risk score exceeds a threshold. |
| Outcome: | The proposed framework reduces toxicity/bias score with significantly lower latency than standard optimization methods. |
Is the Attention Matrix Really the Key to Self-Attention in Multivariate Long-Term Time Series Forecasting? (2026.acl-long)
Copied to clipboard
| Challenge: | In multivariate long-term time series forecasting, it is widely believed that the effectiveness of self-attention arises from its attention matrix. |
| Approach: | They propose a multi-branch MLP that isolates the ‘multi-brain mapping with element-wise operation’ structure from the Transformer and shows that it achieves competitive performance. |
| Outcome: | The proposed model outperforms three classic and three latest Transformer models and shows that it achieves competitive performance. |
ChipSeek: Optimizing Verilog Generation via EDA-Integrated Reinforcement Learning (2026.acl-long)
Copied to clipboard
Zhirong Chen, Kaiyan Chang, Zhuolin Li, Cangyuan Li, Xinyang He, Chujie Chen, Mengdi Wang, Haobo Xu, Yinhe Han, Huawei Li, Ying Wang
| Challenge: | Existing approaches to optimize Register-Transfer Level (RTL) code fail to simultaneously optimize functional correctness and hardware efficiency metrics such as Power, Performance, and Area (PPA). |
| Approach: | They propose a hierarchical reward based reinforcement learning framework that integrates direct feedback from EDA simulators and synthesis tools into a reward mechanism. |
| Outcome: | The proposed framework integrates direct feedback from EDA simulators and synthesis tools into a hierarchical reward based reinforcement learning framework. |
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation (2021.naacl-demos)
Copied to clipboard
Qingyun Wang, Manling Li, Xuan Wang, Nikolaus Parulian, Guangxing Han, Jiawei Ma, Jingxuan Tu, Ying Lin, Ranran Haoran Zhang, Weili Liu, Aabhas Chauhan, Yingjun Guan, Bangzheng Li, Ruisong Li, Xiangchen Song, Yi Fung, Heng Ji, Jiawei Han, Shih-Fu Chang, James Pustejovsky, Jasmine Rah, David Liem, Ahmed ELsayed, Martha Palmer, Clare Voss, Cynthia Schneider, Boyan Onyshkevych
| Challenge: | a new framework to digest relevant biomedical knowledge is needed to combat COVID-19 . quantity of research results is a bottleneck, and false information promoted in publications . |
| Approach: | a team of researchers has developed a framework to extract multimedia knowledge elements from scientific literature to combat COVID-19. |
| Outcome: | a new framework extracts fine-grained multimedia knowledge elements from scientific literature . it provides detailed contextual sentences, subfigures, and knowledge subgraphs as evidence . the framework is based on a case study of drug repurposing . |
RAIDEN Benchmark: Evaluating Role-playing Conversational Agents with Measurement-Driven Custom Dialogues (2025.coling-main)
Copied to clipboard
| Challenge: | Existing benchmarks for RPCA evaluation are lacking for dialogues . authors introduce specialized judging LLM for automatic RPca evaluation . compelling role-playing agent is expected to lead to more in-depth conversations . |
| Approach: | They propose a benchmark to assess the effectiveness of RPCA interactions using dialogues . they introduce a specialized judging LLM tailored for automatic RPca evaluation . |
| Outcome: | The proposed benchmark focuses on assessing particular dimensions at different stages of a conversation, facilitated through interactions conducted by annotators. |
RIPRAG: Hack a Black-box Retrieval-Augmented Generation Question-Answering System with Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to generate RAG documents require knowledge of the target RAG system’s internal composition and implementation details, whereas black-box methods are unable to utilize interactive information. |
| Approach: | They propose a RIPRAG attack framework that treats the target RAG system as a black box and leverages a Reinforcement Learning from Black-box Feedback (RLBF) method to optimize the generation model for poisoned documents. |
| Outcome: | The proposed method achieves an attack success rate (ASR) improvement of up to 0.72 compared to baseline methods. |
Punctuation-Steered Representation Fine-Tuning (2026.acl-short)
Copied to clipboard
| Challenge: | Existing methods for parameter-efficient fine-tuning (PeFT) are limited due to their prohibitive size and computational demands. |
| Approach: | They propose a method that fine-tunes punctuation representations to achieve performance improvements. |
| Outcome: | The proposed method improves performance by altering the representation space alone . but it results in suboptimal performance due to the effects of the method on the output . |
Model-Based Imaginative Planning for Embodied Agents (2026.acl-long)
Copied to clipboard
Junru Song, Hengzhe Jin, Yucong Huang, Tingsong Jiang, Weien Zhou, Feifei Wang, Yang Yang, Ying Wen, Wen Yao
| Challenge: | a lightweight world model converts raw pixels into object-centric symbolic states amenable to language-based reasoning . IMPLEMENT is a framework for grounding language agents in visual embodied environments . |
| Approach: | They propose a model-based reasoning framework that enables frozen large language models to perform imaginative planning. |
| Outcome: | The proposed framework can be used to ground language agents in visual embodied environments. |
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Using advanced Large Language Models, instructors can improve training of smaller models by analyzing their own model's errors. |
| Approach: | They propose a framework that leverages advanced Large Language Models to enhance training of smaller target models. |
| Outcome: | The proposed framework outperforms ChatGPT on multiple benchmarks and shows that it improves on both in-domain and out-of-domain benchmarks. |
From Prediction to Intervention: Personalized Meal-Level Glucose Regulation via an LLM Agent (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to individualized glucose regulation are generic and do not account for individual-specific glucose dynamics. |
| Approach: | They propose a physio-feedback agentic loop that integrates individualized absorption modeling with dietary intervention to regulate glucose response. |
| Outcome: | The proposed system improves prediction accuracy and reduces glucose excursions. |
WebUncertainty: Dual-Level Uncertainty Driven Planning and Reasoning For Autonomous Web Agent (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing web agents struggle with complex tasks due to rigid planning strategies and hallucination-prone reasoning. |
| Approach: | They propose a task-uncertainty-driven Adaptive Planning Mechanism that adaptively selects planning modes to navigate unknown environments. |
| Outcome: | The proposed framework performs better on the WebArena and WebVoyager benchmarks than existing frameworks. |
WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Knowledge-Based Visual Question Answering rely on images as the retrieval key, and often overlook or misplace the role of Vision-Language Models (VLMs) |
| Approach: | They propose a multi-modal RAG framework that assigns VLMs two specialized agents: a Refiner and an Inspector. |
| Outcome: | Experiments on EVQA, InfoSeek, and M2KR show that the proposed framework achieves state-of-the-art performance with significant improvements in both retrieval accuracy and answer quality. |
The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting relies on the initial decisions, causing errors in early steps to accumulate and impact the final answers. |
| Approach: | They propose a divide-and-conquer style algorithm that leverages large language models to raise and answer sub-questions until collecting enough information to tackle the original one. |
| Outcome: | The proposed algorithm is more robust to errors and errors than CoT prompting and Tree-of-Thought prompting methods. |
Summarize before Aggregate: A Global-to-local Heterogeneous Graph Inference Network for Conversational Emotion Recognition (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies focus on modeling emotion influences with utterance-level features, with little attention paid on phrase-level semantic connection between utterrances. |
| Approach: | They propose a two-stage Summarization and Aggregation Graph Inference Network which integrates inference for topic-related emotional phrases and local dependency reasoning over neighbouring utterances in a global-to-local fashion. |
| Outcome: | The proposed model outperforms the state-of-the-art models on three CER benchmark datasets. |
Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots (2025.findings-naacl)
Copied to clipboard
| Challenge: | Multi-modal Large Language Models have shown remarkable progress in visual contexts, yet their ability to convert visual figures into executable code remains underexplored. |
| Approach: | They propose to use a set of visual coding metrics to assess MLLMs' visual . pass rate, text-match ratio, and GPT-4V rating judgement to assess the quality of generated code and rendered images. |
| Outcome: | The proposed benchmark includes 132 high-quality matplotlib plots across six plot types, as well as 150 and 86 plots from Python’s and R’s plotly libraries respectively, totaling 368 plots. |
A Unified Generative Framework for Bilingual Euphemism Detection and Identification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing euphemism datasets are only domain-specific or language-specific. |
| Approach: | They propose a unified model to jointly conduct bilingual euphemism detection and identification tasks. |
| Outcome: | The proposed model is effective and provides a new reference standard for euphemism detection and identification. |
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code (2022.emnlp-demos)
Copied to clipboard
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina Mcmillan-major, Anna Shvets, Ashish Upadhyay, Bernd Bohnet, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh Dhole, Khyathi Raghavi Chandu, Laura Perez Beltrachini, Leonardo F . R. Ribeiro, Lewis Tunstall, Li Zhang, Mahim Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Štajner, Sebastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin Adewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou
| Challenge: | Evaluations in machine learning rarely use the latest metrics, datasets, or human evaluation in favor of remaining compatible with prior work. |
| Approach: | They propose to use the Generation, Evaluation, and Metrics Benchmark to integrate new evaluation methods into existing evaluations. |
| Outcome: | The proposed evaluation infrastructure bridges the gap between the advantages of leaderboards and in-depth and evolving evaluations by allowing model developers to benefit from each other's work. |
Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains (2026.acl-long)
Copied to clipboard
Zhonghang Yuan, Zhefan Wang, Fang Hu, Zihong Chen, Jinzhe Li, Gang Li, Jie Ying, Huanjun Kong, Songyang Zhang, Nanqing Dong
| Challenge: | Recent large language models (LLMs) have demonstrated remarkable progress in reasoning, but their applications on knowledge-intensive domains have not been explored due to the scarcity of high-quality verifiable data. |
| Approach: | They propose a framework that extends reinforcement learning with verifiable rewards (RLVR) to knowledge-intensive domains through automated verififiability data synthesis while enabling verification of the LLM's reasoning process. |
| Outcome: | Extensive experiments show that the proposed framework enhances the reasoning of large language models in knowledge-intensive domains without significantly compromising the model’s general capabilities. |
LLaMA Pro: Progressive LLaMA with Block Expansion (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies have demonstrated that pre-trained LLMs are limited in certain domains, such as programming, mathematics, biomedical, or finance. |
| Approach: | They propose a new post-pretraining method with an expansion of Transformer blocks to tune the expanded blocks using only new corpus, efficiently and effectively improving the model’s knowledge while mitigating forgetting. |
| Outcome: | The proposed model outperforms existing models in programming and math and its instruction-following counterpart LLaMA Pro-8.3B in general tasks, programming, and mathematics. |
Prompt Tuning Pushes Farther, Contrastive Learning Pulls Closer: A Two-Stage Approach to Mitigate Social Biases (2023.acl-long)
Copied to clipboard
| Challenge: | Existing debiasing techniques use Counterfactual Data Augmentation (CDA) to balance the training corpus, but this technique slightly modifies the original corpus limiting the representation distance between different demographic groups. |
| Approach: | They propose a two-stage debiasing model using Contrastive learning with Continuous Prompt Augmentation to mitigate social biases in PLMs’ encoding. |
| Outcome: | The proposed model outperforms baselines in terms of debiasing performance while maintaining the language modeling capability of PLMs. |
Empowering Tabular Data Preparation with Language Models: Why and How? (2026.acl-long)
Copied to clipboard
Mengshi Chen, Yuxiang Sun, Tengchao Li, Jianwei Wang, Kai Wang, Xuemin Lin, Ying Zhang, Wenjie Zhang
| Challenge: | Tabular data preparation is a critical step in enhancing the usability of tabular data. |
| Approach: | They analyze how LMs can be combined with other components for different tabular data preparation tasks. |
| Outcome: | The proposed methods lack the ability to capture the relationships within tables and adapt to the tasks involved. |
TRAC: Token-level Reward Assignment for Coherent Abstractive Summarization (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have achieved remarkable success in text summarization, but maintaining logical coherence and contextual consistency remains a pervasive challenge in long-form generation. |
| Approach: | They propose a framework that introduces a token-level reward function by integrating relative sentence gain, inter-sentence attention, and a Gaussian length penalty. |
| Outcome: | The proposed model outperforms the sequence-level baseline by 11.05% in fluency and 10.61% in Relevance. |
IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation (2026.acl-long)
Copied to clipboard
Bosi Wen, Yilin Niu, Cunxiang Wang, Pei Ke, Xiaoying Ling, Ying Zhang, Aohan Zeng, Hongning Wang, Minlie Huang
| Challenge: | Existing evaluation models for instruction-following have many shortcomings, such as substantial costs and unreliable assessments. |
| Approach: | They propose an LLM critic for fine-grained instruction-following evaluation using a checklist generator and a constraint-level preference optimization method. |
| Outcome: | The proposed model beats strong LLM-as-a-Judge baselines in evaluations under lower computational overhead compared to baselines. |
InternalInspector I2: Robust Confidence Estimation in LLMs through Internal States (2024.findings-emnlp)
Copied to clipboard
Mohammad Beigi, Ying Shen, Runing Yang, Zihao Lin, Qifan Wang, Ankith Mohan, Jianfeng He, Ming Jin, Chang-Tien Lu, Lifu Huang
| Challenge: | Large Language Models (LLMs) often struggle with generating reliable outputs, often producing high-confidence inaccuracies known as hallucinations. |
| Approach: | They propose a framework that leverages contrastive learning on internal states including attention states, feed-forward states, and activation states of all layers to enhance confidence estimation in LLMs. |
| Outcome: | The framework outperforms existing methods in the hallucination detection benchmark HaluEval and the previous methods at the same time. |
IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for instruction-following lack data coverage and oversimplified pairwise evaluation paradigms that misalign with model optimization scenarios. |
| Approach: | They propose a meta-evaluation benchmark for instruction-following that covers diverse instruction and constraint types and a preference graph for each instruction. |
| Outcome: | Extensive experiments on IF-RewardBench show that the proposed benchmark achieves a stronger positive correlation with downstream task performance compared to existing benchmarks. |
ROGRAG: A Robustly Optimized GraphRAG Framework (2025.acl-demo)
Copied to clipboard
| Challenge: | Existing pipelines for large language models struggle with specialized or emerging topics which are rarely seen in the training corpus. |
| Approach: | They propose a multi-stage retrieval mechanism that integrates dual-level with logic form retrieval methods to improve retrieval robustness without increasing computational cost. |
| Outcome: | The proposed framework outperforms Qwen2.5-7B-Instruct and outperformed mainstream methods on seedbench and significantly improves the performance of each component. |
MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to commonsense reasoning include fine-tuning large pre-trained language models or injecting the entire knowledge base for CKGC. |
| Approach: | They propose to learn commonsense knowledge representation by using a multi-alternative contrastive learning framework on COmmonsense Knowledge graphs. |
| Outcome: | Extensive experiments show that the proposed framework is effective in commonsense reasoning tasks. |
LLM-FK: Multi-Agent LLM Reasoning for Foreign Key Detection in Large-Scale Complex Databases (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting missing foreign keys are limited in capturing semantic dependencies across schemas. |
| Approach: | They propose a framework that integrates four agents to detect missing foreign keys . they propose combinatorial search space explosion, ambiguous inference and global inconsistency . |
| Outcome: | The proposed framework achieves F1-scores above 93% on large-scale MusicBrainz database . it reduces candidate search space by two to three orders of magnitude without losing true FKs . |
Enabling Agents to Communicate Entirely in Latent Space (2026.acl-long)
Copied to clipboard
Zhuoyun Du, Runze Wang, Huiyu Bai, Zouying Cao, Xiaoyong Zhu, Yu Cheng, Bo Zheng, Wei Chen, Haochao Ying
| Challenge: | Natural language is the de facto communication medium for LLM-based agents, but it presents a fundamental constraint . natural language downsampling limits the depth and nuance of information that can be transmitted . et al.: inter-agent latent space communication is a promising paradigm for solving complex tasks . |
| Approach: | They propose a paradigm that leverages the last hidden states of an LLM as a representation of its thought for direct communication. |
| Outcome: | The proposed paradigm outperforms fine-tuned chain-of-thought prompting and single-agent baselines even across heterogeneous models. |
Learning Hierarchy-Aware Quaternion Knowledge Graph Embeddings with Representing Relations as 3D Rotations (2022.coling-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding models fail to model semantic hierarchies . Existing methods fail to understand the semantic hierarchies of knowledge graphs . |
| Approach: | They propose a model which embeds entities as pure quaternions and constrains the modulus of entities to make them have hierarchical distributions. |
| Outcome: | The proposed model can encode symmetry/antisymmetry, inversion, composition, multiple relation patterns and learn semantic hierarchies simultaneously. |
RoBGuard: Enhancing LLMs to Assess Risk of Bias in Clinical Trial Documents (2025.coling-main)
Copied to clipboard
Changkai Ji, Bowen Zhao, Zhuoyao Wang, Yingwen Wang, Yuejie Zhang, Ying Cheng, Rui Feng, Xiaobo Zhang
| Challenge: | Existing approaches to assess the risk of bias in RCTs focus on manually crafted prompts and a restricted set of simple questions, limiting their accuracy and generalizability. |
| Approach: | They propose a framework for enhancing Large Language Models to assess the risk of bias in RCTs by reformulation, document parsing and multi-expert collaboration. |
| Outcome: | The proposed framework outperforms existing methods on the RoB-Item and RoB domains. |
Multimodal Instruction Tuning with Conditional Mixture of LoRA (2024.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have demonstrated proficiency in diverse tasks across different domains. |
| Approach: | They propose a method that integrates multimodal instruction tuning with Conditional Mixture-of-LoRA. |
| Outcome: | Experimental results show that MixLoRA outperforms LoRA with the same or higher ranks . MLLMs have demonstrated remarkable proficiency in diverse tasks across domains . |
Express What You See: Can Multimodal LLMs Decode Visual Ciphers with Intuitive Semiosis Comprehension? (2025.findings-acl)
Copied to clipboard
| Challenge: | Traditional VQA benchmarks encounter a modality gap and over-reliance on language priors, whereas human cognition excels at intuitive semiosis, associating abstract visual symbols to linguistic semantics. |
| Approach: | They propose a task of generating abstract linguistics from emoji sequence images, where such reasoning underpins critical applications in cryptography. |
| Outcome: | The proposed model can generate abstract linguistics from emoji sequence images, challenging MLLMs’ reasoning of decoding complex semantics of visual ciphers. |
Think and Recall: Layer-Level Prompting for Lifelong Model Editing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for lifelong model editing suffer from limitations in usability, such as requiring additional training corpora or lacking support for reversible and detachable edits. |
| Approach: | They propose a plug-and-play method for knowledge retrieval and storage, i.e., Layer-Level Prompting, which enables seamless and efficient lifelong model editing. |
| Outcome: | The proposed method outperforms existing methods on question answering and hallucination benchmarks across different LLMs. |
Keep it Consistent: Topic-Aware Storytelling from an Image Stream via Iterative Multi-agent Communication (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for visual storytelling construct text description independently for each image and roughly concatenate them as a story, which leads to the problem of generating semantically incoherent content. |
| Approach: | They propose a topic description task to detect the global semantic context of an image stream and a story is then constructed with the guidance of the topic description. |
| Outcome: | The proposed framework can generate stories with higher quality compared to state-of-the-art methods on a VIST dataset. |
AnchorAlign: A Novel Anchor Alignment-enhanced Generative Method for Joint Named Entity Recognition and Relation Extraction (2026.findings-acl)
Copied to clipboard
| Challenge: | Named Entity Recognition and Relation Extraction are interdependent tasks in information extraction. |
| Approach: | They propose a generative method enhanced by anchor alignment to bridge NER and RE tasks . they use anchor entities as semantic pivots to align the two tasks based on their semantic representations . |
| Outcome: | The proposed method outperforms state-of-the-art models on five benchmark datasets. |
Benchmarking and Improving Compositional Generalization of Multi-aspect Controllable Text Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing MCTG methods face a noticeable performance drop in compositional testing. |
| Approach: | They propose a benchmark to evaluate compositional generalization of MCTG methods by combining multi-aspect labeled datasets and a crafted three-dimensional evaluation protocol. |
| Outcome: | The proposed framework improves compositional generalization performance by 3.64% and 94.4% in compositional testing. |
From Competition to Synergy: Unlocking Reinforcement Learning for Subject-Driven Image Generation (2026.acl-long)
Copied to clipboard
| Challenge: | a naive application of GRPO leads to conflicting gradient signals and a misalignment with the temporal dynamics of the diffusion process. |
| Approach: | They propose a framework that uses synergy-aware reward shaping to penalize conflicted reward signals and amplify synergies to provide a sharper and decisive gradient. |
| Outcome: | The proposed framework outperforms naive GRPO and Time-Aware Dynamic Weighting (TDW) on DreamBench, and achieves a state-of-the-art balance between ID preservation and prompt adherence. |
MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) generate plausible but factually incorrect outputs, posing serious risks to patient safety and clinical decision-making. |
| Approach: | They propose a benchmark for medical hallucination detection using 10,000 question-answer pairs derived from PubMedQA. |
| Outcome: | The proposed model achieves an F1 score as low as 0.625 for detecting 'hard' category hallucinations. |
A + B: A General Generator-Reader Framework for Optimizing LLMs to Unleash Synergy Potential (2024.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is an effective solution to supplement necessary knowledge to large language models. |
| Approach: | They propose a "generate-then-read" pipeline to replace retrieval stage with generation from the LLM itself. |
| Outcome: | The proposed framework outperforms single models in the base and chat versions and addresses safety and helpfulness post-adaptation challenges. |
Beyond A Single AI Cluster: A Survey of Decentralized LLM Training (2025.emnlp-main)
Copied to clipboard
| Challenge: | Decentralized LLM training leverages dispersed resources at varying scales. |
| Approach: | They propose a resource-driven paradigm that leverages dispersed resources across clusters, datacenters and even regions. |
| Outcome: | The proposed model scales are 175 billion to 660 billion parameters, and the exponential growth in computational requirements poses significant challenges. |
Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning (2024.findings-acl)
Copied to clipboard
Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen, Di Jin, Yu Cheng, Qifan Wang, Lifu Huang
| Challenge: | Recent vision-language models (VLMs) have shown impressive capabilities as general visual assistants, but there are two challenges to their performance: (1) lacking task diversity in pretraining and visual instruction tuning; (2) annotation error and bias in GPT-4 synthesized instruction tuning data. |
| Approach: | They propose a two-stage instruction tuning framework that fine tunes VLMs firstly and further tuned on GPT-4 synthesized data. |
| Outcome: | The proposed framework outperforms the traditional single-stage visual instruction tuning framework and achieves state-of-the-art performance across a wide range of multi-modal evaluation benchmarks. |
PENS: A Dataset and Generic Framework for Personalized News Headline Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Using a dataset of Microsoft News, we propose a generic framework to personalize a text generator and establish personalized headlines. |
| Approach: | They propose a generic framework to personalize a news headline generator and establish personalized headlines by leveraging user behavioral data. |
| Outcome: | The proposed framework is based on user preference data and user preference injections to personalize a text generator and establish personalized headlines. |
CrystalICL: Enabling In-Context Learning for Crystal Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for crystal generation are limited to zero-shot scenarios and are unable to benefit from few-shot situations. |
| Approach: | They propose a model designed for few-shot crystal generation that exploits in-context learning by capturing structure-property relationships from limited data. |
| Outcome: | The proposed model reduces complexity of modeling crystal symmetry in LLMs and exploits ICL by capturing structure-property relationships from limited data. |
DuQM: A Chinese Dataset of Linguistically Perturbed Natural Questions for Evaluating the Robustness of Question Matching Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | a comprehensive evaluation of QM models should be conducted on natural texts, not on artificial adversarial examples . ral models are often not robust to adversarials, which means they predict unexpected outputs . |
| Approach: | They use a Chinese dataset to evaluate the robustness of QM models . they show that the effect of artificial adversarial examples does not work on natural texts . |
| Outcome: | The proposed model is more robust than other models on natural questions with 32 linguistic perturbations. |
Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation (2026.acl-long)
Copied to clipboard
Jiaju Chen, Yuxuan Lu, Xiaojie Wang, Huimin Zeng, Jing Huang, Jiri Gesi, Ying Xu, Bingsheng Yao, Dakuo Wang
| Challenge: | Existing "LLM-as-a-judge" evaluation frameworks are limited by persona descriptions and are not generalizable to other tasks. |
| Approach: | They propose a framework that can automatically construct multiple evaluator personas with distinct dimensions from relevant text documents and instantiate LLM agents with the persona. |
| Outcome: | The proposed framework can believably simulate human evaluators . it extracts stakeholders' diverse perspectives from the provided research papers and constructs personas for the agents . |
Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to reduce cognitive errors in MRI interpretations do not work for generating less likely outputs. |
| Approach: | They propose a task that asks a model to generate outputs that humans think are relevant but less likely to happen. |
| Outcome: | The proposed method compares with several state-of-the-art controlled text generation models via automatic and human evaluations and shows that it reduces cognitive errors in interpreting MRI findings. |
PASUM: A Pre-training Architecture for Social Media User Modeling Based on Text Graph (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have incorporated different digital traces to better learn the representations of social media users, limited by overloaded text information and hard-to-collect social network information. |
| Approach: | They propose a Pre-training Architecture for Social Media User Modeling based on Text Graph and combine microblogs to represent social media users based upon the text graph model. |
| Outcome: | The proposed framework can represent users based on text even without social network information on microblogs. |
SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Science (2025.acl-long)
Copied to clipboard
Jie Ying, Zihong Chen, Zhefan Wang, Wanli Jiang, Chenyang Wang, Zhonghang Yuan, Haoyang Su, Huanjun Kong, Fan Yang, Nanqing Dong
| Challenge: | Seed science is essential for modern agriculture, but its application in seed science remains limited due to a shortage of experts and limited availability of online resources. |
| Approach: | They evaluate 26 leading large language models and compare them against a set of benchmarks . they find that there is a gap between the power of LLMs and real-world seed science problems . |
| Outcome: | The new seed benchmark highlights the gap between the power of large language models and real-world seed science problems. |
SR-RAG: Verifiable Multi-Hop Reasoning via On-the-fly Symbolic Graph Construction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing paradigms for multi-hop reasoning suffer from high construction costs and limited adaptability to dynamic knowledge. |
| Approach: | They propose a symbolic reasoning framework for multi-hop question answering that integrates the advantages of both paradigms by dynamically generating sub-questions, performing information retrieval and symbolic encoding based on an on-the-fly graph and using a symbol verifier to validate intermediate reasoning steps. |
| Outcome: | The proposed framework significantly improves accuracy and robustness on multiple multi-hop benchmarks and a medical dataset. |
Sycophancy Mitigation Through Reinforcement Learning with Uncertainty-Aware Adaptive Reasoning Trajectories (2025.emnlp-main)
Copied to clipboard
Mohammad Beigi, Ying Shen, Parshin Shojaee, Qifan Wang, Zichao Wang, Chandan K. Reddy, Ming Jin, Lifu Huang
| Challenge: | Existing studies show that large language models inadvertently foster sycophancy . scophancies are a tendency of models to blindly conform to user preferences without critical reasoning or self-reflection. |
| Approach: | They propose a method to reduce sycophancy by combining uncertainty-aware Monte Carlo tree search and progress-based reinforcement learning. |
| Outcome: | The proposed model outperforms baseline models in effectively reducing sycophancy while maintaining performance on out-of-distribution inputs. |
Agent-based Substructure Counting under Local Differential Privacy (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies have demonstrated the ability of Large Language Models (LLMs) to process graph problems. |
| Approach: | They propose to decompose substructure counting into node-level tasks distributed among node agents and embed the knowledge of distributed algorithms and DP frameworks in the curator agent and privacy controller. |
| Outcome: | Extensive experiments on 6 real-world datasets validate the effectiveness of the proposed framework for substructure counting tasks under edge local differential privacy (LDP). |
APGN: Adversarial and Parameter Generation Networks for Multi-Source Cross-Domain Dependency Parsing (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for dependency parsing use labeled training data for several fixed domains, but performance drops when labeles only exist for several out-domains. |
| Approach: | They propose a model for multi-source cross-domain dependency parsing that uses a parameter generation network and adversarial network for learning domain-invariant representations. |
| Outcome: | The proposed model improves cross-domain parsing performance by about 2 points over strong BERT-enhanced baselines over a recently released dataset for multi-domain dependency parse. |
Cross-Utterance Conditioned VAE for Non-Autoregressive Text-to-Speech (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model improves naturalness and prosody diversity with clear margins. |
| Approach: | They propose a cross-utterance conditional VAE to estimate posterior probability distribution of latent prosody features for each phoneme by conditioning on acoustic features, speaker information, and text features from past and future sentences. |
| Outcome: | The proposed model improves naturalness and prosody diversity with clear margins. |
P3LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing autoregressive left-to-right (L2R) models are limited to unidirectional information and constrained on strong local dependencies. |
| Approach: | They propose a probabilistically permuted prophet language model which strengthens the modeling of bidirectional information and long token dependencies for sequence generation. |
| Outcome: | Experiments on GLGE dataset show that P3LM improves on natural language generation tasks. |
Retrieval-Augmented Process Reward Model for Generalizable Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have advanced mathematical reasoning, but they still struggle with out-of-distribution (OOD) issues. |
| Approach: | They propose a framework to evaluate the logical validity of reasoning steps . they retrieves semantically similar questions and steps for PRM as a warmup . |
| Outcome: | The proposed framework outperforms baseline models on multiple real-world datasets. |
GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent reinforcement learning approaches have advanced reasoning in Large Language Models (LLMs), yet their adaptation to multimodal LLMs remains underexplored. |
| Approach: | They propose a reinforcement learning framework that eliminates KL penalties and rewards consistency . they propose GRPO-CARE, which outperforms standard GR PO, with a base reward for accuracy and an adaptive bonus for consistency. |
| Outcome: | The proposed framework outperforms standard GRPO on the most difficult evaluation level and reasoning consistency test benchmarks. |
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation (2026.findings-acl)
Copied to clipboard
Dongliang Chen, Xinlin Zhuang, Junjie Xu, Luojian Xie, Zehui Wang, Jiaxi Zhuang, Haolin Yang, Liang Dou, Xiao He, Xingjiao Wu, Ying Qian
| Challenge: | APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need. |
| Approach: | They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities . |
| Outcome: | The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy. |
CompTab: A Comprehensive Benchmark for Real-World TableQA with Complex Reasoning and Irregular Tables (2026.acl-long)
Copied to clipboard
Zhen Yang, Wei Du, Jie Wang, Wenze Zhou, Xiangfeng Meng, Zhengyang Wang, Suping Sun, Ziwei Du, Haodong Zou, Jie Chen, Yongbin Liu, Shicheng Tan, Jiahao Ying, Shu Zhao
| Challenge: | Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions. |
| Outcome: | The proposed framework improves generalization and realism of large language models under complex and irregular table conditions. |
GuideLLM: Exploring LLM-Guided Conversation with Applications in Autobiography Interviewing (2025.naacl-long)
Copied to clipboard
Jinhao Duan, Xinyu Zhao, Zhuoxuan Zhang, Eunhye Grace Ko, Lily Boddy, Chenan Wang, Tianhao Li, Alexander Rasgon, Junyuan Hong, Min Kyung Lee, Chenxi Yuan, Qi Long, Ying Ding, Tianlong Chen, Kaidi Xu
| Challenge: | Large Language Models (LLMs) have demonstrated their effectiveness in human-guided dialogues, but tasks in the real world are more complex and require greater autonomy from LLMs. |
| Approach: | They propose to characterize LLM-guided conversation into three fundamental components: Goal Navigation, Context Management, Empathetic Engagement and implement an interviewing environment for the evaluation of LLMs. |
| Outcome: | The proposed LLM outperforms baseline LLMs in interviewing quality and autobiography generation quality. |
More is Better: Enhancing Open-Domain Dialogue Generation via Multi-Source Heterogeneous Knowledge (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge-enhanced methods use a single-source homogeneous knowledge base with limited knowledge coverage. |
| Approach: | They propose a multi-source heterogeneous knowledge-enhanced dialogue generation model that leverages multiple knowledge sources to improve knowledge coverage. |
| Outcome: | The proposed model outperforms existing knowledge-enhanced models on a Chinese dataset and shows that it can leverage multiple heterogeneous knowledge sources to improve knowledge coverage. |
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models (2025.naacl-long)
Copied to clipboard
Ying Nie, Binwei Yan, Tianyu Guo, Hao Liu, Haoyu Wang, Wei He, Binfan Zheng, Weihao Wang, Qiang Li, Weijian Sun, Yunhe Wang, Dacheng Tao
| Challenge: | Large language models (LLMs) have achieved remarkable performance on various NLP tasks, yet their potential in more challenging task like finance, has not been fully explored. |
| Approach: | They propose a benchmark to assess the financial knowledge of large language models (LLMs) in China. |
| Outcome: | The proposed benchmark is the most comprehensive evaluation benchmark to date for LLMs in finance. |
QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for processing large textual content face insufficient adaptation to task-specific needs and missing multi-segmentation relationships. |
| Approach: | They propose a question then reflection memory mechanism which integrates a dual-structured memory pool and a structured graph guidance to facilitate a reflective trial-and-error approach for navigating and identifying relevant segments. |
| Outcome: | The proposed model achieves superior performance on multiple-choice questions and multi-doc QA. |
Exploring the Hidden Reasoning Process of Large Language Models by Misleading Them (2025.findings-emnlp)
Copied to clipboard
Guanyu Chen, Peiyang Wang, Yizhou Jiang, Yuqian Liu, Chujie Zhao, Ying Fang, Tianren Zhang, Feng Chen
| Challenge: | Existing large language models can perform abstract reasoning tasks but are they actually engaging in rule-based reasoning beyond mere memorization? |
| Approach: | They propose a method to examine whether large language models perform abstract reasoning . they fine-tune the model to learn those contradictory rules and assess its generalization ability . |
| Outcome: | The proposed approach examines whether large language models perform abstract reasoning by altering their original understanding of fundamental rules. |
PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning (2025.acl-long)
Copied to clipboard
Zhicong Lu, Changyuan Tian, PeiguangLi PeiguangLi, Li Jin, Sirui Wang, Wei Jia, Ying Shen, Guangluan Xu
| Challenge: | Existing studies on Large Language Models (LLMs) have failed to evaluate their performance in event reasoning with a single event relational type or reasoning format. |
| Approach: | They propose a benchmark to evaluate LLMs' event reasoning capability using a single event relational type or reasoning format. |
| Outcome: | The proposed model improves on 10K diverse instruction-tuning demonstrations to alleviate event reasoning-oriented data scarcity. |
EvoWiki: Evaluating LLMs on Evolving Knowledge (2025.acl-long)
Copied to clipboard
Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao
| Challenge: | Existing knowledge evolution benchmarks are static and fail to capture the evolving nature of LLMs and knowledge. |
| Approach: | They propose an evolving dataset that categorizes information into stable, evolved, and uncharted states. |
| Outcome: | The proposed dataset is auto-updatable and enables evaluation of continuously changing knowledge and newly released LLMs. |
A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition on social media are not efficient for semi-supervised MNER because of the mismatch between the posted text and image. |
| Approach: | They propose a novel method to fuse the text and image features for multimodal named entity recognition under semi-supervised setting by exploiting modal-specific VAEs. |
| Outcome: | The proposed method outperforms baselines under supervised setting and improves performance with less labeled data than existing semi-supervised methods. |
Asymmetric Relational-Geometry Driven Universal Adversarial Perturbations for Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing universal adversarial perturbation (UAP) methods suffer from limited cross-model transferability in black-box scenarios. |
| Approach: | They propose an optimization-based framework that learns universal perturbations under an asymmetric relational-geometry driven objective. |
| Outcome: | The proposed framework outperforms state-of-the-art models in black-box transfer settings. |
DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing adversarial training methods require multi-step gradient ascents or word substitutions to obtain adversarials, which impairs the effectiveness of adversariarial training. |
| Approach: | They propose a procedure for instead adversarial training with only clean data that estimates the adversarials loss by perturbing the input data’s probability distribution rather than their embeddings. |
| Outcome: | The proposed procedure reduces time consumption by up to 70% compared to current best-performing adversarial training methods. |
Latent-Condensed Transformer for Efficient Long Context Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches address these bottlenecks separately: Multi-head Latent Attention (MLA) reduces the KV cache by projecting tokens into a low-dimensional latent space, while sparse attention reduces computation. |
| Approach: | They propose a Latent-Condensed Attention mechanism that performs structured context condensation directly within MLA's latent space. |
| Outcome: | The proposed approach reduces KV cache size and attention cost without adding parameters. |
Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios (2026.findings-acl)
Copied to clipboard
Xiaomin Li, Tala Wang, Zichen Zhong, Ying Zhang, Zirui Zheng, Takashi Isobe, Dezhuang Li, Huchuan Lu, You He, Xu Jia
| Challenge: | Existing benchmarks focus on evaluating MLLMs’ pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning. |
| Approach: | They propose a benchmark designed for visual clue-driven reasoning in daily scenarios that combines rigorous grounding in authentic daily activities and challenging query design that necessitates more than surface-level perception. |
| Outcome: | The proposed benchmark identifies visual clues and their ability to provide robust reasoning in daily scenarios. |
PIArena: A Platform for Prompt Injection Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | OWASP identifies prompt injection as the top-1 security risk for large language models (LLMs). |
| Approach: | They propose a unified platform for prompt injection evaluation that integrates state-of-the-art attacks and defenses into a platform. |
| Outcome: | The proposed attack exploits state-of-the-art defenses and generalizes them on diverse datasets and attacks. |
ECoK: Emotional Commonsense Knowledge Graph for Mining Emotional Gold (2024.findings-acl)
Copied to clipboard
Zhunheng Wang, Xiaoyi Liu, Mengting Hu, Rui Ying, Ming Jiang, Jianfeng Wu, Yalan Xie, Hang Gao, Renhong Cheng
| Challenge: | Existing knowledge graphs focus on the representation and reasoning of general factual knowledge, while there are significant deficiencies in the understanding and reasoning for emotional knowledge. |
| Approach: | They propose a commonsense knowledge graph that can be used to represent emotional knowledge by combining theories from psychology, cognitive science, and linguistics. |
| Outcome: | The proposed model surpasses GPT-4-Turbo in the emotion-related tasks. |