Papers by Qi Zheng

108 papers
Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for code retrieval struggle to balance scalability and annotation quality.
Approach: They propose a method that integrates functions called within the repository and information on third-party APIs to enhance the annotation context.
Outcome: The proposed method improves the annotation context by incorporating functions called within the repository and information on third-party API functionalities.
Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods to defend against adversarial word-substitution attacks have not been evaluated or compared in a systematic manner.
Approach: They propose to compare different defense methods under representative adversarial attacks . they propose a method that improves the robustness of neural text classifiers against such attacks a .
Outcome: The proposed method improves robustness of neural text classifiers against such attacks by a significant margin.
VLA-Mark: A cross modal watermark for large vision-language alignment models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing text watermarking methods disrupt visual-textual alignment, leaving semantic-critical concepts vulnerable.
Approach: They propose a vision-aligned framework that embeds detectable watermarks into outputs . they combine localized patch affinity, global semantic coherence, contextual attention patterns .
Outcome: The proposed framework shows lower PPL and higher BLEU than conventional methods with near-perfect detection (98.8% AUC).
Rethinking LLM Uncertainty: A Multi-Agent Approach to Estimating Black-Box Model Uncertainty (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to gauge model’s uncertainty through self-consistency in responses to the target query are misleading: an LLM may confidently provide an incorrect answer to a target query, yet give a confident and accurate answer to that same query when answering a knowledge-preserving perturbation of the query.
Approach: They propose a method that uses multi-agent interaction to estimate black-box LLMs' uncertainty.
Outcome: The proposed method outperforms existing self-consistency based methods and improves hallucination detection.
LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin (2024.acl-long)

Copied to clipboard

Challenge: Experimental results show that, as the instruction data increases, LoRAMoE can significantly improve the ability to process downstream tasks, while maintaining the world knowledge stored in the LLM.
Approach: They propose a framework that introduces several low-rank adapters and integrates them by using a router network to freeze the backbone model and force a portion of LoRAs to focus on leveraging world knowledge to solve downstream tasks.
Outcome: The proposed framework freezes the backbone model and forces a portion of LoRAs to focus on leveraging world knowledge to solve downstream tasks, to alleviate world knowledge forgetting.
Decorrelate Irrelevant, Purify Relevant: Overcome Textual Spurious Correlations from a Feature Perspective (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to debiase samples with biased features obstructs the model in learning from non-biased parts of the samples.
Approach: They propose to eliminate spurious correlations in a fine-grained manner from a feature space perspective by using Random Fourier Features and weighted re-sampling to decorrelate dependencies between features.
Outcome: The proposed method eliminates spurious correlations in a fine-grained manner from a feature space perspective.
Enhancing Model Privacy in Federated Learning with Random Masking and Quantization (2025.findings-emnlp)

Copied to clipboard

Challenge: federated learning approaches are limited by the complexity of large language models and the need for specialized expertise to protect intellectual property.
Approach: They propose a federated learning approach that leverages random masking to obscure a subnetwork of model parameters and applies quantization to the remaining parameters.
Outcome: The proposed approach maintains strong model performance in federated learning settings and achieves enhanced protection of model parameters compared to baseline methods.
Balancing Classification and Calibration Performance in Decision-Making LLMs via Calibration Aware Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly deployed in decision-making tasks where accuracy and reliable confidence estimates are essential.
Approach: They propose a calibration-aware reinforcement learning formulation that directly adjusts decision-token probabilities.
Outcome: The proposed model preserves RLVR’s accuracy level while mitigating overconfidence, reducing ECE scores up to 9 points.
Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking (2026.eacl-long)

Copied to clipboard

Challenge: Existing evaluations for visual hallucinations are narrow.
Approach: They propose a framework that decomposes reasoning chains into perception versus reasoning steps and uses off-the-shelf VLM judges for step-level faithfulness.
Outcome: The proposed framework reduces Unfaithful Perception Rate while preserving final-answer accuracy.
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Current methods rely on ranking losses to teach reward model to assess preferences, but they are susceptible to noise and ambiguous data, often failing to deeply understand human intentions.
Approach: They propose a method that incorporates contrastive learning into the reward modeling process to enhance generalization and stabilize the reinforcement learning training process.
Outcome: The proposed method enhances generalization of the reward model, stabilizes the reinforcement learning training process, and improves the final alignment with human preferences.
Governance in Motion: Co-evolution of Constitutions and AI models for Scalable Safety (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences lack flexibility . static alignment preferences lack the ability to correct misaligned behaviors as they emerge .
Approach: They propose a framework that enables dynamic and continuous alignment of large language models with human preferences.
Outcome: The proposed framework improves safety and accuracy of a 7B model with human annotations.
Granular Entity Mapper: Advancing Fine-grained Multimodal Named Entity Recognition and Grounding (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for fine-grained content extraction are limited by long-tailed distribution of textual entity categories and performance of object detectors.
Approach: They propose a multi-granularity entity recognition module and a reranking module to integrate hierarchical information of entity categories, visual cues, and external textual resources collectively.
Outcome: The proposed framework achieves state-of-the-art on the fine-grained content extraction task.
How Helpful is Inverse Reinforcement Learning for Table-to-Text Generation? (2021.acl-short)

Copied to clipboard

Challenge: Existing approaches to Table-to-Text generation suffer from issues such as missing information, repetition and repetition.
Approach: They propose to use Inverse Reinforcement Learning (IRL) to solve the Table-to-Text task . they use multiple interpretable unsupervised reward components that are combined linearly to form a composite reward function.
Outcome: The proposed task outperforms strong RL baselines marginally in the Table-to-Text task.
Logical DA: Enhancing Data Augmentation for Logical Reasoning via a Multi-Agent System (2025.findings-acl)

Copied to clipboard

Challenge: Existing data augmentation paradigms isolate data synthesis from label validation, thereby reducing their utility for complex reasoning tasks.
Approach: They propose a framework for enhancing reasoning-focused data augmentation in few-shot learning scenarios that integrates four agents through two synergistic phases: diverse data generation and label verification.
Outcome: The proposed framework achieves the highest average improvement in task accuracy in both fine-tuning and in-context learning paradigms.
DARM: Distribution-Aware Reward Modeling by Alleviating Biases from Low Preference-Context Dependency Data (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for training reward models are vulnerable to context neglect and degraded accuracy.
Approach: They propose distribution-aware reward modeling that augments the RM objective with a conditional mutual information regularizer that maximizes context and the predicted reward conditioned on the response.
Outcome: The proposed model improves performance in RLHF and improves accuracy in other settings.
LongTutor: Benchmarking Large Language Models for Long-term Personalized Tutoring (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluations focus on isolated, short-term interactions, overlooking the inherently long-term nature of learning.
Approach: They propose a benchmark for long-term personalized tutoring based on an annotated learning log . they propose an automated generator–verifier pipeline to enable benchmark expansion .
Outcome: The proposed benchmarks evaluate LLMs across three progressive tasks: evidence acquisition, knowledge state diagnosis, and adaptive teaching action.
Adaptive Preference Optimization with Uncertainty-aware Utility Anchor (2025.findings-emnlp)

Copied to clipboard

Challenge: Offline preference optimization methods are efficient for large language models (LLMs) alignment.
Approach: They propose an offline preference optimization framework that estimates uncertainties from preference data . the method enables training even in scenarios where the data is unpaired .
Outcome: The proposed method enables training even in scenarios where the data is unpaired .
TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities (2024.emnlp-main)

Copied to clipboard

Challenge: Current datasets cater to user-led systems and are limited to predefined specific scenarios and slots.
Approach: They propose to use a Chinese dialogue dataset to train a model that authentically simulates human-computer dialogues in 30 popular life service scenarios.
Outcome: The proposed model achieves a joint accuracy of 75.09% in out-of-domain evaluations . it also achieves notable abilities in slot filling and questioning .
PQR: Improving Dense Retrieval via Potential Query Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing training data is sparse, with each document associated with one or a few labeled queries.
Approach: They propose a training-free potential query retrieval framework to address this problem . they use a Gaussian mixture distribution to model all potential queries for a document .
Outcome: The proposed method is able to capture comprehensive semantic information from a document with multiple queries.
PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Parallel Coordinated Reasoning (PaCoRe) overcomes a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window.
Approach: They propose a training-and-inference framework to overcome a central limitation of language models: their inability to scale test-time compute (TTC) under a fixed context window.
Outcome: The proposed model scales to multi-million-token effective TTC without exceeding context limits.
Orthogonal Subspace Learning for Language Model Continual Learning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for continual learning in language models suffer catastrophic forgetting when learning sequential tasks.
Approach: They propose an orthogonal low-rank adaptation approach for continual learning in language models that uses orthogons to learn sequentially.
Outcome: The proposed approach outperforms state-of-the-art methods on continual learning benchmarks and preserves generalization ability of LLMs on unseen tasks.
Flooding-X: Improving BERT’s Resistance to Adversarial Attacks via Loss-Restricted Fine-Tuning (2022.acl-long)

Copied to clipboard

Challenge: Existing approaches to generating adversarial perturbations scale up the cost of training computational complexity by the number of gradient steps it takes to obtain the adversarials.
Approach: They propose a flood method which aims at better generalization and a criterion to bring hyper-parameter-dependent flooding into effect with a narrowed-down search space by measuring how the gradient steps taken within one epoch affect the loss of each batch.
Outcome: The proposed method improves BERT’s resistance to textual adversarial attacks by a large margin and achieves state-of-the-art robust accuracy on various text classification and GLUE tasks.
Capturing the Content of a Document through Complex Event Identification (2022.starsem-1)

Copied to clipboard

Challenge: Recent work grouped granular events into more general events, called complex events . however, this approach assumes that a given complex event is always described in consecutive sentences .
Approach: They propose a context-augmented representation learning approach that uses contextual information to model pairwise relation between granular events.
Outcome: The proposed approach outperforms baselines on the complex event identification task.
Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing prompting methods have been used to enhance multistep reasoning capabilities of large language models, but they have overlooked the potential of formulating higher-quality problems.
Approach: They propose a method that starts from the problem side and refines problems to be more comprehensible and solvable for models.
Outcome: The proposed method achieves notable and consistent effectiveness on five reasoning benchmarks across different models.
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents.
Approach: They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Outcome: The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Multi-Programming Language Sandbox for LLMs (2025.acl-demo)

Copied to clipboard

Challenge: MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs).
Approach: They propose a multi-programming language sandbox that provides unified feedback from compilers and analysis tools for Large Language Models.
Outcome: The proposed multi-language sandbox can provide comprehensive feedback from compilers and analysis tools for large language models (LLMs).
TALON: A Multi-Agent Framework for Long-Table Exploration and Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to query-relevant content retrieval fail to retrieve contextually relevant data.
Approach: They propose a multi-agent framework for table question answering over long tables . TALON features a planning agent that iteratively invokes a tool agent to access tabular data .
Outcome: The proposed framework achieves average accuracy improvements of 7.5% and 12.0% across all language models.
ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on large language model-based agents focus on evaluation benchmarks without training support.
Approach: They propose a large-scale Chinese shopping simulation environment that uses large language models to train agents.
Outcome: The proposed model performs poorly in a large-scale and challenging shopping environment in China.
HyperLoRA: Efficient Cross-task Generalization via Constrained Low-Rank Adapters Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to adapt pre-trained language models (PLMs) to emerging tasks are costly and inefficient.
Approach: They propose a meta-network that generates task-specific weights without any optimization.
Outcome: The proposed approach has flexible generalization ability and superior performance over hypenetworks.
Uncertainty Aware Learning for Language Model Alignment (2024.acl-long)

Copied to clipboard

Challenge: Existing alignment strategies that focus on diverse and high-quality data often overlook the intrinsic uncertainty of tasks, learning all data samples equally.
Approach: They propose to introduce the sample uncertainty into the alignment of different task scenarios by a simple fashion by setting the label smoothing value of training according to the uncertainty of individual samples.
Outcome: The proposed model outperforms standard supervised fine-tuning on high-entropy tasks and complex low-entropic tasks.
Building Multi-domain Dialog State Trackers from Single-domain Dialogs (2023.emnlp-main)

Copied to clipboard

Challenge: Existing multi-domain dialog state tracking models require significant manual effort to define domain relations and collect data.
Approach: They propose a divide-and-conquer (DAC) DST paradigm and a multi-domain dialog synthesis framework to build multi- domain DST models from single-domain dialogues.
Outcome: The proposed paradigm makes building multi-domain DST models easier on unseen domain combinations.
Enhancing Contrastive Learning with Noise-Guided Attack: Towards Continual Relation Extraction in the Wild (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for continual relation extraction (CRE) excel in preserving old knowledge but falter when confronted with contaminated data streams.
Approach: They propose a noise-resistant contrastive framework for continual relation extraction (CRE) that preserves old knowledge while learning incremental corrupted relations.
Outcome: The proposed framework outperforms state-of-the-art methods on various benchmarks with increasing noise rates.
Intelligent Document Parsing: Towards End-to-end Document Parsing via Decoupled Content Parsing and Layout Grounding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods fragment document parsing into pipeline of separated subtasks, resulting in incomplete semantics and error propagation.
Approach: They propose an end-to-end document parsing framework that leverages vision-language priors of MLLMs.
Outcome: The proposed method surpasses existing methods significantly in document parsing . it leverages the vision-language priors of MLLMs to decouple parse and layout grounding based on visual information.
Searching for Best Practices in Retrieval-Augmented Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, especially in specialized domains.
Approach: They propose several strategies for deploying RAG that balance performance and efficiency.
Outcome: The proposed approaches can significantly enhance question-answering capabilities and accelerate the generation of multimodal content using a “retrieval as generation” strategy.
Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generation (2024.acl-srw)

Copied to clipboard

Challenge: Customizing LLMs for a specific task involves separating high-quality responses from lower-quality ones. Obtaining a large volume of expert-annotated data is costly for most tasks.
Approach: They propose a method that trains the model to prioritize the best responses from a pool of candidates created for a task using ranking metrics.
Outcome: The proposed method is more robust, less sensitive to noise, and can be achieved with limited human annotations or through heuristic methods.
Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models (2026.acl-long)

Copied to clipboard

Challenge: Recent studies observe a phenomenon where reward models achieve high accuracy on static datasets but fail to generalize effectively during RLHF.
Approach: They propose a method that combines rationale consistency with outcome accuracy to improve performance on RM-Bench and JudgeBench.
Outcome: The proposed method surpasses baselines on RM-Bench and JudgeBench by an average of 5% and improves creative writing tasks by 7%.
Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph (2026.acl-long)

Copied to clipboard

Challenge: Tabular data is used in fields such as finance and healthcare due to its heterogeneity and complexity.
Approach: They propose a Logic-Graph-Enhanced LLM Reasoning framework that integrates the strengths of tree-based models and LLMs to improve their interpretability.
Outcome: The proposed framework outperforms tree-based models and state-of-the-art LLMs on tabular prediction tasks, achieving superior accuracy and interpretability.
Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System (2025.acl-long)

Copied to clipboard

Challenge: Recent AI methods have shown promise in tasks such as hypothesis generation and experimental design, but they fail to replicate the collaborative nature of real-world scientific practices.
Approach: They propose a virtual scientific system that mimics the collaborative nature of scientific research by organizing a team of agents to generate, evaluate, and refine research ideas.
Outcome: The proposed system outperforms the state-of-the-art method in producing new scientific ideas and offers valuable insights to guide future research.
Open Domain Question Answering with Conflicting Contexts (2025.findings-naacl)

Copied to clipboard

Challenge: Open domain question answering systems often rely on information retrieved from large collections of text to answer questions.
Approach: They evaluate and benchmark three powerful Large Language Models with a dataset . they find that 25% of unambiguous open domain questions can lead to conflicting contexts .
Outcome: The proposed model can't be used to answer questions with conflicting contexts . it can be fine tuned to provide richer information into the model's training .
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition (2025.coling-main)

Copied to clipboard

Challenge: Current Large Language Models struggle with complex entity taxonomies in open domains and lack NER capabilities.
Approach: They propose a dataset to guide LLMs' generalization in Open NER under a universal entity taxonomy.
Outcome: The proposed model outperforms GPT-4 in 3 out-of-domain benchmarks across 15 datasets and 6 languages.
Improving Consistency for Text Summarization with Energy Functions (2023.findings-emnlp)

Copied to clipboard

Challenge: Current abstractive summarization models generate inconsistent content due to the inherently noisy dataset and the discrepancy between maximum likelihood estimation based training objectives and consistency measurements.
Approach: They propose a new consistency taxonomy that categorizes inconsistent content into faithfulness, factuality, and self-supportiveness.
Outcome: Experiments on XSUM and CNN/DM datasets show that EnergySum mitigates the trade-off between accuracy and consistency.
Reinforcement Learning on Pre-Training Data (2026.acl-long)

Copied to clipboard

Challenge: Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings.
Approach: They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data.
Outcome: Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base.
Evaluating LLMs’ Assessment of Mixed-Context Hallucination Through the Lens of Summarization (2025.findings-acl)

Copied to clipboard

Challenge: Large language models generate coherent text and follow instructions across diverse tasks, but a critical challenge in scaling LLM applications is hallucination, where the generated content lacks factual grounding or deviates from the intended discourse context.
Approach: They use summarization as a representative task to evaluate LLMs' capability in detecting mixed-context hallucinations, specifically distinguishing between factual and non-factual hallucinos.
Outcome: The proposed model distinguishes between factual and non-factual hallucinations, and their performance bottlenecks.
Adversarial Knowledge Stimulated Contrastive Prompting for Few-shot Language Learners (2023.findings-acl)

Copied to clipboard

Challenge: Prompt-based fine-tuning has boosted performance of Pre-trained language models on few-shot Natural Language Understanding (NLU) tasks by employing task-specific prompts.
Approach: They propose a Cloze-driven prompt framework for prompt tuning that implicitly stimulates knowledge from pre-trained language models.
Outcome: The proposed framework outperforms state-of-the-art for prompt-based fine-tuning on few-shot NLU tasks.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
Knowledge Poisoning Attacks on Medical Multi-Modal Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing studies have investigated knowledge poisoning attacks in medical RAG systems . knowledge poison attacks can disrupt model outputs and undermine system reliability .
Approach: They propose a knowledge poisoning framework that injects misinformation into textual data . they propose to use paired visual data as a query-agnostic trigger to promote retrieval .
Outcome: The proposed framework produces clinically plausible but incorrect generations on five LLMs and datasets.
Modeling the Q-Diversity in a Min-max Play Game for Robust Optimization (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for minimizing the worst-case loss of annotated groups are lacking in practice due to expensive annotations and privacy issues.
Approach: They propose a distributionally robust optimization framework that relaxes group identification into direct parameterization by using an interactive training mode.
Outcome: The proposed method outperforms state-of-the-art methods on synthetic and real-world text classification tasks.
CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset (2020.tacl-1)

Copied to clipboard

Challenge: Despite the significant contributions to the community, there is still a gap between existing dialogue corpora and real-life human dialogue data.
Approach: They propose to develop Chinese cross-domain wizard-of-oz task-oriented dataset CrossWOZ with rich annotations of dialogue states and dialogue acts on both user and system sides.
Outcome: The proposed dataset contains 6K dialogue sessions and 102K utterances for 5 domains, including hotel, restaurant, attraction, metro, and taxi.
PlugAT: A Plug and Play Module to Defend against Textual Adversarial Attack (2022.coling-1)

Copied to clipboard

Challenge: Recent studies have shown that adversarial examples can be easily fooled by adversarially perturbed examples.
Approach: They propose a pluggable defense module PlugAT to provide robust predictions by adding a few trainable parameters to the model inputs while keeping the original model frozen.
Outcome: The proposed model improves robustness over several strong baselines whilst training only 9.1% parameters.
Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signals (2024.lrec-main)

Copied to clipboard

Challenge: Existing models that extract discrete inputs into fixed-length representations are vulnerable to adversarial attacks that place perturbations on clean inputs to fool DNNs.
Approach: They propose to inspect the subspaces of sample features through spectral analysis to better understand adversarial attacks.
Outcome: The proposed strategy enables the model to inherently suppress adversaries, which boosts model robustness and motivates new directions of effective adversarial defense.
Detecting Adversarial Samples through Sharpness of Loss Landscape (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that adversarial samples are more vulnerable than normal ones to textual adversarials.
Approach: They propose a simple and effective sharpness-based detector that can distinguish adversarial samples by maximizing the loss increment within the region where the inference sample is located.
Outcome: The proposed method outperforms previous detection methods by large margins on three text classification tasks.
All Information is Valuable: Question Matching over Full Information Transmission Network (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods for question matching only transmit one kind of information while failing to utilize both kinds of information simultaneously.
Approach: They propose a question matching network that can transmit both representation and interactive information together in a simultaneous fashion.
Outcome: The proposed approach outperforms strong baseline models on two standard benchmarks.
AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing multi-objective preference alignment methods for large language models face limitations such as auxiliary reward/reference models and computational complexity.
Approach: They propose a framework that achieves dynamic balance across preference dimensions by using dimension-aware generation metrics as implicit rewards.
Outcome: Empirical results show that AMoPO outperforms state-of-the-art methods by 28.5% .
Connectivity Patterns are Task Embeddings (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for predicting inter-task transferability are sparse and task-specific.
Approach: They propose a method that uses connectivity patterns of neurons as a unique identifier associated with a task.
Outcome: The proposed method outperforms baselines in predicting inter-task transferability across data regimes and transfer settings while keeping high efficiency in computation and storage.
Reward Modeling Requires Automatic Adjustment Based on Data Quality (2024.findings-emnlp)

Copied to clipboard

Challenge: Reinforcement Learning from Human Feedback (RLHF) is a method for aligning language models with human values.
Approach: They propose a method that automatically adjusts reward modeling based on data quality . they use preference data to train a reward model that is more aligned with human values .
Outcome: The proposed method stabilizes reward model training and significantly improves alignment performance on human preference datasets.
MEAV: Model Editing with Alignment Vectors for inference time LLM alignment in single and multidomain preference spectrum (2026.findings-acl)

Copied to clipboard

Challenge: Existing training-time alignment methods require full retraining when a change is needed.
Approach: They propose an inference-time model-editing-based alignment method that learns encoded representations of preference dimensions and allows dynamic adjusting of the model behavior.
Outcome: The proposed method can be used to align large language models to human preferences . it reduces the cost of inference by half compared to the prompt engineering approach .
Characterizing the Impacts of Instances on Robustness (2023.findings-acl)

Copied to clipboard

Challenge: Existing defense approaches focus on developing new model structures or training algorithms, but they do little to tap the potential of training instances.
Approach: They propose a method that can distinguish between robust and non-robust instances according to the model’s sensitivity to perturbations on individual instances during training.
Outcome: The proposed method can distinguish between robust and non-robust instances according to the model’s sensitivity to perturbations on individual instances during training.
Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees (2026.acl-long)

Copied to clipboard

Challenge: Existing training data detectors fail to detect clean samples from contaminated test sets . existing methods fail to identify clean samples due to black-box nature of LLMs .
Approach: They propose a framework that detects and filters contaminated evaluation data . they propose 'failure detection' to reduce the proportion of contaminated samples mistakenly retained .
Outcome: The proposed framework reduces false discovery rate (FDR) under valid FDR control while maintaining evaluation consistency.
ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing tools for building TOD systems often lack a user-friendly interface . a toolkit with advanced, easily integrable modules is needed to bridge this gap .
Approach: They propose a multifaceted dialogue system toolkit that integrates diverse datasets and models with a streamlined training process and in-depth evaluation tools.
Outcome: The proposed toolkit combines RL and transfer learning to support the rapid development and evaluation of robust dialogue policies.
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach: They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome: The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.
CausalMACE: Causality Empowered Multi-Agents in Minecraft Cooperative Tasks (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing work on multi-agent collaborative tasks in Minecraft is limited due to inefficiency and limited fault tolerance.
Approach: They propose a framework that incorporates causality to manage dependencies among subtasks.
Outcome: The proposed framework achieves state-of-the-art performance in multi-agent cooperative tasks of Minecraft.
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS).
Approach: They propose a framework that leverages LLMs for cross-domain neural architecture optimization without extensive domain-specific tuning.
Outcome: The proposed framework achieves competitive performance in both in-domain and out-of-domain tasks.
Can LLMs Simulate L2-English Dialogue? An Information-Theoretic Analysis of L1-Dependent Biases (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) can simulate non-native-like English use observed in human second language (L2) learners interfered with by their native first language (N1) knowledge.
Approach: They use large language models to simulate non-native-like English use observed in human second language (L2) learners, and then compare their outputs to real L2 learner data.
Outcome: The proposed models replicate L1-dependent patterns observed in human second language (L2) learners, with distinct influences from various languages.
Towards Identification and Intervention of Safety-Critical Parameters in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety-related methodologies for large language models are lacking . despite advances in safety alignment techniques, safeguarding LLMs during adaptation to various tasks remains a challenge.
Approach: They propose a framework to quantify how different parameters affect LLM safety . they propose two targeted intervention paradigms for safety enhancement and preservation .
Outcome: The proposed framework reveals safety-critical patterns across different LLM architectures.
Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Information (2022.findings-acl)

Copied to clipboard

Challenge: Existing sememe KBs only cover a few languages, which hinders the wide utilization of sememes.
Approach: They propose to build a multilingual sememe KB based on a dictionary called BabelNet . they use multilingual synonyms, multilingual glosses and images to encode sememes .
Outcome: The proposed model outperforms previous methods in terms of MAP and F1 scores.
Robust Lottery Tickets for Pre-trained Language Models (2022.acl-long)

Copied to clipboard

Challenge: Recent studies have shown that pre-trained language models contain smaller matching subnetworks that are not robust to adversarial examples.
Approach: They propose a method to find robust tickets hidden in pre-trained language models by learning binary weight masks and an adversarial loss objective to guide the search.
Outcome: The proposed method improves on previous work on adversarial robustness evaluation.
ORTicket: Let One Robust BERT Ticket Transfer across Different Tasks (2024.lrec-main)

Copied to clipboard

Challenge: Pretrained language models are susceptible to subtle perturbations and require multiple adversarial training during fine-tuning to improve their robustness.
Approach: They propose a novel adversarial defense method ORTicket that fine-tunes a model for downstream tasks.
Outcome: The proposed method achieves comparable robustness to other defense methods while maintaining the efficiency of fine-tuning.
Toward Optimal LLM Alignments Using Two-Player Games (2025.findings-emnlp)

Copied to clipboard

Challenge: Alignment of large language models (LLM) is a process that ensures the model’s responses to user prompts align with human intentions and social values.
Approach: They propose an alignment method based on a two-agent game consisting of an adversarial agent and a defensive agent.
Outcome: The proposed method improves on a two-agent game with an adversarial agent and a defensive agent.
GEM: Gestalt Enhanced Markup Language Model for Web Understanding via Render Tree (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models that use plain HTMLs do not include crucial visual information in the rendered web.
Approach: They propose a Gestalt Enhanced Markup Language Model for hosting visual information without visual input.
Outcome: The proposed model can handle multiple downstream tasks without visual input.
CASN:Class-Aware Score Network for Textual Adversarial Detection (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to counteract adversarial attacks can be divided into two directions, adversarials defense and adversarially detection.
Approach: They propose a score-based generative method to implicitly model the data distribution using a log-density distribution and supervised contrastive learning to guide the estimation using label information.
Outcome: The proposed method improves on three text classification tasks on four advanced attack algorithms.
Efficient Adversarial Training with Robust Early-Bird Tickets (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods to improve the robustness of pre-trained language models are expensive because of the need to generate adversarial examples via gradient descent.
Approach: They propose an adversarial optimization method that searches for robust tickets with structured sparsity in the early stage and fine-tunes tickets in the remaining time.
Outcome: The proposed method achieves up to 7 13 training speedups while maintaining comparable or even better robustness compared to the most competitive state-of-the-art methods.
Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable capabilities in various tasks, but may rely on dataset biases as shortcuts for prediction.
Approach: They propose to use a test suite to evaluate the impact of shortcuts on LLMs' performance.
Outcome: The proposed test suite incorporates six shortcut types, five evaluation metrics, and four prompting strategies.
Retrieved Sequence Augmentation for Protein Representation Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Using multiple sequence alignments (MSA) to extract evolutionary knowledge is limited.
Approach: They propose to use multiple sequence alignments to augment protein representations . they propose to employ Retrieved Sequence Augmentation to enhance protein representation learning .
Outcome: The proposed method surpasses MSA Transformer by 5% in structural and property prediction tasks while being 373 times faster.
R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: RAG systems that integrate external knowledge with Large Language Models often become bottlenecks due to their limited parameters compared to LLMs and their inability to perform step-by-step reasoning.
Approach: They propose a model that integrates external knowledge with Large Language Models to enhance factual correctness and mitigate hallucination.
Outcome: The proposed model outperforms baselines and can transfer well to different retrievers.
FinMRAGBench: A Realistic and Complex Benchmark for Multi-Modal RAG in Financial Document Analysis (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for realistic financial analysis fail to capture realistic financial situations involving cross-document retrieval, multi-page evidence integration, and diverse analytical tasks.
Approach: They propose a multi-modal financial RAG benchmark that evaluates large language models in realistic financial analysis settings.
Outcome: The proposed framework achieves the strongest overall performance across all models.
Towards Long Context Hallucination Detection (2025.findings-naacl)

Copied to clipboard

Challenge: Large language models are prone to contextual hallucination, generating information that is either unsubstantiated or contradictory to the given context.
Approach: They propose a dataset specifically designed for long-context hallucination detection.
Outcome: The proposed architecture outperforms existing models while providing faster inference.
NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Queries (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) generate code for productive activities, but current benchmarks for code synthesis are oriented towards introductory tasks on algorithm and data science.
Approach: They propose a code benchmark to mirror the complexity and variety of scenarios in real-world coding tasks.
Outcome: The proposed benchmark improves on 39 large language models with close HumanEval scores and achieves an efficiency increase of more than 4 times.
Think and Recall: Layer-Level Prompting for Lifelong Model Editing (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for lifelong model editing suffer from limitations in usability, such as requiring additional training corpora or lacking support for reversible and detachable edits.
Approach: They propose a plug-and-play method for knowledge retrieval and storage, i.e., Layer-Level Prompting, which enables seamless and efficient lifelong model editing.
Outcome: The proposed method outperforms existing methods on question answering and hallucination benchmarks across different LLMs.
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for detection of misinformation generated by large language models fail to mitigate societal risks . authors propose a paradigm shift from passive detection to anticipatory mitigation strategies . existing defenses remain reactionary in an era demanding proactive defense, authors say .
Approach: They propose a three-pillar approach to prevent misinformation by fortifying integrity of training data and inference reliability by embedding self-corrective mechanisms during reasoning.
Outcome: The proposed framework improves existing methods in misinformation prevention by 63% . it demonstrates that existing methods exhibit false negative rates against misinformation .
Boosting LLM Agents with Recursive Contemplation for Effective Deception Handling (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have led to significant success in using LLMs as agents.
Approach: They propose a cognitive framework that incorporates first-order and second-order perspective transitions into LLMs to enhance their ability to identify and counteract deceptive information.
Outcome: The proposed framework enhances LLMs’ ability to identify and counteract deceptive information without extra fine-tuning and data.
UniRAG: Unified Query Understanding Method for Retrieval Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing query augmentation methods face knowledge update lag and hallucinations in large language models (LLMs) Existing methods face two key challenges: (1) separation of query augmented and encoding tasks, which hinders information sharing and introduces cumulative errors; (2) difficulty of selecting optimal augmentation strategy for different scenarios.
Approach: They propose a unified framework for query understanding in RAG that integrates internal and external knowledge to enhance query augmentation and encoding tasks.
Outcome: The proposed framework outperforms traditional query augmentation methods in five knowledge-intensive benchmark tasks in both closed and open domain question answering.
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs? (2025.findings-acl)

Copied to clipboard

Challenge: Existing research demonstrates the effectiveness of grammar-based code representations in small-scale models, showing their ability to reduce syntax errors and enhance performance.
Approach: They develop a series of billion-scale grammar-based code representations that incorporate grammar rules into the code generation process.
Outcome: Experiments on HumanEval and MBPP show that grammar-based representations reduce syntax errors and improve performance even in billion-scale models.
RJE: A Retrieval-Judgment-Exploration Framework for Efficient Knowledge Graph Question Answering with LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Knowledge graph question answering (KGQA) aims to answer natural language questions using knowledge graphs.
Approach: They propose a framework that retrieves refined reasoning paths and evaluates their sufficiency.
Outcome: The proposed framework outperforms existing baselines while enabling small open-source LLMs to achieve competitive results without fine-tuning LLM.
CoRAG: Enhancing Hybrid Retrieval-Augmented Generation through a Cooperative Retriever Architecture (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base, which often miss relevant information located further away from a global view.
Approach: Hybrid-RAG combines textual documents and graph-structured relational information for RAG . existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base .
Outcome: Hybrid-RAG combines textual documents and graph-structured relational information . existing methods only retrieve related documents from local neighbors or subgraphs in the knowledge base .
Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality.
Approach: They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward.
Outcome: The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability.
CL2GEC: A Multi-Discipline Benchmark for Continual Learning in Chinese Literature Grammatical Error Correction (2026.acl-long)

Copied to clipboard

Challenge: Existing CGEC benchmarks for multi-disciplinary writing are limited . continual learning (CL) is a promising solution to handle domain-specific linguistic variation and prevent catastrophic forgetting.
Approach: They propose a Chinese Literature Continual Learning benchmark to evaluate adaptive CGEC across disciplines.
Outcome: The proposed benchmark includes 10,000 human-annotated sentences spanning 10 disciplines, each exhibiting distinct linguistic styles and error patterns.
Is Cognition Consistent with Perception? Assessing and Mitigating Multimodal Knowledge Conflicts in Document Understanding (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal large language models (MLLMs) have shown impressive capabilities in document understanding due to different types of annotation noise in training.
Approach: They propose a method to reduce C&P knowledge conflicts across all tested MLLMs . they propose to use annotation noise to train models to understand document content .
Outcome: The proposed method reduces C&P knowledge conflicts across all tested MLLMs and enhances their performance in both cognitive and perceptual tasks.
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems (2020.acl-demos)

Copied to clipboard

Challenge: ConvLab-2 inherits Convlab's framework but integrates more powerful dialogue models and supports more datasets.
Approach: They present ConvLab-2, an open-source toolkit that enables researchers to build task-oriented dialogue systems with state-of-the-art models and perform an end-to-end evaluation.
Outcome: The new tool inherits ConvLab's framework and extends it by integrating many recently proposed state-of-the-art dialogue models.
Modeling Intra and Inter-modality Incongruity for Multi-Modal Sarcasm Detection (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for sarcasm detection ignore the incongruity character in sarcasm, which is often manifested between modalities or within modalités.
Approach: They propose to capture inter-modality incongruity in a text-based model by using a self-attention mechanism and a co-attention model to model the contradiction within the text.
Outcome: The proposed model achieves state-of-the-art on a public multi-modal sarcasm detection dataset.
StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback (2024.acl-long)

Copied to clipboard

Challenge: Existing work integrates reinforcement learning with compiler feedback to enhance code generation quality but the long code generated by LLMs makes RL exploration ineffective.
Approach: They propose a framework that integrates reinforcement learning and compiler feedback to enhance code generation quality.
Outcome: The proposed framework outperforms state-of-the-art approaches in corresponding benchmarks and integrates reinforcement learning with compiler feedback to improve code generation quality.
Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to address the "lost-in-the-middle" problem suffer from high latency or suboptimal hand-crafted scaling strategies.
Approach: They propose a layer-specific positional embedding scaling method that assigns distinct scaling factors to each layer.
Outcome: Experiments show that the proposed method mitigates positional attention bias and delivers consistent improvements across multiple long-context benchmarks.
RealBehavior: A Framework for Faithfully Characterizing Foundation Models’ Human-like Behavior Mechanisms (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on human-like behaviors in foundation models do not verify their faithfulness . a simple application of psychological tools cannot faithfully characterize all human-type behaviors .
Approach: They propose a framework to characterize humanoid behaviors in foundation models . they argue that a simple application of psychological tools cannot faithfully characterize all human-like behaviors .
Outcome: The proposed framework assesses the faithfulness of results based on reproducibility, internal consistency, and generalizability.
Understanding Gender Bias in Knowledge Base Embeddings (2022.acl-long)

Copied to clipboard

Challenge: Knowledge base (KB) embeddings have been shown to contain gender biases . authors develop two new bias measures to quantify them and trace their origins in KB .
Approach: They propose two ways to quantify gender biases in knowledge base (KB) embeddings . they use the influence function to inspect the contribution of each triple in KB to the overall group bias .
Outcome: The proposed measures are compared with real-world census data to examine gender biases.
DocHieNet: A Large and Diverse Dataset for Document Hierarchy Parsing (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for document hierarchy parsing are limited due to the small scale and inconsistency of datasets.
Approach: They propose a document hierarchy parsing dataset to compensate for the data scarcity problem and propose 'dHP' framework to grasp fine-grained text content and coarse-grounded pattern at layout element level.
Outcome: The proposed framework grasps both fine-grained text content and coarse-grounded pattern at layout element level, enhancing the capacity of pre-trained text-layout models in handling multi-page and multi-level challenges.
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)

Copied to clipboard

Challenge: Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL).
Approach: They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
Outcome: The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
PerSphere: A Comprehensive Framework for Multi-Faceted Perspective Retrieval and Summarization (2025.acl-long)

Copied to clipboard

Challenge: Experimental results show that the main challenge lies in long context and perspective extraction.
Approach: They propose a benchmark to facilitate multi-faceted perspective retrieval and summarization . they propose measurable metrics to evaluate the comprehensiveness of the retrieval pipeline .
Outcome: The proposed system breaks free from information silos by combining two opposing claims . it can be used to extract multiple perspectives and improve performance on the platform .
Mitigating Hallucinations in VLMs: Enhancing Visual Attention via Head-Wise Perturbation (2026.findings-acl)

Copied to clipboard

Challenge: Vision–Language Models (VLMs) have demonstrated strong capabilities in tasks that require joint understanding of text and images.
Approach: They propose a strategy that incorporates head-wise attention perturbation via continuous multiplicative noise coupled with a visual-guided loss focused on vision-sensitive text tokens to promote a more balanced attention distribution.
Outcome: The proposed approach outperforms baseline models on three benchmarks and consistently outperformed the baseline model.
SimulBench: Evaluating Language Models with Creative Simulation Tasks (2025.findings-naacl)

Copied to clipboard

Challenge: Existing benchmarks for large language models do not fully evaluate their potential for broad implementation.
Approach: They propose to use a fixed LLM as a user agent to engage with an LLM to collect dialogues first under different tasks.
Outcome: The proposed framework outperforms LLaMA-3-70b-Chat on 18.55% more cases.
Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results prove that language models can learn from human feedback better, irrespective of sequence length . emergence of length bias often induces the model to favor longer outputs .
Approach: They propose to separate reward modeling from the influence of sequence length by using the Product-of-Experts technique.
Outcome: The proposed approach shows that language models perform better regardless of sequence length . the main expert is focused on understanding human intents, while the biased expert targets the identification and capture of length bias.
TMATH A Dataset for Evaluating Large Language Models in Generating Educational Hints for Math Word Problems (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly being applied in education, showing significant potential in personalized instruction, student feedback, and intelligent tutoring systems (ITSs).
Approach: They propose a dataset specifically designed to evaluate LLMs’ ability to generate high-quality hints for Math Word Problems.
Outcome: The proposed dataset shows that LLMs can generate more accurate and contextually appropriate educational hints for math word problems without offering direct answers.
Mitigating Object Hallucinations in MLLMs via Multi-Frequency Perturbations (2025.findings-emnlp)

Copied to clipboard

Challenge: Multimodal large language models have demonstrated remarkable performance in visual-language tasks, but their authenticity is often compromised by object hallucinations.
Approach: They propose a multi-frequency perturbation method that leverages both low-frequency and high-frequency features of images to perturb visual feature representations and explicitly suppress redundant frequency-domain features during inference.
Outcome: The proposed method significantly mitigates object hallucinations across various model architectures.
SoulChat: Improving LLMs’ Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) are used in psychological counseling to provide universal advice.
Approach: They constructed a multi-turn empathetic conversation dataset with 2 million samples . they found that the model's empathy ability is enhanced when finetuning .
Outcome: Experiments show that large language models can be finetuned to provide empathy . but, when applied to mental health or emotional support conversation, there are three main issues .
A Unified Dialogue User Simulator for Few-shot Data Augmentation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to augment large-scale task-oriented dialogues rely on annotated data.
Approach: They propose to build a unified dialogue user simulation model by pre-training on publicly available datasets.
Outcome: The proposed model can be tuned on a target domain with few-shot data.
Can Language Models Understand Physical Concepts? (2023.emnlp-main)

Copied to clipboard

Challenge: Existing language models do not understand basic physical concepts in the human world.
Approach: They propose a method to transfer embodied knowledge from visual models to LMs . they use visual concepts and embodies concepts learned from interaction with the world .
Outcome: The proposed method achieves comparable performance with scaling up parameters of LMs 134.
ConvLab: Multi-Domain End-to-End Dialog System Platform (P19-3)

Copied to clipboard

Challenge: ConvLab is an open-source multi-domain end-to-end dialog system platform . it allows researchers to quickly set up experiments with reusable components and compare a large set of different approaches in common environments.
Approach: They propose to use an open-source multi-domain end-to-end dialog system platform to train and evaluate dialog bots in common environments.
Outcome: The proposed system enables researchers to quickly set up experiments with reusable components and compare a large set of different approaches in common environments.
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Copied to clipboard

Challenge: Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach: They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome: The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.
Example Quality Matters: Multi-Aspects Example Augmentation for Private Library Programming (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to code generation fail to consider the quality of retrieved examples.
Approach: They propose a retrieval-augmented generation method that combines existing API examples to improve complexity and readability.
Outcome: The proposed method achieves up to 22% accuracy improvement over baseline methods.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations