Papers by Chen Jiang

320 papers
UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook (2025.acl-long)

Copied to clipboard

Challenge: Existing neural audio codecs are not capable of handling multi-domain audio data . et al., 2023) integrate speech modality with text-based large language models .
Approach: They propose a unified audio codec with a single codebook to support multi-domain audio data . they propose combining a mix-of-experts strategy and a partitioned domain-adaptive codebook method .
Outcome: The proposed codec outperforms existing codecs on acoustic and semantic representation capabilities.
Agentic Knowledgeable Self-awareness (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks.
Approach: They propose a data-centric approach that applies agents with knowledgeable self-awareness like humans to a heuristic situation judgement criterion to mark special tokens on their self-explored trajectories for collecting training data.
Outcome: The proposed paradigm outperforms baseline models on various tasks with minimal external knowledge.
Exploiting Global and Local Hierarchies for Hierarchical Text Classification (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods encode label hierarchy in a global view, which makes them hard to exploit hierarchical information.
Approach: They propose to leverage label hierarchy in multi-label text classification by encoding label hierarchy as a static hierarchical structure containing all labels.
Outcome: The proposed method achieves significant improvement on three benchmark datasets compared with the state-of-the-art method HGCLR.
Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
Enhancing Neural Data-To-Text Generation Models with External Background Knowledge (D19-1)

Copied to clipboard

Challenge: Recent neural models for data-to-text generation rely on parallel pairs of data and text to learn writing knowledge.
Approach: They propose to enhance neural models with external knowledge to improve fidelity of generated text.
Outcome: The proposed model improves on Wikipedia infobox-to-text datasets on 21 datasets.
S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks rely heavily on text-based evaluation and largely ignore paralinguistic cues such as prosody, emotion, and speaker traits.
Approach: They propose a speech-native benchmark for evaluating instruction-following S2S models with explicit assessment of both semantic understanding and paralinguistic expression.
Outcome: The proposed system enables more natural, robust, and human-aligned speech agents.
DentalGPT: Incentivizing Multimodal Reasoning in Dentistry (2026.findings-acl)

Copied to clipboard

Challenge: Current multimodal large language models (MLLMs) show limited understanding of dental images.
Approach: They propose a dental-specialized multimodal large language model trained via staged multimodal alignment and reinforcement learning.
Outcome: The proposed model outperforms state-of-the-art models on disease classification and dental VQA tasks.
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation.
Approach: They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting.
Outcome: The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods.
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks.
Approach: They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges.
Outcome: The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization.
When Evolution Strategy Meets Language Models Tuning (2025.coling-main)

Copied to clipboard

Challenge: Autoregressive language models with pretraining often display limited capability in effectively following instructions.
Approach: They propose an on-policy approach to optimize models by harnessing the principle of biological evolution, namely survival of the fittest.
Outcome: The proposed method can achieve superior performance in various tasks and comparable performance in the human alignment task.
LLM-Rec: Personalized Recommendation via Prompting Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have showcased their remarkable ability to harness commonsense knowledge and reasoning.
Approach: They propose a novel approach which incorporates four distinct prompting strategies of text enrichment for improving personalized text-based recommendations.
Outcome: The proposed approach improves recommendation quality and even basic MLP models achieve comparable or even better results than complex content-based methods.
Event Ontology Completion with Hierarchical Structure Evolution Networks (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for event detection require predefined schemas, but manual defining is expensive and labor-intensive.
Approach: They propose a task to achieve event clustering, hierarchy expansion and type naming . they propose 'neighbor Contrastive Clustering' module and a Hierarchy-Aware Linking module .
Outcome: The proposed method outperforms baseline methods on three datasets.
Stylized Knowledge-Grounded Dialogue Generation via Disentangled Template Rewriting (2022.naacl-main)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue generation models only produce pedantic responses, which lacks emotion and attraction compared with the responses with polite style, positive and negative sentiments.
Approach: They propose a method which generates responses via combing disentangled style templates and content templates.
Outcome: The proposed method improves on evaluation metrics compared with state-of-the-art methods.
The “Knowledge–Behavior Gap” in Cultural Taboo Safety of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing cultural benchmarks assess cultural knowledge or values biases, but ignore cultural taboos.
Approach: They propose a benchmark to evaluate and improve the cultural taboo safety of large language models.
Outcome: The proposed benchmark spans 77 countries and regions, and includes over 2,020 taboos.
Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters (2024.acl-long)

Copied to clipboard

Challenge: Existing studies focus on misspelled characters, ignoring faked characters which are more common and difficult to correct.
Approach: They propose to use Chinese character checking to identify and correct wrong characters in texts by human annotation.
Outcome: The proposed dataset is the first real-world visual and the largest human-crafted dataset for the Chinese character checking scenario.
Multi-hop Graph Convolutional Network with High-order Chebyshev Approximation for Text Reasoning (2021.acl-long)

Copied to clipboard

Challenge: Existing single-hop graph reasoning in Graph convolutional networks may miss some important non-consecutive dependencies.
Approach: They propose a graph convolutional network with the high-order dynamic Chebyshev approximation which augments multi-hop graph reasoning by fusing messages aggregated from direct and long-term dependencies into one convolutionalist layer.
Outcome: The proposed model improves on four transductive and inductive NLP tasks and the ablation of the existing model.
Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs (2026.acl-long)

Copied to clipboard

Challenge: despite significant progress, full-duplex SLMs are constrained by severe modality interference, authors say . modality interferes with acoustic and semantic modeling, making them unintelligent and unnatural . authors propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers .
Approach: They propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers while preserving cross-modality coherence via a dedicated semantic alignment channel.
Outcome: The proposed method significantly advances the state of the art on full-duplex benchmarks . it decouples conflicting modalities in deep layers while preserving cross-modality coherence .
ChatMap: Mining Human Thought Processes for Customer Service Chatbots via Multi-Agent Collaboration (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for enhancing dialogue performance rely on summarizing behavior . e-commerce chatbots need to align their dialogue strategies with human behavior to achieve coherent, human-like conversations with customers.
Approach: They propose a method to extract core patterns from dialogue data and integrate them into models by mining service thought processes using a multi-agent aPproach.
Outcome: The proposed method outperforms manual methods and outperfies baselines on Taobao in China.
Towards Better Utilization of Multi-Reference Training Data for Chinese Grammatical Error Correction (2024.findings-acl)

Copied to clipboard

Challenge: a high proportion of Chinese training data is multi-referenced for the grammatical error correction task . however, there are many ways to correct an erroneous input sentence . a systematic study on multi-referencing training data has been proposed .
Approach: They propose two new approaches and a simple two-stage training strategy to better utilize multi-reference training data.
Outcome: The proposed methods show that Chinese training data contain multiple references.
From Answers to Arguments: Toward Trustworthy Clinical Diagnostic Reasoning with Toulmin-Guided Curriculum Goal-Conditioned Learning (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are obstructed by their opaque and often unreliable reasoning.
Approach: They propose a framework for trustworthy clinical argumentation by adapting the Toulmin model to the diagnostic process.
Outcome: The proposed method achieves diagnostic accuracy comparable to resource-intensive RL methods while offering a more stable and efficient training pipeline.
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks (2022.emnlp-main)

Copied to clipboard

Challenge: Existing domain-adaptive pre-training (DAPT) models tend to forget the general knowledge acquired by general PLMs, leading to catastrophic forgetting and sub-optimal performance.
Approach: They propose a framework which augments the domain-specific PLM by a memory built from the frozen general PLM without losing the general knowledge.
Outcome: The proposed framework augments the domain-specific PLM by a memory built from the frozen general PLM without losing the general knowledge.
mCLIP: Multilingual CLIP via Cross-lingual Transfer (2023.acl-long)

Copied to clipboard

Challenge: Existing multilingual vision-language pretrained models are biased towards English due to the lack of sufficient non-English image-text pairs.
Approach: They propose to train a retrieval-efficient dual-stream multilingual VLP model by aligning CLIP model and a multilingual text encoder through a novel Triangle Cross-modal Knowledge Distillation method.
Outcome: Empirical results show that mCLIP achieves new state-of-the-art performance for both zero-shot and finetuned multilingual image-text retrieval tasks.
Magnet: Multi-turn Tool-use Data Synthesis and Distillation via Graph Translation (2025.acl-long)

Copied to clipboard

Challenge: Large language models have been shown to be effective in multi-turn interactions . however, their performance may be limited in complex, multi-turned interactions involving users and multiple tools.
Approach: They propose a framework for synthesizing high-quality training trajectories to enhance the function calling capability of large language model agents in multi-turn conversations with humans.
Outcome: The proposed model outperforms the teacher model by 68.01 on BFCL-v3 and 73.30 on ToolQuery.
How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Cantonese has scant representation in NLP research, especially compared to other languages from similarly developed regions.
Approach: They propose to evaluate Cantonese LLM performance in factual generation, mathematical logic, complex reasoning, and general knowledge in Cantonesian.
Outcome: The proposed models will evaluate Cantonese's performance in factual generation, mathematical logic, complex reasoning, and general knowledge in Cantone.
Tug-of-War between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge conflicts in RALMs can ensnare them in a tug-of-war between knowledge and evidence, limiting their practical applicability.
Approach: They propose a method called Conflict-Disentangle Contrastive Decoding (CD2) to better calibrate the model’s confidence.
Outcome: The proposed method can resolve knowledge conflicts in large language models with the help of conflict-disentangle contrast decoding (CD2) .
Large Language Models in Bioinformatics: A Survey (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are revolutionizing bioinformatics, enabling advanced analysis of DNA, RNA, proteins, and single-cell data.
Approach: They examine the evolution of Large Language Models (LLMs) in bioinformatics and precision medicine by focusing on genomic sequence modeling, RNA structure prediction, protein function inference, and single-cell transcriptomics.
Outcome: The proposed models are capable of predicting RNA structure and function and predicting single-cell transcriptomics.
MED-COREASONER: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing models that use English and local languages have a multilingual gap . a language-informed co-reasoning framework can be used to improve multilingual reasoning .
Approach: They propose a language-informed co-reasoning framework that elicits parallel English and local-language reasoning and abstracts them into structured concepts.
Outcome: Experiments show that Med-CoReasoner improves multilingual reasoning performance by 5% . the framework produces clinically sound and culturally grounded reasoning traces .
Reasoning in a Combinatorial and Constrained World: Benchmarking LLMs on Natural-Language Combinatorial Optimization (2026.findings-acl)

Copied to clipboard

Challenge: NLCO evaluates large language models for combinatorial optimization (CO) . existing evaluations emphasize relatively simple reasoning competencies .
Approach: They propose a combinatorial optimization benchmark that evaluates large language models on CO reasoning.
Outcome: The proposed model can handle combinatorial optimization without writing code or calling external solvers.
A Comprehensive Literary Chinese Reading Comprehension Dataset with an Evidence Curation Based Solution (2025.emnlp-main)

Copied to clipboard

Challenge: Low-resource language understanding is challenging for large language models (LLMs).
Approach: They propose a CompRehensive lIterary Chinese readIng comprehenSion procedure with a large dataset for CRISIS.
Outcome: The proposed procedure has the largest dataset and substantiates the effectiveness of the proposed procedure with a 7 percent hike in accuracy compared with the baseline.
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)

Copied to clipboard

Challenge: TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications.
Approach: They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities.
Outcome: The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions.
LiteVL: Efficient Video-Language Learning with Enhanced Spatial-Temporal Modeling (2022.emnlp-main)

Copied to clipboard

Challenge: Recent large-scale video-language pre-trained models have shown appealing performance on downstream tasks.
Approach: They propose a video-text model that adapts a pre-trained image-language model into a text-based model without heavy pre-training.
Outcome: The proposed model outperforms existing models on video-text retrieval and video question answering tasks without heavy pre-training.
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Mainstream approaches to aligning large language models heavily rely on human preference data.
Approach: They propose a framework that fine-tunes a policy model using pairwise feedback data automatically mined from its outputs.
Outcome: The proposed framework outperforms the base model with an average win rate of 69.7% across seven conversational or instruction-following datasets.
Aligning Large Language Models with Implicit Preferences from User-Generated Content (2025.acl-long)

Copied to clipboard

Challenge: Existing preference learning methods rely heavily on curated data from humans or advanced LLMs, which is costly and difficult to scale.
Approach: They propose a framework that leverages implicit preferences in unlabeled user-generated content to generate preference data.
Outcome: The proposed framework transforms user-generated content into user queries and generates responses from the policy model.
Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in vision-language models have unified perception and understanding tasks within Visual Question Answering paradigms.
Approach: They propose to outline timeline, architecture, and pipeline of nearly all TIU MLLMs and review their performance on mainstream benchmarks.
Outcome: The proposed models perform well on mainstream benchmarks and are compared with other models.
Benchmarking Data Science Agents (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as promising data science aids, assisting humans in data analysis and processing.
Approach: They propose an evaluation paradigm and benchmarks that assess the performance of data science agents throughout the entire data science lifecycle.
Outcome: The proposed evaluation paradigm streamlines dataset preparation, improves coverage, and expands benchmarking comprehensiveness.
Youling: an AI-assisted Lyrics Creation System (2020.emnlp-demos)

Copied to clipboard

Challenge: Recent studies have focused on a single pass of lyrics generation with little human intervention.
Approach: They propose an AI-assisted lyrics creation system that supports one pass full-text generation and interactive generation modes.
Outcome: The proposed system supports full-text generation and interactive generation modes . it also provides a revision module which enables users to revise undesired lyrics repeatedly.
Mitigating Lost in Multi-turn Conversation via Curriculum RL with Verifiable Accuracy and Abstention Rewards (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models exhibit strong capabilities in single-turn instruction following but suffer from Lost-in-Conversation (LiC) when instructions are revealed progressively in multi-turn settings, models get "Lost in Conversation"
Approach: They propose a framework that encourages models to generate correct answers and judge solvability in multi-turn conversations.
Outcome: The proposed framework improves models' ability to balance problem-solving with abstention . it reduces premature answering behaviors that cause lost-in-conversation (LiC)
VLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training (2025.findings-emnlp)

Copied to clipboard

Challenge: a significant drawback of Vision-language Models is their reliance on static training data, leading to outdated information and limited contextual awareness.
Approach: They propose a framework with knowledge-enhanced reranking and noise-injected training to improve the VLM's ranking ability.
Outcome: The proposed framework is based on a simple yet effective instruction template and is able to induce its ranking ability and serve it as a reranker to precisely filter the top-k retrieved images.
GeAR: Graph-enhanced Agent for Retrieval-augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented Generation (RAG) relies on effective retrieval capabilities, yet traditional sparse and dense retrievers struggle with multi-hop retrieval scenarios.
Approach: They propose a graph expansion mechanism that augments any conventional base retriever and an agent framework that incorporates the resulting graph-based retrieval into a multi-step retrieval framework.
Outcome: The proposed system achieves state-of-the-art results on three multi-hop question answering datasets while consuming fewer tokens and requiring fewer iterations than existing multi-step retrieval systems.
BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented Large Language Models struggle with complex inputs and noisy knowledge retrieval hindering model effectiveness.
Approach: They propose a query generation method that integrates query generation blending with knowledge filtering to enhance retrieval-augmented LLMs.
Outcome: The proposed approach surpasses state-of-the-art benchmarks on open-domain question answering benchmarks.
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement (2025.naacl-long)

Copied to clipboard

Challenge: Existing large language models (LLMs) show exceptional problem-solving capabilities but struggle with complex reasoning tasks.
Approach: They propose a novel RAG approach that integrates retrieved information to guide tree-based reasoning process based on LLMs.
Outcome: The proposed approach outperforms existing methods in large language models . iteratively plans intermediate sub-queries and answers based on the LLM itself .
MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing (2024.findings-acl)

Copied to clipboard

Challenge: Current benchmarks focus on coarse-grained knowledge, leaving the intricacies of fine-grounded knowledge unexplored.
Approach: They propose a benchmark and dataset specifically designed for FG multimodal entity knowledge editing.
Outcome: The proposed benchmark underscoring the complexity of FG knowledge editing in MLLMs.
Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability (2026.acl-long)

Copied to clipboard

Challenge: Large language models have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning, but their strictly sequential nature constrains test-time scalability.
Approach: They propose an end-to-end reinforcement learning framework to enhance LLMs' DAC-style reasoning capacity by decomposing a problem into subproblems and solving them sequentially.
Outcome: The proposed model surpasses CoT by 8.6% and 6.3% on competition-level benchmarks and is available at the [github.com/MasterVito/DAC-RL].
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation (2024.lrec-main)

Copied to clipboard

Challenge: Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient.
Approach: They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve.
Outcome: The proposed approach improves on three SLT datasets conducted under the gloss-free setting.
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts.
Approach: They propose a method that prunes conflicting attention heads without updating model parameters.
Outcome: The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters.
Hide and Seek in Noise Labels: Noise-Robust Collaborative Active Learning with LLMs-Powered Assistance (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for learning from noisy labels are difficult to improve . existing methods identify noisy labels and use active learning to query experts .
Approach: They propose a collaborative learning framework to combine LLMs and small models for learning from noisy labels.
Outcome: The proposed framework outperforms state-of-the-art baselines on synthetic and real-world noise datasets.
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adversarial regularization treat adversarials and defending players equally, which is undesirable because only the defending player contributes to the generalization performance.
Approach: They propose a method which formulates adversarial regularization as a Stackelberg game and induces a competition between a leader and a follower.
Outcome: The proposed method outperforms existing adversarial regularization baselines on a set of machine translation and natural language understanding tasks.
CKnowEdit: A New Chinese Knowledge Editing Dataset for Linguistics, Facts, and Logic Error Correction in LLMs (2025.acl-long)

Copied to clipboard

Challenge: CKnowEdit is the first-ever knowledge editing dataset designed to correct linguistic, factual, and logical errors in Large Language Models.
Approach: They propose a Chinese knowledge editing dataset to correct linguistic, factual, and logical errors in Large Language Models.
Outcome: The proposed dataset highlights the challenges that LLMs face in mastering Chinese . CKnowEdit can correct linguistic, factual, and logical errors in Chinese, the authors show .
MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question Answering (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in few-shot question answering rely on pre-trained large language models and fine-tuning in specific settings.
Approach: They propose to select the most informative data for fine-tuning to improve efficiency . they use an approximate graph algorithm and unsupervised question generation to generate QA pairs .
Outcome: The proposed framework improves the performance of the few-shot question answering task on the open-domain QA task.
Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training (2025.naacl-long)

Copied to clipboard

Challenge: Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability.
Approach: They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs .
Outcome: The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks.
Improving Preference Alignment of LLM with Inference-Free Self-Refinement (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) develop in-context learning capability through pretraining and instruction tuning.
Approach: Large language models (LLMs) develop in-context learning capability through pretraining and instruction tuning.
Outcome: Experiments show that incorporating IFSR into preference alignment yields performance improvement over 10%.
Unearthing Gems from Stones: Policy Optimization with Negative Sample Augmentation for LLM Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in reasoning language models have witnessed a paradigm shift from short to long CoT pattern.
Approach: They propose a behavior-constrained policy gradient with negative sample augmented (BCPG-NSA) negative steps are valuable components in long CoT models, authors argue .
Outcome: The proposed framework outperforms baselines on math/coding reasoning benchmarks using the same training dataset.
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods to train cross-lingual pre-trained language models have shown great success in cross-linguistic sequence labeling tasks.
Approach: They propose a cross-lingual language informative span masking task to eliminate the objective gap between pre-training and fine-tuning stages.
Outcome: The proposed method surpasses the state-of-the-art methods on multiple benchmarks even with limited pre-training data.
Few-shot Named Entity Recognition via Superposition Concept Discrimination (2024.lrec-main)

Copied to clipboard

Challenge: Few-shot named entity recognition (NER) aims to identify entities of target types with limited number of illustrative instances.
Approach: They propose a superposition concept discriminator which solves the intrinsic generalization problem by an active learning paradigm.
Outcome: The proposed model significantly improves few-shot named entity recognition (FS-NER) with minimal additional efforts.
A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis (D19-1)

Copied to clipboard

Challenge: Existing ABSA methods only use one aspect or multiple aspects with the same sentiment polarity . recent studies show that neural network methods can be trained end-to-end and automatically learn important features.
Approach: They propose a large-scale multi-aspect multi-sentiment dataset with two different aspects with different sentiment polarities.
Outcome: The proposed model outperforms the state-of-the-art models on the large-scale dataset . it is based on a novel neural network approach that can be trained end-to-end .
DecoupleSearch: Decouple Planning and Search via Hierarchical Reward Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems have emerged as a pivotal methodology for enhancing Large Language Models (LLMs).
Approach: They propose a framework that decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding.
Outcome: The proposed framework decouples planning and search processes using dual value models, enabling independent optimization of plan reasoning and search grounding.
PQR: Improving Dense Retrieval via Potential Query Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing training data is sparse, with each document associated with one or a few labeled queries.
Approach: They propose a training-free potential query retrieval framework to address this problem . they use a Gaussian mixture distribution to model all potential queries for a document .
Outcome: The proposed method is able to capture comprehensive semantic information from a document with multiple queries.
Enhancing Foundation Models in Transaction Understanding with LLM-based Sentence Embeddings (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing foundation models for tabular transactional data rely on index-based representations for categorical merchant fields.
Approach: They propose a framework that uses LLM-generated embeddings as semantic initializations for lightweight transaction models.
Outcome: The proposed framework improves performance on large transaction datasets.
Evolutionary Guided Decoding: Iterative Value Refinement for LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for directing language model outputs are limited in their accuracy due to a distributional gap . existing methods train static value functions on trajectories sampled exclusively from the base policy .
Approach: They propose a framework to bridge a distributional gap in the accuracy of value functions . they propose RLHF to align language models with human values and task requirements .
Outcome: The proposed framework reduces computational costs and improves value function accuracy by leveraging principled value function optimization.
PaperRegister: Boosting Flexible-grained Paper Search via Hierarchical Register Indexing (2026.acl-long)

Copied to clipboard

Challenge: Existing paper search systems lack detailed information to support finer-grained queries.
Approach: They propose a paper-based index that transforms abstract-based corpus index into hierarchical index tree and offline can support paper search queries.
Outcome: The proposed system achieves the SOTA performance and excels in fine-grained scenarios.
NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Texts (2023.findings-acl)

Copied to clipboard

Challenge: Recent studies on Chinese grammatical error correction focus on learning essays.
Approach: They propose a Chinese grammatical error correction dataset that annotates multiple references for 12,500 sentences from three native domains.
Outcome: The proposed dataset can be used to facilitate research on Chinese grammatical error correction (CGEC) for native speaker texts from multiple domains.
Xiaomingbot: A Multilingual Robot News Reporter (2020.acl-demos)

Copied to clipboard

Challenge: Xiaomingbot is a multilingual and multimodal software robot with four capabilities: news generation, news translation, news reading and avatar animation.
Approach: They propose to build a multilingual and multimodal software robot with four inte- gal capabilities: news generation, news translation, news reading and avatar animation.
Outcome: The proposed system generates Chinese news, then reads it in multiple languages and generates an animated avatar reading it.
FinDVer: Explainable Claim Verification over Long and Hybrid-content Financial Documents (2024.emnlp-main)

Copied to clipboard

Challenge: FinDVer is a benchmark to evaluate the explainable claim verification capabilities of LLMs . financial documents are typically long, intricate and dense, and they include both quantita and numerical reasoning.
Approach: They propose a benchmark to evaluate the explainable claim verification capabilities of LLMs . they assess 25 LLM systems under long-context and RAG settings .
Outcome: The proposed benchmark can be used to evaluate the explainable claim verification capabilities of LLMs in financial documents.
Confidence-Aware Ranker Ensembles for Robust In-Context Knowledge Editing (2026.findings-acl)

Copied to clipboard

Challenge: Large language models excel at factual recall, but can propagate stale or incorrect knowledge.
Approach: They propose a feature-weighted ensemble for in-context knowledge editing that calibrates three heterogeneous rankers and extracts simple confidence features from each ranker.
Outcome: The proposed method achieves 88.33% Edit-Success Rate over the best single retriever . it improves edit accuracy without touching model weights and approaches oracle upper bound (91%).
PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks.
Approach: They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes.
Outcome: The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset.
Contrastive Token Learning with Similarity Decay for Repetition Suppression in Machine Translation (2024.findings-emnlp)

Copied to clipboard

Challenge: Neural machine translation (NMT) is pivotal for crosslingual conversation and trade . traditional solutions that penalize text redundancy or token reoccurrence have shown limited efficacy .
Approach: They propose an algorithm that modulates suppression of tokens dynamically, informed by attention weights and inter-token distances.
Outcome: The proposed algorithm outperforms existing methods in precision and generalizability.
CR-LLM: A Dataset and Optimization for Concept Reasoning of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing concept reasoning related datasets suffer from modeledge leakage and context leakage.
Approach: They propose a concept reasoning for large language models with modeledge leakage prevention and context leakage preventive methods to improve the models' conceptual reasoning abilities.
Outcome: The proposed method significantly improves the existing models and reasoning methods, achieving a 7% increase in accuracy compared to CoT and showing better granularity.
KPatch: Knowledge Patch to Pre-trained Language Model for Zero-Shot Stance Detection on Social Media (2024.lrec-main)

Copied to clipboard

Challenge: Existing knowledge injection methods fail to understand the semantics of tweets .
Approach: They propose a method to flexibly inject knowledge into a pre-trained language model and adaptively expand tweets context.
Outcome: The proposed method is based on two training stages to flexibly inject knowledge into the pre-trained language model and adaptively expand tweets context.
A Table-to-Text Framework with Heterogeneous Multidominance Attention and Self-Evaluated Multi-Pass Deliberation (2023.findings-emnlp)

Copied to clipboard

Challenge: Table-to-text works have been widely applied in different domains, such as weather forecast and financial report generation.
Approach: They propose a table-to-text approach on top of Self-evaluated multi-pass Generation and Heterogenous Multidominance Attention to explore the hierarchical structure.
Outcome: The proposed method outperforms several SOTA methods quantitatively and qualitatively on three public datasets.
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents.
Approach: They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety.
Outcome: The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system.
Beyond Screenshots: Evaluating VLMs’ Understanding of UI Animations (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies of Vision Language Models (VLMs) for UI understanding have focused primarily on static screenshots, leaving it unclear how well these models handle dynamic UI animations.
Approach: They evaluate UI animation models' ability to perceive animation effects and interpret animation meaning . they use motion, context, and perceptual cues to probe factors affecting VLM performance .
Outcome: The proposed model can detect primitive motion, but its interpretation is inconsistent . the proposed model is based on 300 annotated UI animation videos .
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: In the era of evaluating large language models, data contamination is an increasingly prominent concern . static benchmarking has been used for evaluation, but there are limitations of *dynamic* benchmarks .
Approach: They propose a series of optimal design principles for *dynamic* benchmarking and analyze the limitations of existing *static* benchmarks.
Outcome: The proposed benchmarks highlight a critical gap in the evaluation of LLMs.
RLKGF: Reinforcement Learning from Knowledge Graph Feedback Without Human Annotations (2025.findings-acl)

Copied to clipboard

Challenge: Lack of human preference labels remains a significant bottleneck when applying RLHF to a downstream domain.
Approach: They propose a method that leverages human priors encoded in Knowledge Graphs (KGs) to derive RL rewards in the absence of manual annotations.
Outcome: Experiments on three public and one private medical dialogue datasets show that the proposed method outperforms the competitive RLAIF in improving LLM diagnostic accuracy.
Interpreting Sentiment Composition with Latent Semantic Tree (2023.findings-acl)

Copied to clipboard

Challenge: Current researches on sentiment classification are shifting from improving model performance to interpretability.
Approach: They propose a new tree form capable of interpreting sentiment composition in a principled way.
Outcome: The proposed tree can explain sentiment composition in a principled way.
ArchiDocGen: Multi-Agent Framework for Expository Document Generation in the Architectural Industry (2025.acl-industry)

Copied to clipboard

Challenge: drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers .
Approach: They propose a framework that automates method statement generation by using multi-agent collaboration.
Outcome: The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity.
ℛ3: Advertisement Compliance ℛectification via Group-ℛelative Experience Extractor and Curriculum ℛeinforcement (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods of content moderation are infeasible due to over-editing and compromise the advertiser’s original semantic intent.
Approach: They propose a framework to harmonize compliance with original intent preservation that integrates a data-driven framework and a curriculum to enforce compliance while maximizing semantic consistency.
Outcome: The proposed framework outperforms state-of-the-art baselines on industrial datasets and on online A/B testing on industrial video.
Token-wise Curriculum Learning for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing curriculum learning approaches to Neural Machine Translation (NMT) require sampling sufficient amounts of “easy” samples from training data at the early stage of training.
Approach: They propose a token-wise curriculum learning approach that creates sufficient amounts of easy samples from training data.
Outcome: The proposed approach outperforms baselines on five language pairs on low-resource languages.
Instant Personalized Large Language Model Adaptation via Hypernetwork (2026.acl-long)

Copied to clipboard

Challenge: Existing parameter-efficient fine-tuning methods require training a separate adapter for each user, making them computationally expensive and impractical for real-time updates.
Approach: They propose a scalable framework that maps a user's profile directly to a full set of adapter parameters.
Outcome: The proposed framework outperforms prompt-based personalization and OPPU while using substantially fewer computational resources at deployment.
PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers in Overleaf (2026.acl-demo)

Copied to clipboard

Challenge: Emerging AI-powered writing assistants focus on grammar fixes or simulating peer review with final scores, yet they fall short of providing concrete, actionable suggestions that help students improve their papers during drafting.
Approach: They propose a human-centered writing assistant system that delivers actionable suggestions as Overleaf-native inline comments while leaving the actual writing entirely to human authors.
Outcome: The proposed system outperforms a baseline with the skill library and provides actionable suggestions while leaving the actual writing to human authors.
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to design the interaction strategy between large language models and knowledge graphs (KGs) are not effective for large language model (LLM)s to solve complex tasks due to the large volume and structured format of KG data.
Approach: They propose an LLM-based agent framework that enables small LLMs to actively make decisions over knowledge graphs.
Outcome: The proposed framework outperforms existing methods on in-domain and out-domain datasets using 10K samples.
UniConv: Unifying Retrieval and Response Generation for Large Language Models in Conversations (2025.acl-long)

Copied to clipboard

Challenge: Existing conversational search systems are usually built with two different models . this separation restricts the system from leveraging the model's intrinsic knowledge simultaneously . Existing studies for developing unified models cannot fully address the aspects of understanding conversational context, managing retrieval independently, and generating responses.
Approach: They propose to unify dense retrieval and response generation for large language models in conversation by fine-tuning and mitigating data discrepancy.
Outcome: The proposed model can outperform existing models on five conversational search datasets and reduce inconsistency risks while mitigating data discrepancy.
Learning from Sibling Mentions with Scalable Graph Inference in Fine-Grained Entity Typing (2022.acl-long)

Copied to clipboard

Challenge: Existing models struggle to handle hard mentions due to insufficient contexts, limiting their overall typing performance.
Approach: They propose to exploit sibling mentions to enhance the mention representations by adding unseen test mentions as new nodes for inference.
Outcome: The proposed model outperforms ten strong baseline models and outperformed strong baselines.
Spatiotemporal Sycophancy: Negation-Based Gaslighting in Video Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing Vid-LLMs lack robust mechanisms for maintaining grounded spatiotemporal beliefs under conversational feedback.
Approach: They propose a negation-based gaslighting evaluation framework and introduce a benchmark to investigate spatiotemporal sycophancy.
Outcome: The proposed framework evaluates state-of-the-art Vid-LLMs across video understanding tasks.
HiEdit: Lifelong Model Editing with Hierarchical Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to lifelong model editing apply parameter perturbations to static and dense layers for all instances.
Approach: They propose a hierarchical reinforcement learning framework that identifies the most knowledge-relevant layers for each editing instance.
Outcome: The proposed framework boosts the performance of the competitive RLEdit by 8.48% with perturbing only half of the layers per edit.
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents.
Approach: They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Outcome: The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (2021.acl-long)

Copied to clipboard

Challenge: 'lottery tickets' can be trained to match the performance of a full model . subnetwork training can also outperform random sampled subnetworks of the same size .
Approach: They propose to train a subnetwork of 'lottery tickets' to match the full model's performance.
Outcome: The proposed model outperforms subnetworks of the same size in a phase transition phenomenon . the proposed model improves single task fine-tuning by 0.9 points on BERT-base and 1.0 points on GLUE large .
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences.
Approach: They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference .
Outcome: The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks.
Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations (2022.acl-long)

Copied to clipboard

Challenge: Existing studies focus on coarse-grained response selection in retrieval-based dialogue systems.
Approach: They propose a Contextual Fine-to-Coarse (CFC) distilled model for coarse-grained response selection in open-domain conversations.
Outcome: The proposed model improves over baseline methods on two datasets based on the Reddit comments dump and Twitter corpus compared with baseline methods.
Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Cantonese is considered a low-resource language due to the dominance of Mandarin . rich colloquial vocabulary of Cantone, English loanwords, and code-switching characteristics add to the complexity of corpus collection and processing.
Approach: We collect Cantonese texts from open source corpora, Hong Kong-specific forums, Wikipedia . we refine the model through supervised fine-tuning on curated Cantonesian tasks .
Outcome: The model achieves state-of-the-art (SOTA) performance on four Cantonese benchmarks.
Reliable Use of Lemmas via Eligibility Reasoning and Section-Aware Reinforcement Learning (2026.acl-short)

Copied to clipboard

Challenge: Recent large language models (LLMs) perform strongly on mathematical benchmarks but often import conclusions without validating assumptions.
Approach: They propose a model that encodes a lemma specification and trains with reinforcement learning and section-aware loss masking to assign penalty to the section responsible for errors.
Outcome: The proposed model performs well on benchmarks but often misapplyes lemmas . the model is able to encode the specification and train with reinforcement learning .
EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering (2026.acl-long)

Copied to clipboard

Challenge: Entropy-Guided Stepwise Scaling (EGSS) is a novel TTS framework for software engineering tasks.
Approach: They propose an entropy-guided stepwise scaling framework that balances efficiency and effectiveness through entropic-guide encoding and robust test-suite augmentation.
Outcome: EGSS boosts performance by 5–10% across all evaluated models, and reduces inference-time token usage by over 28% . compared to existing methods, EGS reduces token usage and reduce inference time by over 20% .
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models (2026.acl-long)

Copied to clipboard

Challenge: a recent study evaluated large audio-language models against jailbreak attacks . a new benchmark is being developed to evaluate LAM safety against jailbreaking attacks based on temporal and semantic nature of speech .
Approach: They propose a benchmark to evaluate LAM jailbreak vulnerabilities in adversarial audio prompts . they use a dataset of 1,495 adversarials to evaluate their performance .
Outcome: The proposed benchmark evaluates state-of-the-art LAMs against jailbreak attacks . it demonstrates that even small, semantically preserved perturbations can reduce safety .
CLEAR: A Clinically Grounded Tabular Framework for Radiology Report Evaluation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing metrics lack the granularity and interpretability to capture nuanced clinical differences between candidate and ground-truth radiology reports.
Approach: They propose a tabular framework with E**xpert-curated labels and an attribute-level comparison for radiology report evaluation (**CLEAR)
Outcome: The proposed framework can extract clinical attributes and provide automated metrics that are strongly aligned with clinical judgment.
GhostBERT: Generate More Features with Cheap Operations for BERT (2021.acl-long)

Copied to clipboard

Challenge: Existing studies show that some parameters in pre-trained language models can be pruned away without severe accuracy degradation.
Approach: They propose a method which generates more features with very cheap operations from the remaining features and can be applied to unpruned BERT models to enhance their performance.
Outcome: Empirical results on the GLUE benchmark on three backbone models (i.e., BERT, RoBERTa and ELECTRA) verify the efficacy of the proposed method.
Align Voting Behavior with Public Statements for Legislator Representation Learning (2021.acl-long)

Copied to clipboard

Challenge: Existing studies rely on roll call data to estimate political preference of legislators.
Approach: They propose to integrate voting behavior and public statements on Twitter to jointly model legislators.
Outcome: The proposed model improves on the task of roll call vote prediction . it also shows that the model captures nuances in statements .
AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning (2024.acl-long)

Copied to clipboard

Challenge: Existing language agent systems struggle with costly data reliance and need multiple models for multiple functions.
Approach: They propose an automatic agent learning framework for QA that synthesizes planning trajectories without human intervention.
Outcome: The proposed framework outperforms existing models on question-answering tasks with a division-of-labor strategy.
Are Large Language Models Capable of Generating Human-Level Narratives? (2024.emnlp-main)

Copied to clipboard

Challenge: a recent HCI study has pointed to gaps in machine storytelling ability at the global level . authors show that LLMs have less suspense and less tension than human stories .
Approach: They propose a computational framework to analyze narratives through three discourse-level aspects.
Outcome: The proposed framework analyzes narratives through three discourse-level aspects . it shows that LLMs fall short of human abilities in discourse understanding .
LV-BERT: Exploiting Layer Variety for BERT (2021.findings-acl)

Copied to clipboard

Challenge: Modern pre-trained language models are mostly built upon stereotyped development sets . LV-BERT model obtained by our method outperforms BERT on various downstream tasks .
Approach: They propose to exploit layer variety from the layer type set and the layer order to improve pre-trained models.
Outcome: The proposed model outperforms BERT and its variants on various downstream tasks.
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts.
Approach: They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts.
Outcome: The proposed model outperforms existing models on all evaluation datasets.
LINKED: Eliciting, Filtering and Integrating Knowledge in Large Language Model for Commonsense Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) often exhibit poor performance on knowledge-intensive tasks, such as commonsense reasoning.
Approach: They propose a method to elicit, filter and integrate knowledge in large language models (LINKED) they propose 'reward model' to filter out noisy knowledge and 'take marginal consistent reasoning module'
Outcome: The proposed method outperforms SOTA baselines on two commonsense reasoning tasks.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
HuatuoGPT, Towards Taming Language Model to Be a Doctor (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases.
Approach: They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage.
Outcome: The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources.
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models have shown remarkable memory formation, but vanilla networks without pre-training suffer catastrophic forgetting problem.
Approach: They conduct experiments to investigate the retentive-forgetful contradiction between vanilla and pre-trained language models by controlling the target knowledge types, learning strategies and learning schedules.
Outcome: The results show that pre-trained language models are forgetful and pre-training leads to retentive models .
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons.
Approach: They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation .
Outcome: The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation .
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question .
Approach: They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance .
Outcome: The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered .
ProLongVid: A Simple but Strong Baseline for Long-context Video Instruction Tuning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adapt image-focused models for video understanding have not been successful in analyzing long video sequences.
Approach: They propose a video instruction dataset that outperforms existing video instruction data for fine-tuning MLLMs by incrementally increasing input context length.
Outcome: The proposed model outperforms existing models on video benchmarks and outperformed proprietary models on VideoMME even with a compact 7B model.
Teaching According to Talents! Instruction Tuning LLMs with Competence-Aware Curriculum Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Efficient instruction tuning aims to enhance the ultimate performance of large language models (LLMs) current methods suffer from the curriculum rigidity, resulting in a fixed and potentially sub-optimal learning trajectory.
Approach: a framework for efficient instruction tuning is proposed to address the issue of curriculum rigidity . current methods rely on static heuristic difficulty metrics and fail to adapt to evolving capabilities .
Outcome: Efficient instruction tuning aims to enhance the ultimate performance of large language models . current methods suffer from the curriculum rigidity, resulting in a fixed learning trajectory .
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach: They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome: The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.
Explore, Propose, and Assemble: An Interpretable Model for Multi-Hop Reading Comprehension (P19-1)

Copied to clipboard

Challenge: Existing models for multi-hop reading comprehension only require a single-hop reasoning, meaning that the evidence needed to answer the question is scattered in a set of supporting documents.
Approach: They propose an interpretable 3-module system called Explore-Propose-Assemble reader (EPAr) that explores and connects relevant information from multiple documents in order to answer a question about the context.
Outcome: The proposed model approximates coarse-to-fine-grained comprehension behavior of human readers when facing multiple long documents.
ARM: An Alignment-and-Replacement Module for Chinese Spelling Check Based on LLMs (2024.emnlp-main)

Copied to clipboard

Challenge: Chinese Spelling Check (CSC) aims to identify and correct spelling errors in Chinese texts, where enhanced semantic understanding of a sentence can significantly improve correction accuracy.
Approach: They propose a plug-and-play Alignment-and -Replacement module that enhances existing Chinese CSC models without retraining or fine-tuning.
Outcome: The proposed module improves existing models while reducing retraining and fine-tuning.
Aerial Vision-and-Dialog Navigation (2023.findings-acl)

Copied to clipboard

Challenge: Aerial visionand-dialling navigation (AVDN) is a new approach to autonomous drones that can converse with humans and follow natural language commands to complete tasks.
Approach: They propose to use Aerial Visionand-Dialog Navigation (AVDN) to navigate a drone via natural language conversation by collecting a dataset of over 3k recorded navigation trajectories with asynchronous human-human dialogs between commanders and followers.
Outcome: The proposed system can converse with humans and follow natural language commands to fly to the expected destination.
RORA: Robust Free-Text Rationale Evaluation (2024.acl-long)

Copied to clipboard

Challenge: Existing metrics rely on degree to which rationale supports a label, but they fail to evaluate rationales that inadvertently leak the label.
Approach: They propose a RObust free-text RAtionale evaluation against label leakage that quantifies the new information supplied by a rationale to justify the label.
Outcome: The proposed evaluation outperforms existing methods in evaluating human-written, synthetic, or model-generated rationales, particularly demonstrating robustness against label leakage.
Convert Language Model into a Value-based Strategic Planner (2025.acl-industry)

Copied to clipboard

Challenge: Emotional support conversation (ESC) aims to alleviate the emotional distress of individuals through effective conversations.
Approach: They propose a framework that bootstraps the planning during ESC and determines the optimal strategy based on long-term returns.
Outcome: The proposed framework outperforms baseline models on ESC datasets and can be used to guide the LLM to response.
Code Execution with Pre-trained Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Pre-trained code intelligence models ignore the execution trace and only rely on source code and syntactic structures to understand code execution.
Approach: They develop a mutation-based data augmentation technique to create a Python dataset and task for code execution that challenges existing models.
Outcome: The proposed model outperforms existing models on code execution and shows its potential for zero-shot code-to-code search and text-to code generation.
MCPG: A Flexible Multi-Level Controllable Framework for Unsupervised Paraphrase Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on controllable unsupervised paraphrase generation are expensive and require supervised training on large parallel corpora.
Approach: They propose a method for controllable unsupervised paraphrase generation that is flexible to adapt to specific domains without extra training.
Outcome: The proposed method outperforms state-of-the-art unsupervised baselines by a margin.
Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templates (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have strong reasoning and tool-use capabilities, yet fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent.
Approach: They propose a curriculum-inspired framework that leverages structured reasoning templates to guide LLMs through more deliberate step-by-step instructions for generating function calls.
Outcome: The proposed framework reduces tool-use errors and improves interpretability and transparency of tool-using agents.
OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated remarkable progress in machine writing such as open domain long-form generation.
Approach: They propose a slow-thinking machine writing framework that emulates the human-like process of iterative expansion and reflection to improve the knowledge density of generated articles.
Outcome: The proposed framework improves the knowledge density of generated articles without compromising metrics such as coherence and depth.
When Generative Adversarial Networks Meet Sequence Labeling Challenges (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches for sequence labeling use a feature extractor and sequence tagger . a recent study shows that SLGAN is versatile and highly effective .
Approach: They propose a framework that harnesses the capabilities of Generative Adversarial Networks to address sequence labeling challenges.
Outcome: The proposed framework exhibits strong adaptability to various sequence labeling tasks.
Why Did Apple Fall: Evaluating Curiosity in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating curiosity-like behaviors in large language models lack curiosity-inspired features.
Approach: They propose a psychology-inspired framework to evaluate curiosity in large language models . they adapt the Five-Dimensional Curiosity scale Revised (5DCR) to LLMs .
Outcome: The proposed framework evaluates curiosity in large language models using questionnaires and behavioral studies.
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard.
Approach: They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system.
Outcome: The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De.
HyperText: Endowing FastText with Hyperbolic Geometry (2020.findings-emnlp)

Copied to clipboard

Challenge: Empirically, we show that HyperText outperforms FastText on a range of text classification tasks with much reduced parameters.
Approach: They propose a model that uses hyperbolic geometry to model tree-like hierarchies in natural language sentences by embedding words or ngrams in hyperbolical space.
Outcome: Empirically, the proposed model outperforms FastText on a range of text classification tasks with much reduced parameters.
Accurate Word Alignment Induction from Neural Machine Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Prior work suggests that Transformer captures poor word alignments through its attention mechanism.
Approach: They propose two new word alignment induction methods that use attention weights to capture accurate word alignments.
Outcome: The proposed methods outperform baselines on three publicly available datasets and are significantly better than GIZA++.
SeCuRepair: Semantics-Aligned, Curriculum-Driven, and Reasoning-Enhanced Vulnerability Repair Framework (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for automating vulnerability repair suffer from syntactic overfitting . nvd published 49,230 Common Vulnerabilities and Exposures (CVE) records in 2025 alone .
Approach: They propose a semantic-aware reward framework that optimizes for code semantic equivalence rather than lexical mimicry.
Outcome: The proposed framework outperforms state-of-the-art frameworks on repository-level splits . it incorporates expert-aligned reasoning mechanism that grounds patch generation in structured diagnosis.
ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling (2026.acl-long)

Copied to clipboard

Challenge: Recent efforts on text-to-audio generation are exploring fine-grained controllability . however, their performance at scale is limited due to data scarcity .
Approach: They propose a multi-task learning problem for high-controllability text-to-audio generation . they propose scalable diffusion transformers that augment condition information in sequence .
Outcome: The proposed method outperforms existing methods on objective and subjective evaluations.
ReMedi: Reasoner for Medical Clinical Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to predicting future clinical outcomes from EHRs focus on enhancing medical knowledge through distillation or RAG while relying on the model’s internal ability to interpret contextual information.
Approach: They propose a framework for improving clinical outcome prediction from EHR using a sample regeneration mechanism that leverages ground-truth answers as hints to enhance reasoning.
Outcome: Experiments on multiple EHR prediction tasks show significant gains of up to 19.9% over state-of-the-art baselines in terms of F1 score, underscoring ReMedi’s effectiveness in real-world clinical prediction.
Too Good to be Bad: On the Failure of LLMs to Role-Play Villains (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly tasked with creative generation, but their ability to portray non-prosocial, antagonistic personas remains largely unexamined.
Approach: They propose a moral alignment benchmark to test the safety of large language models . they find that models struggle with traits directly antithetical to safety principles .
Outcome: The proposed model fails to accurately portray morally ambiguous or villainous characters . the model fails most with traits directly antithetical to safety principles .
Dataset and Enhanced Model for Eligibility Criteria-to-SQL Semantic Parsing (2020.lrec-1)

Copied to clipboard

Challenge: Clinical trials require that patients meet eligibility criteria to ensure safety and effectiveness of studies.
Approach: They propose a dataset that includes the first-of-its-kind eligibility-criteria corpus and queries for criteria-to-sql . they propose 'neuro semantic parser' which can translate eligibility criteria to executable SQL queries .
Outcome: The proposed parser outperforms existing state-of-the-art general-purpose models while highlighting the challenges presented by the new dataset.
ARCH: Efficient Adversarial Regularized Training with Caching (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to regularize models require generating a perturbation for each sample in each epoch.
Approach: They propose an adversarial regularization method where perturbations are generated and cached once every several epochs.
Outcome: The proposed method significantly eases the computational burden (saves up to 70% of computational time) it produces a notably better (in most of the tasks) or comparable model generalization.
CORAL: Learning Consistent Representations across Multi-step Training with Lighter Speculative Drafter (2025.acl-long)

Copied to clipboard

Challenge: Existing methods that focus on training and inference suffer from misalignment . speculative decoding is a powerful technique that accelerates large language models .
Approach: They propose a framework that improves both accuracy and efficiency in speculative drafting by using cross-step representational alignment.
Outcome: The proposed framework outperforms existing methods on three LLM families and three benchmark datasets.
No More Stale Feedback: Co-Evolving Critics for Open-World Agent Learning (2026.acl-long)

Copied to clipboard

Challenge: Current methods for training Large Language Model agents rely on static or offline critic models, which fail to adapt as the policy evolves.
Approach: They propose a framework that integrates a critique and a policy to optimize the policy and critic through a synchronized co-evolutionary loop.
Outcome: The proposed framework yields more stable training and higher long-horizon task success across open-world environments.
VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation (2026.acl-long)

Copied to clipboard

Challenge: Multimodal large language models have advanced rapidly, yet most remain English-centric . scaling multilingual multimodal instruction tuning is limited by the scarcity and high cost of non-English image–text supervision.
Approach: They propose a framework that decouples multilingual language enhancement from visual alignment by composing complementary task vectors over a shared LLM backbone.
Outcome: The proposed framework achieves competitive performance with a fully multimodally trained model using less than 2% of the text data.
Towards Omni-RAG: Comprehensive Retrieval-Augmented Generation for Large Language Models in Medical Applications (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to source planning fail to achieve this due to misalignment between the model’s expectation of the sources and their actual content.
Approach: They propose a method to optimise large-scale medical knowledge models by combining multiple medical knowledge sources into one query.
Outcome: The proposed method significantly improves multi-source planning performance while training a smaller model to learn source alignment.
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)

Copied to clipboard

Challenge: Foundational models and their checkpoints have advanced deep learning, boosting performance across applications.
Approach: They propose a method for pruning fine-tuned models by calculating differences between them and original model.
Outcome: The proposed method can improve performance across vision, NLP, and multi-modal benchmarks.
When Efficiency Meets Safety: A Benchmark Security Analysis of KV Cache Compression in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Key-Value (KV) caching is widely used in large language models to enable long-context inference efficiently, yet its security implications remain underexplored.
Approach: They propose a history-aware, per-head feedback merging strategy that prevents safety degradation while maintaining efficiency.
Outcome: The proposed strategy prevents safety degradation while maintaining efficiency.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in open-source Large Language Models (LLMs) have achieved notable successes in natural language processing.
Approach: They propose a Parameter Efficient Fine-Tuning paradigm for improved fine-tuning and parameter efficiency in multi-task learning.
Outcome: The proposed model outperforms existing methods on multi-task learning while reducing training costs by over 80% without losing general capability.
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to predict event sequences are complex and ignore the knowledge of external events.
Approach: They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events.
Outcome: The proposed model outperforms existing methods on an event sequence prediction task.
Lion: Adversarial Distillation of Proprietary Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for transferring knowledge from a proprietary large language model to an open-source LLM have been criticized for not incorporating any feedback to boost student model's proficiency iteratively.
Approach: They propose a novel adversarial distillation framework that integrates feedback to identify challenging instructions where the student model’s performance falls short.
Outcome: The proposed framework surpasses existing state-of-the-art LLMs by 55.4% in challenging zero-shot reasoning benchmarks and 16.7% on AGIEval.
Exploring the Capability Boundaries of LLMs in Mastering of Chinese Chouxiang Language (2026.findings-acl)

Copied to clipboard

Challenge: Current state-of-the-art LLMs exhibit clear limitations on multiple tasks, while performing well on tasks that involve contextual semantic understanding.
Approach: They propose a mouse-based benchmark to evaluate LLMs' performance on NLP tasks involving Chouxiang Language.
Outcome: The proposed benchmark evaluates the performance of LLMs on six NLP tasks involving Chouxiang Language.
Ensembling Prompting Strategies for Zero-Shot Hierarchical Text Classification with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Hierarchical text classification is a challenging task in natural language processing.
Approach: They propose a method which integrates the results of diverse prompting strategies to promote LLMs’ reliability.
Outcome: The proposed method boosts the performance of single prompting strategies and achieves SOTA results on three benchmark datasets.
LoRA Meets Dropout under a Unified Framework (2024.findings-acl)

Copied to clipboard

Challenge: Parameter-efficientfinetuning (PEFT) has gained popularity as a lightweight approach for model customization.
Approach: They propose a parameter-efficient dropout method that is overfitting-prone and parameter-freezed.
Outcome: The proposed method is superior to existing methods and compares with transformer-specific methods.
ReLayout: Towards Real-World Document Understanding via Layout-enhanced Pre-training (2025.coling-main)

Copied to clipboard

Challenge: Recent approaches for visually-rich document understanding use manually annotated semantic groups.
Approach: They propose a new variant of the VrDU task that does not use manually annotated semantic groups.
Outcome: The proposed method improves on the existing methods while sacrificing performance.
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering (2021.acl-demo)

Copied to clipboard

Challenge: Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA.
Approach: They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer .
Outcome: The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark.
Linguistic Rule Induction Improves Adversarial and OOD Robustness in Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Existing large language models (LLMs) do not perform satisfactorily in OOD and adversarial robustness evaluations.
Approach: They propose to use linguistic rule induction to fine-tune large language models with linguistic rules to achieve better adversarial and OOD robustness.
Outcome: The proposed model achieves comparable or better results with GPT-3.5 and GPT-4 on various adversarial and OOD robustness evaluations.
PHMOSpell: Phonological and Morphological Knowledge Guided Chinese Spelling Check (2021.acl-long)

Copied to clipboard

Challenge: False gram and phonological errors make Chinese spelling check difficult . a novel end-to-end trainable model outperforms existing methods .
Approach: They propose a trainable Chinese spelling check model that integrates phonological and visual information into a pre-trained language model.
Outcome: The proposed model outperforms existing state-of-the-art models on three benchmarks.
An Empirical Study on Multiple Information Sources for Zero-Shot Fine-Grained Entity Typing (2021.emnlp-main)

Copied to clipboard

Challenge: Auxiliary information from multiple sources has been demonstrated to be effective in zero-shot fine-grained entity typing (ZFET) however, there is no comprehensive understanding of how to make better use of the existing information sources and how they affect the performance of ZFET.
Approach: They propose a multi-source fusion model targeting auxiliary information from multiple sources to improve zero-shot fine-grained entity typing (ZFET)
Outcome: The proposed model achieves 11.42% and 22.84% gains over state-of-the-art baselines on BBN and Wiki respectively with regard to macro F1 scores.
ACECODER: Acing Coder RL via Automated Test-Case Synthesis (2025.acl-long)

Copied to clipboard

Challenge: Recent coder models have been driven by supervised fine-tuning, but the potential of reinforcement learning remains unexplored due to the lack of reliable reward data/model in the code domain.
Approach: They propose a pipeline that generates extensive test-case pairs from existing code data and constructs preference pairs based on pass rates over sampled programs.
Outcome: The proposed pipeline generates extensive (question, test-cases) pairs from existing code data and trains them with Bradley-Terry loss.
DoG-Instruct: Towards Premium Instruction-Tuning Data via Text-Grounded Instruction Wrapping (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods to collect high-quality instruction-response pairs suffer from unaffordable labor costs or severe hallucinations in the self-generation of LLMs.
Approach: They propose a method that trains LLMs to generate instruction-response pairs based on human-written documents rather than relying solely on self-generation without context.
Outcome: The proposed method outperforms existing typical methods on multiple benchmarks and shows that it is 100% scalable.
Enriching Word Embeddings with Domain Knowledge for Readability Assessment (C18-1)

Copied to clipboard

Challenge: Existing word embedding models focus on syntactic or semantic relations of words, while ignoring reading difficulty.
Approach: They propose a method which learns the word embedding for readability assessment . they extract the knowledge on word-level difficulty from three perspectives to construct a knowledge graph .
Outcome: The proposed method is effective and potential, the authors show . they use the knowledge-enriched word embedding model on English and Chinese datasets .
LM2Protein: A Structure-to-Token Protein Large Language Model (2025.findings-emnlp)

Copied to clipboard

Challenge: RNA-binding proteins are critical for various molecular functions, relying on their precise tertiary structures.
Approach: They propose a method to integrate protein 3D structural data within a sequence processing framework.
Outcome: The proposed method achieves high sequence recovery in inverse folding and protein-conditioned RNA design.
VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing video metrics are lagging behind in providing reliable scores over generated videos due to lack of large-scale human-annotated dataset.
Approach: They propose to use VideoFeedback to train a human-annotated multi-aspect score over 37.6K synthesized videos from 11 existing video generative models.
Outcome: The proposed model outperforms the prior best metrics by 50 points in the test.
LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have extended context windows through scaling positional encodings and lightweight continual pre-training, but performance degradation is still not fully explored.
Approach: They propose a novel approach to reduce short-text performance degradation by minimizing distribution drift in hidden states and attention scores.
Outcome: The proposed approach minimizes the distribution discrepancy between the extended and original models while maintaining or even enhancing the model's long-context abilities.
SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) language models are a dominant paradigm in the field of parallelism and non-causal modeling.
Approach: They propose a blockwise discrete diffusion model that preserves AR-compatible serving while enabling parallel intra-block generation.
Outcome: The proposed model achieves theoretical speedups over 5 and wall-clock speedup of 2.3 on H200 GPUs in latency-critical regimes.
MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have made significant progress in natural language understanding and generation, proving valuable especially in the medical field.
Approach: They propose a medical LLM through decoupling Clinical Alignment and Knowledge Aggregation which uses a and a to encode diverse knowledge in the first stage and filter out detrimental information.
Outcome: The proposed model achieves promising performance on over 20 medical tasks and specific medical alignment tasks.
FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) are prone to misuse and misinformation, posing serious compliance risks.
Approach: They propose a bilingual red-teaming benchmark to test an LLM’s refusal of requests that violate financial compliance.
Outcome: The proposed benchmark is based on real-world financial crime cases and ethical violations and includes 14 subcategories covering financial crimes and ethical breaches.
Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have evolved from statistical sequence predictors to sophisticated autonomous agents capable of reasoning, planning, and sustaining multi-turn conversa-tions.
Approach: They propose a system that instantiates a "Sentient Agent" that simulates human-like emotional changes and inner thoughts to provide a more realistic evaluation of the model in multi-turn conversations.
Outcome: The proposed framework measures the agent's higher-order social cognition in multi-turn conversations.
Dynamic Retriever for In-Context Knowledge Editing via Policy Optimization (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models excel at factual recall yet propagate stale or incorrect knowledge.
Approach: They propose a framework that allows users to rank demonstrations by editing reward . it uses a *learnable threshold* to prune low-value examples, reducing edit success by 17.1% .
Outcome: The proposed framework improves edit success by 17.1% and reduces latency by 41.6% on the CounterFact benchmark.
Language-Coupled Reinforcement Learning for Multilingual Retrieval-Augmented Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multilingual retrieval-augmented generation (MRAG) use a single-turn retrieval and subsequent optimization to acquire and integrate beneficial external knowledge from multilingual collections.
Approach: They propose a multilingual search-augmented reinforcement learning framework that integrates a language-coupled Group Relative Policy Optimization into the policy and reward models.
Outcome: The proposed framework achieves competitive performance and is appropriate for various practical scenarios such as constrained training data and retrieval over collections encompassing a large number of languages.
Toward Safe and Human-Aligned Game Conversational Recommendation via Multi-Agent Decomposition (2026.findings-eacl)

Copied to clipboard

Challenge: Existing systems for conversational recommender systems (CRS) have strong results in movies, but games present distinct challenges . MATCHA framework provides specialized agents for intent parsing, tool-augmented retrieval, multi-LLM ranking, and stronger safety.
Approach: They propose a framework for conversational recommender systems that assigns specialized agents for intent parsing, tool-augmented retrieval, multi-LLM ranking and risk control.
Outcome: MATCHA outperforms baselines on real user request dataset, improves Hit@5 by 20%, reduces popularity bias by 24%, and achieves 97.9% adversarial defense.
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios .
Approach: They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios.
Outcome: The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm.
The Linguistic Connectivities Within Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have discovered notable disparities in their performance across different languages.
Approach: They conduct a systematic investigation into the behaviors of large language models across 27 different languages on 3 different scenarios and reveals a Linguistic Map correlates with the richness of available resources and linguistic family relations.
Outcome: The proposed model demonstrates that there are significant disparities in performance across languages across 27 different languages on 3 different scenarios.
Toward Automated Robustness Evaluation of Mathematical Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing robustness evaluations rely on hand-crafted templates or a limited set of perturbation rules, resulting in model failure.
Approach: They propose a framework inspired by software stress testing that generates adversarial variants via a multi-round rewrite-verify loop, ensuring semantic consistency while successfully inducing model failure.
Outcome: The proposed framework generates adversarial variants dynamically for each LLM, minimizing the risk of data contamination.
HICD: Hallucination-Inducing via Attention Dispersion for Contrastive Decoding to Mitigate Hallucinations in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect.
Approach: They propose a method that selects attention heads crucial to the model's prediction as inducing heads and induces hallucinations by dispersing attention of these inducers.
Outcome: The proposed method significantly improves performance on tasks requiring contextual faithfulness, reading comprehension, and question answering.
Dream to Chat: Model-based Reinforcement Learning on Dialogues with User Belief Modeling (2025.findings-emnlp)

Copied to clipboard

Challenge: a framework for constructing dialogue world models for natural language tasks is currently lacking.
Approach: They propose a framework that can be used to train a dialogue world model.
Outcome: The proposed framework can predict future utterances and user beliefs . it can achieve state-of-the-art performance on emotion classification and sentiment identification .
READoc: A Unified Benchmark for Realistic Document Structured Extraction (2025.findings-acl)

Copied to clipboard

Challenge: Document Structured Extraction (DSE) is a field of document structure analysis that aims to extract structured content from raw documents.
Approach: They propose a benchmark to evaluate document structured extraction systems by converting unstructured PDFs into semantically rich Markdown.
Outcome: The proposed benchmark is based on 3,576 diverse and real-world documents from arXiv, GitHub, and Zenodo.
KCS: Diversify Multi-hop Question Generation with Knowledge Composition Sampling (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to multi-hop question answering focus on generating simple questions and neglecting the integration of essential knowledge, such as relevant sentences within documents.
Approach: They propose a framework to expand the diversity of generated multi-hop questions by sampling varied knowledge compositions within a given context.
Outcome: The proposed framework improves the overall accuracy of knowledge composition selection by 3.9% on hotpotQA and 2WikiMultihopQA datasets.
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)

Copied to clipboard

Challenge: prevailing pre-training approaches for large language models involve several complexities.
Approach: They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data .
Outcome: The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data .
Humans or LLMs as the Judge? A Study on Judgement Bias (2024.emnlp-main)

Copied to clipboard

Challenge: Proprietary models such as GPT-4, Claude, Gemini-Pro and others are being democratized to improve evaluations of LLMs.
Approach: They propose a framework that is free from referencing groundtruth annotations for investigating **Misinformation Oversight Bias**, **Gender Bia**,**Authority Bia* and **Beauty Bia's** on LLM and human judges.
Outcome: The proposed framework investigates **Misinformation Oversight Bias**, **Gender Bia**,**Authority Bia* and **Beauty Bia' on LLM and human judges.
Structure-aware Domain Knowledge Injection for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Structure-aware Continual Pre-Training (SCPT) and Structure-Aware Supervised Fine-Tuning (SSFT) are two-stage strategies for knowledge injection and alignment that reduces the training corpus needs to 5% while achieving 100% of traditional knowledge injection performance.
Approach: They propose a method to efficiently transform foundation Large Language Models into domain specialists by using two-stage strategies: Structure-aware Continual Pre-Training and Structure-Aware Supervised Fine-Tuning.
Outcome: The proposed method significantly reduces the training corpus needs to a mere 5% while achieving 100% of traditional knowledge injection performance.
SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems (2025.findings-acl)

Copied to clipboard

Challenge: SciVerse is a multi-modal scientific evaluation benchmark to assess large multi-models . it examines the scientific knowledge comprehension, multi-mod content interpretation and Chain-of-Thought reasoning . authors examine the scientific proficiency of LMMs in scientific domains based on their work .
Approach: They propose a multi-modal scientific evaluation benchmark to thoroughly assess Large Multi-modal Models across 5,735 test instances in five different versions.
Outcome: The proposed evaluation reveals critical limitations in LMMs' scientific proficiency and provides new insights into future developments.
Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge (2025.acl-long)

Copied to clipboard

Challenge: Existing methods rely on majority voting or criteria expansion to capture detailed and detailed details, often leading to incomplete outcomes.
Approach: They propose a method which introduces additional crowd responses to compare with the candidate responses, thereby exposing deeper and more comprehensive details within the candidate answers.
Outcome: Experiments show that the proposed method improves evaluation reliability and achieves an average gain of 6.7% across five benchmarks.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
Optimizing Packing and Shuffling Strategies for Enhanced Performance in Generative Language Models (2026.acl-srw)

Copied to clipboard

Challenge: Documents are typically concatenated to chunks of maximum sequence length (MSL) and shuffled in chunks (atom-size chunks).
Approach: They propose to pack and shuff documents in chunks of tokens to prevent overfitting . they also propose to use padding to only include one document per chunk .
Outcome: The proposed method reduces the risk of overfitting and improves generalizability.
All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection (2026.acl-long)

Copied to clipboard

Challenge: RFC-Bench evaluates large language models on financial misinformation under realistic news . current models struggle to maintain coherent belief states without external grounding, study finds .
Approach: They propose a benchmark for evaluating large language models on financial misinformation under realistic news.
Outcome: The proposed model performs better when context is available, while reference-free settings expose significant weaknesses.
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation (2021.acl-demo)

Copied to clipboard

Challenge: Existing models for pre-training are not convenient for users to find and set them up.
Approach: They propose to extend ProphetNet into other domains and languages by pre-training models . they pre-train a cross-lingual generation model ProphetNet-Multi and a Chinese generation model .
Outcome: The proposed models achieve new state-of-the-art on 10 benchmarks.
Unexpected Phenomenon: LLMs’ Spurious Associations in Information Extraction (2024.findings-acl)

Copied to clipboard

Challenge: Information extraction (IE) tasks require a limited number of example instructions to achieve effective performance.
Approach: They propose two strategies to find spurious associations in large language models (LLMs) they use forward label extension and backward label validation to leverage extended labels to improve model performance.
Outcome: The proposed methods improve performance on Chinese and English datasets and 9.55%, 11.42%, and 21.27% in F1 scores on SciERC, ACE05, and DuEE datasets.
Reasoning Graph Enhanced Exemplars Retrieval for In-Context Learning (2025.coling-main)

Copied to clipboard

Challenge: Existing methods focus on semantic similarity between queries and candidate exemplars, while logical connections between reasoning steps can be beneficial to depict problem-solving process.
Approach: They propose a method to retrieve exemplars with semantic and structural similarity using a graph kernel.
Outcome: The proposed method is superior to state-of-the-art retrieval-based approaches on mathematics and logical reasoning tasks.
BBScoreV2: Learning Time-Evolution and Latent Alignment from Stochastic Representation (2025.emnlp-main)

Copied to clipboard

Challenge: Autoregressive generative models are gaining traction in language tasks such as text generation and machine translation.
Approach: They propose a likelihood-based evaluation metric that fits transformer-based model embeddings into a stochastic process and propose it as a probability-based metric.
Outcome: The proposed model embeddings induce a "clustered-to-temporal ordered" mapping of language model representations in high-dimensional space, and this structure enhances performance on tasks such as temporal consistency evaluation and AI-generated content detection.
Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings . attribution under visual confounding is a central challenge in measuring social bias .
Approach: They propose a face-only counterfactual evaluation paradigm that isolates demographic effects while preserving real-image realism.
Outcome: The proposed paradigm isolates demographic effects while preserving real-image realism.
Thought-Action Graph Reasoning: Faithful and Efficient Reasoning of Large Language Models via Reusing Past Experience (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs with LLMs suffer from poor generalization or low reasoning efficiency.
Approach: They propose a thought-action Graph (TAG) that decomposes LLM-KG interaction trajectories into fine-grained semantic operators and guides LLM to execute on them.
Outcome: The proposed paradigm outperforms state-of-the-art methods on KGQA benchmarks while reducing the number of LLM calls and generated tokens.
Sticker-TTS: Learn to Utilize Historical Experience with a Sticker-driven Test-Time Scaling Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Large reasoning models have exhibited strong performance on complex reasoning tasks, but current test-time scaling methods rely on redundant sampling and ignore historical experience utilization.
Approach: They propose a test-time scaling framework that coordinates three collaborative LRMs to iteratively explore and refine solutions guided by historical attempts.
Outcome: The proposed framework surpasses strong baselines on three mathematical reasoning benchmarks, including AIME-24, AIME-25, and OlymMATH.
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption (2022.findings-acl)

Copied to clipboard

Challenge: enabling pre-trained models inference on ciphertext data is difficult due to the complex computations in transformer blocks.
Approach: They propose an approximation approach for transformers which enables inference on ciphertext data.
Outcome: The proposed approach can infer pre-trained models on encrypted data with negligible performance drop but enjoy theory-guaranteed privacy-preserving advantage.
Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on single-turn scenarios, which might lack the ability to handle multi-turn interactions.
Approach: They propose a conversational agent that interleaves search and reasoning across turns and provides tailored rewards towards evolving user goals.
Outcome: The proposed agent interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training with tailored rewards towards evolving user goals.
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching (2025.acl-long)

Copied to clipboard

Challenge: Existing methods focus on disentangling speakers and content, while others focus on preserving the source's prosody.
Approach: They propose a rhythm-controllable and efficient zero-shot voice conversion model that transforms the source speaker’s timbre into an unseen one while retaining speech content.
Outcome: The proposed model adapts the linguistic content duration to the desired speaking style, facilitating the transfer of the target speaker’s rhythm.
UrbanLLM: Autonomous Urban Activity Planning and Management with Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: UrbanLLM is a fine-tuned large language model designed to tackle diverse urban problems.
Approach: They propose a fine-tuned large language model to tackle diverse urban problems . UrbanLLM decomposes urban-related queries into manageable sub-tasks .
Outcome: The proposed model outperforms existing models in urban planning and management tasks.
Learning to Ground Visual Objects for Visual Dialog (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to ground visual objects are inadequate for visual dialog . a posterior distribution is inferred from context and questions, while posterior distributions are used to facilitate visual objects grounding.
Approach: They propose a method to learn to ground visual objects for visual dialog using prior and posterior distributions over visual objects to facilitate visual objects grounding.
Outcome: The proposed approach improves the existing models in generative and discriminative settings by a significant margin.
On the Impact of Cross-Domain Data on German Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Traditionally, large language models have been trained on general web crawls or domain-specific data.
Approach: They present a German dataset and a dataset aimed at containing high-quality data to examine the importance of data diversity over quality.
Outcome: The proposed model outperforms models trained on quality data on multiple downstream tasks.
Smart-Searcher: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-augmented generation (RAG) helps by injecting external information, but current methods are costly, generalize poorly, or ignore the model’s internal knowledge.
Approach: They propose a framework to train large language models to leverage both internal and external knowledge sources.
Outcome: The proposed framework outperforms existing methods and achieves efficient retrieval-augmented reasoning.
UniMoE-Audio: Unified Speech and Music Generation with Dynamic-Capacity Mixture-of-Experts (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in unified multimodal models indicate a clear trend towards comprehensive content generation.
Approach: They propose a unified speech and music generation model built upon a novel framework . they propose specialized MoE architectures and curated training strategies to tackle data imbalances .
Outcome: The proposed model achieves state-of-the-art performance on major speech and music generation benchmarks.
RecMind: Large Language Model Powered Agent For Recommendation (2024.findings-naacl)

Copied to clipboard

Challenge: Existing recommendations systems are limited in generalizing to new tasks due to model scale and data size constraints.
Approach: They propose an LLM-powered autonomous recommender agent, RecMind, which is capable of leveraging external knowledge to provide zero-shot personalized recommendations.
Outcome: The proposed model outperforms existing zero/few-shot LLM-based recommendation baseline methods in various tasks and achieves comparable performance to a fully trained recommendation model P5.
McQueen: a Benchmark for Multimodal Conversational Query Rewrite (2022.emnlp-main)

Copied to clipboard

Challenge: Recent studies have focused on conversational-related tasks that involve drawing information from more than one modality.
Approach: They propose a task of multimodal conversational query rewrite which performs query . they collect a large-scale visual conversation dataset and benchmark it against other tasks .
Outcome: The proposed task performs on a large-scale visual conversation dataset . it eliminates coreference and ellipsis in the original query without changing its semantic information.
GLGE: A New General Language Generation Evaluation Benchmark (2021.findings-acl)

Copied to clipboard

Challenge: Multi-task benchmarks focus on a range of Natural Language Understanding (NLU) tasks without considering the Natural Language Generation (NLG) models.
Approach: They propose a multi-task benchmark for evaluating the generalization capabilities of NLG models across eight language generation tasks.
Outcome: The proposed benchmarks are based on GLUE and Su-perGLUE for English and several other languages.
Act as you think: Reinforcing Consistent Reasoning in Medical Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Recent advances have improved the accuracy of medical visual question answering (Med-VQA) however, the high stakes nature of the medical domain has precipitated a shift towards interpretability and transparency of reasoning processes.
Approach: They propose a reinforcement learning from verifiable rewards framework that rewards internal consistency and logical coherence.
Outcome: The proposed framework rewards internal consistency and logical coherence, and is highly versatile, the authors show.
LLM-Based Multi-Hop Question Answering with Knowledge Graph Integration in Evolving Environments (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for knowledge editing in Large Language Models face difficulties with multi-hop questions that require accurate fact identification and sequential logical reasoning.
Approach: They propose a method that merges explicit knowledge representations of Knowledge Graphs with the linguistic flexibility of Large Language Models to convert free-form language into structured queries and fact triples.
Outcome: The proposed method significantly surpasses state-of-the-art knowledge editing methods in the multi-hop question answering benchmark, MQuAKE.
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach: They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome: The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers (2026.acl-long)

Copied to clipboard

Challenge: Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions .
Approach: They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification.
Outcome: The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing.
RikiNet: Reading Wikipedia Pages for Natural Question Answering (2020.acl-main)

Copied to clipboard

Challenge: Using Wikipedia pages to answer open-domain questions remains challenging in natural language understanding.
Approach: They propose a model which reads Wikipedia pages for natural question answering . it uses a dynamic paragraph dual-attention reader and a cascaded answer predictor .
Outcome: The proposed model outperforms the human model on the Natural Questions dataset . it achieves 74.3 F1 and 57.9 F1 on long-answer and short-answer tasks .
Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect the knowledge boundary of Vision Large Language Models (VLLMs) are expensive and require indiscriminate retrieval to address questions that require real-time information or are knowledge-intensive.
Approach: They propose a method that fine-tunes a VLLM on an automatically constructed dataset for boundary identification.
Outcome: The proposed method reduces indiscriminate retrieval while maintaining or improving the performance of a VLLM on an automatically constructed dataset.
Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on evaluating large language models in close-ended QA tasks, but many clinical decisions involve answering open-ended questions without pre-set options.
Approach: They construct a benchmark to better understand large language models in the clinic . they use existing datasets to evaluate LLMs in clinical situations .
Outcome: The proposed model outperforms human experts in multiple medical tasks.
LocAgent: Graph-Guided LLM Agents for Code Localization (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches struggle to efficiently navigate complex codebases when identifying relevant code snippets.
Approach: They propose a graph-guided agent framework that addresses code localization through a distributed graph-based agent.
Outcome: The proposed framework improves accuracy on real-world benchmarks and can be used to locate code snippets at a cost of 86%.
Theory of Mind in Large Language Models: Assessment and Enhancement (2025.acl-long)

Copied to clipboard

Challenge: Theory of Mind (ToM) is a cornerstone of human social intelligence . Large Language Models (LLMs) are increasingly integrated into daily life .
Approach: They analyze evaluation benchmarks and enhancement strategies to evaluate LLMs' ToM capabilities.
Outcome: The proposed and widely used story-based benchmarks and enhancement strategies are used to evaluate LLMs' ToM capabilities.
Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomalies (2025.naacl-long)

Copied to clipboard

Challenge: Existing household robots are inability to recognize potential problems or dangers in home environments.
Approach: They propose a task of creating anomaly scenarios using generative models instead of manually labeled data to build simulated environments.
Outcome: The proposed framework outperforms existing models in terms of task description and scene diversity.
FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting (2026.findings-acl)

Copied to clipboard

Challenge: FineState-Bench evaluates whether an agent can correctly ground an instruction to the intended UI control and reach the exact target state.
Approach: They propose a benchmark that evaluates whether an agent can correctly ground an instruction to the intended UI control and reach the exact target state.
Outcome: The proposed benchmark evaluates whether an agent can ground an instruction to the intended UI control and reach the exact target state.
Alleviating Over-smoothing for Unsupervised Sentence Representation (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to learn better unsupervised sentence representations have been successful . over-smoothing problem in unsupervised sentences reduces the capacity of powerful PLMs .
Approach: They propose a method to solve the over-smoothing problem in unsupervised sentence representations by combining negatives from PLMs intermediate layers.
Outcome: The proposed method improves on different strong baselines on Semantic Textual Similarity and Transfer datasets.
Towards Generating Controllable and Solvable Geometry Problem by Leveraging Symbolic Deduction Engine (2025.acl-industry)

Copied to clipboard

Challenge: Compared to math word problems, geometry problems emphasize multi-modal formats and the translation between informal and formal languages.
Approach: They propose a symbolic deduction engine-based geometry problem generation framework that leverages a symbolic deduction engine to generate geometry problems.
Outcome: The proposed method avoids inherent biases in translating natural language into formal language and guarantees to control the generated problems in terms of knowledge points and difficulties by an elaborate checking function.
Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation (2026.findings-acl)

Copied to clipboard

Challenge: a new technology is transforming customer service chatbots into strategic bridges for business intelligence . a recent study shows that customer service bots are increasingly being used as reactive support tools .
Approach: They propose a task of Proactive Information Probing which optimizes when to probe users for pre-specified information while minimizing conversation turns and user friction.
Outcome: The proposed framework outperforms baselines in both information probing and service quality.
GPT-4V Cannot Generate Radiology Reports Yet (2025.findings-naacl)

Copied to clipboard

Challenge: Large language models (LLMs) are becoming multimodal, and GPT-4 models are supposed to possess advanced skills across a wide range of domains, including high-stakes scenarios such as medicine.
Approach: They perform a systematic evaluation of GPT-4 in generating radiology reports across three chest X-ray report benchmarks: MIMIC-CXR, CheXpert Plus, and IU X ray.
Outcome: The proposed model fails in lexical and clinical efficacy metrics . the distributions of model-predicted labels remain constant regardless of groundtruth conditions on the image, suggesting that the model is not interpreting chest X-rays meaningfully.
RiT: Rubrics-in-Thinking Reinforcement Learning for Improved Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large Reasoning Models benefit from generating intermediate reasoning steps alongside final answers.
Approach: They propose a framework to introduce thinking-rubric supervision into intermediate reasoning.
Outcome: The proposed framework outperforms outcome-only RL baselines on reasoning-intensive and open-ended tasks.
A Self-Evolving LLM Agent Framework for Role-Based Norm Compliance in Healthcare (2026.findings-acl)

Copied to clipboard

Challenge: Existing systems treat roles as static prompts and rely on one-shot safety filters . a self-evolving LLM agent is proposed that learns from role-based social experience .
Approach: They propose a self-evolving LLM agent that learns from role-based social experience and explicitly models communicator-level individual traits informed by prior communication questionnaires and clinical literature.
Outcome: The proposed agent learns from role-based social experience and models communicator-level individual traits informed by prior communication questionnaires and clinical literature.
Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey (2025.emnlp-main)

Copied to clipboard

Challenge: Existing literature on ambiguity and disambiguation with Large Language Models (LLMs) ambiguities are a fundamental challenge in human-AI interactions due to complexity and flexibility of human language.
Approach: They propose to define key terms and concepts and categorize various disambiguation approaches enabled by LLMs and provide a comparative analysis of their advantages and disadvantages.
Outcome: The proposed frameworks are compared against different disambiguation approaches and highlight their relevance for future research.
TernaryBERT: Distillation-aware Ultra-low Bit BERT (2020.emnlp-main)

Copied to clipboard

Challenge: Transformer-based pre-training models like BERT are computationally expensive and limited to resource-constrained devices.
Approach: They propose a method which ternarizes the weights in a fine-tuned BERT model.
Outcome: The proposed method outperforms the other methods on the GLUE and SQUAD benchmarks while being 14.9x smaller.
Towards Better Chain-of-Thought: A Reflection on Effectiveness and Faithfulness (2025.findings-acl)

Copied to clipboard

Challenge: Chain-of-thought (CoT) prompting demonstrates varying performance under different reasoning tasks.
Approach: They propose to recall extra information from the question to enhance CoT generation and evaluate CoTs based on their information gain.
Outcome: The proposed method improves both the faithfulness and effectiveness of CoT and evaluates it based on their information gain.
RiskLab: A Controlled Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems (2026.acl-demo)

Copied to clipboard

Challenge: Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks.
Approach: They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions.
Outcome: The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks.
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities.
Approach: They propose a comprehensive benchmark covering 29 languages, built on an English benchmark.
Outcome: The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark.
ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (2025.acl-long)

Copied to clipboard

Challenge: Prior zero-shot TTS models only mimic the speaker’s voice without further control and adjustment capabilities while prior controllable TTS systems cannot perform speaker-specific voice generation.
Approach: They propose a style control module that captures codec representations corresponding to timbre, content, and style in a discrete decoupling codec space.
Outcome: The proposed system can fully clone the speaker's voice and perform speech-specific adjustment and control functions.
Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have substantially improved the reasoning abilities of Large Language Models (LLMs).
Approach: They propose a method that balances exploration and exploitation in the hidden-state space of response trajectories.
Outcome: The proposed model yields consistent improvements across models, algorithms and reasoning benchmarks.
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)

Copied to clipboard

Challenge: XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios .
Approach: They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora.
Outcome: The proposed dataset is labeled in English and includes only natural language understanding tasks.
LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem (2025.findings-emnlp)

Copied to clipboard

Challenge: distributing LLMs without a proven track record like ‘meta-llama‘ or ‘qwen‘ rarely gains community traction.
Approach: They propose a simple, efficient, yet specific recipe for a backdoor LoRA to be injected into task-enhancing LoRAs and examine the mechanisms of such infections.
Outcome: The proposed model allows attackers to scale the distribution of compromised LoRAs with minimal effort by leveraging the rich pool of shared LoRA assets.
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge.
Approach: They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage.
Outcome: The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold.
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are criticized for lack of expertise and knowledge conflict . KG-Adapter is a parameter-level KG integration method for decoder-only LLMs .
Approach: They propose a parameter-level KG integration method based on parameter-efficient fine-tuning . they use KG-Adapter to integrate knowledge graphs with LLMs and perform joint reasoning .
Outcome: The proposed method outperforms the current state-of-the-art method on four datasets for two different tasks.
CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding Tasks (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly used to judge code, but their reliability remains poorly understood.
Approach: They propose a benchmark to evaluate Large Language Models as code judges . they find that small reasoning models outperform larger non-reasoning models .
Outcome: The proposed benchmark evaluates LLM-as-a-Judge models across three coding tasks.
Benchmarking and Enabling Efficient Chinese Medical Retrieval via Asymmetric Encoders (2026.acl-long)

Copied to clipboard

Challenge: Effective medical text retrieval requires high accuracy and low latency.
Approach: They propose a benchmark for medical text retrieval in Chinese using a symmetric architecture . CARE is a lightweight encoder with an LLM-based encoder for offline document encoding .
Outcome: The proposed benchmark surpasses state-of-the-art symmetric models on CMedTEB . it matches high retrieval quality without increasing latency, and it performs well on a single GPU .
CMB: A Comprehensive Medical Benchmark in Chinese (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) provide a great breakthrough in medicine, says a new study . existing studies on LLMs leverage subjective evaluation, but evaluation in medicine is professional .
Approach: They propose a localized medical benchmark in Chinese rooted in native Chinese . they propose to use traditional Chinese medicine to evaluate large-scale LLMs .
Outcome: a new benchmark is developed to evaluate large-scale LLMs in china . the proposed model is rooted in the native Chinese linguistic and cultural framework .
Express What You See: Can Multimodal LLMs Decode Visual Ciphers with Intuitive Semiosis Comprehension? (2025.findings-acl)

Copied to clipboard

Challenge: Traditional VQA benchmarks encounter a modality gap and over-reliance on language priors, whereas human cognition excels at intuitive semiosis, associating abstract visual symbols to linguistic semantics.
Approach: They propose a task of generating abstract linguistics from emoji sequence images, where such reasoning underpins critical applications in cryptography.
Outcome: The proposed model can generate abstract linguistics from emoji sequence images, challenging MLLMs’ reasoning of decoding complex semantics of visual ciphers.
IceBreaker for Conversational Agents: Breaking the First-Message Barrier with Personalized Starters (2026.acl-industry)

Copied to clipboard

Challenge: Existing efforts focus on activation within ongoing dialogues, while overlooking a key real-world bottleneck.
Approach: They propose a conversation starter generation system that generates personalized starters to guide users into conversation without explicit user intent.
Outcome: The proposed system improves user active days by +1.84 and click-through rate by +94.25 and has been deployed in production.
Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success in Natural Language Processing, yet their cross-lingual consistency remains a significant challenge.
Approach: They propose a method to identify cross-lingual weaknesses in Large Language Models . they construct bilingual question pairs that expose performance discrepancies between English and target languages .
Outcome: The proposed method uncovers over 50% accuracy drops in target languages across models.
Structural Contrastive Pretraining for Cross-Lingual Comprehension (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to train multilingual language models using pretraining tasks like mask language modeling have yielded promising results on a wide range of downstream tasks.
Approach: They propose a new task to align the structural words in a parallel sentence, enhancing models’ ability to comprehend cross-lingual representations.
Outcome: The proposed task improves model's ability to comprehend cross-lingual representations by increasing the frequency of negative pairings.
bert2BERT: Towards Reusable Pretrained Language Models (2022.acl-long)

Copied to clipboard

Challenge: Pre-training large language models can be expensive and wasteful.
Approach: They propose a method which can transfer the knowledge of an existing smaller pre-trained model to a large model through parameter initialization and a two-stage learning method to further accelerate the pre-training.
Outcome: The proposed method can transfer the knowledge of an existing smaller pre-trained model to a large model through parameter initialization and significantly improve the pre-training efficiency of the large model.
LaoPLM: Pre-trained Language Models for Lao (2022.lrec-1)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) can capture different levels of concepts in context . previous work on Lao has been hampered by the lack of annotated datasets .
Approach: They construct a text classification dataset to alleviate the resource-scarce situation of Lao . they evaluate them on two downstream tasks: part-of-speech tagging and text classification .
Outcome: The proposed model can capture different levels of concepts in context and generate universal language representations.
VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation (2024.acl-long)

Copied to clipboard

Challenge: Existing metrics for conditional image generation are opaque and lack explainability . evaluators of these metrics have limited ability to evaluate image synthesis tasks .
Approach: They propose a Visual Instruction-guided Explainable metric for evaluating conditional image models.
Outcome: The proposed model achieves a high Spearman correlation with human evaluations, but is weaker than GPT-4o and GPT-v in evaluating synthetic images.
Optimizing Cross-Client Domain Coverage for Federated Instruction Tuning of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Federated domain-specific instruction tuning (FedDIT) for large language models (LLMs) aims to enhance performance in specialized domains using distributed private and limited data.
Approach: They introduce an algorithm that explicitly maximizes cross-client domain coverage through diversity-oriented client center selection and retrieval-based augmentation.
Outcome: The proposed algorithm achieves performance gains of 29.19% and domain coverage improvements of 4.82%-21.36% over 11 baselines.
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark (2025.coling-main)

Copied to clipboard

Challenge: Recent work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer dynamic questions well.
Approach: They propose a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest dynamic questions on the Chinese Internet.
Outcome: The proposed benchmark will be one of the key data resources for improving LLMs’ Chinese question-answering ability in the future.
Learning to Disentangle Interleaved Conversational Threads with a Siamese Hierarchical Network and Similarity Ranking (N18-1)

Copied to clipboard

Challenge: Existing methods to disentangle interleaved conversations can lead to difficulties in following discussions and retrieving relevant information from simultaneous messages.
Approach: They propose to leverage representation learning to separate intermingled messages into detached conversations by estimating conversation-level similarity between closely posted messages.
Outcome: The proposed approach outperforms baselines in pairwise similarity estimation and conversation disentanglement.
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering (2022.naacl-main)

Copied to clipboard

Challenge: a table-based question answering system requires complex reasoning and alignment between questions and tables.
Approach: They propose a table-based QA model that consumes both natural and synthetic data . they combine retrieval with masking to pair natural sentences with QA .
Outcome: The proposed model outperforms existing models in few-shot and full settings and on WikiTableQuestions.
Sudowoodo: A Chinese Lyric Imitation System with Source Lyrics (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing studies on lyrics generation focus on generating accurate lyrics using keywords, rhymes, etc. However, there is no parallel corpus for lyrics imitation.
Approach: They propose a Chinese lyrics imitation system that can generate new lyrics based on source lyrics.
Outcome: The proposed system can generate new lyrics based on the source lyrics . human evaluation shows it can perform better lyric imitation.
MedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses (2025.emnlp-main)

Copied to clipboard

Challenge: Existing medical fact-checking datasets focus on human-generated content, leaving the verification of content generated by large language models (LLMs) relatively unexplored.
Approach: They propose to use Chinese medical fact-checking datasets to verify LLM-generated medical content by combining in-context learning and fine-tuning.
Outcome: The first evidence-based Chinese medical fact-checking dataset of LLM-generated medical content consists of 1,321 questions and 7,409 claims .
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
Exploring Reasoning Reward Model for Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for agentic reinforcement learning rely on sparse outcome-based reward for training, leading to suboptimal results.
Approach: They propose an agent-based reward model that produces structured feedback for agentic trajectories, including an explicit reasoning trace and a focused critique.
Outcome: The proposed model produces structured feedback for agentic trajectories including an explicit reasoning trace, a focused critique, and an overall score that evaluates process performance.
Complex Event Schema Induction with Knowledge-Enriched Diffusion Model (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on event schema induction have been hindered by errors and data quality issues.
Approach: They propose a knowledge-enriched discrete diffusion model that distills event scenario knowledge from LLMs.
Outcome: The proposed model achieves outstanding performance across evaluation metrics.
SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for MU forget quality and model utility are not fully explored for safety in MLLMs.
Approach: They propose a safety unlearning benchmark for MLLMs to measure over-forgetting . they propose MU methods to forget quality and model utility .
Outcome: The proposed method reduces over-forgetting by 79.5% while maintaining forget quality and model utility.
Self-Training with Differentiable Teacher (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods for self-training are interpreted as teacher-student frameworks, where the teacher generates pseudo-labels and the student makes predictions.
Approach: They propose a differentiable self-training method that treats teacher-student as a Stackelberg game where a leader is always in a more advantageous position than a follower.
Outcome: The proposed model outperforms existing methods on semi- and weakly-supervised learning tasks on semi and weak supervised tasks.
Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Document understanding is critical for applications from financial analysis to scientific discovery.
Approach: They propose a taxonomy based on domain, retrieval modality, and granularity and review advances involving graph structures and agentic frameworks.
Outcome: The proposed model enables holistic retrieval and reasoning across all modalities, unlocking comprehensive document intelligence.
SiBert: Enhanced Chinese Pre-trained Language Model with Sentence Insertion (2020.lrec-1)

Copied to clipboard

Challenge: Recent studies show that pre-trained models can learn unsupervised language representations by self-supervised tasks on large-scale corpora.
Approach: They propose a pre-training task called Sentence Insertion for Chinese query-passage pairs NLP tasks . they propose 'word segmentation' method to enhance Chinese Bert performance .
Outcome: The proposed task improves Chinese pre-trained models significantly.
GUITester: Enabling GUI Agents for Exploratory Defect Discovery (2026.findings-acl)

Copied to clipboard

Challenge: Exploratory GUI testing is essential for software quality but suffers from high manual costs.
Approach: They propose a framework that decouples navigation from verification via two modules . they propose 143 tasks and a GUITestBench benchmark that features 26 defects .
Outcome: The proposed framework outperforms state-of-the-art benchmarks in 143 tasks and 26 defects.
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)

Copied to clipboard

Challenge: Existing retrieval augmented language models often overlook effective alignment with human preferences.
Approach: They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity .
Outcome: The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources.
Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality (2024.findings-acl)

Copied to clipboard

Challenge: a fine-grained, comprehensive understanding of multimodal environments remains under-explored.
Approach: They propose an automated workflow for integrating AI agents into extended reality (XR) they propose a cerebral language agent that integrates LLM with memory, planning, and interaction with XR tools and a vision-language agent .
Outcome: The proposed workflow integrates AI agents seamlessly into extended reality (XR) applications for fine-grained training.
SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Science (2025.acl-long)

Copied to clipboard

Challenge: Seed science is essential for modern agriculture, but its application in seed science remains limited due to a shortage of experts and limited availability of online resources.
Approach: They evaluate 26 leading large language models and compare them against a set of benchmarks . they find that there is a gap between the power of LLMs and real-world seed science problems .
Outcome: The new seed benchmark highlights the gap between the power of large language models and real-world seed science problems.
A General Framework for Adaptation of Neural Machine Translation to Simultaneous Translation (2020.aacl-main)

Copied to clipboard

Challenge: Despite the success of neural machine translation, simultaneous neural machine translators are challenging due to syntactic structure difference and simultaneity requirements.
Approach: They propose a framework for adapting neural machine translation to translate simultaneously . they propose 'prefix translation' that utilizes a consecutive NMT model to translate source prefixes .
Outcome: The proposed framework balancing quality and latency on three translation corpora and two language pairs shows that it performs well.
SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to detect and correct spelling errors in Chinese take external input or just heuristic rules.
Approach: They propose to incorporate phonological and visual similarity knowledge into Chinese language models by using a specialized graph convolutional network.
Outcome: The proposed method outperforms existing models on three human-annotated datasets.
SeMob: Semantic Synthesis for Dynamic Urban Mobility Prediction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing spatiotemporal models struggle to interpret and adapt to abrupt changes caused by external events.
Approach: They propose a LLM-powered semantic synthesis pipeline that extracts spatiotemporally related text from online texts and integrates it with spatio-temporal data.
Outcome: The proposed framework achieves maximal reductions of 13.92% in MAE and 11.12% in RMSE compared to the spatiotemporal model.
TinyBERT: Distilling BERT for Natural Language Understanding (2020.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models are computationally expensive and difficult to efficiently execute on resource-restricted devices.
Approach: They propose a Transformer distillation method that performs Transformer distillations at pre-training and task-specific learning stages.
Outcome: The proposed method accelerates inference and reduces model size while maintaining accuracy.
CodeRetriever: A Large Scale Contrastive Pre-Training Method for Code Search (2022.emnlp-main)

Copied to clipboard

Challenge: Existing code pre-training approaches often adopt (masked) language modeling as the training objective which targets on learning to predict (macked) tokens in a given code context.
Approach: They propose a code-text contrastive learning model which learns function-level code semantic representations through large-scale code corpus.
Outcome: The proposed model achieves new state-of-the-art with significant improvement over existing pre-trained models on eleven domain/language-specific code search tasks with six programming languages in different code granularity.
Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images.
Approach: They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations.
Outcome: The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images.
Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate that our method significantly outperforms traditional contrastive learning approaches when using the same amount of data.
Approach: They propose a new contrastive learning method built on embedding conditional probability distributions that integrates two tasks: information compression and conditional distribution alignment.
Outcome: The proposed method outperforms traditional contrastive learning approaches and achieves comparable performance to state-of-the-art models when using the same amount of data.
Uncertain Natural Language Inference (2020.acl-main)

Copied to clipboard

Challenge: Existing categorical bin assignments for NLI are not effective for entailment inference.
Approach: They propose a refinement of Natural Language Inference that targets direct prediction of subjective probability assessments.
Outcome: The proposed model can be used in pre-training and correlates well with humans.
TabDSR: Decompose, Sanitize, and Reason for Complex Numerical Reasoning in Tabular Data (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models often underperform due to complex queries, noisy data, and limited numerical capabilities.
Approach: They propose a framework that integrates seamlessly with mainstream LLMs to improve tabular reasoning.
Outcome: The proposed framework outperforms existing methods in state-of-the-art analysis.
Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for contrastive pre-training ignore the relevance between codes in large code corpus.
Approach: They propose a Soft-labeled contrastive pre-training framework with positive sample construction methods to learn functional-level code representation.
Outcome: The proposed framework can obtain fine-grained soft-labels through an iterative adversarial manner and use them to learn better code representation.
Maria: A Visual Experience Powered Conversational Agent (2021.acl-long)

Copied to clipboard

Challenge: Existing studies focus on grounding conversational agents on text-only corpora, but they lack the perception ability to our physical world.
Approach: They propose to ground conversational agents on images retrieved from large-scale image indexes . they propose to use visual knowledge to generate informative responses based on the extracted knowledge .
Outcome: The proposed agent outperforms state-of-the-art methods on automatic metrics and human evaluation.
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026.acl-long)

Copied to clipboard

Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Ďurech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolčec, Yixuan Xu, Michael Aerni, Badr AlKhamissi, Inés Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag
Challenge: Apertus is a fully open suite of large language models (LLMs) designed to address responsibility shortcomings in today’s open model ecosystem, namely data responsibility and global representation.
Approach: They propose to release a fully open suite of large language models (LLMs) that address data responsibility and global representation shortcomings in today’s open model ecosystem.
Outcome: The proposed model is pretrained on openly available data and suppresses verbatim recall of data while retaining task performance.
Graph Meets LLM: A Novel Approach to Collaborative Filtering for Robust Conversational Understanding (2023.emnlp-industry)

Copied to clipboard

Challenge: Defective queries impact the robustness of conversational AI systems such as Alexa, Siri or Google Assistant.
Approach: They propose a Personalized Query Rewriting system that takes into account individual preferences or unique error patterns identified from a user's historical interactions with the conversational AI.
Outcome: The proposed approach has been proven on a large-scale real-world dataset and online A/B experiments.
FUSE: Measure-Theoretic Compact Fuzzy Set Representation for Taxonomy Expansion (2024.findings-acl)

Copied to clipboard

Challenge: Existing work models taxonomy concepts as vectors or geometric objects, but fuzzy sets are efficient for concept modeling.
Approach: They propose a set representation learning task based on fuzzy set approximation . they demonstrate remarkable improvements in taxonomy expansion using FUSE .
Outcome: The proposed framework improves taxonomy expansion performance by 23% over baselines.
Learning from Textual Radiology Reports: A Benchmark Dataset for Coronary CT Angiography (2026.acl-industry)

Copied to clipboard

Challenge: CCTA reports provide an assessment of coronary disease severity to guide patient management.
Approach: They propose a pipeline that decouples structuring from classification by an LLM-based parser . CCTA-RADS is the largest publicly available dataset of CCDA reports .
Outcome: The proposed approach improves the F1-score by 6%-13% compared with direct methods.
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs .
Approach: They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations .
Outcome: The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation .
Constructing coherent spatial memory in LLM agents through graph rectification (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to map construction and map repair are limited by context constraints and inconsistencies in text processing environments.
Approach: They propose a framework for LLM-driven construction and map repair . it detects, localizes, and corrects structural inconsistencies in incremental navigation graphs .
Outcome: The proposed method significantly improves map correctness and robustness in entangled or chained inconsistencies.
Dialogue Language Model with Large-Scale Persona Data Engineering (2025.naacl-industry)

Copied to clipboard

Challenge: Existing persona-consistent dialogue models lack robustness due to limited scale and diversity of datasets.
Approach: They propose an open-domain persona dialogue system that employs extensive generative pre-training on a persona dialog dataset to enhance persona consistency.
Outcome: The proposed model generates vast persona dialogue datasets and addresses invalid persona bias.
TKGT: Redefinition and A New Way of Text-to-Table Tasks Based on Real World Demands and Knowledge Graphs Augmented LLMs (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on text-to-table tasks that ignore domain structures and use simple datasets to extract structured information from unstructured text.
Approach: They propose a new text-to-table task that generates domain knowledge graphs from raw text using a mixed-IE method and a hybrid retrieval augmented generation method.
Outcome: The proposed dataset improves compatibility with long text-processing tasks by incorporating domain knowledge graphs (KGs) classes into tables.
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Challenge: a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach: They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome: The proposed agents are based on operating systems (OS) and operating systems frameworks.
Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)

Copied to clipboard

Challenge: Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use.
Approach: They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools.
Outcome: The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities.
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases (D19-1)

Copied to clipboard

Challenge: CoSQL is a corpus for building cross-domain, general-purpose database querying dialogue systems.
Approach: They present a corpus for building cross-domain, general-purpose database querying dialogue systems . they use a Wizard-of-Oz collection of 3k turns plus 10k+ annotated SQL queries .
Outcome: The proposed corpus is based on a Wizard-of-Oz dataset of 3k dialogues querying 200 complex DBs spanning 138 domains.
Multi-view Classification Model for Knowledge Graph Completion (2020.aacl-main)

Copied to clipboard

Challenge: Existing knowledge graph completion models only evaluated candidate triples from content information.
Approach: They propose a multi-view classification model where multiple views are performed based on both content and context information for candidate triple evaluation.
Outcome: The proposed model improves on two representative datasets and improves performance.
Comparative Graph-based Summarization of Scientific Papers Guided by Comparative Citations (2022.coling-1)

Copied to clipboard

Challenge: Comparative citations can help researchers find related and comparable articles and common topics.
Approach: They propose a comparative graph-based summarization method to find related articles and compare them using citations as guidance.
Outcome: The proposed method outperforms baselines on CSSC and performs well on DUC2006 and DUC2007.
TrojFSP: Trojan Insertion in Few-shot Prompt Tuning (2024.naacl-long)

Copied to clipboard

Challenge: Prompt tuning on a few data samples presents security issues, e.g., Trojan attacks.
Approach: They propose a method to transfer established data poisoning attacks directly to few-shot prompt tuning, a technique to address the poisoned imbalance issue.
Outcome: The proposed method achieves an ASR of over 99% while maintaining negligible decreases in CDA.
Mixture of insighTful Experts (MoTE): The Synergy of Reasoning Chains and Expert Mixtures in Self-Alignment (2025.acl-long)

Copied to clipboard

Challenge: Recent studies show that reasoning abilities contribute significantly to model safety, while integrating Mixture-of-Experts (MoE) architectures can further enhance alignment.
Approach: They propose a framework that synergistically combines reasoning chains and expert mixtures to improve self-alignment.
Outcome: The proposed framework improves model safety, jailbreak resistance, and over-refusal capabilities, achieving performance comparable to OpenAI’s state-of-the-art o1 model.
XLM-D: Decorate Cross-lingual Pre-training Model as Non-Autoregressive Neural Machine Translation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pre-training language models have been successful in natural language understanding and autoregressive generation tasks, but non-autoregressive models have not been sufficiently successful.
Approach: They propose a pre-trained masked language model (MLM) and a non-autoregressive generation model with a lightweight decorator.
Outcome: The proposed model outperforms the previous mask-predict model on translation datasets by 19.9x.
Knowledge Mechanisms in Large Language Models: A Survey and Perspective (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we can understand knowledge mechanisms in LLMs for learning, storage, utilization, and evolution.
Approach: They propose to analyze knowledge mechanisms in Large Language Models (LLMs) they examine utilization, evolution, and the potential dark knowledge (hypothesis) they hope to help understand knowledge in LLMs and provide insights for future research .
Outcome: The proposed model can be used to analyze the evolution of parametric knowledge in LLMs.
AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER (2021.acl-long)

Copied to clipboard

Challenge: Named entity recognition models rely on expensive labeled data for training, which is not always available across languages.
Approach: They propose an adversarial approach where an encoder learns entity domain knowledge from labeled source-language data and better shared features are captured via adversarially trained discriminators.
Outcome: The proposed approach outperforms existing state-of-the-art methods on standard benchmark datasets and outperformed existing methods on the target language.
Relation Classification via Bidirectional Prompt Learning with Data Augmentation by Large Language Model (2024.lrec-main)

Copied to clipboard

Challenge: Recent studies investigate Relation Extraction task from two different aspects.
Approach: They propose to use Large Language Model (LLM) to do data augmentation and propose a bidirectional prompt template for prompt learning.
Outcome: The proposed model outperforms the state-of-the-art on four datasets and outperformed existing methods on TACREV, RETACRED and Semeval.
RaFe: Ranking Feedback Improves Query Rewriting for RAG (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved to enhance document retrieval by reformulating queries.
Approach: They propose a framework for training query rewriting models that leverages a reranker framework.
Outcome: The proposed framework provides ranking feedback aligned well with the rewriting objectives without needing signals from annotations and supports both online and offline training models.
Frustratingly Easy Label Projection for Cross-lingual Transfer (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve cross-lingual transfer performance are based on word alignment, but no empirical studies have evaluated their effectiveness or limitations.
Approach: They propose a mark-then-translate method that integrates translation and projection by inserting special markers around the labeled spans in the original sentence.
Outcome: The proposed method outperforms word alignment-based methods in 57 languages and three tasks.
SSR-A: Spatial- and Semantic-Aware Instructions and Curriculum Reinforcement for Advertisement Compliant Rectification (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods to fix non-compliant images suffer from over-editing, destroying original intent and perceptual similarity.
Approach: They propose a framework for the minimalist rectification of non-compliant image ads.
Outcome: The proposed framework outperforms state-of-the-art baselines in both compliance and preservation of visual and commercial consistency.
Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing (2020.acl-main)

Copied to clipboard

Challenge: Existing multi-domain neural machine translation models lack adaptation to individual domains.
Approach: They propose a multi-domain neural machine translation model with individual modules for each domain . they use word-level, adaptive and layer-wise domain mixing to achieve this .
Outcome: The proposed model outperforms existing models in several NMT tasks.
SynWorld: Virtual Scenario Synthesis for Agentic Action Knowledge Refinement (2025.acl-short)

Copied to clipboard

Challenge: Using Large Language Models (LLMs)-based agents can enhance their understanding of environments and tasks.
Approach: They propose a framework that allows agents to synthesize possible scenarios with multi-step action invocation within the action space and perform Monte Carlo Tree Search exploration to refine their action knowledge in the current environment.
Outcome: The proposed framework synthesizes possible scenarios with multi-step action invocation within the action space and performs Monte Carlo Tree Search exploration to refine action knowledge in the current environment.
Using Interpretation Methods for Model Enhancement (2023.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks for enhancing neural models with interpretation methods and gold rationales have not been fully explored.
Approach: They propose a framework for utilizing interpretation methods and gold rationales to enhance neural models.
Outcome: The proposed framework outperforms gradient-based methods in low-resource settings on a variety of tasks.
LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to learn behavioral sequences fail to capture complex behavioral patterns due to a lack of deep reasoning capabilities and world knowledge.
Approach: They propose a framework that integrates the reasoning power of Large Language Models with the sequential modeling strengths of traditional KT methods via multi-level plug-and-play alignment.
Outcome: Extensive experiments on four standard datasets show that the proposed framework outperforms existing methods on state-of-the-art questions.
Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing MLLMs are strong at understanding single plots, but struggle with multi-step reasoning . Existing approaches to manage context in chart reasoning include text-based chain-of-thought prompting .
Approach: They propose a hierarchical visual agent framework that iteratively constructs a working context in an image–text space.
Outcome: The proposed framework improves on strong multimodal baselines.
From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing models for visual information extraction suffer from limitations in scale and realism . ReceiptBench is a large-scale, human-annotated benchmark for receipts .
Approach: They propose a large-scale, human-annotated benchmark for visual information extraction . the method organizes information extraction into four hierarchical sub-tasks .
Outcome: The proposed method surpasses proprietary models on complex reasoning tasks.
Causally Modeling the Linguistic and Social Factors that Predict Email Response (2025.naacl-long)

Copied to clipboard

Challenge: a key intent behind many emails is to get a reply from the recipient.
Approach: They propose to model the intents, expectations, and responsiveness in email exchanges by using a dataset containing 1800 emails annotated with nuanced types of intents and expectations.
Outcome: The proposed model is based on 1800 emails annotated with nuanced types of intents and expectations . it shows that social status, argumentation, and strength of social connection influence email response rates .
CO3: Low-resource Contrastive Co-training for Generative Conversational Query Rewrite (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in conversational IR systems have seen a resurgent interest in conversation . generative query rewrite generates reconstructed query based on the conversation history .
Approach: They propose to use unlabeled data to make further improvements using contrastive co-training paradigm.
Outcome: The proposed model is robust to noise and language style shift under few-shot and zero-shot scenarios.
ContrastKV: Robust KV Cache Eviction via Contrastive Signal Fusion for Multi-Query Generalization (2026.acl-long)

Copied to clipboard

Challenge: Existing query-agnostic approaches rely on a single proxy query, leading to fragile eviction decisions under high evict ratios.
Approach: They propose a query-agnostic KV cache eviction algorithm that exploits complementary semantic and non-semantic signals.
Outcome: Experiments show that the proposed algorithm outperforms state-of-the-art methods while retaining up to 92% accuracy with only 20% of the KV cache budget.
Exploring the Hidden Reasoning Process of Large Language Models by Misleading Them (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing large language models can perform abstract reasoning tasks but are they actually engaging in rule-based reasoning beyond mere memorization?
Approach: They propose a method to examine whether large language models perform abstract reasoning . they fine-tune the model to learn those contradictory rules and assess its generalization ability .
Outcome: The proposed approach examines whether large language models perform abstract reasoning by altering their original understanding of fundamental rules.
Leveraging Context-Aware Prompting for Commit Message Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for writing comprehensive commit messages focus on the changed lines or nearest context lines, but excessive contexts can lead to noise.
Approach: They propose a code model COMMIT that can generate automatic commit messages by combining a dataset with a context-aware prompt.
Outcome: The proposed model surpasses all existing models including pre-trained language models for code and large language models such as Code-LlaMa.
Learning Neural Templates for Recommender Dialogue System (2021.emnlp-main)

Copied to clipboard

Challenge: Recent advances in neural models have shown promising progress on this task, but key challenges remain .
Approach: They propose a framework that can decouple dialogue generation from item recommendation . they use a response template generator and item selector to generate a responses template .
Outcome: The proposed framework outperforms the state-of-the-art methods on the benchmark ReDial.
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety (2026.acl-long)

Copied to clipboard

Challenge: Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections.
Approach: They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight.
Outcome: The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%.
ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring (2026.acl-industry)

Copied to clipboard

Challenge: Existing regulatory policies create label inconsistencies and reasoning ambiguities in historical datasets.
Approach: They propose a policy-adaptive governance system that enables evolving reinforcement through multi-agent adversarial umpiring.
Outcome: The proposed system outperforms fine-tuning baselines on industrial and public datasets . it enables evolving reinforcement through multi-agent adversarial umpiring .
Multi-Prompting Decoder Helps Better Language Understanding (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to adapt Pre-trained Language Models to downstream tasks are limited by their inference APIs.
Approach: They propose a multi-prompting decoding framework that query PLMs with multiple prompts . they propose to query Plms with optimal transport for hidden states and calibrated decoding for class scores .
Outcome: The proposed framework achieves state-of-the-art results on multiple natural language understanding datasets under the few-shot setting.
Cache-of-Thought: Master-Apprentice Framework for Cost-Effective Vision Language Model Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Recent Vision Language Models (VLMs) have shown tremendous promise in a wide range of realworld applications, but their size has made at-scale deployment and operation challenging due to high consumption of cloud computing resource, high latency, and expensive API calls.
Approach: They propose a master–apprentice framework for collaborative inference between large and small vision language models.
Outcome: The proposed framework improves reasoning performance on widely-recognized and challenging general reasoning benchmarks and specifically boosts reasoning of apprentice VLMs by 36.6%.
RL-PLUS: Countering Capability Boundary Collapse of LLMs in Reinforcement Learning with Hybrid-policy Optimization (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs).
Approach: They propose a hybrid-policy optimization approach that synergizes internal exploitation with external data to achieve stronger reasoning capabilities.
Outcome: The proposed approach achieves state-of-the-art performance on six math reasoning benchmarks and superior performance on out-of distribution reasoning tasks.
Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances, Resources, and Future Directions (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are used to assist with driving decisions, but they face limitations in perception and computational demands.
Approach: They propose a survey of LLM-based multi-agent ADSs and their applications . they analyze agent-human interactions in scenarios where LLM agents engage with humans .
Outcome: The proposed approach reduces human intervention and improves safety and efficiency.
OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing RLHF frameworks face inference bottlenecks and complexity barriers restricting their accessibility for newcomers.
Approach: They propose an open-source RLHF framework that can be used to train large language models.
Outcome: The proposed framework achieves superior training efficiency with speedups ranging from 1.22 to 1.68 across different model sizes compared to state-of-the-art frameworks, while requiring significantly fewer lines of code for implementation.
BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS).
Approach: They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features.
Outcome: The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization.
Generative Personality Simulation via Theory-Informed Structured Interview (2026.eacl-long)

Copied to clipboard

Challenge: Personality structured interviews are often lacking in advancing social science research.
Approach: They propose a method to incorporate psychological insights into LLM simulations . they use a measure theory grounded evaluation procedure to evaluate reliability and validity .
Outcome: The proposed method improves human-like heterogeneity in LLM-simulated personality data and predicts personality-related behavioral outcomes.
PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA (2024.acl-long)

Copied to clipboard

Challenge: Partially Rotation-enhanced Low-Rank Adaptation (PRoLoRA) is an intra-layer sharing mechanism that circumvents the drawbacks of peer parameter-sharing methods.
Approach: They propose a partially rotation-enhanced low-rank adaptation (PRoLoRA) that shares four components to reduce the cost of LoRA and improves model capacity.
Outcome: Empirical results show that PRoLoRA outperforms LoRA on multiple instruction tuning datasets.
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning pre-trained models fail to generalize to unseen data.
Approach: They propose a framework for robust and efficient fine-tuning for pre-trained models . proposed framework achieves new state-of-the-art performance on a number of NLP tasks .
Outcome: The proposed framework outperforms the state-of-the-art T5 model on GLUE, SNLI, SciTail and ANLI.
TST: A Schema-Based Top-Down and Dynamic-Aware Agent of Text-to-Table Tasks (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to extract text content based on static table structures neglect to deal with precise inner-document evidence extraction and dynamic information such as multiple entities and events.
Approach: They propose a dynamic content extraction agent framework that uses type recognition to extract context evidences with the conduction of domain schema sequentially.
Outcome: The proposed framework exhibits state-of-the-art (SOTA) performance on a large dataset.
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation (2021.acl-demo)

Copied to clipboard

Challenge: TextBox is an open-source text generation framework that is modularized and extensible.
Approach: They propose to provide a unified, modularized, and extensible text generation framework that implements 21 text generation models on 9 benchmark datasets.
Outcome: The proposed framework implements 21 models on 9 benchmark datasets and is available under the Apache License 2.0 license.
Large Language Models Meet Harry Potter: A Dataset for Aligning Dialogue Agents with Characters (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing models that can create open-domain dialogue agents lack character representation and annotations.
Approach: They propose a dataset to study character alignment and character representation . it includes all dialogue sessions from the Harry Potter series and includes annotations .
Outcome: The proposed dataset can be used as a universal benchmark for character-driven LLMs.
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models (2021.acl-long)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) have achieved great success in natural language processing.
Approach: They propose a method that automatically searches architecture hyper-parameters in BERT . they use one-shot learning and the search space to provide an adaptive development way .
Outcome: The proposed method outperforms both the baseline and distillation-based methods on GLUE and SQUAD benchmarks.
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)

Copied to clipboard

Challenge: Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance.
Approach: They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents.
Outcome: The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain.
Ensuring Readability and Data-fidelity using Head-modifier Templates in Deep Type Description Generation (P19-1)

Copied to clipboard

Challenge: Existing generative methods overlook grammatical structure or make factual mistakes in generated texts.
Approach: They propose a template-based method to ensure the readability of generated type descriptions . they also propose measurable metrics to measure the readibility of the generated type description .
Outcome: The proposed method improves substantially compared with baselines and achieves state-of-the-art performance on both datasets.
Structured Optimal Brain Pruning for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing pruning methods for Large Language Models rely on unstructured pruning or require special hardware to accelerate computation.
Approach: They propose a retraining-free structured pruning method called SoBP . they evaluate the effectiveness of SoBP across 14 models from 3 LLM families .
Outcome: The proposed method outperforms current state-of-the-art pruning methods on 8 datasets.
Leros: Learning Explicit Reasoning on Synthesized Data for Commonsense Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Recent work shows large language models can generate useful rationales for commonsense question answering (CQA) however, the cost of deployment and further tuning is relatively expensive for the large models.
Approach: They propose a framework that leverages both knowledge graphs and large language models to synthesize rationale-augmented CQA data.
Outcome: The proposed model can generate useful rationales on unseen CQA benchmarks.
Synapse: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models excel at generalized reasoning, but lack the ability to accumulate experiences and maintain narrative coherence over long horizons.
Approach: They propose a unified memory architecture that transcends static vector similarity.
Outcome: The proposed model outperforms state-of-the-art methods in temporal and multihop reasoning tasks.
Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for infrared modeling ignore supervisory signals of infra-modality-specific attributes, which may lead to biased understanding of in-frarea images.
Approach: They propose a multi-agent generation system which transfers knowledge from visible images to generate infrared image-text pairs and infra-instructional data.
Outcome: The proposed system generates infrared image-text pairs and infra-response data and is able to answer common infreas tasks with the proposed model.
KuiLeiXi: a Chinese Open-Ended Text Adventure Game (2021.acl-demo)

Copied to clipboard

Challenge: Recent advances in pre-trained language models have made it possible to generate human-like text.
Approach: They propose to integrate an open-ended text adventure game in Chinese, named KuiLeiXi, where players interact with the AI until the plot goals are reached.
Outcome: The proposed game lacks incentives and relies on players to explore on their own.
Enhancing Cross Text-Molecule Learning by Self-Augmentation (2024.findings-acl)

Copied to clipboard

Challenge: Existing datasets are limited due to the difficulty of collecting precise molecule-description pairs. Existing approaches to enhance large language models include a data augmentation framework and a new dataset called SAPubChem-41.
Approach: They propose a framework that interweaves model fine-tuning and data augmentation to overcome the scarcity of high-quality labeled data.
Outcome: The proposed framework interweaves model fine-tuning and data augmentation to overcome the scarcity of high-quality labeled data.
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval Augmented Generation can be used to process long contexts in Open-Domain Question-Answering tasks.
Approach: They propose a method to cover longer contexts in Open-Domain Question-Answering tasks by using a small encoder language model and cross-attention with origin inputs.
Outcome: The proposed method can cover longer contexts while keeping the computing requirements close to the baseline.
When TableQA Meets Noise: A Dual Denoising Framework for Complex Questions and Large-scale Tables (2026.acl-long)

Copied to clipboard

Challenge: Extensive research shows that noisy data significantly degrades the performance of table reasoning in real-world applications.
Approach: They propose a dual denoising framework for complex questions and large-scale tables that uses Tree-guided table pruning to remove irrelevant data step by step.
Outcome: The proposed framework achieves outstanding performance on TableQA tasks with complex questions and large-scale tables.
FuseSearch: Learning Adaptive Parallel Execution for Efficient Code Localization (2026.findings-acl)

Copied to clipboard

Challenge: Existing parallel code localization agents suffer from a 34.9% redundant tool invocation rate . specialized localization agent that operate as dedicated search components is needed to achieve high localization accuracy.
Approach: They propose a parallel code localization system that reframes parallel code execution as a quality–efficiency co-optimization problem.
Outcome: The proposed method matches SOTA performance while being 93.6% faster.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations