Papers by Xiao Hu

79 papers
Multiview Clickbait Detection via Jointly Modeling Subjective and Objective Preference (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing clickbait detection models rely on analyzing the objective semantics of posts or correlating posts with article content only, but fail to identify and exploit the manipulation intention of clickbaiting from a user’s subjective perspective.
Approach: They propose a multiview clickbait detection model to model subjective and objective preferences simultaneously to capture clickbaiting from a user's subjective perspective.
Outcome: The proposed model outperforms state-of-the-art models on two real-world datasets and shows that it integrates subjective and objective preferences simultaneously.
Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent training-based TTS methods, such as continued reinforcement learning, have surged in popularity, while training-free TTS approaches are gradually fading from prominence.
Approach: They propose a fine-grained sequential scaling method guided by process verification that integrates training-free TTS methods with other classical parallel scaling methods at the step level.
Outcome: Experiments on five instruction-tuned large language models (LLMs) show that training-free TTS methods can extend reasoning performance boundaries.
Automatic Table Union Search with Tabular Representation Learning (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to identify uniability based on column representations are insufficient to reveal latent relational features to describe column relation between pair of columns.
Approach: They propose a self-supervised table union search framework called AutoTUS to learn column relational representations in a multi-stage manner.
Outcome: The proposed framework improves on the SOTA baseline and on real-world datasets.
Event Pattern-Instance Graph: A Multi-Round Role Representation Learning Strategy for Document-Level Event Argument Extraction (2025.findings-acl)

Copied to clipboard

Challenge: Existing role-based span selection strategies ignore interrelations between events . authors propose a multi-round role representation learning strategy for document-level event argument extraction .
Approach: They propose a pattern-instance graph to capture role semantics embedded in various associations . they also propose re-inventing the role representations learned from previous analyzed documents .
Outcome: The proposed model captures role semantics embedded in various associations . iteratively updates representations of role nodes and edges to enrich their semantic information . the model improves prediction performance in subsequent rounds of span selection .
Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables (2022.naacl-main)

Copied to clipboard

Challenge: Existing fact extraction and verification tasks only consider evidence of a single format . Existing models convert evidence into either sentences or tables, thus losing context information .
Approach: They propose a Dual Channel Unified Format fact verification model which unifies various evidence into parallel streams, i.e., natural language sentences and a global evidence table, simultaneously.
Outcome: The proposed model outperforms existing models in two formats by a large margin . it makes the most of existing tables and tables to absorb evidence of two formats .
IFlyEA: A Chinese Essay Assessment System with Automated Rating, Review Generation, and Recommendation (2021.acl-demo)

Copied to clipboard

Challenge: Automated Essay Assessment (AEA) aims to judge students’ writing proficiency in an automatic way.
Approach: They propose to use Chinese AEA system IFlyEssayAssess to evaluate essays written by native Chinese students from primary and junior schools.
Outcome: The proposed system provides application services for essay scoring, review generation, recommendation, and explainable analytical visualization.
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly.
Approach: They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show .
Outcome: The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models.
Task Oriented In-Domain Data Augmentation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for large language models suffer from two major issues: in-domain data are scarce compared with general domain-agnostic data.
Approach: They propose a task-oriented in-domain data augmentation framework that uses in- domain data selection and task-orientated synthetic passage generation to adapt LLMs to two domains: advertisement and math.
Outcome: The proposed framework improves LLM performance by 8% in the advertisement domain and 7.5% in the math domain.
MCiteBench: A Multimodal Benchmark for Generating Text with Citations (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing work focuses on generating citations for text-only content . experimental results reveal MLLMs struggle to ground outputs reliably when handling multimodal input .
Approach: They propose a benchmark to assess the ability of MLLMs to generate text with citations in multimodal contexts.
Outcome: The proposed benchmark assesses the ability of MLLMs to generate text with citations in multimodal contexts.
\mathtt{GeLLM^3O}: Generalizing Large Language Models for Multi-property Molecule Optimization (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have remarkable out-of-domain generalizability to novel optimization tasks.
Approach: They propose a series of instruction-tuned LLMs for molecule optimization that outperform state-of-the-art instruction-based LLM models.
Outcome: mathttMuMOInstruct outperforms state-of-the-art LLMs on 5 in-domain and 5 out-of domain tasks.
Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data (2023.emnlp-demo)

Copied to clipboard

Challenge: Reaction Miner is a system designed to extract chemical reactions from raw scientific PDFs.
Approach: They propose a system that extracts chemical reactions directly from raw scientific PDFs.
Outcome: The proposed system can extract chemical reactions from raw scientific PDFs.
Pause or Fabricate? Training Language Models for Grounded Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models implicitly fabricate information when inputs are incomplete, causing confidence but unreliable conclusions.
Approach: They propose a framework for grounded reasoning under incomplete information that decomposes reasoning into two stages . they propose stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification.
Outcome: The proposed framework improves premise detection and task success by 30% . it also reduces average response length by over 20% .
PrinciplismQA: A Philosophy-Grounded Approach to Assessing LLM-Human Clinical Medical Ethics Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks lack systematic approaches to integrate philosophical frameworks and expert validation for ethical reasoning assessment.
Approach: They propose a philosophy-grounded approach to assess medical ethics alignment . PrinciplismQA comprises 3,648 expert-validated questions spanning knowledge assessment and clinical reasoning .
Outcome: PrinciplismQA provides a philosophy-grounded approach to assessing medical ethics alignment.
RankPrompt: Step-by-Step Comparisons Make Language Models Better Reasoners (2024.lrec-main)

Copied to clipboard

Challenge: Existing solutions to reasoning tasks require extensive human annotations or fail in scenarios with inconsistent responses.
Approach: They propose a new method that enables LLMs to self-rank their responses without additional resources.
Outcome: The proposed method improves reasoning performance of ChatGPT and GPT-4 with 13% improvement over existing methods.
Bridging the Granularity Gap for Acoustic Modeling (2023.findings-acl)

Copied to clipboard

Challenge: Despite the success of speech recognition, how to encode the speech features effectively remains an open problem.
Approach: They propose a Progressive Down-Sampling technique which compresses acoustic features into coarser-grained units containing more complete semantic information, like text-level representation.
Outcome: The proposed method yields comparable or better results on the speech recognition task and inference speedups ranging from 1.20x to 1.47x.
Video-MMMU: Evaluating Knowledge Acquisition from Multidisciplinary Professional Videos (2026.acl-long)

Copied to clipboard

Challenge: Existing video benchmarks do not evaluate the knowledge acquisition capabilities of Large Multimodal Models (LMMs) existing video benchmark focuses on static, general visual understanding tasks, without evaluating whether models can acquire knowledge dynamically.
Approach: They propose a multi-modal, multi-discipline, multitrack benchmark that evaluates Large Multimodal Models’ ability to acquire knowledge from college-level, educational videos.
Outcome: The proposed benchmark reveals a substantial gap between human learners and current Large Multimodal Models (LMMs) and focuses on improving their learning efficiency.
Legal Fact Prediction: The Missing Piece in Legal Judgment Prediction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies use legal facts to predict judgments, but legal facts are difficult to obtain in early stages of litigation.
Approach: They propose a legal fact prediction task that takes evidence from trial as input to make predictions in the absence of ground-truth legal facts.
Outcome: The proposed task can predict court rulings without ground-truth legal facts . the first benchmark dataset, LFPBench, is used to evaluate the task .
Token-level Inference-Time Alignment for Vision-Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) often prioritize linguistic fluency over visual fidelity . despite widespread adoption, VLMs often exhibit a critical failure mode: hallucination .
Approach: They propose a framework for Token-level Inference-Time Alignment that steers the decoding process without updating the base model parameters.
Outcome: The proposed framework improves performance on 13 benchmarks across architectures . it boosts LLaVA-1.5-7B by 8.6% on MMVet and achieves a 74.0 MMStar score .
Improving Continual Relation Extraction through Prototypical Contrastive Learning (2022.coling-1)

Copied to clipboard

Challenge: Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks.
Approach: They propose a Continual Relation Extraction framework with Contrastive Learning which is built with a classification network and a prototypical contrastive network to achieve incremental-class learning of CRE.
Outcome: The proposed framework outperforms the state-of-the-art methods on two public datasets and proves its effectiveness on improving performance.
MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation.
Approach: They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation.
Outcome: Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation.
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach: They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome: The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Data-Efficient Selection via Grammatical Complexity in Continual Pre-training of Domain-Specific LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing data selection strategies for continual pre-training of large language models often rely on scarce labeled data or computationally expensive LLMs.
Approach: They propose an annotation-independent data selection framework for CPT that evaluates grammatical complexity using lexical diversity and syntactic complexity.
Outcome: The proposed framework outperforms baselines on a financial dataset and surpasses full-data training by 1.7% using only 20% of the data.
Anti-Length Shift: Dynamic Outlier Truncation for Training Efficient Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Existing efficient reasoning methods rely on explicit length penalties for excessive verbosity on simple queries.
Approach: They propose a training-time intervention that selectively suppresses redundant tokens . they find length shift occurs when models generate unnecessary reasoning on trivial inputs - a phenomenon that is often unexplored .
Outcome: The proposed method reduces inference token usage by 78% while increasing accuracy compared to the initial policy and surpasses state-of-the-art efficient reasoning methods.
Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMs (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) safety alignment predominantly operates on a binary assumption that requests are either safe or unsafe.
Approach: They propose a methodology that embeds harmful requests within ethical framings to exploit this vulnerability.
Outcome: The proposed framework achieves high success rates by exploiting model's own ethical reasoning to frame harmful actions as morally necessary compromises.
ChatSOP: An SOP-Guided MCTS Planning Framework for Controllable LLM Dialogue Agents (2025.acl-long)

Copied to clipboard

Challenge: Existing models that use Large Language Models (LLMs) show superior performance in various tasks, but lack of controllability leads to unfocused conversations or task failure.
Approach: They propose a standard operating procedure (SOP) framework to regulate dialogue flow by integrating Chain of Thought reasoning and supervised fine-tuning for SOP prediction.
Outcome: The proposed method achieves a 27.95% improvement in action accuracy compared to baseline models based on GPT-3.5 and also shows notable gains for open-source models.
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard.
Approach: They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system.
Outcome: The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for instruction data selection have limitations such as relying on fragile external APIs, being affected by biases in GPT models, or reducing the diversity of the selected instruction dataset.
Approach: They propose an industrial-friendly, expert-aligned and diversity-preserved instruction data selection method: Clustering and Ranking (CaR).
Outcome: The proposed method outperforms Alpaca's existing methods by 32.1% in GPT-4 evaluations.
RankNAS: Efficient Neural Architecture Search by Pairwise Ranking (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods require training millions of architectures to estimate the accuracy of the search results.
Approach: They propose a performance ranking method (RankNAS) that uses pairwise ranking and search space pruning to enlarge the search space.
Outcome: The proposed method significantly accelerates NAS through pairwise ranking and search space pruning.
Distill, Fuse, Pre-train: Towards Effective Event Causality Identification with Commonsense-Aware Pre-trained Model (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to detect causal relationships in unstructured texts ignore trivial knowledge which may prejudice performance.
Approach: They propose a pipeline to build a commonsense-aware pre-trained model which integrates reliable task-specific knowledge from commonsens graphs.
Outcome: The proposed pipeline integrates reliable task-specific knowledge from commonsense graphs.
Neural Multitask Learning for Simile Recognition (D18-1)

Copied to clipboard

Challenge: Simile is a special type of metaphor, where comparators such as like and as are used to compare two objects.
Approach: They propose a neural network framework for simile sentence classification, simile component extraction and language modeling.
Outcome: The proposed framework outperforms rule-based and feature-based approaches in simile sentence classification and simile component extraction tasks.
ChemNER: Fine-Grained Chemistry Named Entity Recognition with Ontology-Guided Distant Supervision (2021.emnlp-main)

Copied to clipboard

Challenge: Named entity recognition (NER) is a fundamental step in scientific literature analysis to build AI-driven systems for molecular discovery, synthetic strategy designing, and manufacturing.
Approach: They propose an ontology-guided method for fine-grained named entity recognition (NER) it leverages the chemistry type ontologies to generate distant labels with flexible KB-matching .
Outcome: The proposed method significantly outperforms the state-of-the-art methods with a .25 absolute F1 improvement.
Advancing Fine-Grained Visual Understanding with Multi-Scale Alignment in Multi-Modal Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in multi-modal large language models have demonstrated remarkable capabilities in multimodal understanding, reasoning, and interaction.
Approach: They propose a method that effectively aligns and integrates multi-scale knowledge of objects . they use a pipeline that provides over 300K essential training data to enhance alignment .
Outcome: The proposed method effectively aligns and integrates multi-scale knowledge of objects, including texts, coordinates, and images.
AD-LLM: Benchmarking Large Language Models for Anomaly Detection (2025.findings-acl)

Copied to clipboard

Challenge: Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring.
Approach: They propose a benchmark that evaluates how large language models (LLMs) can help with NLP anomaly detection.
Outcome: The proposed model can perform zero-shot detection without tasks-specific training, data augmentation and model selection, and it can suggest unsupervised AD models.
“Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for model extraction attacks on large language models are inadequate . existing methods neglect the inconsistency between training tasks and LLM alignment .
Approach: They propose a model extraction algorithm that uses a policy-gradient-style training task to guide the crafting of preference for the local model.
Outcome: The proposed algorithm reduces query complexity while mitigating watermark protection . it can extract various state-of-the-art commercial LLMs while minimizing query complexity .
Counterfactual Recipe Generation: Exploring Compositional Generalization in a Realistic Scenario (2022.emnlp-main)

Copied to clipboard

Challenge: Existing models fail to learn and use culinary knowledge in a compositional way, argues a new study.
Approach: They propose a task that asks models to modify a base recipe according to the change of an ingredient.
Outcome: The proposed model can perform compositional generalization in a realistic setting . existing models have difficulties in modifying ingredients while preserving original style .
Towards Robust Evidence-Aware Fake News Detection via Improving Semantic Perception (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods lack sufficient semantic perception and are easily blinded by textual expressions.
Approach: They propose a model-agnostic training framework to improve the semantic perception of evidence-aware fake news detection by combining two kinds of data augmentations with synthetic data.
Outcome: The proposed framework outperforms state-of-the-art methods on the extended test set while achieving competitive performance on the original one.
PolyJoin: Semantic Multi-key Joinable Table Search in Data Lakes (2025.findings-naacl)

Copied to clipboard

Challenge: Existing joinable table search methods focus on single key (unary) joins, where a single column is the join key, but are ineffective when dealing with join keys composed of multiple columns (n-ary joins) Existing methods are inefficient when dealing . with joins composed of n-aries, which are prevalent on web table corpora.
Approach: They propose a joinable table search method that finds multi-key joinable tables on the web, given a query table.
Outcome: The proposed method outperforms the state-of-the-art methods on two real-world web table benchmarks.
Multi-Task Representation Alignment on Language Understanding: A Mutual Information Perspective (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to multitask learning fail to address task interference issues . Existing methods focus on task balancing or probabilistic modeling but fail to learn sufficient representations for all target tasks.
Approach: They propose a multi-task representation alignment framework to achieve task-specific alignment and self-alignment on shared representations from a mutual information perspective.
Outcome: The proposed framework outperforms 13 representative MTL methods under label-noisy and data-constrained conditions.
From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs? (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmark datasets focus on low-level cognitive tasks while providing limited coverage of higher-level reasoning skills.
Approach: They analyze the cognitive depth of popular LLM benchmarks using Bloom’s Taxonomy to evaluate both the cognitive and knowledge dimensions.
Outcome: The results show that incorporating higher-level cognitive instructions into the current instruction fine-tuning process improves model performance.
ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research has focused on optimizing general-purpose large language models to downstream tasks . however, these approaches inherently introduce data dependency, which hinders generalization and reusability.
Approach: They propose an algorithm that localizes the most task-sensitive attention heads and prunes by restricting attention training updates to these heads, thereby reducing alignment costs.
Outcome: The proposed algorithm achieves 2% performance improvement over baselines on three tasks while localizing the most task-sensitive attention heads.
Geo-BERT Pre-training Model for Query Rewriting in POI Search (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to solve the word mismatch between queries and documents are often inadequate to integrate geographic information into the pre-training model.
Approach: They propose to train a pre-training model to integrate semantics and geographic information in the pre-trained representations of POIs.
Outcome: The proposed model achieves excellent accuracy on a wide range of real-world datasets of map services.
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders (2021.acl-long)

Copied to clipboard

Challenge: End-to-end Speech Translation (E2E ST) encoders lack global context representation, whereas MT encoder lacks it.
Approach: They propose a Stacked Acoustic-and-Textual Encoding method for speech translation . they propose an adaptor module to alleviate representation inconsistency .
Outcome: The proposed method achieves state-of-the-art BLEU scores of 18.3 and 25.2 on two ST tasks.
Diversifying Dialogue Generation with Non-Conversational Text (2020.acl-main)

Copied to clipboard

Challenge: Neural network-based sequence-to-sequence models suffer from low diversity in open-domain dialogue generation.
Approach: They propose a way to diversify dialogue generation by leveraging non-conversational text . they collect large-scale corpus from forum comments, idioms and book snippets .
Outcome: The proposed model produces significantly more diverse responses without sacrificing relevance with context.
Unveiling the Potential of BERT-family: A New Recipe for Building Scalable, General and Competitive Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Generative large language models (LLMs) have significantly influenced various aspects of society, reshaping how we access and interact with information and knowledge.
Approach: They propose a pre-training task that helps BERT-family excel in wider applications . they also explore the integration of cutting-edge technologies into their models to further enhance their capabilities.
Outcome: The proposed model exhibits performance levels comparable to current SOTA LLMs across a spectrum of tasks.
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach: They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome: The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.
Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to extract relationships from texts depend on memory size and replay these memorized samples in subsequent tasks.
Approach: They propose to use a model to extract relations between entities from texts where the samples of different relations are delivered into the model continuously.
Outcome: The proposed model outperforms the state-of-the-art models and avoids catastrophic forgetting.
A Span-Extraction Dataset for Chinese Machine Reading Comprehension (D19-1)

Copied to clipboard

Challenge: Existing reading comprehension datasets are mostly in English . MRC is a new field of research that aims to comprehend the context of articles and answer the questions based on them.
Approach: They propose a Span-Extraction dataset for Chinese machine reading comprehension to add language diversities to existing reading comprehension datasets.
Outcome: The proposed dataset is composed of 20,000 real questions annotated on Wikipedia paragraphs by human experts.
ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbations (2024.emnlp-main)

Copied to clipboard

Challenge: Existing large language models struggle with systematically perturbed data designed to evade detection mechanisms.
Approach: They propose a large language model with homophonic substitutions and emoji transformations to test their models' robustness against cloaking perturbations.
Outcome: The proposed model underperforms in detecting offensive content when perturbations are applied to Chinese language datasets.
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026.acl-long)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) is a key parameter-efficient fine-tuning method . however, its effectiveness is hampered by semantic drift and structural incoherence .
Approach: They propose a low-rank Adaptation framework that tackles semantic drift and structural incoherence by pruning task-irrelevant directions.
Outcome: Experiments on large language models, vision models, and vision models show that the proposed framework outperforms LoRA and advanced dynamic rank allocation and sparsity-based methods.
Reinforcement Learning for Large Language Models via Group Preference Reward Shaping (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning Large Language Models (LLMs) are expensive and sensitive to reward model quality.
Approach: They propose a method that leverages preference-based comparisons rather than precise numerical rewards.
Outcome: Experiments show that GPRS outperforms critic-model-free RL algorithms on RLHF and reasoning tasks.
Improving Autoregressive Grammatical Error Correction with Non-autoregressive Models (2023.findings-acl)

Copied to clipboard

Challenge: Autoregressive models assign low probabilities to tokens that need corrections . grammatical error correction (GEC) is widely applied to natural language processing tasks .
Approach: They propose to use a non-autoregressive model as an auxiliary model to train GEC models to correct grammatical errors in sentences.
Outcome: The proposed method outperforms baselines on English and Chinese GEC tasks significantly.
Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for multimodal retrieval-augmented generation rely on semantic relevance or surface-level similarity, which are often misaligned with the actual utility of visual evidence for downstream reasoning.
Approach: They propose a latent notion of evidence usefulness and propose 'surrogate-accelerated' framework that efficiently estimates evidence utility using lightweight multimodal models.
Outcome: The proposed framework outperforms state-of-the-art models while achieving substantial reductions in computational cost.
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on knowledge distillation have shown that not all knowledge is necessary for learning a good student model.
Approach: They propose an actor-critic approach to selecting appropriate knowledge to transfer during the process of knowledge distillation.
Outcome: The proposed method outperforms several strong knowledge distillation baselines significantly on the GLUE datasets.
Joint Document-Level Event Extraction via Token-Token Bidirectional Event Completed Graph (2023.acl-long)

Copied to clipboard

Challenge: a joint exaction method can be used to extract document-level event records . it avoids inefficiency and error propagation issues in traditional pipeline methods .
Approach: They propose a joint exaction method that can avoid inefficiency and error propagation issues . they propose eType-Role1-Roul2 as the edge type to reveal which tokens play argument roles .
Outcome: The proposed method can avoid inefficiency and error propagation issues in traditional pipeline methods.
Predicting Entity Salience in Extremely Short Documents (2024.emnlp-industry)

Copied to clipboard

Challenge: False positive: ES is a natural language understanding task that determines which entities are most salient to a passage . Falsity: Popsicle, Frank Epperson and San Francisco are salient entities .
Approach: They propose a lightweight and data-efficient approach for entity salience detection on short documents . they propose he use of a human-labeled dataset to evaluate entity salient on short questions .
Outcome: The proposed approach achieves competitive performance over state-of-the-art models at significant cost and latency advantages.
Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering (2025.coling-main)

Copied to clipboard

Challenge: Hallucination remains a critical challenge in large language models (LLMs) in high-stake domains such as legal question answering.
Approach: They propose a method to mitigate hallucination in legal question answering by using behavior cloning and a novel Hard Sample-aware Direct Preference Optimization.
Outcome: The proposed method improves non-hallucinated Statute Rate, Statute Relevance Rate, Legal Claim Truthfulness, and traditional metrics.
PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for text generation still suffer from incoherence problems . Neural sequence-to-sequence (seq2sequ) models generate fluent results .
Approach: They propose a novel generation framework that leverages autoregressive self-attention mechanism to conduct content planning and surface realization dynamically.
Outcome: The proposed framework outperforms baseline models and generates more coherent texts with richer contents.
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have expanded their potential applications in finance.
Approach: They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions.
Outcome: The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios.
Learning Architectures from an Extended Search Space for Language Modeling (2020.acl-main)

Copied to clipboard

Challenge: Neural architecture search (NAS) has advanced in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell.
Approach: They propose a general approach to learn both intra-cell and inter-cell architectures . they implement their approach in a differentiable architecture search system .
Outcome: The proposed approach outperforms the baseline on PTB and WikiText data and shows good transferability to other systems.
Extract-Select: A Span Selection Framework for Nested Named Entity Recognition with Generative Adversarial Training (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies treat named entity recognition as a sequential labeling problem.
Approach: They propose a span selection framework for nested named entity recognition . they propose nesting entities with different input categories would be separately extracted .
Outcome: The proposed framework outperforms competing models on four benchmark datasets.
TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation (2024.acl-long)

Copied to clipboard

Challenge: e.g., GPT-4 still lag behind humans in effective multitasking, a study finds . current textual simulations do not adequately address the notion of time .
Approach: They propose a textual simulated environment that incorporates complex temporal dynamics and constraints that better reflect real-life planning scenarios.
Outcome: The proposed model incorporates complex temporal dynamics and constraints that better reflect real-life planning scenarios.
NLP-ADBench: NLP Anomaly Detection Benchmark (2025.findings-emnlp)

Copied to clipboard

Challenge: Anomaly detection (AD) is an important machine learning task, but its effectiveness in detecting harmful content, phishing attempts, and spam reviews is limited.
Approach: They introduce NLP-ADBench, the most comprehensive NLP anomaly detection benchmark to date . it includes eight curated datasets and 19 state-of-the-art algorithms .
Outcome: The NLP-ADBench benchmark includes 19 state-of-the-art methods and 8 curated datasets . no single model dominates across all datasets, indicating need for automated model selection .
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches focus on minimizing distances between words in aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates.
Approach: They propose a ranking-oriented induction model to learn personalized mapping function for each word.
Outcome: The proposed model can learn personalized mapping function for each word on public datasets including rich-resource and low-resourced languages.
T 2 -NER: A Two-Stage Span-Based Framework for Unified Named Entity Recognition with Templates (2023.tacl-1)

Copied to clipboard

Challenge: Named Entity Recognition (NER) has evolved from flat to overlapped and discontinuous . NER is a text recognition task that recognizes mentions that represent entities in text .
Approach: They propose a two-stage span-based framework to solve a unified NER task using two stages . they extract entity spans, classify over all entity span pairs and combine them to train two stages.
Outcome: The proposed framework beats all the current competitive baselines on eight benchmark datasets, obtaining the best performance of unified NER.
COSMOS: Connectivity-Oriented Submodular Maximization for Optimal Subgraph Retrieval (2026.acl-long)

Copied to clipboard

Challenge: Existing paradigms treat facts independently or employ myopic search, failing to optimize collective subgraph utility.
Approach: They propose a framework that formalizes evidence retrieval as a constrained submodular maximization problem.
Outcome: The proposed framework captures the trade-off between information relevance and structural complexity.
LRBench and Judge-R1: Principled Evaluation and Training of LLM-Based Judges for Long-Context Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for evaluating large language models (LLMs) under long contexts are underexplored.
Approach: They propose a large-scale benchmark for evaluating large language models (LLMs) that combines reinforcement learning with multi-turn search to enable grounded and principle-aware evaluation.
Outcome: The proposed model outperforms single-turn baselines across domains and principles.
AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting (2025.findings-acl)

Copied to clipboard

Challenge: Keyword spotting (KWS) is a useful mechanism to identify spoken commands in voice-enabled systems, but catastrophic forgetting is causing models to lose their ability to recognize earlier keywords.
Approach: They propose an exemplar-free method that updates model parameters without revisiting earlier data.
Outcome: The proposed method outperforms existing continual learning methods on a variety of datasets and settings.
Teaching Language Models to Self-Improve by Learning from Language Feedback (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) generate content that can be untruthful or harmful.
Approach: They propose a method that leverages model feedback for alignment . they use a base language model to generate initial responses, critiqued and refined .
Outcome: The proposed method outperforms strong baselines across diverse tasks and model sizes.
MedCite: Can Language Models Generate Verifiable Text for Medicine? (2025.findings-acl)

Copied to clipboard

Challenge: Existing LLM-based medical question answering systems lack citation generation and evaluation capabilities, raising concerns about their adoption in practice.
Approach: They propose a framework that facilitates the design and evaluation of LLM citations for medical tasks and a retrieval-citation method that generates high-quality citation.
Outcome: The proposed method achieves superior citation precision and recall improvements compared to strong baseline methods and correlates well with annotation results from professional experts.
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Challenge: a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach: They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome: The proposed agents are based on operating systems (OS) and operating systems frameworks.
MultiAgentESC: A LLM-based Multi-Agent Collaboration Framework for Emotional Support Conversation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on generating responses directly and neglect integration of domain-specific reasoning and expert interaction.
Approach: They propose a training-free multi-agent collaboration framework for ESC to emulate human-like process of providing emotional support through dialogue analysis, strategy deliberation, and response generation.
Outcome: The proposed framework excels at providing emotional support and diversifying support strategy selection.
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition (D19-1)

Copied to clipboard

Challenge: Neural architecture search (NAS) is a popular approach for finding new models and freeing researchers from the hard work of designing network architectures.
Approach: They propose differentiable neural architecture search methods for natural language processing . they remove the softmax-local constraint and apply it to named entity recognition .
Outcome: The proposed method outperforms strong baselines on the language modeling task.
Why Can Distillation Work with Limited Resources? A Systematic Study (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have driven reasoning performance . low-resource distillation can boost models' performance, but a framework is missing .
Approach: They conduct a controlled experiment to find out why low-resource distillation can boost model performance . they find that distillation enhances the presence of advanced cognitive behaviors .
Outcome: The proposed model shows more flexible reasoning, the authors show . they show that distillation enhances the presence of advanced cognitive behaviors .
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Copied to clipboard

Challenge: Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach: They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome: The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.
Large Language Models for Controllable Multi-property Multi-objective Molecule Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for molecule optimization fail to capture property-specific objectives . a series of instruction-tuned LLMs can perform targeted property-specific optimization .
Approach: They propose a set of instruction-tuned LLMs that can perform targeted property-specific optimization.
Outcome: a new instruction-tuned LLM can perform targeted property-specific optimization.
Explaining Length Bias in LLM-Based Preference Evaluations (2025.findings-emnlp)

Copied to clipboard

Challenge: a preference evaluation metric is often biased towards longer responses, revealing a reliability problem . a decomposition of the preference evaluation into two components is needed to understand this bias.
Approach: They propose to decompose the preference evaluation metric into two key components . the first component is length-dependent and related to trustworthiness .
Outcome: The proposed evaluation metric is based on two components: desirability and information mass.
DiNeR: A Large Realistic Dataset for Evaluating Compositional Generalization (2023.emnlp-main)

Copied to clipboard

Challenge: Existing compositional generalization datasets lack natural language variation due to limited data scale or lack of diversity.
Approach: They propose a compositional generalization task to evaluate natural language understanding ability under compositional settings.
Outcome: The proposed method outperforms the plain seq2seq trained version by a large margin . it uses two strong baseline methods and large language models to tackle the task .
DiscoverGPT: Multi-task Fine-tuning Large Language Model for Related Table Discovery (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods to learn and evaluate the table semantic relatedness of tabular data are based on pretrain-and-finetune paradigms.
Approach: They propose a multi-task fine-tuning framework that holistically discovers and leverages the intricate relationships among the supervisions to optimize the performance on the data discovery task.
Outcome: The proposed framework outperforms the best performing baseline by up to 7% in F1 score.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations