Papers by Hao He

85 papers
Optimizing Code Retrieval: High-Quality and Scalable Dataset Annotation through Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for code retrieval struggle to balance scalability and annotation quality.
Approach: They propose a method that integrates functions called within the repository and information on third-party APIs to enhance the annotation context.
Outcome: The proposed method improves the annotation context by incorporating functions called within the repository and information on third-party API functionalities.
AIDA-SEAT: Towards Reliable AI Doctor Assistant via State-Evaluation-Action Tree Enhanced LLMs in Online Hospital (2026.acl-industry)

Copied to clipboard

Challenge: Existing systems rely on large language models or retrieval-augmented generation (RAG) but these methods lack the explicit logical pathways essential for multi-step reasoning.
Approach: They propose an AIDA-SEAT framework to provide reliable clinical decision-making support by transforming and modifying medical documents and doctors' state-evaluation-action trees.
Outcome: The proposed framework achieves 1.01% higher than current state-of-the-art (SOTA) baselines across five departments, including common RAG-based methods.
Forest for the Trees: Overarching Prompting Evokes High-Level Reasoning in Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have greatly propelled the progress of natural language process (NLP).
Approach: They propose a deductive paradigm that decomposes the reasoning process and a prompting method that elicits high-level thinking of large language models (LLMs).
Outcome: The proposed method improves ChatGPT and CoT by 19.0% and 3.1% on MMLU’s College Physics, 8.8% and 2.3% on GSM8k, and 10.3% and 2.5% on StrategyQA, respectively.
On the Sentence Embeddings from Pre-trained Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Pre-trained contextual representations like BERT have been widely used for NLP tasks.
Approach: They propose to transform anisotropic sentence embedding distribution to smooth and isotropic Gaussian distribution by normalizing flows that are learned with an unsupervised objective.
Outcome: The proposed method achieves significant performance gains over state-of-the-art embeddings on a variety of semantic textual similarity tasks.
Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs struggle to identify errors in financial documents, a study shows . 18% of financial practitioners make errors daily, one-third make errors several times weekly, and 59% make errors multiple times monthly.
Approach: They introduce FinED-Bench, a publicly available Benchmark for financial error detection . it covers nine real-world financial scenarios and includes over 900 documents in 2025 . supervised fine-tuning can significantly improve the performance of weaker LLMs, they show .
Outcome: The proposed benchmark covers nine real-world financial scenarios and includes over 900 documents reported in 2025 that are unseen by existing language models.
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis (2020.acl-main)

Copied to clipboard

Challenge: sentiment knowledge is ignored in sentiment analysis, despite its use in pretraining.
Approach: They propose to use sentiment knowledge to learn a unified sentiment representation for multiple sentiment analysis tasks.
Outcome: The proposed method outperforms strong pre-training baseline on three kinds of sentiment tasks.
Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL (2026.findings-acl)

Copied to clipboard

Challenge: Translating natural language questions into SQL is a core challenge in natural language understanding and human-computer interaction.
Approach: They propose a reinforcement learning framework and model family to generate accurate, executable SQL using a lightweight reward signal based solely on execution correctness.
Outcome: The proposed framework outperforms previous versions of 70B-class systems and achieves state-of-the-art execution accuracy across six diverse Text2SQL benchmarks.
Code Representation Pre-training with Complements from Program Executions (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing languages have syntactic representations of code to improve code intelligence, but they are difficult to learn from code.
Approach: They propose to embed dynamic information of programs revealed by their test cases into feature representations of code as complements.
Outcome: The proposed method yields 6%/19% mAP improvements over its masked language modeling counterparts.
A Unified One-Step Solution for Aspect Sentiment Quad Prediction (2023.findings-acl)

Copied to clipboard

Challenge: Existing ASQP datasets are small and low-density, hindering technical advancement . et al. (2017): aspect sentiment quad prediction provides a complete aspect-level sentiment structure.
Approach: They propose a one-step solution for Aspect sentiment quad prediction that can detect aspect categories and identify aspectopinion-sentiment triplets simultaneously.
Outcome: The proposed solution can detect aspect categories and identify aspectopinion-sentiment triplets simultaneously.
T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Concepts (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on text-to-image (T2I) models focus on text alignment, image quality, and object composition capabilities.
Approach: They propose a T2I-FactualBench benchmark to evaluate the factuality of knowledge-intensive concept generation.
Outcome: The proposed framework evaluates the factuality of knowledge-intensive concept generation tasks.
Progressive Re-ranking for Multimodal Retrieval-Augmented Generation via Curriculum Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve retrieval performance of large language models are limited by static knowledge.
Approach: They propose a multimodal re-ranking framework that combines curriculum learning with fine-grained reranking and multimodal section reassessment to improve CLIP-based visual coarse-grain retrieval.
Outcome: The proposed framework achieves state-of-the-art answer accuracy and competitive retrieval performance on InfoSeek and Enc-VQA.
Correctable-DST: Mitigating Historical Context Mismatch between Training and Inference for Improved Dialogue State Tracking (2022.emnlp-main)

Copied to clipboard

Challenge: Existing dialogue state tracking approaches predict the dialogue state of a target turn sequentially based on the ground-truth previous dialogue state.
Approach: They propose a method that predicts dialogue state sequentially based on previous dialogue state . they propose generating a previously “predicted” dialogue state using ground-truth previous dialogue states .
Outcome: The proposed method achieves 67.51%, 68.24%, 70.30%, 71.38%, and 81.27% joint goal accuracy on MultiWOZ 2.0-2.4 datasets.
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline (2022.naacl-main)

Copied to clipboard

Challenge: Rather than pursuing the reachless SOTA accuracy, researchers are focusing on model efficiency and usability.
Approach: They propose an evaluation and a public leaderboard for efficient NLP models that depicts the Pareto Frontier for various language understanding tasks.
Outcome: The proposed model outperforms or performs on par with SOTA compressed and early exiting models.
TRACE: Traversal Retrieval-Augmented Chain of Evidence for Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Long-context Document Visual Question Answering (DocVQA) methods struggle with visual semantics or handling finite context windows.
Approach: They propose a new approach to longcontext document visual question answering that transforms retrieval into adaptive evidence chain construction using a Bi-Layered Graph.
Outcome: The proposed approach achieves an average accuracy improvement of 14.07% on M5BookVQA and exhibits robust generalization with a 13.38% gain across four established benchmarks.
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance.
Approach: They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning .
Outcome: Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance .
ALCAP: Alignment-Augmented Music Captioner (2023.emnlp-main)

Copied to clipboard

Challenge: Traditional approaches to music captioning ignore the intricate interplay between the two . however, a comprehensive understanding of music necessitates the integration of both these elements.
Approach: They propose a method to learn multimodal alignment between audio and lyrics through contrastive learning.
Outcome: The proposed method achieves new state-of-the-art on two music captioning datasets.
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding (2020.acl-demos)

Copied to clipboard

Challenge: MT-DNN is an open-source natural language understanding toolkit . it allows researchers and developers to train customized deep learning models .
Approach: They present MT-DNN, an open-source natural language understanding toolkit . it is designed to facilitate rapid customization for a broad spectrum of NLU tasks . MT supports multi-task knowledge distillation, which can substantially compress a deep neural model without significant performance drop.
Outcome: The proposed model can significantly compress a large model without significant performance drop.
Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation (2021.naacl-main)

Copied to clipboard

Challenge: Existing non-autoregressive machine translation models have shown significant inference speedup but suffer from inferior translation accuracy.
Approach: They propose to use AT as an auxiliary task to transfer AT knowledge to NAT models by knowledge distillation.
Outcome: The proposed method achieves significant improvements over baseline non-Autoregressive machine translation models on WMT14 En-De and WMT16 En-Ro datasets.
Calibrated Speculative Decoding: Frequency-Guided Candidate Selection for Efficient Inference (2026.acl-long)

Copied to clipboard

Challenge: Speculative decoding (SD) is a powerful and efficient way to accelerate autoregressive generation.
Approach: They propose a training-free framework that recovers valid tokens discarded by standard verification . they use online correction memory and Semantic Consistency Gating to analyze rejections .
Outcome: The proposed framework outperforms existing methods and achieves peak throughput speedup of 2.33x.
FuzzAug: Data Augmentation by Coverage-guided Fuzzing for Neural Test Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Using large language models to generate meaningful tests is expensive and time-consuming .
Approach: They propose a data augmentation technique that incorporates valid testing semantics and diverse coverage-guided inputs into large language models.
Outcome: The proposed technique improves performance over the baselines by incorporating valid testing semantics and providing diverse coverage-guided inputs.
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing performance through increased use of expert knowledge often result in diminishing sparsity during expert selection.
Approach: They propose a framework that integrates the computational processes of MoE with the concept of knowledge transferring in multi-task learning.
Outcome: The proposed framework outperforms existing methods under identical conditions concerning the number of experts.
CLEAN–EVAL: Clean Evaluation on Contaminated Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods to evaluate large language models are prone to data contamination.
Approach: They propose a method which parses contaminated data and back-translates it into a candidate set.
Outcome: The proposed method reduces data contamination and evaluates the LLMs more cleanly.
End-to-End Conversational Search for Online Shopping with Utterance Transfer (2021.emnlp-main)

Copied to clipboard

Challenge: a new study proposes a conversational search system that integrates product attributes and dialog with search . but it faces two real world challenges: imperfect product schema/knowledge and lack of training dialog data .
Approach: They propose an end-to-end conversational search system that integrates search with text . they propose an utterance transfer approach that generates dialogue utterations from other domains .
Outcome: The proposed system outperforms the best tested baseline in a conversational search dataset for online shopping.
On Safety Risks in Experience-Driven Self-Evolving Agents (2026.findings-acl)

Copied to clipboard

Challenge: Experience-driven self-evolution has emerged as a promising paradigm for improving the autonomy of large language model agents, yet its reliance on self-curated experience introduces underexplored safety risks.
Approach: They investigate how experience accumulation and utilization in self-evolving agents affect safety performance across web-based and embodied environments.
Outcome: The findings expose inherent limitations of current self-evolving agents and call for more principled strategies to ensure safe and reliable adaptation.
STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework (P19-1)

Copied to clipboard

Challenge: Simultaneous translation is notoriously dif- ficult due to word-order differences.
Approach: They propose a prefix-to-prefix framework that implicitly learns to anticipate in a single translation model.
Outcome: The proposed framework achieves low latency and reasonable qual- ity on 4 directions.
Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have made it difficult to build an automated debate system that helps people to synthesise persuasive arguments.
Approach: They propose to use an argument mining dataset to capture the end-to-end process of preparing an argumentative essay for a debate.
Outcome: The proposed dataset shows that it performs better on individual tasks than on human-centred evaluations.
Modeling Content Importance for Summarization with Pre-trained Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Existing studies on content importance do not consider semantics and context when evaluating importance.
Approach: They apply information theory to pre-trained language models to define the concept of importance from the perspective of information amount.
Outcome: Experiments on CNN/Daily Mail and New York Times show that the proposed model can model the importance of content better than previous methods based on F1 and ROUGE scores.
PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling (2022.coling-1)

Copied to clipboard

Challenge: Existing slot filling models memorize inherent patterns of entities and contexts from training data.
Approach: They propose a perturbed semantic structure awareness transferring method for slot filling models . they use two MLM-based training strategies to learn contextual semantic structure and word distribution .
Outcome: The proposed method outperforms existing methods and gains strong generalization while preventing model from memorizing inherent patterns of entities and contexts.
When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing research on personalized LLM agents focuses on the effectiveness of personalized responses.
Approach: They propose a benchmark to quantify intent legitimation in personalized interactions . they propose 'detection-reflection' method that detects intent legititimation from internal representation space .
Outcome: The proposed method reduces safety degradation by using internal representation space.
LatticeGen: Hiding Generated Text in a Lattice for Privacy-Aware Large Language Model Generation on Cloud (2024.findings-naacl)

Copied to clipboard

Challenge: Currently, the server controls the generated text, but users can't keep it private . prompted generation is a common interaction paradigm for large language models on cloud .
Approach: They propose a protocol where the server handles most of the computation while the client controls the sampling operation.
Outcome: The proposed protocol protects both prompt and generation under strong attacks.
Pattern-revising Enhanced Simple Question Answering over Knowledge Bases (C18-1)

Copied to clipboard

Challenge: Simple question answering over knowledge bases is one of the most important natural language processing tasks.
Approach: They propose to conduct pattern extraction and entity linking first and put forward pattern revising procedure to mitigate the error propagation problem.
Outcome: The proposed method outperforms the current state-of-the-art in this task by an absolute large margin.
LONGAGENT: Achieving Question Answering for 128k-Token-Long Documents through Multi-Agent Collaboration (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have been successful in understanding language and processing text, but their cost prohibits their practical applications.
Approach: They propose a multi-agent collaboration method that breaks down lengthy documents into smaller, more manageable chunks and organizes the member agents to read their assigned chunks.
Outcome: The proposed method achieves 16.42% and 1.63% accuracy gains over existing models on single-hop and multi-hop QA settings.
FacLens: Transferable Probe for Foreseeing Non-Factuality in Fact-Seeking Question Answering of Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing non-factuality detection methods require response generation, which incurs significant computational overhead.
Approach: They propose a lightweight model called Factuality Lens which effectively probes hidden representations of fact-seeking questions for the NFP task.
Outcome: The proposed model is able to probe hidden representations of fact-seeking questions and reduce development costs.
Exploring Logically Dependent Multi-task Learning with Causal Inference (2020.emnlp-main)

Copied to clipboard

Challenge: Hierarchical multi-task learning models can utilize task dependencies by stacking encoders and outperform democratic ones.
Approach: They propose a model that utilizes the labels of all lower-level tasks and a Gumbel sampling model to deal with cascading errors.
Outcome: The proposed model outperforms democratic models on six out of seven subtasks and achieves state-of-the-art on the two English and one Chinese datasets.
SimPBL: A Multi-Agent Framework for Project-Based Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing LLMs provide partial assistance without modeling these roles, and overly comprehensive help can reduce learner autonomy.
Approach: They propose a multi-agent framework with an orchestrator agent that provides adaptive scaffolding from interaction logs and collaborator agents that support project work through boundary-aware collaboration.
Outcome: The proposed framework improves learner examination scores by 14% . it is based on a multi-agent framework with an orchestrator agent .
Rethinking Text-based Protein Understanding: Retrieval or LLM? (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies have focused on integrating protein-related knowledge into large language models through continued pretraining and multi-modal alignment.
Approach: They propose a retrieval-enhanced method which significantly outperforms fine-tuned LLMs for protein-to-text generation and shows accuracy and efficiency in training-free scenarios.
Outcome: The proposed method significantly outperforms fine-tuned LLMs for protein-to-text generation and shows accuracy and efficiency in training-free scenarios.
VisualEDU: A Benchmark for Assessing Coding and Visual Comprehension through Educational Problem-Solving Video Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: VisualEDU is a benchmark to evaluate VLMs' ability to produce coherent video from text . advanced proprietary models show promise, but struggle with increasing task complexity .
Approach: VisualEDU is a benchmark to evaluate VLMs' ability to produce coherent video from text . it integrates meta-prompt learning, visual and code feedback, and a drawing toolkit to enhance output quality.
Outcome: VisualEDU is a benchmark to evaluate VLMs' ability to produce coherent video from text . it integrates meta-prompt learning, visual and code feedback, and a drawing toolkit to improve output quality.
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks primarily focus on Python and are limited in terms of language diversity.
Approach: They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions.
Outcome: The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task.
To What Extent Do Natural Language Understanding Datasets Correlate to Logical Reasoning? A Method for Diagnosing Logical Reasoning. (2022.coling-1)

Copied to clipboard

Challenge: Reasoning and knowledge-related skills are considered as fundamental skills for natural language understanding (NLU) tasks.
Approach: They propose a method to diagnose correlations between an NLU dataset and a specific skill.
Outcome: The proposed method is able to diagnose correlations between dataset and logical reasoning skill on 8 MRC and 3 NLI datasets.
Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding (2023.emnlp-main)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) is a technique that guides large language models to decompose complex tasks into multi-step reasoning processes.
Approach: They propose a two-step reasoning framework based on prompt tuning to implement step-by-step thinking for MLMs on NLU tasks.
Outcome: The proposed framework outperforms baselines and achieves state-of-the-art performance on two NLU tasks.
Benchmarking Commonsense Knowledge Base Population with an Effective Evaluation Dataset (2021.emnlp-main)

Copied to clipboard

Challenge: Existing evaluations on the population task are either not accurate (automatic evaluation with randomly sampled negative examples) or of small scale (human annotation).
Approach: They propose a reasoning over commonsense knowledge bases (CSKBs) that are free-text and have a human annotation set to probe commonsensical reasoning.
Outcome: The proposed model is based on a human-annotated evaluation set and is compared with existing models on the population task.
Robust Neural Machine Translation with Joint Textual and Phonetic Embedding (P19-1)

Copied to clipboard

Challenge: Neural machine translation models are sensitive to noises in input sentences . one special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations.
Approach: They propose to embed phonetic and textual information into neural machine translation datasets to improve robustness to homophone noises.
Outcome: The proposed method improves the robustness of neural machine translation to homophone noises on clean test sets.
Diversified Multiple Instance Learning for Document-Level Multi-Aspect Sentiment Classification (2020.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that D-MILN outperforms recent weakly-supervised baselines . document-level multi-aspect sentiment classification requires a lot of manual aspect-level annotations - which is time-consuming and laborious .
Approach: They propose a novel Diversified Multiple Instance Learning Network to achieve DMSC with only document-level weak supervision.
Outcome: The proposed method outperforms weakly-supervised baselines on TripAdvisor and BeerAdvocate datasets.
LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration Benchmark (2026.findings-acl)

Copied to clipboard

Challenge: Mobile GUI agents show promise in automating tasks but face significant generalization challenges in long-tail scenarios.
Approach: They propose a benchmark framework for mobile GUI agents that measures the performance of GUI agents by analyzing their performance.
Outcome: The LearnGUI benchmark outperforms existing methods in offline and online evaluations and demonstrates consistent gains across model architectures.
GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR (2026.acl-long)

Copied to clipboard

Challenge: Existing parameter-efficient methods for RLVR face limitations . low-rank adaptation methods do not account for the distinct optimization dynamics .
Approach: They propose a low-rank adaptation method tailored for RLVR that exploits the anisotropic structure of RL update subspace and extracts its principal directions via Singular Value Decomposition (SVD).
Outcome: Experiments on large reasoning models show that GeoRA outperforms strong low-rank baselines across RLVR settings while showing stronger generalization and less forgetting on out-of-domain tasks.
De-Confounded Variational Encoder-Decoder for Logical Table-to-Text Generation (2021.acl-long)

Copied to clipboard

Challenge: Logical table-to-text generation is challenging where deep learning models capture surface-level spurious correlations rather than the causal relationships between the table x and the sentence y.
Approach: They propose to use variational inference to estimate the confounders in the latent space and cooperate with the causal intervention based on Pearl’s do-calculus to alleviate the spurious correlations.
Outcome: The proposed model outperforms baselines and achieves new state-of-the-art performance on two logical table-to-text datasets in terms of logical fidelity.
Fine-Mem: Fine-Grained Feedback Alignment for Long-Horizon Memory Management (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to memory management rely on final task performance as the primary reward, resulting in severe reward sparsity and ineffective credit assignment.
Approach: They propose a framework for fine-grained feedback alignment using a Chunk-level step reward and Evidence-Anchored Reward Attribution to redistribute global rewards based on memory items utilized as evidence in reasoning.
Outcome: The proposed framework outperforms baselines and supports generalization across different model configurations and backbones.
Multi-agent Learning for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Experimental results show that training with more than one agent improves translation quality and improves accuracy.
Approach: They propose to introduce diverse agents in an in- teractive updating process to train NMT models with an additional agent.
Outcome: The proposed approach improves on NIST Chinese-English, IWSLT 2014 German- English, WMT 2014 English-German translation tasks and shows competitive performance on all tasks.
Better Literary Translation: A Multi-Aspect Data Generation and LLM Training Approach (2026.acl-industry)

Copied to clipboard

Challenge: Literary translation requires balancing expression fluency with literary effect due to the scarcity of high-quality training data and the difficulty of capturing nuanced quality trade-offs.
Approach: They propose a multi-aspect iterative refinement framework that generates high-quality translation references and preference data through specialized LLM translators.
Outcome: The proposed models outperform the ground truth for SFT by 8.65 CEA100 points while leveraging an explicit reward model for GRPO yields an additional 1.51 point improvement.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
A Semantically Consistent and Syntactically Variational Encoder-Decoder Framework for Paraphrase Generation (2020.coling-main)

Copied to clipboard

Challenge: Paraphrase generation is a longstanding problem in natural language processing (NLP) Neural network-based methods have shown great progress on paraphrase generation.
Approach: They propose a framework that integrates variational inference on a target-related latent variable to introduce the diversity.
Outcome: The proposed framework outperforms baseline models on the metrics based on n-gram matching and semantic similarity, and it can generate multiple different paraphrases by assembling different syntactic variables.
Breaking the Reasoning Barrier A Survey on LLM Complex Reasoning through the Lens of Self-Evolution (2025.findings-acl)

Copied to clipboard

Challenge: OpenAI's O1 and subsequent projects like DeepSeek R1 have significantly advanced research on complex reasoning in LLMs.
Approach: They analyze existing reasoning studies from the perspective of self-evolution and summarize O1-like works from open-source projects like DeepSeek R1 and Kimi-k1.5.
Outcome: The proposed models are based on open-source models and pioneer advanced methodologies like Scaling Reinforcement Learning (RL).
Bridging SFT and RL: Dynamic Policy Optimization for Robust Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing unified optimization strategies overlook the statistical conflict between these distinct gradient signals.
Approach: They propose a framework to reduce bias-variance trade-offs in Large Language Models . they propose DYPO, which leverages intrinsic group dynamics to significantly reduce RL gradient variance .
Outcome: The proposed framework outperforms traditional pipelines on reasoning benchmarks and out-of-distribution tasks.
Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research focused on developing data generation methods, while insufficient attention has been paid to quality control mechanisms and often produces inaccurate and unhelpful data.
Approach: They propose an algorithm that automatically generates high-quality preference data, eliminating manual annotation requirements.
Outcome: The proposed algorithm outperforms baselines in human preference alignment and reward optimization.
AJ-Bench: Benchmarking Agent-as-a-Judge for Environment-Aware Evaluation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to verify agent behaviors in complex environments rely on rule-based verifiers or LLM-as-a-Judge models.
Approach: They propose a benchmark to evaluate Agent-as-a-Judge across three domains . the benchmark covers search, data systems, and graphical user interfaces - with 155 tasks and 516 trajectories .
Outcome: The proposed benchmark outperforms existing benchmarks in search, data systems, and GUI domains while revealing open challenges in agent-based verification.
UnitedQA: A Hybrid Approach for Open Domain Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Recent work on open-domain question answering focuses on either extractive or generative readers exclusively.
Approach: They propose a hybrid approach to extractive and generative readers that leverages both models.
Outcome: The proposed approach outperforms state-of-the-art models on NaturalQuestions and TriviaQA respectively.
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)

Copied to clipboard

Challenge: Existing intent detection models can only handle predefined intent classes in the offline environment.
Approach: They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems .
Outcome: The proposed method outperforms existing models on three benchmarks.
HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization (2021.naacl-main)

Copied to clipboard

Challenge: Existing models for hierarchical text classification do not consider statistical constraint on label representations learned by structure encoder.
Approach: They propose a new hierarchical text classification model called HTCInfoMax which incorporates two modules to improve the model's representations.
Outcome: The proposed model can model the interaction between each text sample and its ground truth labels explicitly which filters out irrelevant information.
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored.
Approach: They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain.
Outcome: MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows.
Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies have focused on diagnosing LMs' reasoning abilities in natural language understanding tasks.
Approach: They propose a diagnostic method for first-order logic reasoning with a proposed benchmark, LogicNLI.
Outcome: The proposed method disentangles the target FOL reasoning from commonsense inference and can be used to diagnose LMs from four perspectives: accuracy, robustness, generalization, and interpretability.
Prototype-based HyperAdapter for Sample-Efficient Multi-task Tuning (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning pre-trained language models are limited to low-data regimes and require learning different modules to adapt to diverse tasks.
Approach: They propose a framework for parameter-efficient fine-tuning that trains modules per task . they use an instance-dense retriever and a prototypical hypernetwork to generate conditional modules .
Outcome: The proposed framework outperforms existing methods on multi-task learning and few-shot transfer learning.
SimRPD: Optimizing Recruitment Proactive Dialogue Agents through Simulator-Based Data Evaluation and Selection (2026.acl-industry)

Copied to clipboard

Challenge: High-quality data in training proactive dialogue agents is scarce, despite fine-tuning and reinforcement learning . a recent study has shown that the effectiveness of supervised fine-touring is limited by the lack of high-quality, domain-specific training data.
Approach: They propose a framework for training recruitment proactive dialogue agents using a high-fidelity user simulator and a multi-dimensional evaluation framework based on Chain-of-Intention.
Outcome: The proposed framework outperforms existing simulator-based data selection strategies in a real-world recruitment scenario.
Efficient Paths and Dense Rewards: Probabilistic Flow Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to mitigate inference inefficiency and optimization difficulty are fragmented and constrained by inherent trade-offs.
Approach: They propose a framework that reconceptualizes discrete reasoning steps as a continuous probabilistic flow, quantifying the contribution of each step toward the ground-truth answer.
Outcome: The proposed framework achieves a superior balance between inference efficiency and reasoning performance on challenging benchmarks.
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training (2024.acl-long)

Copied to clipboard

Challenge: Large language models suffer from severe hallucinations, compromising performance in knowledge-oriented QA, dialogue, and writing.
Approach: They propose to enhance the information searching and reflection ability of large language models by training them in position-agnostic multi-step QA tasks to improve their model's accuracy.
Outcome: The proposed model improves in multi-doc QA and other benchmarks by 13.7% absolute gain in shuffled settings, by 21.5% in passage retrieval task.
Understanding Programs by Exploiting (Fuzzing) Test Cases (2023.findings-acl)

Copied to clipboard

Challenge: Semantic understanding of programs has attracted great attention in the community . large language models (LLMs) are capable of learning contextual information from data at scale .
Approach: They propose to incorporate a relationship between inputs and possible outputs into learning for achieving a deeper semantic understanding of programs.
Outcome: The proposed method outperforms current state-of-the-art on two programming tasks and outperformed current state of the art by large margins.
Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidance (2025.emnlp-main)

Copied to clipboard

Challenge: Existing solutions for text-to-image synthesis are sensitive on textual prompts, posing a challenge for novice users.
Approach: They propose a dialogue-based TIS prompt generation model that emphasizes user experience for novice users.
Outcome: The proposed model emphasizes user experience for novice users . it improves user-centricity score while maintaining a competitive quality of synthesized images.
Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Long-context modeling capabilities are important for large language models (LLMs) however, training LLMs with long context windows is insufficient since some samples do not exhibit strong semantic dependencies across long contexts.
Approach: They propose a data mining framework ProLong that assigns each training sample with a long dependency score and ranks and filters them according to their results.
Outcome: The proposed framework can rank and filter training samples that exhibit more powerful long-context modeling abilities.
Tree-CoT-RT: An Explainable Multi-Path Tree-Guided Chain-of-Thought and Reinforcement Learning Framework for Aspect Sentiment Quad Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods lack explainability and generalization, making it difficult to justify inference decisions and detect implicit sentiment across domains and varied expression patterns.
Approach: They propose an explainable multi-path tree-guided chain-of-thought framework specifically designed for ASQP.
Outcome: Experiments on benchmark datasets show that Tree-CoT-RT outperforms baselines.
MTR: A Dataset Fusing Inductive, Deductive, and Defeasible Reasoning (2023.findings-acl)

Copied to clipboard

Challenge: Existing datasets for logical reasoning focus on monotonic logic and a single form of reasoning.
Approach: They propose to use a dataset to study the human-like reasoning in machine reading comprehension.
Outcome: The proposed dataset shows that state-of-the-art neural models perform noticeably worse than expected.
GLiM: Integrating Graph Transformer and LLM for Document-Level Biomedical Relation Extraction with Incomplete Labeling (2025.findings-acl)

Copied to clipboard

Challenge: Document-level relation extraction (DocRE) solves problems of document quality . number of entities and entity-pair relations increases, causing incomplete annotations .
Approach: a framework that reduces the problem space using a graph-enhanced Transformer-based model is proposed . GLiM leverages large language models for reasoning to reduce the problem-space .
Outcome: GLiM boosts average recall and F1 scores on biomedical datasets . compared with existing models, GLim outperforms existing models on biomedicine benchmarks compared to existing models .
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)

Copied to clipboard

Challenge: Significant concerns emerge when addressing cultural sensitivity and local values.
Approach: They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models.
Outcome: The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks.
TrimTokenator: Towards Adaptive Visual Token Pruning for Large Multimodal Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing token pruning methods rely on costly calibration or suboptimal importance metrics, leading to redundant retained tokens.
Approach: They propose a token pruning strategy that preserves cross-modal alignment and informational diversity.
Outcome: The proposed method maintains strong performance while reducing tokens by 88.9% on two models.
Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing text watermarking technologies lack consistency when texts are translated into different languages.
Approach: They propose a cross-lingual watermark removal attack to bypass watermarking by first obtaining a response from an LLM in a pivot language and then translating it into the target language.
Outcome: The proposed method can remove watermarks without performance loss by obtaining a response from an LLM in a pivot language and then translating it into the target language.
SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have high computational costs and privacy concerns due to their high computational expenses and data privacy.
Approach: They propose a method that empowers SLMs to internalize symbolic knowledge and few-shot examples gradually through a progressive fine-tuning process.
Outcome: The proposed approach outperforms state-of-the-art baselines by over 5% while reducing inference costs by up to 4 across a wide range of SLMs in both in-domain (ID) and out-of domain (OOD) tasks.
Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checking (2024.findings-acl)

Copied to clipboard

Challenge: Chinese Spell Checking (CSC) is a widely used technology for speech to text and optical character recognition.
Approach: They propose to use Chinese rich semantic information to introduce large language models as the foundation model.
Outcome: The proposed framework performs better on few-shot CSC task than existing methods.
Task-Level Thinking Steps Help Large Language Models for Challenging Classification Task (2023.emnlp-main)

Copied to clipboard

Challenge: Experimental results prove the superiority of our proposed method on challenging classification tasks.
Approach: They propose a task-level thinking step that eliminates bias introduced by demonstrations . they propose 'progressive revision framework' which can improve the thinking steps by correcting hard demonstrations.
Outcome: The proposed method achieves best performance on three kinds of classification tasks in zero-shot and few-shot settings.
INT: Establishing Information Transfer for Multilingual Intent Detection and Slot Filling (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies struggle to achieve performance comparable to that on high-resource languages due to inherent linguistic diversity of multilingual SLU tasks.
Approach: They propose a multilingual information transfer network to solve these challenges . they propose to reformulate SF as a span prediction problem and introduce a slot-matching attention mechanism to achieve slot alignment across languages.
Outcome: The proposed model outperforms baseline models on the MASSIVE and MASSIV-UG datasets in overall accuracy across all languages.
MRT: Multi-modal Short- and Long-range Temporal Convolutional Network for Time-sync Comment Video Behavior Prediction (2024.lrec-main)

Copied to clipboard

Challenge: Using time-sync comments, it is difficult to understand user behavior due to complexity of interactions between users, videos, and comments.
Approach: They propose a novel time-sync comment behavior prediction model that takes historical behavior into account and optimizes it on the basis of user preferences.
Outcome: The proposed model improves the performance of time-sync comments on visual frames and textual comments on two cats playing simultaneously.
Content Fuzzing for Escaping Information Cocoons on Digital Social Media (2026.findings-acl)

Copied to clipboard

Challenge: Information cocoons restrict users’ exposure to posts with diverse viewpoints . social media platforms restrict the range of viewpoints that users encounter .
Approach: They propose a confidence-guided fuzzing framework that rewrites posts while preserving their human-interpreted intent and induces different machine-inferred stance labels.
Outcome: The proposed framework rewrites posts while preserving human-interpreted intent and induces different machine-inferred stance labels while maintaining semantic integrity with respect to the original content.
Hierarchical Bi-Directional Self-Attention Networks for Paper Review Rating Recommendation (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for review rating prediction ignore hierarchies among data . paper review rating predictions are important for improving paper review process .
Approach: They propose a Hierarchical bi-directional self-attention Network framework for paper review rating prediction and recommendation . they leverage hierarchical structure of paper reviews with three levels of encoders .
Outcome: The proposed approach can be used to make an effective decision-making tool for the academic paper review process.
An Instruction Tuning-Based Contrastive Learning Framework for Aspect Sentiment Quad Prediction with Implicit Aspects and Opinions (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for aspect-based sentiment analysis have not explored how to effectively leverage the knowledge of pre-trained language models to handle implicit aspects and opinions.
Approach: They propose a framework leveraging Instruction Tuning and Supervised Contrastive Learning to improve aspect sentiment quad prediction for implicit aspects and opinions.
Outcome: The proposed framework significantly outperforms existing methods on benchmark datasets.
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved remarkable performance on various NLP tasks, yet their potential in more challenging task like finance, has not been fully explored.
Approach: They propose a benchmark to assess the financial knowledge of large language models (LLMs) in China.
Outcome: The proposed benchmark is the most comprehensive evaluation benchmark to date for LLMs in finance.
InTriage: Intelligent Telephone Triage in Pre-Hospital Emergency Care (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing TT processes face challenges such as incomplete data collection, communication barriers, and manual errors, leading to high over-triage and under-triages rates.
Approach: They propose to use an AI-driven multilingual TT system to provide decision support for triage.
Outcome: The proposed system achieves word error rate of 14.57% for speech recognition and an F1 score of 73.34% for key information extraction.
Spectral Disentanglement: Rank-Aware Task Adaptation for Rehearsal-free Continual Learning in LLMs (2026.acl-long)

Copied to clipboard

Challenge: Continual Learning (CL) for Large Language Models faces a fundamental Stability-Plasticity Dilemma . Rank-Blindness enforces a single rank constraint across diverse tasks, leading to catastrophic forgetting of earlier tasks and underfitting on complex new ones.
Approach: They propose a rank-spectrum-based rehearsal-free framework that explicitly disentangles knowledge into two orthogonal subspaces.
Outcome: The proposed framework achieves a superior stability-plasticity balance compared to single-rank baselines.
Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to slot filling only learn surface mapping of slot types between D S and D T and get poor generalization capability or robustness.
Approach: They propose a generative zero-shot prompt learning framework for cross-domain slot filling which improves generalization and robustness than previous work.
Outcome: The proposed framework improves generalization and robustness on unseen slots and an efficient prompt tuning strategy boosts performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations