Papers by Wei Feng

86 papers
RETAIL: Towards Real-world Travel Planning for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing travel planning systems assume users provide explicit queries, limiting their practical utility.
Approach: They propose a dataset RETAIL which supports decision-making for implicit queries while covering explicit queries.
Outcome: The proposed model achieves a 1.0% pass rate, suggesting real-world travel planning remains challenging.
Unsupervised Neural Machine Translation with Weight Sharing (P18-1)

Copied to clipboard

Challenge: Unsupervised neural machine translation (NMT) is a new approach for machine translation . the model uses only one shared encoder to map pairs of sentences from different languages to a shared-latent space .
Approach: They propose an unsupervised approach which trains the model without labeling data . they propose two independent encoders but share some partial weights to extract high-level representations of input sentences.
Outcome: The proposed approach achieves significant improvements on English-German, English-French and Chinese-to-English translation tasks.
Beyond Online Sampling: Bridging Offline-to-Online Alignment via Dynamic Data Transformation for LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Direct Preference Optimization (DPO) eliminates complex reward modeling in aligning large language models with human preferences, but its online variant faces significant efficiency bottlenecks due to costly real-time preference sampling and the reward model annotation.
Approach: They propose a framework that transforms static datasets into dynamically adaptive equivalents without the need for an explicit reward model.
Outcome: The proposed approach matches or exceeds the performance of a fully online DPO.
Empowering Math Problem Generation and Reasoning for Large Language Model via Synthetic Data based Continual Learning Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Existing learning frameworks for large language models (LLMs) for math problem generation are limited and lack quality data.
Approach: They propose a synthetic data based continual learning framework to improve LLMs ability for MPG and math reasoning.
Outcome: The proposed framework improves performance on large language models and math reasoning using supervised fine-tuning, data synthesis and direct preference optimization.
Rethinking LLM Uncertainty: A Multi-Agent Approach to Estimating Black-Box Model Uncertainty (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to gauge model’s uncertainty through self-consistency in responses to the target query are misleading: an LLM may confidently provide an incorrect answer to a target query, yet give a confident and accurate answer to that same query when answering a knowledge-preserving perturbation of the query.
Approach: They propose a method that uses multi-agent interaction to estimate black-box LLMs' uncertainty.
Outcome: The proposed method outperforms existing self-consistency based methods and improves hallucination detection.
TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching (2020.coling-main)

Copied to clipboard

Challenge: Recent studies show that pre-trained language models can produce informative and fluent text with the help of large-scale datasets, but they suffer insufficient learning problem with limited training data.
Approach: They propose to use table transformation module with template to rewrite structured table in natural language as input for GPT-2 and exploit multi-task learning with two auxiliary tasks to preserve table’s structural information.
Outcome: The proposed model outperforms existing systems on most few-shot settings.
I-MCTS: Enhancing Agentic AutoML via Introspective Monte Carlo Tree Search (2026.findings-eacl)

Copied to clipboard

Challenge: Existing LLM-based agents struggle with low diversity and suboptimal code generation.
Approach: They propose an approach that iteratively expands tree nodes through an introspective process that meticulously analyzes solutions and results from parent and sibling nodes.
Outcome: The proposed approach shows a 4% improvement in performance compared to the strong open-source AutoML agents.
Don’t Reinvent the Wheel: Efficient Instruction-Following Text Embedding based on Guided Space Transformation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for text embedding require re-encoding the entire corpus for each instruction.
Approach: They propose a framework that generates dynamic text embeddings that adapt to user instructions, highlighting specific attributes of text.
Outcome: The proposed framework improves instruction-following text embedding quality over state-of-the-art methods while speeding up processing on large datasets.
Expectation Confirmation Preference Optimization for Multi-Turn Conversational Recommendation Agent (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have propelled the development of Conversational Recommendation Agents (CRAs).
Approach: They propose a multi-turn preference optimization paradigm that leverages Expectation Confirmation Theory to explicitly model the evolution of user satisfaction throughout multi-turned dialogues.
Outcome: The proposed paradigm eliminates the significant sampling overhead of existing MTPO methods while ensuring the optimization process drives meaningful improvements.
Personalized Microblog Sentiment Classification via Adversarial Cross-lingual Multi-task Learning (D18-1)

Copied to clipboard

Challenge: Existing personalized microblog sentiment classification methods suffer from the insufficiency of discriminative tweets for personalization learning.
Approach: They propose to use user-attention-based Convolutional Neural Networks to capture individuality and opinion bias in microblog posts and a novel adversarial cross-lingual learning framework to enrich the user post representation.
Outcome: The proposed method outperforms state-of-the-art baseline algorithms with large margins on English and Chinese microblog datasets.
SEGMENT+: Long Text Processing with Short-Context Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks that increase context window do not guarantee robust performance across long input tasks.
Approach: They propose a framework that enables language models to handle extended inputs within limited context windows efficiently.
Outcome: The framework improves performance on long-document question-answering and Needle-in-a-Haystack tasks.
Context-DPO: Aligning Language Models for Context-Faithfulness (2025.findings-acl)

Copied to clipboard

Challenge: Context-DPO is the first alignment method specifically designed to enhance contextfaithfulness for large language models.
Approach: They propose a benchmark that simulates Retrieval-Augmented Generation scenarios with knowledge conflicts to evaluate context-faithfulness.
Outcome: The proposed method improves LLMs' context-faithfulness by 35% to 280% over open-source models.
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework (2025.acl-long)

Copied to clipboard

Challenge: Experiments show that ShifCon significantly enhances the performance of non-dominant languages due to the imbalance in training data across languages.
Approach: They propose a Shift-based multilingual Contrastive framework that aligns the internal forward process of other languages toward that of the dominant one.
Outcome: The proposed framework significantly improves performance of non-dominant languages, particularly for low-resource ones.
WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruning (2026.acl-long)

Copied to clipboard

Challenge: Open-source web agents rely on long tool-call trajectories with cyclic reasoning loops and exploration of unproductive branches.
Approach: They propose a framework that compresses web agent trajectories via graph-based pruning.
Outcome: The proposed framework reduces tool-call rounds by 20% while improving accuracy and efficiency while maintaining the same level of performance as existing models.
Beyond Linguistic Cues: Fine-grained Conversational Emotion Recognition via Belief-Desire Modelling (2024.lrec-main)

Copied to clipboard

Challenge: Emotion recognition in conversation (ERC) is essential for dialogue systems to identify the emotions expressed by speakers.
Approach: They propose a method that incorporates both belief and desire to accurately identify emotions by extracting emotion-eliciting events from utterances and construct graphs that represent beliefs and desires in conversations.
Outcome: The proposed model outperforms existing models on four popular ERC datasets and validates its performance with multiple state-of-the-art models.
Generalized Intent Discovery: Learning from Open World Dialogue System (2022.coling-1)

Copied to clipboard

Challenge: Existing intent classification models rely on a pre-defined intent set and supervised labels, which is limited in some practical scenarios.
Approach: They propose to extend an IND intent classifier to an open-world intent set including IND and OOD intents.
Outcome: The proposed task can classify IND and OOD intents while discovering new unlabeled OOD types incrementally.
Latent Suicide Risk Detection on Microblog via Suicide-Oriented Word Embeddings and Layered Attention (D19-1)

Copied to clipboard

Challenge: Existing approaches to detect suicidal ideation on social media are limited to a small group of people.
Approach: They propose to use tree holes to embed words into microblogs to strengthen the sensibility of suicide-related lexicons and to use a two-layered attention mechanism to grasp intermittently changing points from individual's open blog streams.
Outcome: The proposed approach can achieve over 91% accuracy with the use of suicide-oriented word embeddings and attention on a large-scale well-labelled suicide data set.
Uncertainty-Aware Test-Time Search for Optimization Problem Solving (2026.acl-long)

Copied to clipboard

Challenge: Language model hallucinations and limited availability of labeled datasets often result in misaligned formulations, code errors and feasibility failures.
Approach: They propose a Monte Carlo Tree Search framework that automates optimization problems from natural language descriptions with efficiency and reliability.
Outcome: The proposed framework achieves state-of-the-art solution accuracy and reduces token usage.
Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaboration (2026.acl-demo)

Copied to clipboard

Challenge: Recent LLM-based agents can automate content creation, but naively applying them yields uncontrollable and unverifiable outputs.
Approach: They propose a human-agent collaborative system that generates interactive educational documents from a single topic input.
Outcome: The proposed system generates documents comparable in quality to human-authored ones.
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are a promising alternative to expensive human evaluations.
Approach: They propose a framework that iteratively aligns LLM-based evaluators with human preference . they decompose a given evaluation task into finer-grained criteria .
Outcome: The proposed framework iteratively aligns LLM-based evaluators with human preference . it decomposes a given evaluation task into finer-grained criteria . the framework is efficient to train and more explainable than relying solely on prompts .
A Deep Relevance Model for Zero-Shot Document Filtering (P18-1)

Copied to clipboard

Challenge: Existing methods for document classification do not consider document filtering . existing methods do not include document filter.
Approach: They propose a deep relevance model for zero-shot document filtering called DAZER . they use word embeddings to extract the relevance signals from word embeds .
Outcome: The proposed model outperforms existing models on two document collections . it estimates the relevance between a document and a category by using seed words .
SAFER: Advancing Safety Alignment via Efficient Ex-Ante Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing alignment methods struggle to cover diverse safety scenarios and remain vulnerable to adversarial attacks.
Approach: They propose a framework for 'S**afety' alignment via e**F**ficient' E**x-Ante-R**easoning that instantiates structured Ex-Ance reasoning and embeds predefined safety rules.
Outcome: The proposed framework enhances safety performance while maintaining usefulness and efficiency.
Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning (2024.acl-long)

Copied to clipboard

Challenge: Experimental results show that fine-tuning of large language models for specific tasks can be challenging . distribution shift during fine-timing can lead to performance degradation in general task capabilities .
Approach: They propose a new approach that bridges the distribution gap between task datasets and LLMs by guiding fine-tuning with a distilled dataset generated by the model itself.
Outcome: The proposed approach achieves comparable or superior performance on downstream tasks compared to the vanilla approach.
MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool.
Approach: They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images .
Outcome: The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images.
CR-LLM: A Dataset and Optimization for Concept Reasoning of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing concept reasoning related datasets suffer from modeledge leakage and context leakage.
Approach: They propose a concept reasoning for large language models with modeledge leakage prevention and context leakage preventive methods to improve the models' conceptual reasoning abilities.
Outcome: The proposed method significantly improves the existing models and reasoning methods, achieving a 7% increase in accuracy compared to CoT and showing better granularity.
Past Meets Present: Creating Historical Analogy with Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Historical analogies are important abilities that help people make decisions and understand the world.
Approach: They propose a historical analogy acquisition task that uses large language models to acquire historical analogies.
Outcome: The proposed method mitigates hallucinations and stereotypes when LLMs generate historical analogies.
HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: In-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to inconsistent document quality and retrieval system imperfections.
Approach: They propose that RAG models should possess three progressively hierarchical abilities: (1) Filtering: the ability to select relevant information; (2) Combination: the capability to combine semantic information across paragraphs; (3) RAG-specific reasoning: the capacity to further process external knowledge using internal knowledge.
Outcome: Experiments show that the proposed method significantly improves the model’s open-book examination capability on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA.
AdaDHP: Fine-Grained Fine-Tuning via Dual Hadamard Product and Adaptive Parameter Selection (2025.acl-long)

Copied to clipboard

Challenge: Increasing number of parameters can be challenging under resource-constrained environments.
Approach: They propose a parameter-efficient fine-tuning method with fewer parameters and finer granularity that can adaptively select important parameters for each task.
Outcome: The proposed method can fine-tune important parameters for each task, while maintaining the same weights.
Examining False Positives under Inference Scaling for Mathematical Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in language models have led to significant improvements in mathematical reasoning across benchmarks.
Approach: They analyze the prevalence of false positives in language models by using heuristic evaluation methods . they find that false positive models produce correct final answers but with flawed deduction paths .
Outcome: The proposed model performance improvements are based on the proposed model and its evaluation metrics.
Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems (P19-1)

Copied to clipboard

Challenge: Existing methods for learning a robust matching model from noisy training data are retrieval-based or generation-based.
Approach: They propose a general co-teaching framework that learns matching models from noisy training data.
Outcome: The proposed learning framework can improve existing models on two public data sets.
CARL: Constraint-Aware Reinforcement Learning for Planning with LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to constraint-aware planning fail to enhance the model’s intrinsic focus on constraints.
Approach: They propose a constraint-aware reinforcement learning framework that encourages constraint focus and penalizes neglect of LLMs.
Outcome: The proposed framework outperforms existing frameworks and state-of-the-art reasoning models in a number of real-world applications.
CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, mixture-of-experts (MoE) is underutilized on heterogeneous datasets, ignoring the fact that experts may learn similar knowledge.
Approach: They propose a method to promote modularization and specialization in MoE by specializing functionalities into different experts and sparsely activating them appropriately.
Outcome: The proposed method improves the capacity and specialization of mixture-of-experts (MoE) by sampling from activated and inactivated experts in top-k routing.
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce (P18-2)

Copied to clipboard

Challenge: Recent researches focus on deep learning and reinforcement learning for multi-turn information seeking conversation systems.
Approach: They propose an efficient and effective multi-turn conversation model based on convolutional neural networks and extend it to adapt the knowledge learned from a resource-rich domain to enhance the performance.
Outcome: The proposed model performs better than the existing model on an industrial chatbot called AliMe Assist.
GeAR: Generation Augmented Retrieval (2025.findings-acl)

Copied to clipboard

Challenge: Document retrieval techniques are used to compute semantic similarity between a query and documents, but the scalar similarity fails to reflect enough information, hindering the interpretation of retrieval results.
Approach: They propose a method which improves the global document-query similarity through contrastive learning and integrates well-designed fusion and decoding modules.
Outcome: The proposed method improves the global document-query similarity through contrastive learning and integrates well-designed fusion and decoding modules.
The Mark Fades: Adaptive Evolutionary Paraphrase-based Attack against LLM Watermarks (2026.findings-acl)

Copied to clipboard

Challenge: Existing paraphrase-based watermark removal methods struggle to balance efficacy with text quality.
Approach: They propose a training-free evolutionary framework that models watermark removal as a constrained multi-objective optimization problem by using a Pseudo-Log-Likelihood-guided mutation to precisely target and modify watermark-carrying tokens.
Outcome: The proposed method outperforms baseline methods on a Qwen3 series watermark scheme while maintaining high semantic fidelity.
Democratizing Reasoning Ability: Tailored Learning from Large Language Model (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and closed-source nature.
Approach: They propose a tailored learning approach to distill the exclusive reasoning ability to smaller LMs to facilitate democratization.
Outcome: The proposed approach enables the democratization of the exclusive reasoning ability by leveraging the black-box model as a reasoning teacher.
AdaSwitch: Adaptive Switching between Small and Large Agents for Effective Cloud-Local Collaborative Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large language models have been remarkable . users face a choice between using cloud-based LLMs for generation quality or local-based ones for lower computational cost .
Approach: They propose a new LLM utilization paradigm that facilitates collaborative operation . they evaluate AdaSwitch across 7 benchmarks and compare it to other LLMs .
Outcome: The proposed model improves performance of local and cloud agents across 7 benchmarks . it achieves competitive results compared to the cloud agent while utilizing less computational overhead.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Sampling Matters! An Empirical Study of Negative Sampling Strategies for Learning of Matching Models in Retrieval-based Dialogue Systems (D19-1)

Copied to clipboard

Challenge: Existing studies focus on constructing a matching model with sophisticated neural architectures, but do little to how to effectively learn such architectures from data.
Approach: They propose to sample negative examples to automatically construct a training set for effective model learning in retrieval-based dialogue systems by using four sampling strategies.
Outcome: The proposed learning method improves the performance of matching models on two benchmarks with three matching models.
A Coarse-to-Fine Prototype Learning Approach for Multi-Label Few-Shot Intent Detection (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for few-shot intent detection are limited due to data scarcity and lack of information for unseen domains.
Approach: They propose to enhance utterance representations with label synset augmentation and refine prototypes by distilling coarse domain knowledge from a universal teacher model.
Outcome: The proposed approach outperforms existing methods in terms of accuracy and generalization across domains.
Boundary Detection with BERT for Span-level Emotion Cause Analysis (2021.findings-acl)

Copied to clipboard

Challenge: Emotion cause analysis (ECA) is an emerging topic in natural language processing, which aims to identify the reasons behind a given emotion.
Approach: They propose to detect the precise boundaries of text spans conveying accurate emotion causes from the given context by a sequence labeling and position identification problem.
Outcome: The proposed methods outperform existing models on two benchmark datasets on the emotion cause analysis task.
MECoT: Markov Emotional Chain-of-Thought for Personality-Consistent Role-Playing (2025.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Models struggle to maintain emotionally consistent and psychologically plausible character personalities.
Approach: They propose a framework that enhances LLMs’ ability to generate authentic personality-driven dialogues through stochastic emotional transitions.
Outcome: The proposed framework achieves 93.3% emotional accuracy on the RAPD dataset and significantly outperforms existing approaches.
DialogConv: A Lightweight Fully Convolutional Network for Multi-view Response Selection (2022.emnlp-main)

Copied to clipboard

Challenge: Existing retrieval-based dialogue systems suffer from slow inference or huge number of parameters.
Approach: They propose a lightweight fully convolutional architecture for response selection using convolution.
Outcome: The proposed architecture extracts matching features of context and response from 3D views.
DeepPlanner: Scaling Planning Capability for Deep Research Agents via Advantage Shaping (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to planning involve implicit planning or introduce explicit planners without systematically optimizing the planning stage.
Approach: They propose an end-to-end RL framework that enhances the planning capabilities of deep research agents.
Outcome: Experiments show that DeepPlanner improves planning quality and achieves state-of-the-art results under a lower training budget.
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach: They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome: The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues (2022.acl-long)

Copied to clipboard

Challenge: Existing work in vision language cross-modal reasoning uses binary or multi-choice classification based on source image and textual query.
Approach: They propose a task where a textual premise is the background presumption on each source image.
Outcome: The proposed task is based on a dataset of 15,360 movie screenshots and human-curated premise templates from 6 pre-defined categories.
Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing studies focus on contrastive learning on the instance level without discriminating the contribution of each word.
Approach: They propose a hierarchical contrastive learning mechanism which can unify semantic meaning in the input text.
Outcome: The proposed model outperforms baselines on storytelling, paraphrasing, dialogue generation, and storytelling tasks.
NL2Lean: Translating Natural Language into Lean 4 through Multi-Aspect Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing formal proof assistants rely on instruction tuning and lack fine-grained structural and semantic alignment.
Approach: They propose a reinforcement learning framework that enables LLMs to translate natural language into formal language such as Lean 4 . they use a model with basic translation ability to refine the model's reinforcement learning .
Outcome: The proposed method outperforms baseline models on NL-to-Lean 4 tasks.
Self-Reflection Improves Safety of Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety alignment methods are shallow and do not address deeper risks and attacks in reasoning processes.
Approach: They propose a technique that introduces a special Self-Reflection token to enable LRMs to perform self-reflection during generation and recover from harmful outputs.
Outcome: The proposed approach outperforms the baseline model in terms of safety and helpfulness, and significantly improves model safety without adversarial training.
IGenBench: Benchmarking the Reliability of Text-to-Infographic Generation (2026.acl-long)

Copied to clipboard

Challenge: Generated infographics may appear correct at first glance but contain easily overlooked issues, such as distorted data encoding or incorrect textual content.
Approach: They propose to evaluate reliability of text-to-infographic generation using IGenBench . they employ multimodal large language models to verify each question .
Outcome: The proposed framework decomposes reliability verification into atomic yes/no questions based on a taxonomy of 10 question types.
Prompts Can Play Lottery Tickets Well: Achieving Lifelong Information Extraction via Lottery Prompt Tuning (2023.acl-long)

Copied to clipboard

Challenge: Existing research on information extraction tasks focuses on one specific task, but in real-world scenarios, new data of different IE tasks and domains come in a stream over time.
Approach: They propose a parameter- and deployment-efficient prompt tuning method to evaluate the UIE system under a “lifelong learning” setting.
Outcome: The proposed method is able to learn new tasks without forgetting old ones and expand knowledge and functionalities without retraining the whole system.
SAM3-I: Segment Anything with Instructions (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for concept-level grounding and instruction-level reasoning use coarse representations and iterative mask filtering.
Approach: They propose an instruction-following extension of the Segment Anything Model 3 family that unifies concept-level grounding and instruction-level reasoning within a single segmentation framework.
Outcome: Experiments show that SAM3-I achieves appealing performance across referring and reasoning-based segmentation while maintaining its strong concept recall ability.
Cross-lingual Feature Extraction from Monolingual Corpora for Low-resource Unsupervised Bilingual Lexicon Induction (2022.coling-1)

Copied to clipboard

Challenge: Unsupervised bilingual lexicon induction models fail on low-resource language pairs due to insufficient initialization.
Approach: They propose a method to learn cross-lingual features from monolingual corpora for low-resource UBLI by integrating cross-linguistic representations with pre-trained word embeddings in a fully unsupervised initialization.
Outcome: The proposed method outperforms state-of-the-art methods on low-resource language pairs and improves representational ability and robustness of existing embedding models.
FrontCoder: Scaling Visual Fidelity in Front-End Code Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing work on front-end code generation fails to provide visual fidelity and rendering quality for front- end developers.
Approach: They propose a three-stage pipeline to enhance front-end code generation capabilities in LLMs . they use synthetic data, quality-controlled supervised fine-tuning, and reinforcement learning .
Outcome: The proposed model achieves competitive performance with frontier models while maintaining generation efficiency.
Masked Diffusion Captioning for Visual Feature Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Unlike autoregressive captioning, the strength of the visual learning signal in MDC does not depend on each token’s position in the sequence, reducing the need for auxiliary objectives.
Approach: a decoder conditioned on visual features is trained to reconstruct the original text.
Outcome: masked diffusion captioning (MDC) is a form of image-conditioned captioning that can be applied to visual tasks.
ResLoRA: Identity Residual Mapping in Low-Rank Adaption (2024.findings-acl)

Copied to clipboard

Challenge: Low-rank adaptation (LoRA) is one of the most popular parameter-efficient fine-tuning methods.
Approach: They propose a low-rank adaptation method that adds residual paths during training and merges them together during inference to achieve better results.
Outcome: The proposed method achieves 2.5x faster convergence speed and improves performance by 14.3% on NLG, NLU, and text-to-image tasks.
UniKeyphrase: A Unified Extraction and Generation Framework for Keyphrase Prediction (2021.findings-acl)

Copied to clipboard

Challenge: Mainstream methods that ignore the diversity among keyphrases or weakly capture the relation between tasks implicitly ignore keyphrase diversity.
Approach: They propose a novel end-to-end learning framework that jointly learns to extract and generate keyphrases by exploiting latent semantic relation between extraction and generation.
Outcome: The proposed approach outperforms mainstream methods on a benchmarked document on keyphrase prediction.
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning.
Approach: They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking.
Outcome: The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup.
Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets (N18-1)

Copied to clipboard

Challenge: Experimental results show that the proposed model consistently outperforms the traditional RNNSearch and the newly emerged state-of-the-art Transformer on English-German and Chinese-English translation tasks.
Approach: They propose an approach for applying GANs to NMT by building a conditional sequence generative adversarial net with two adversarials.
Outcome: The proposed model outperforms the existing RNNSearch and Transformer on English-German and Chinese-English translation tasks.
Supporting Clustering with Contrastive Learning (2021.naacl-main)

Copied to clipboard

Challenge: Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space, but different categories overlap with each other at the beginning of the learning process.
Approach: They propose a framework to leverage contrastive learning to promote better separation between different categories by optimizing a clustering objective defined in the representation space.
Outcome: The proposed framework improves state-of-the-art accuracy and normalized mutual information on short text clustering and combines top-down and bottom-up instance discrimination to achieve better distances.
Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approach (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt.
Approach: They propose to refine a Large Language Model (LLM) with prompt-output pairs with equivalent semantics to achieve semantic consistency.
Outcome: The proposed method improves the semantic consistency and task performance of LLMs.
Dynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language Recognition (2024.lrec-main)

Copied to clipboard

Challenge: Current sign language recognition methods use spatial graphs and temporal modules to capture spatial and temporal features, but their spatial graph modules are typically built on fixed graph structures.
Approach: They propose a new spatial architecture that captures input-sensitive joint relationships and a temporal module to model multi-scale temporal information to capture complex human dynamics.
Outcome: The proposed method achieves state-of-the-art accuracy on four large-scale SLR benchmarks.
From Discrimination to Generation: Low-Resource Intent Detection with Language Model Instruction Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies fine-tune discriminative models on specific defined intent classes, preventing them from being directly adopted to new intent domains.
Approach: They propose to use a pre-trained generative intent model to detect new intents from different domains with no parameter updates.
Outcome: The proposed model outperforms baselines that need further fine-tuning or domain-specific samples.
Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality.
Approach: They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward.
Outcome: The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability.
Boosting Event Extraction with Denoised Structure-to-Text Augmentation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for event extraction neglect grammatical incorrectness, structure misalignment, and semantic drifting . et al., 2004; Ahn, 2006) show that the proposed method generates more diverse text representations for event extracting compared with the state-of-the-art.
Approach: They propose a framework for event extraction that generates additional training data and iteratively selects the effective subset from the generated training data.
Outcome: The proposed method generates more diverse representations of training data and achieves comparable results with the state-of-the-art.
Semi-Supervised Disfluency Detection (C18-1)

Copied to clipboard

Challenge: Detecting disfluency can be difficult because of the flexible nature of reparandum structure and the lack of a nested structure.
Approach: They propose a semi-supervised approach which extracts hidden features from self-attention without any Recurrent Neural Network (RNN) or Convolutional Neural Net (CNN).
Outcome: The proposed approach improves over baselines by using unlabelled data . identifying and removing non-fluent factors would help to improve spontaneous speech quality .
SWING: Balancing Coverage and Faithfulness for Dialogue Summarization (2023.findings-eacl)

Copied to clipboard

Challenge: Existing approaches to dialogue summarization rely on features of conversation data.
Approach: They propose to use natural language inference models to improve coverage and faithfulness . they use fine-grained training signals to encourage model to generate missing content .
Outcome: The proposed model achieves higher faithfulness and coverage while maintaining conciseness compared to prior methods.
CIRAG: Construction–Integration Retrieval and Adaptive Generation for Multi-hop Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for iterative retrieval-augmented generation (iRAG) suffer from greedy single-path expansion and granularity–demand mismatch .
Approach: They propose a model that constructs candidate triples and history-conditionally integrates them to distill core triples to generate the next-hop query.
Outcome: The proposed model mitigates the greedy single-path expansion and granularity–demand mismatch by preserving multiple plausible evidence chains.
Advancing Sequential Numerical Prediction in Autoregressive Models (2025.acl-short)

Copied to clipboard

Challenge: Autoregressive models are the de facto choice for sequence generation tasks, but standard approaches treat digits as independent tokens and apply cross-entropy loss, overlooking the coherent structure of numerical sequences.
Approach: They propose a novel approach to entropy loss by extending the Earth Mover’s Distance to preserve ordinal relationships between numerical values and sequence-level to penalize the overall discrepancy between predicted and actual sequences.
Outcome: Extensive experiments show that NTIL improves numerical prediction and integrates effectively with LLMs/MLLMs.
Language-agnostic BERT Sentence Embedding (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for learning bilingual sentence embeddings are not well explored.
Approach: They propose to combine best methods for learning multilingual sentence embeddings with pre-trained models to achieve 83.7% bi-text retrieval accuracy over 112 languages on Tatoeba.
Outcome: The proposed model achieves 83.7% bi-text retrieval accuracy over 112 languages on Tatoeba, above the 65.5% achieved by LASER.
SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to detect and correct spelling errors in Chinese take external input or just heuristic rules.
Approach: They propose to incorporate phonological and visual similarity knowledge into Chinese language models by using a specialized graph convolutional network.
Outcome: The proposed method outperforms existing models on three human-annotated datasets.
MultiLingPoT: Boosting Mathematical Reasoning in LLMs through Multilingual Program Integration (2025.findings-emnlp)

Copied to clipboard

Challenge: Program-of-Thought is an important way for LLMs to solve mathematical problems.
Approach: They propose a multilingual programme reasoning method that uses program instead of natural language in reasoning and proposes to integrate multilingual integration into the training and inference.
Outcome: The proposed method improves individual language’s reasoning accuracy by 2.5% and improves performance by 8%.
Mis-prompt: Benchmarking Large Language Models for Proactive Error Handling (2025.acl-long)

Copied to clipboard

Challenge: Current error-handling works are performed in a passive manner, with explicit error- handling instructions.
Approach: They propose a new benchmark to analyze LLMs' performance on a mis-prompt benchmark and a dataset to promote further research.
Outcome: The proposed benchmark shows that current LLMs show poor performance on proactive error handling, and that SFT improves on error handling instances.
Rethinking Multimodal Entity and Relation Extraction from a Translation Point of View (2023.acl-long)

Copied to clipboard

Challenge: Special attention is paid to the cross-modal misalignment in text-image datasets which may mislead the learning.
Approach: They propose a multimodal back-translation method which uses diffusion-based generative models for pseudo-paralleled pairs and a divergence estimator to construct a high-resource corpora as a bridge for low-ressource learners.
Outcome: The proposed method outperforms 14 state-of-the-art methods in both entity and relation extraction tasks.
Calibrating LLM-Based Evaluator (2024.lrec-main)

Copied to clipboard

Challenge: Existing models for large language models lack the ability to calibrate their outputs towards human preference.
Approach: They propose a multi-stage, gradient-free approach to calibrate an LLM-based evaluator toward human preference.
Outcome: The proposed approach improves correlation with expert evaluation on multiple text quality evaluation datasets.
Clear Up Confusion: Iterative Differential Generation for Fine-grained Intent Detection with Contrastive Feedback (2025.coling-main)

Copied to clipboard

Challenge: Recent studies on fine-grained intent detection have focused on collecting large-scale and high-quality samples via crowdsourcing resulting in data scarcity.
Approach: They propose an iterative differential generation framework with contrastive feedback to generate high-quality pseudo samples and accurately capture the crucial nuances in target class distribution.
Outcome: The proposed framework generates high-quality pseudo samples and captures crucial nuances in target class distribution.
STAPO: Selective Trajectory-Aware Policy Optimization for LLM Agent Training (2026.acl-long)

Copied to clipboard

Challenge: Prior work has explored step-level supervision using Shannon-entropy-based uncertainty signals, which conflate inherent state complexity with agent confidence.
Approach: They propose a hierarchical group-based RL framework that leverages normalized entropy to locate outlier steps associated with trajectory neglect and optimizes them via a mechanism of trajectory-aware reward and trajectory-independent penalty.
Outcome: Experiments on ALFWorld, WebShop, and Search-Augmented QA show that STAPO achieves state-of-the-art performance while substantially alleviating trajectory neglect.
A Survey of Data Augmentation Approaches for NLP (2021.findings-acl)

Copied to clipboard

Challenge: Data augmentation is a field of research that has been underexplored due to the discrete nature of language data.
Approach: They present a comprehensive survey of data augmentation for NLP by summarizing the literature in a structured manner.
Outcome: The proposed methods are used for popular NLP applications and tasks and highlight current challenges and directions for future research.
QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for processing large textual content face insufficient adaptation to task-specific needs and missing multi-segmentation relationships.
Approach: They propose a question then reflection memory mechanism which integrates a dual-structured memory pool and a structured graph guidance to facilitate a reflective trial-and-error approach for navigating and identifying relevant segments.
Outcome: The proposed model achieves superior performance on multiple-choice questions and multi-doc QA.
Investigating Human and LLMs’ Decisions in Unverifiable Environments: A Case Study with GitHub Activity Overview (2026.findings-acl)

Copied to clipboard

Challenge: examining the behaviors of Large Language Models as artificial social actors is underexplored, especially in unverifiable scenarios where conventional benchmarking has little to help improve their abilities.
Approach: They propose a method to collect, compare, and reason about human and LLMs' decisions in an unverifiable scenario and use it to examine their behaviors.
Outcome: The proposed method compared human and LLM decisions in an unverifiable scenario on GitHub and found that proprietary LLMs behave more like humans than open-source LLM systems.
Dual Class Knowledge Propagation Network for Multi-label Few-shot Intent Detection (2023.acl-long)

Copied to clipboard

Challenge: Existing studies on multi-label intent detection are confused by the identical representation of the utterance with multiple labels and overlook the intrinsic intra-class and inter-class relations.
Approach: They propose a dual class knowledge propagation network to learn well-separated representations for utterances with multiple intents.
Outcome: The proposed method outperforms baselines on two multi-label intent datasets by a large margin.
Enhancing Content Planning for Table-to-Text Generation with Data Understanding and Verification (2020.findings-emnlp)

Copied to clipboard

Challenge: Table-to-text models that select and order salient data and verbalize them fluently are lacking in content planning stage.
Approach: They propose to enhance neural content planning by understanding data values with contextual numerical value representations that bring the sense of value comparison into content planning.
Outcome: The proposed model outperforms existing systems with respect to content planning metrics on ROTOWIRE and MLB datasets.
MotifAgent: Learning Molecular Assembly through Multi-Agent Collaboration for Chemical Language Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to molecular understanding are limited to static motif recognition without understanding connection rules governing how motifs assemble into valid topological structures.
Approach: They propose a multi-agent reinforcement learning framework inspired by emergent collective intelligence to solve a problem where each motif is represented by an agent sharing a common LLM backbone.
Outcome: Extensive experiments show that the proposed framework surpasses specialized expert models in molecular understanding tasks.
Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting (2025.findings-acl)

Copied to clipboard

Challenge: Current document image parsing solutions rely on specialized models or generate content autoregressively.
Approach: They propose a multimodal document image parsing model that integrates specialized models with autogeneous content generation.
Outcome: The proposed model achieves state-of-the-art performance across diverse page-level and element-level settings while ensuring superior efficiency.
LAiW: A Chinese Legal Large Language Models Benchmark (2025.coling-main)

Copied to clipboard

Challenge: Xie et al., 2023) show that large language models (LLMs) can generate legal text, but lack the legal syllogism . legal experts are cautious about their practical application due to the opaque nature of the LLMs.
Approach: They propose a Chinese legal LLM benchmark structured around the legal syllogism . they evaluate LLMs across three levels of capability, each reflecting a more complex stage of legal .
Outcome: The proposed benchmark identifies that LLMs lack the legal syllogism, which hinders trust and understanding from legal experts.
Enhancing Interpretable Image Classification Through LLM Agents and Conditional Concept Bottleneck Models (2025.acl-long)

Copied to clipboard

Challenge: Concept Bottleneck Models (CBMs) map visual representations to a set of humanunderstandable textual concepts, which are then interpreted by a linear combination of these concept scores.
Approach: They propose a dynamic, agent-based approach that adjusts the concept bank in response to environmental feedback, optimizing the number of concepts for sufficiency yet concise coverage.
Outcome: The proposed model improves classification accuracy by 6% and interpretability assessments by 30%.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations