Papers by Meng Lin

47 papers
Soft Language Clustering for Multilingual Model Pre-training (2023.acl-long)

Copied to clipboard

Challenge: Multilingual pre-trained language models have demonstrated impressive (zero-shot) cross-lingual transfer abilities, however, their performance is hindered when the target language has distant typology from the source language or when pre-training data is limited in size.
Approach: They propose a method that contextually retrieves prompts as flexible guidance for encoding instances conditionally.
Outcome: The proposed method improves on the XTREME task and also for low-resource languages in unsupervised sentence retrieval.
DialogQAE: N-to-N Question Answer Pair Extraction from Customer Service Chatlog (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing work on question-answer extraction fails to integrate incomplete utterances from dialog context for composite QA retrieval.
Approach: They propose a task where questions and corresponding answers might be separated across different utterances.
Outcome: The proposed methods perform well on 5 customer service datasets and set a benchmark for N-to-N DialogQAE with utterance and session level evaluation metrics.
Argue with Me Tersely: Towards Sentence-Level Counter-Argument Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing work describes paragraph-level counter-argument generation task as paragraph-based . however, sentence-level generation can be quite different due to its unique constraints and brevity-focused challenges.
Approach: They propose a benchmark framework for sentence-level counter-argument generation . they use an annotated debate forum dataset to generate high-quality counter-argments .
Outcome: The proposed framework and evaluator are competitive in counter-argument generation tasks.
Direct Behavior Optimization: Unlocking the Potential of Lightweight LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing prompt optimization methods rely on extensive manual effort or meta-cognitive abilities, making them less effective for LwLLMs.
Approach: They propose a direct behavior optimization parameter that transforms the optimization of complex prompts into discrete, quantifiable execution sequences using a gradient-free Monte Carlo Tree Search.
Outcome: The proposed method outperforms current prompt optimization methods on seven challenging tasks where state-of-the-art LLMs excel but LwLLMs generally underperform.
Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Current data selection paradigms rely on static, externally defined metrics, which fail to adapt to the evolving capabilities of models during training.
Approach: They propose a dynamic sampling framework that aligns training data with the model's intrinsic competence by iterating on real-time feedback.
Outcome: Extensive experiments on eight benchmarks show that SAI-DPO outperforms static baselines at most nearly 6 points, achieving state-of-the-art efficiency with significantly less data.
Mirror-Consistency: Harnessing Inconsistency in Majority Voting (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a widely-used decoding strategy that relies on the plurality voting rule, which focuses on the most frequent answer while overlooking all other minority responses.
Approach: They propose to incorporate a ‘reflective mirror’ into the self-ensemble decoding process and enables LLMs to critically examine inconsistencies among multiple generations.
Outcome: The proposed method incorporates a ‘reflective mirror’ into the self-ensemble decoding process and enables LLMs to critically examine inconsistencies among multiple generations.
A Shared-Private Representation Model with Coarse-to-Fine Extraction for Target Sentiment Analysis (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing models with span-based labeling have achieved promising results in sentiment analysis.
Approach: They propose a shared-private representation model with a coarse-to-fine extraction algorithm to solve this problem.
Outcome: The proposed model achieves state-of-the-art on target phrases and extraction tasks.
CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fingerprinting model ownership traces are vulnerable to illegal plagiarism and are not reliable.
Approach: They propose a rule-driven fingerprinting framework that encodes contextual correlations across multiple dialogue turns.
Outcome: The proposed framework achieves stronger stealth and robustness than previous work.
Evaluating Readability and Faithfulness of Concept-based Explanations (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for evaluating concepts from different perspectives lack a unified formalization.
Approach: They propose a formal definition of concepts generalizing to diverse concept-based explanations’ settings and apply it to other types of explanations or tasks.
Outcome: Extensive experimental analysis was carried out to determine the evaluation measures for explanation evaluation measures.
Silencing the Guardrails: Inference-Time Jailbreaking via Dynamic Contextual Representation Ablation (2026.findings-acl)

Copied to clipboard

Challenge: Existing strategies to circumvent safety constraints face significant trade-offs between effectiveness and efficiency.
Approach: They propose a framework that allows to infer model refusal behaviors without expensive parameter updates or training.
Outcome: The proposed framework outperforms baselines in multiple safety-aligned open-source LLMs.
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that pre-trained masked language models can be factual knowledge bases.
Approach: They conduct a rigorous study to explore the underlying predicting mechanisms of MLMs . they find that previous decent performance mainly owes to the biased prompts which overfit dataset artifacts a .
Outcome: The proposed model improves on illustrative cases and external contexts . the results question the previous findings that MLMs can be reliable factual knowledge bases .
DialogUSR: Complex Dialogue Utterance Splitting and Reformulation for Multiple Intent Detection (2022.findings-emnlp)

Copied to clipboard

Challenge: DialogUSR is a plug-in and domain-agnostic module that empowers multi-intent detection for chatbots . a single user query triggers inquiries on highspeed train ticket price and weather of destination.
Approach: They propose a dialog utterance splitting and reformulation task that splits multi-intent user query into multiple single-intention sub-queries and recovers all coreferred and omitted information in the sub-questions.
Outcome: The proposed model can be used to split multi-intent user queries into multiple sub-queries . it can be trained in two stages and perform in-depth analyses on the proposed models .
Gumbel Reranking: Differentiable End-to-End Reranker Optimization (2025.acl-long)

Copied to clipboard

Challenge: Existing distillation-based approaches suffer from training-inference misalignment and fail to capture interdependencies among candidate documents.
Approach: They propose a method to optimize rerankers by learning a stochastic, document-wise Top-k attention mask using the Gumbel Trick and Relaxed Top-K Sampling.
Outcome: The proposed framework minimizes the overall language loss and improves recall on hotpotQA.
Knowledge Graph Embedding with Hierarchical Relation Structure (D18-1)

Copied to clipboard

Challenge: Existing knowledge graph embedding models embed entities and relations into latent vectors without leveraging rich information from relation structure.
Approach: They extend existing KGE models to learn knowledge representations by leveraging relation structure . authors say their approach is capable of extending other KGEs .
Outcome: The proposed approach can extend existing KGE models, and validates against baselines.
Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator (2023.findings-acl)

Copied to clipboard

Challenge: Existing transformer models are computationally demanding and prohibitively costly for long sequences due to the quadratic complexity of its selfattention module.
Approach: They propose a transformer-based model that inherits weights from large pretrained models by removing redundancies in hidden sequences using the ready-made Fast Fourier Transform operator.
Outcome: The proposed model outperforms the standard BART model on the long-range modeling benchmark LRA with significant improvements in speed and space.
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible Knowledge Selection (2022.findings-emnlp)

Copied to clipboard

Challenge: Empathy is a key trait of everyday human conversations.
Approach: They propose a serial encoding and Emotion-Knowledge interaction method for empathetic dialogue generation which is more sensitive to emotion dynamics in conversations.
Outcome: The proposed method outperforms baseline evaluations on the utterance-level annotated EMPATHETICDIALOGUES.
Training LLMs to be Better Text Embedders through Bidirectional Reconstruction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing text embedding approaches often leverage the embeddment of the final token, typically a reserved special token such as ‘[EOS]‘.
Approach: They propose to add a new training stage before contrastive learning to enrich the semantics of the final token embedding.
Outcome: The proposed training stage improves performance on the Massive Text Embedding Benchmark (MTEB), achieving new state-of-the-art results across different LLM base models and scales.
Text Smoothing: Enhance Various Data Augmentation Methods on Text Classification Tasks (2022.acl-short)

Copied to clipboard

Challenge: Experimental results show text smoothing outperforms data augmentation methods by a substantial margin.
Approach: They propose to use a masked language model to convert a token to a smoothed representation by converting a sentence from its one-hot representation to 'controllable smoothes' they propose to combine text smoothing with other data augmentation methods to achieve better performance.
Outcome: The proposed method outperforms mainstream data augmentation methods by a substantial margin on different datasets in a low-resource regime.
DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to generate empathetic responses are monotonous and generic, resulting in shallow empathy and few connections to the context.
Approach: They propose to use explicit control to guide the empathy expression and a framework DiffusEmp to unify the utilization of dialogue context and attribute-oriented control signals.
Outcome: The proposed framework outperforms baselines on EmpatheticDialogue in terms of controllability, informativeness, diversity, and diversity without the loss of context-relatedness.
OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods for object navigation are limited to household datasets with close-set objects, and they lack the ability to generalize to new environments in a zero-shot manner.
Approach: They propose a framework that leverages reasoning abilities of large vision language models to extract proposed objects from natural language instructions that meet the user’s demand.
Outcome: The proposed framework surpasses baselines on all metrics and can be used in a HM3D ObjectNav benchmark.
E2E-GMNER: End-to-End Generative Grounded Multimodal Named Entity Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches decouple textual entity recognition and visual grounding, leading to error accumulation and suboptimal joint optimization.
Approach: They propose a fully end-to-end generative framework that unifies recognition, semantic typing, visual grounding and implicit knowledge reasoning within a single multimodal large language model.
Outcome: The proposed framework achieves highly competitive performance compared with state-of-the-art methods.
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to extract event records from text decompose complex structure prediction task into multiple subtasks.
Approach: They propose a sequence-to-structure generation paradigm that can extract events from text . they propose unified event extraction, constrained decoding algorithm and curriculum learning algorithm .
Outcome: The proposed method can achieve competitive performance using record-level annotations in both supervised learning and transfer learning settings.
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues (2022.acl-long)

Copied to clipboard

Challenge: Existing work in vision language cross-modal reasoning uses binary or multi-choice classification based on source image and textual query.
Approach: They propose a task where a textual premise is the background presumption on each source image.
Outcome: The proposed task is based on a dataset of 15,360 movie screenshots and human-curated premise templates from 6 pre-defined categories.
Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have shown that biased samples can be brittle for VQA models . however, the improvements on OOD data severely sacrifice the performance on the in-distribution (ID) data.
Approach: They propose a contrastive learning approach that exploits biased samples for unbiased information that contributes to reasoning.
Outcome: The proposed method achieves competitive performance on the OOD dataset while maintaining robustness on the ID dataset.
Knowledge-Augmented Methods for Natural Language Processing (2022.acl-tutorials)

Copied to clipboard

Challenge: Knowledge in natural language processing (NLP) is a rising trend especially after the advent of large scale pre-trained models.
Approach: This tutorial introduces the key steps in integrating knowledge into natural language processing (NLP) it introduces knowledge grounding from text, knowledge representation and fusing.
Outcome: This tutorial introduces the key steps in integrating knowledge into natural language processing including knowledge grounding from text, knowledge representation and fusing.
A Secure and Efficient Federated Learning Framework for NLP (2021.emnlp-main)

Copied to clipboard

Challenge: Existing FL frameworks require a trusted aggregator or require heavy-weight cryptographic primitives, which makes the performance significantly degraded.
Approach: They propose a framework that is federated and efficient for NLP . they propose to eliminate the need for trusted entities and achieve better model accuracy .
Outcome: The proposed framework achieves better model accuracy and model accuracy than existing FL frameworks.
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation (2021.acl-long)

Copied to clipboard

Challenge: Knowledge distillation (KD) has shown great success in BERT compression.
Approach: They propose a knowledge distillation paradigm that extracts the teacher's hidden state knowledge and then compresses it into three dimensions.
Outcome: The proposed paradigm gives rise to training speedup of 2.7x 3.4x for two kinds of student models and computing devices.
MCP-Guard: A Multi-Stage Defense-in-Depth Framework for Securing Model Context Protocol in Agentic AI (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are vulnerable to jailbreak, authors say . authors propose a robust, layered defense architecture designed for LLM–tool interactions .
Approach: They propose a robust, layered defense architecture designed for LLM–tool interactions . they propose XCP-Guard, which employs a three-stage detection pipeline .
Outcome: The proposed model achieves 96.01% accuracy in identifying adversarial prompts . the model is based on a three-stage detection pipeline that balances efficiency with accuracy .
Web Fraud Attacks Against LLM-Driven Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Model (LLM)-driven multi-agent systems (MAS) are rapidly gaining popularity, and its inherent security risks are rapidly becoming a concern.
Approach: They propose a novel attack manipulating unique structures of web links to deceive MAS by using homoglyph deception, sub-directory nesting, and parameter obfuscation.
Outcome: The proposed attacks exploit unique structures of web links to deceive MAS . they exhibit significant destructive potential across different MAS architectures .
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training (2022.naacl-main)

Copied to clipboard

Challenge: Recent studies show pre-trained language models contain matching subnetworks that have similar transfer learning performance as the original PLM.
Approach: They propose to prune matching subnetworks using magnitude-based pruning . they propose to optimize the subnetwork structure towards the pre-training objectives .
Outcome: The proposed method is more efficient in searching subnetworks and advantageous when fine-tuning within a range of data scarcity.
A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences (2025.findings-acl)

Copied to clipboard

Challenge: a recent study focuses on generating impartial and interpretable judicial judgments based on established criminal fact.
Approach: They propose a law reasoning schema enriched with hierarchical factum probandum, evidence, and implicit experience that enables public scrutiny and preventing bias.
Outcome: The proposed schema enables public scrutiny and prevents bias in the "Intelligent Court" it employs a suite of legal analysis tools to address the challenge task.
A Sentiment-Controllable Topic-to-Essay Generator with Topic Knowledge Graph (2020.findings-emnlp)

Copied to clipboard

Challenge: Topic-to-essay generation is a promising task for natural language generation.
Approach: They propose a Sentiment Controllable topic-to- essay generator with a Topic Knowledge Graph enhanced decoder to generate essays with only several given topic words.
Outcome: The proposed model outperforms the state-of-the-art model on automatic and human evaluation.
Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension (2023.findings-acl)

Copied to clipboard

Challenge: Compared to standard RC tasks, dialogue reading comprehension (DRC) has raised challenges because of the complex speaker information and noisy dialogue context.
Approach: They propose a new method for dialogue reading comprehension that extracts answers from dialogues by using key-utterances-extracting methods and a Question-Interlocutor Scope Realized Graph.
Outcome: The proposed method achieves state-of-the-art performance against previous works.
Ranking and Sampling in Open-Domain Question Answering (D19-1)

Copied to clipboard

Challenge: Existing approaches focus on positive paragraphs which contain the answer during training, making it disturbed by similar but irrelevant paragraphs during testing.
Approach: They propose a ranking model leveraging the paragraph-question and the paragraph relevance to compute a confidence score for each paragraph.
Outcome: Experiments on three datasets show that the proposed model advances the state of the art.
BertGCN: Transductive Text Classification by Combining GNN and BERT (2021.findings-acl)

Copied to clipboard

Challenge: Text classification is a core task in natural language processing (NLP) Graph neural networks (GNNs) serve as an effective approach for transductive learning.
Approach: They propose a model that combines large scale pretraining and transductive learning for text classification.
Outcome: The proposed model achieves SOTA performance on a wide range of datasets.
Knowing When to Quit: Diagnosing and Training LLMs to Abort Futile Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models generate costly yet semantically void reasoning on beyond-capability tasks . the dominant failure mode is specious reasoning, superficially valid outputs with subtle hallucinations .
Approach: They propose a capability-aligned reinforcement learning approach that aligns model behavior with capability boundaries.
Outcome: The proposed model reduces futile reasoning while maintaining performance across tasks.
BrowseComp-Plus: A Fair and Disentangled Evaluation Benchmark for Deep Search Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for deep search agents rely on blackbox web search APIs . dynamic and opaque web APIs hinder reproducibility and fair comparisons - authors .
Approach: They propose a benchmark that employs a fixed corpus for controlled retrieval for deep search agents.
Outcome: The new benchmark shows that agents that combine large language models with retrieval tools excel at complex, reasoning-intensive queries.
Multi-modal Contrastive Representation Learning for Entity Alignment (2022.coling-1)

Copied to clipboard

Challenge: Existing studies focus on how to utilize information from different modalities, but it is not trivial to leverage multi-modal knowledge in entity alignment because of the modality heterogeneity.
Approach: They propose a Multi-modal Contrastive Learning based Entity Alignment model which learns multiple individual representations from multiple modalities and performs contrastive learning to jointly model inter-modal and inter-modal interactions.
Outcome: The proposed model outperforms state-of-the-art models on public datasets under both supervised and unsupervised conditions.
Seg2Act: Global Context-aware Action Generation for Document Logical Structuring (2024.emnlp-main)

Copied to clipboard

Challenge: Document logical structuring is crucial for document intelligence due to the complexity of text segment dependencies in the document.
Approach: They propose an end-to-end, generation-based method for document logical structuring that generates the action sequence via a global context-aware generative model and updates its global context and current logical structure based on the generated actions.
Outcome: Experiments on ChCatExt and HierDoc datasets show that Seg2Act performs better than previous methods in both supervised and transfer learning settings.
TAKE: Topic-shift Aware Knowledge sElection for Dialogue Generation (2022.coling-1)

Copied to clipboard

Challenge: Recent work finds that realizing who holds the initiative can help select knowledge . however, there is a strong semantic transition between two rounds, probably leading to initiative misjudgment .
Approach: They propose a topic-shift Aware Knowledge sElector(TAKE) model which locates relevant parts from dialogue history to improve knowledge selection.
Outcome: The proposed model outperforms baseline models on the WoW.
From Discourse to Narrative: Knowledge Projection for Event Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing event-centric knowledge graphs rely on explicit connectives to extract relations between events.
Approach: They propose a knowledge projection paradigm for event relation extraction using commonalities between events.
Outcome: The proposed method achieves state-of-the-art performance and extrinsic results verify the extracted event relations.
WebDP: Understanding Discourse Structures in Semi-Structured Web Documents (2023.findings-acl)

Copied to clipboard

Challenge: Web documents are one of the most primary and biggest data resources in current era, and understanding their discourse structure will benefit various downstream document processing applications.
Approach: They propose a web document discourse structure representation schema by extending classical discourse theories and adding special features to well represent discourse characteristics of web documents.
Outcome: The proposed task is feasible but challenging for current models.
Graph-Assisted Large Language Models: A Perspective on Mitigating Intrinsic Limitations (2026.findings-acl)

Copied to clipboard

Challenge: Large language models exhibit intrinsic limitations such as knowledge cutoff, single-threaded reasoning that hinders finer-grained branch and aggregation, and rigid collaboration mechanisms that struggle to coordinate specialized capabilities.
Approach: They propose a taxonomy spanning *Graph-Assisted Knowledge Augmentation*, *Graph Assisted Reasoning and Planning*, and *Graphed LLM Collaboration*.
Outcome: The proposed models show that graphs can augment and correct LLMs and support dynamic coordination among experts and agents in collaborative settings.
Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA (2022.findings-emnlp)

Copied to clipboard

Challenge: Visual Question Answering (VQA) models are prone to learn the shortcut solution formed by dataset biases rather than the intended solution.
Approach: They propose a dataset that considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets.
Outcome: The proposed dataset considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets.
DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade (2024.naacl-long)

Copied to clipboard

Challenge: Existing models for natural language understanding are based on a well-defined intent 1 ontology.
Approach: They propose to retrain the natural language understanding model as new data from real users are merged into existing data.
Outcome: The proposed model shows that the semantically entangled intents can be recognized with an automatic workflow.
ECO v1: Towards Event-Centric Opinion Mining (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies on event-centric opinion mining focus on entity-centric opinions . entity-centered opinions focus on sentimental polarity of events, while event-centered ones focus on content .
Approach: They propose to perform event-centric opinion mining on event-argument structure and expression categorizing theory and benchmark it against a pioneer corpus.
Outcome: The proposed task is feasible and challenging, and the results are beneficial for future studies.
On Length Divergence Bias in Textual Matching Models (2022.findings-acl)

Copied to clipboard

Challenge: Existing deep models have been successful in textual matching tasks, but it is unclear whether they understand language or measure semantic similarity of texts.
Approach: They propose an adversarial evaluation scheme which invalidates the length divergence bias in TM datasets.
Outcome: The proposed method improves the robustness and generalization ability of models at the same time.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations