Papers by Jun Lin

49 papers
Learning to Solve Domain-Specific Calculation Problems with Knowledge-Intensive Programs Generator (2025.naacl-long)

Copied to clipboard

Challenge: Domain Large Language Models (LLMs) are developed for domain-specific tasks based on general LLMs, but it still requires professional knowledge to facilitate the expertise for some domain- specific tasks.
Approach: They propose a pipeline to solve domain-specific calculation problems with KIPG . they use it to extract key variables and calculate outcomes dependent on domain knowledge .
Outcome: The proposed pipeline solves domain-specific calculation problems more effectively . it generates knowledge-intensive programs according to the domain- specific documents .
RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models (2021.emnlp-main)

Copied to clipboard

Challenge: Recent named entity recognition models have great performance on many conventional benchmarks, but it is not reliable in realistic applications.
Approach: They propose a method to create natural adversarial examples using Wikidata and pre-trained language models.
Outcome: The proposed method produces natural adversarial examples with a shifted distribution from training data.
Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for prompt tuning can overfit to few-shot training samples, causing overfitting . authors propose a new framework for prompt learning with supervised meta-learning .
Approach: They propose a self-supervised meta-prompt learning framework with MEta-gradient Regularization for few-shot generalization that leverages self-recognized meta-learning with a diverse set of meta-tasks to learn a universal prompt initialization using only unlabeled data.
Outcome: The proposed framework learns a universal prompt initialization for efficient adaptation using only unlabeled data.
Direct Behavior Optimization: Unlocking the Potential of Lightweight LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing prompt optimization methods rely on extensive manual effort or meta-cognitive abilities, making them less effective for LwLLMs.
Approach: They propose a direct behavior optimization parameter that transforms the optimization of complex prompts into discrete, quantifiable execution sequences using a gradient-free Monte Carlo Tree Search.
Outcome: The proposed method outperforms current prompt optimization methods on seven challenging tasks where state-of-the-art LLMs excel but LwLLMs generally underperform.
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)

Copied to clipboard

Challenge: Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data.
Approach: They propose a framework that imposes strong typing constraints and incorporates key relationships from schema.
Outcome: The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider.
On the Robustness of Reading Comprehension Models to Entity Renaming (2022.naacl-main)

Copied to clipboard

Challenge: SpanBERT model is more robust than RoBERTa, despite having similar accuracy on unperturbed test data.
Approach: They propose a pipeline to replace entity names with names from a variety of sources.
Outcome: The proposed model performs worse when entities are renamed, the authors show . SpanBERT, which is pretrained with span-level masking, is more robust than RoBERTa .
Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Current data selection paradigms rely on static, externally defined metrics, which fail to adapt to the evolving capabilities of models during training.
Approach: They propose a dynamic sampling framework that aligns training data with the model's intrinsic competence by iterating on real-time feedback.
Outcome: Extensive experiments on eight benchmarks show that SAI-DPO outperforms static baselines at most nearly 6 points, achieving state-of-the-art efficiency with significantly less data.
Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods focus on manipulating entity features to find pairwise relations, yet neglect the more fundamental structural information that links disparate entity pairs together.
Approach: They propose a Visual Relation Extraction framework that generates relation predictions on entity pairs extracted from scanned images and incorporates global structural knowledge into the representations of the entities.
Outcome: The proposed framework outperforms existing methods in fine-tuning setting and yields stronger data-efficient performance in the low-resource setting.
WebNovelBench: Placing LLM Novelists on the Web Novel Distribution (2026.findings-eacl)

Copied to clipboard

Challenge: Existing benchmarks for long-form novel generation lack scale, diversity, or objective measures.
Approach: They propose a framework that assesses long-form novel generation using an LLM-as-Judge approach.
Outcome: The proposed framework differentiates between human-written masterpieces, popular web novels, and LLM-generated content.
Selecting Demonstrations for Many-Shot In-Context Learning via Gradient Matching (2025.findings-acl)

Copied to clipboard

Challenge: In-Context Learning (ICL) empowers Large Language Models for rapid task adaptation without fine-tuning.
Approach: They propose a method that aligns fine-tuning gradients between entire training set and selected examples to enable in-context learning and fine-uning.
Outcome: The proposed method outperforms random selection on large LLMs from 4-shot to 128-shot scenarios across 9 datasets.
CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging (2026.findings-acl)

Copied to clipboard

Challenge: Existing PEFT methods suffer from limited parameter efficiency and coarse-grained adaptation due to proliferation of LoRA experts and instance-level routing.
Approach: They propose a new MoE-LoRA framework that incorporates expert diversity, parameter efficiency, and fine-grained adaptation.
Outcome: The proposed framework outperforms existing methods on multiple tasks while maintaining parameter efficiency.
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document .
Approach: They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document.
Outcome: The proposed model over-estimates tokens and makes it well-calibrated on common datasets.
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Existing work on augmenting question answering models with external knowledge (e.g., knowledge graphs) lacks transparency into the model’s prediction rationale.
Approach: They propose a knowledge-aware approach that equips pre-trained language models with a multi-hop relational reasoning module that performs multi-relational reasoning over subgraphs extracted from external knowledge graphs.
Outcome: The proposed model performs multi-hop, multi-relational reasoning over subgraphs extracted from external knowledge graphs.
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce (P18-2)

Copied to clipboard

Challenge: Recent researches focus on deep learning and reinforcement learning for multi-turn information seeking conversation systems.
Approach: They propose an efficient and effective multi-turn conversation model based on convolutional neural networks and extend it to adapt the knowledge learned from a resource-rich domain to enhance the performance.
Outcome: The proposed model performs better than the existing model on an industrial chatbot called AliMe Assist.
HammerBench: Fine-Grained Function-Calling Evaluation in Real Mobile Assistant Scenarios (2025.findings-acl)

Copied to clipboard

Challenge: Evaluating the performance of LLMs in multi-turn interactions presents significant challenges due to the complexity and variability of user behavior.
Approach: They propose a benchmark framework for assessing LLMs’ function-calling capabilities in multi-turn dialogues.
Outcome: The proposed framework is based on a dataset derived from popular mobile apps and anonymized user logs.
A Semantic Mention Graph Augmented Model for Document-Level Event Argument Extraction (2024.lrec-main)

Copied to clipboard

Challenge: Document-level Event Argument Extraction (DEAE) aims to identify arguments and their specific roles from unstructured document.
Approach: They propose a document-prompt-based method for document-level event argument extraction that uses a semantic mention graph to capture relations between documents and prompts.
Outcome: The proposed method surpasses baseline methods and achieves state-of-the-art performance on RAMS and WikiEvents datasets.
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact (2024.findings-acl)

Copied to clipboard

Challenge: Existing quantization methods are compromising performance of large language models (LLMs) despite their high computational intensity, LLMs are still demanding intensive computation.
Approach: They propose to generate the KV cache of pivot tokens losslessly from the full-precision model.
Outcome: The proposed method generates the KV cache of pivot tokens losslessly from the full-precision model with no extra inference overhead.
A Diffusion Model for Event Skeleton Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for event schema generation are noise-sensitive and error-accumulating, e.g., inability to correct errors while generating schema.
Approach: They propose a novel diffusion event graph model that embeds and roundes event graphs into learnable latent representations and a denoising process to maintain the model's robustness.
Outcome: The proposed model achieves better results than existing state-of-the-art models on three IED bombing datasets.
Dual-Reasoner: Bridging Interleaved Atomicity and Streaming Latency via Thinking-while-Talking (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to integrate Chain-of-Thought into spoken dialogue models incur prohibitive latency.
Approach: They propose a Streaming Masking Mechanism to ensure uninterrupted audio streaming . they use a quadruple-constraint system to reconstruct logical atomicity .
Outcome: Experimental results show that Dual-Reasoner improves speech generation performance with low latency.
MUR: Momentum Uncertainty guided Reasoning for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for optimizing reasoning quality are limited by overthinking.
Approach: They propose a method that allocates thinking budgets to critical reasoning steps by tracking and aggregating step-wise uncertainty over time.
Outcome: The proposed method reduces computation by over 45% on average while improving accuracy by 0.33–3.46%.
Using Customer Service Dialogues for Satisfaction Analysis with Context-Assisted Multiple Instance Learning (D19-1)

Copied to clipboard

Challenge: Existing studies fail to provide comprehensive service satisfaction analysis . Existing models fail to include satisfaction polarity classification and sentimental utterance identification .
Approach: They propose a model that predicts customer sentiments and aggregates them into service satisfaction polarity.
Outcome: The proposed model predicts customer sentiments and aggregates them into service satisfaction polarity and reasoning clues.
Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment (2025.coling-main)

Copied to clipboard

Challenge: Human values are inherently diverse, making it insufficient to align LLMs solely with general preferences.
Approach: They propose a flexible paradigm for individual preference alignment that disentangles preference representation from text generation in LLMs.
Outcome: The proposed method produces aligned quality and better than PEFT-based methods while reducing training time for each new individual preference by 80% to 90%.
TECHS: Temporal Logical Graph Networks for Explainable Extrapolation Reasoning (2023.acl-long)

Copied to clipboard

Challenge: Existing frameworks for extrapolating knowledge graphs are incomplete and do not represent real-world knowledge.
Approach: They propose an explainable extrapolation reasoning framework that integrates propositional reasoning and first-order reasoning by introducing a reasoning graph that iteratively expands to find the answer.
Outcome: The proposed framework outperforms state-of-the-art baselines in explaining future facts based on past counterparts.
OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model (2025.emnlp-demos)

Copied to clipboard

Challenge: Empathetic speech models are increasingly closed off, leaving details about the architecture, data and development opaque to researchers.
Approach: They propose an open-source empathetic speech-to-text model with a streaming interleaved decoding architecture and a data pipeline to enable end-to end training.
Outcome: The proposed model is open-source and transparent, with no data or data required to build it.
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey (2023.findings-emnlp)

Copied to clipboard

Challenge: Transferability estimation has been a topic of great interest in computer vision fields . a lack of a comprehensive comparison between these estimation methods is a problem .
Approach: They conduct a thorough survey of existing methods to find the most suitable model . they also outline difficulties of consideration of training details and applicability to text generation .
Outcome: The proposed methods perform well with superiorities in effectiveness and efficiency.
APT: Improving Specialist LLM Performance with Weakness Case Acquisition and Iterative Preference Training (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models often require domain-specific fine-tuning to address targeted tasks, which risks degrading their general capabilities.
Approach: They propose to use self-generated dis-preferred weakness data to enhance model performance with a targeted training approach that minimizes interference with existing knowledge base.
Outcome: The proposed approach ensures no reduction in generic capacity and achieves superior performance on downstream tasks compared to existing methods.
Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have found that when LLMs are given criminal facts and legal rules, then asked whether cases constitute a certain charge, they struggle to understand legal theories and perform basic legal reasoning tasks.
Approach: They propose a task to assess LLMs' understanding of legal theories and reasoning capabilities by using a novel framework: Multi-Agent framework for improving complex legal reasoning capability.
Outcome: The proposed framework improves LLMs' understanding of legal theories and reasoning abilities in real-world scenarios.
RED: Unleashing Token-Level Rewards from Holistic Feedback via Reward Redistribution (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate the superiority of our approach to aligning large language models with human preferences.
Approach: They propose a method that evaluates and assigns specific credit to each token using an off-the-shelf reward model.
Outcome: The proposed method evaluates and assigns specific credit to each token using an off-the-shelf reward model.
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing (2022.emnlp-demos)

Copied to clipboard

Challenge: Pre-Trained Models (PTMs) have reshaped the development of natural language processing (NLP) but it is not easy to obtain high-performing PTMs without a large amount of labeled training data and deploy them online with fast inference speed.
Approach: They propose to make it easy to build NLP applications with knowledge-enhanced pre-training and knowledge distillation.
Outcome: EasyNLP supports a comprehensive suite of NLP algorithms and features knowledge-enhanced pre-training, knowledge distillation and few-shot learning functionalities.
Specificity-Driven Cascading Approach for Unsupervised Sentiment Modification (D19-1)

Copied to clipboard

Challenge: Existing methods for unsupervised sentiment modification lack specific information in text generated without parallel data . specificity-driven cascading approach can improve specificity of generated text and content preservation .
Approach: They propose a specificity-driven cascading approach for unsupervised sentiment modification . the method performs target sentiment addition and content reconstruction independently .
Outcome: The proposed method outperforms competitive systems by a large margin on Yelp and Amazon datasets.
LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models (2026.acl-long)

Copied to clipboard

Challenge: Masked diffusion language models have achieved significant progress in language modeling . however, the systematic analysis and empirical validation of their alignment on general tasks remains underexplored.
Approach: They propose a framework that analyzes the bias and variance of preference optimization loss and gradient based on Direct Preference Optimization.
Outcome: The proposed model outperforms its SFT-only predecessor on general benchmarks . it consistently outperformed other strong language models and ARMs on general tasks .
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach: They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome: The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Rapid Diffusion: Building Domain-Specific Text-to-Image Synthesizers with Fast Inference Speed (2023.acl-industry)

Copied to clipboard

Challenge: Text-to-Image Synthesis (TIS) aims to generate images based on textual inputs . but, current diffusion-based models lack entity knowledge and low inference speed .
Approach: They propose a framework for training and deploying latent diffusion models with rich entity knowledge injected and optimized networks.
Outcome: The proposed framework improves image quality and inference speed and can be used in industrial applications.
Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have limitations when it comes to comprehending and expressing world knowledge that extends beyond the boundaries of natural language.
Approach: They propose a model that integrates symbolic data into LLM training without loss of generality ability.
Outcome: The proposed model performs better on symbol- and NL-centric tasks.
GUICourse: From General Vision Language Model to Versatile GUI Agent (2025.acl-long)

Copied to clipboard

Challenge: Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction.
Approach: They propose a series of datasets for training visual-based GUI agents using general VLMs.
Outcome: The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks.
Inductive Relation Prediction with Logical Reasoning Using Contrastive Representations (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for relation prediction in knowledge graphs (KGs) are limited by the inductive setting because entities in training process are finite.
Approach: They propose a graph convolutional network-based model LogCo with logical reasoning by contrastive representations that extracts subgraphs and relational paths between two entities to supply the entity-independence.
Outcome: The proposed model outperforms existing methods on twelve inductive datasets.
SeaPO: Strategic Error Amplification for Robust Preference Optimization of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for preference optimization of large language models use pairs of positive and negative samples, but the quality of positive samples may become similar during training, complicating preference learning.
Approach: SeaPO introduces error types commonly occurring in large language models to improve preference learning.
Outcome: SeaPO introduces error types into model Preference Optimization to improve model performance . negative samples are more erroneous than positive samples, and preference-based training mitigates errors .
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains.
Approach: They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore.
Outcome: The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore.
PathReasoner: Modeling Reasoning Path with Equivalent Extension for Logical Question Answering (2024.acl-long)

Copied to clipboard

Challenge: Existing logical reasoning tasks are challenging, especially for large language models.
Approach: They propose a logic reasoning task model that transforms each logical sample into reasoning paths and propose an atom extension strategy supported by equivalent logical formulas to form new reasoning paths.
Outcome: The proposed architecture achieves competitive performances on two logical reasoning benchmarks and great generalization abilities.
Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for text ranking are based on intuition, but their estimated transferability may not align well with the objectives of text ranking.
Approach: They propose to compute expected rank as transferability, explicitly reflecting the model’s ranking capability.
Outcome: The proposed method shows significant improvements over previous classification-oriented TE methods, human intuition, and ChatGPT with minor time consumption.
LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Current systems for legal consultation are insufficient to handle the knowledge-intensive nature of real-world consultations.
Approach: They propose a multi-turn benchmark dataset to evaluate LLMs in legal consultation settings.
Outcome: The proposed framework assesses LLMs’ consultation capabilities in terms of (1) clarification capability and (2) professional advice quality.
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation (2022.findings-naacl)

Copied to clipboard

Challenge: Existing diverse NMT models lack translation diversity due to a discrepancy between training and inference . despite the success of diverse NTM, there is still a lack of translation diversity .
Approach: They propose a multi-candidate optimization framework for diverse NMT to deal with this defect.
Outcome: The proposed framework is transparent to basic diverse NMT models, and universally makes better trade-off between diversity and quality.
COF: Adaptive Chain of Feedback for Comparative Opinion Quintuple Extraction (2025.coling-main)

Copied to clipboard

Challenge: Comparative Opinion Quintuple Extraction (COQE) aims to extract all comparative sentiment quintuples from product review text.
Approach: They propose a model-unaware adaptive chain-of-feedback method to extract quintuples from product review text.
Outcome: The proposed method improves performance on three benchmarks.
DICP: Deep In-Context Prompt for Event Causality Identification (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing prompt-learning-based methods concatenate in-context examples only at the input layer, limiting the model’s ability to capture abstract semantic cues necessary for identifying complex causal relationships.
Approach: They propose a model that injects in-context examples into the deeper layer of a pre-trained language model (PLM) this model leverages hierarchical semantic representations formed in deeper layers, thereby enhancing its capacity to learn high-level causal abstractions.
Outcome: The proposed model improves on two widely used datasets and shows that it can learn high-level causal abstractions.
UEGP: Unified Expert-Guided Pre-training for Knowledge Rekindle (2024.findings-naacl)

Copied to clipboard

Challenge: Existing paradigms for pre-training and fine-tuning have limitations . knowledge rekindle aims to break through performance upper bounds of experts without introducing additional annotated data.
Approach: They propose a new paradigm for pre-training and fine-tuning that aims to re-incorporate the fine- tuned expert model into the training cycle and break through performance upper bounds of experts.
Outcome: The proposed model breaks through performance upper bounds of experts without additional annotated data.
Language Modeling with Sparse Product of Sememe Experts (D18-1)

Copied to clipboard

Challenge: Existing language modeling methods rely on large-scale text data to learn the sequential patterns of words.
Approach: They propose to use sememes to represent the implicit semantics behind words for language modeling . they propose to employ sememe-driven language models to fine-grained semem-level semantics .
Outcome: Experiments on language modeling and the downstream application of headline generation show the effectiveness of SDLM.
Retrieval-Augmented Process Reward Model for Generalizable Mathematical Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have advanced mathematical reasoning, but they still struggle with out-of-distribution (OOD) issues.
Approach: They propose a framework to evaluate the logical validity of reasoning steps . they retrieves semantically similar questions and steps for PRM as a warmup .
Outcome: The proposed framework outperforms baseline models on multiple real-world datasets.
MAXS: Meta-Adaptive Exploration with LLM Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for inference are often myopic and have divergent reasoning paths . a meta-adaptive reasoning framework is proposed to improve the efficiency of LLM agents .
Approach: They propose a meta-adaptive reasoning framework that integrates tool execution and reasoning planning.
Outcome: The proposed framework outperforms existing methods in performance and inference efficiency.
𝜙-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation (2025.acl-long)

Copied to clipboard

Challenge: Existing inference-time optimization strategies address the shortsightedness of auto-regressive generation, but the vast search space leads to excessive exploration and insufficient exploitation.
Approach: They propose a decoding strategy that approximates two distributions via foresight and clustering to provide an efficient estimation of step value.
Outcome: The proposed decoding strategy outperforms strong baselines in performance and efficiency.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations