Papers by Min Lin

50 papers
OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction (2025.acl-long)

Copied to clipboard

Challenge: Existing methods focus on replicating dialogues in textual form, neglecting the role’s voice traits as a crucial effect in interaction, which tends to be more immersive experiences in realistic scenarios.
Approach: They propose a first seamless speech-language personality interaction model to achieve immersive RPAs with low latency.
Outcome: The proposed model exhibits role-specific personality traits and vocal traits throughout the interaction, enabling a mixture of speech and language responses.
CFSum Coarse-to-Fine Contribution Network for Multimodal Summarization (2023.acl-long)

Copied to clipboard

Challenge: Existing multimodal summarization models ignore the contribution of visual modalities . we propose a novel contribution network to consider different contributions of images .
Approach: They propose a Coarse-to-Fine contribution network for multimodal summarization to consider different contributions of images for summarizing.
Outcome: The proposed system outperforms baselines on the visual and textual modalities.
JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection (2022.acl-long)

Copied to clipboard

Challenge: Existing methods achieve promising performance in in-target stance detection when trained and tested on the same datasets.
Approach: They propose a joint contrastive learning framework to generalize stance features for unseen targets.
Outcome: The proposed framework achieves state-of-the-art on three benchmark datasets.
Multi-modal Stance Detection: New Datasets and Model (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for stance detection for pure texts have limited results to multi-modal content.
Approach: They propose a multi-modal stance detection framework that leverages target information to learn multi-modal stance features from textual and visual modalities.
Outcome: The proposed framework achieves state-of-the-art in multi-modal stance detection on five datasets based on Twitter .
mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrieval (2024.emnlp-industry)

Copied to clipboard

Challenge: Existing models for text retrieval are based on a multi-stage process that involves retrieving documents from a large corpus.
Approach: They propose to build a multilingual text representation model and a cross-encoder reranker from scratch for text retrieval.
Outcome: The proposed models outperform the state-of-the-art models on long-context retrieval benchmarks.
ToolRM: Towards Agentic Tool-Use Reward Modeling (2026.findings-acl)

Copied to clipboard

Challenge: lack of reliable reward models for tool-use tasks has limited progress toward agentic AI . recent advances in agentic artificial intelligence are driven by tool-using capabilities of large language models.
Approach: They propose a pipeline that constructs pairwise preference data using rule-based scoring and multidimensional sampling to build lightweight reward models.
Outcome: The proposed model outperforms existing models on tool calling tasks with higher accuracy.
A Multimodal In-Context Tuning Approach for E-Commerce Product Description Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for generating product descriptions from images are inaccurate and generic . e-commerce product descriptions are important for content marketing and increasing engagement .
Approach: They propose a new setting for generating product descriptions from images, augmented by marketing keywords.
Outcome: The proposed approach improves the accuracy and diversity of product descriptions by up to 3.3% on Rouge-L and 9.4% on D-5.
Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Current data selection paradigms rely on static, externally defined metrics, which fail to adapt to the evolving capabilities of models during training.
Approach: They propose a dynamic sampling framework that aligns training data with the model's intrinsic competence by iterating on real-time feedback.
Outcome: Extensive experiments on eight benchmarks show that SAI-DPO outperforms static baselines at most nearly 6 points, achieving state-of-the-art efficiency with significantly less data.
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature.
Approach: They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management.
Outcome: The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench.
Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for aspect category sentiment analysis do not necessarily occur in a sentence.
Approach: They propose a Beta Distribution-guided aspect-aware graph construction based on external knowledge . they use aspect-related words as the pivots to derive aspect-relevant weights .
Outcome: The proposed approach outperforms the state-of-the-art methods on 6 benchmark datasets.
Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction (2026.acl-long)

Copied to clipboard

Challenge: Current distractor generation methods produce shared distractors for all students, ignoring individual variations in reasoning, which limits their diagnostic effectiveness.
Approach: They propose a method which tailors distractors to each student’s specific cognitive flaws, inferred from their past question-answering (QA) history.
Outcome: The proposed framework outperforms existing methods in generating plausible distractors and adapts to group-level settings.
Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Image-to-text tasks such as captioning and controllable image descriptions have received extensive attention for decades.
Approach: They propose a new perspective for image-to-text to generate spatial descriptions by combining two objects in an image.
Outcome: The proposed model is awe-inspiring and human-like, and the proposed end-to-end architecture is the better choice for their integration.
Just Like a Human Would, Direct Access to Sarcasm Augmented with Potential Result and Reaction (2023.acl-long)

Copied to clipboard

Challenge: sarcasm is a form of irony conveying mockery and contempt . social media has become increasingly popular for identifying sarcasm .
Approach: They develop a method to detect sarcasm from social media using augmented potentials.
Outcome: The proposed method outperforms baselines on benchmark datasets.
Beyond Memorization: The Challenge of Random Memory Access in Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in Language Models (LMs) have shown their effectiveness in knowledge-intensive tasks.
Approach: They investigate whether a generative language model is able to access its memory sequentially or randomly.
Outcome: The proposed LMs are able to access memory sequentially or randomly.
MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct (2025.findings-acl)

Copied to clipboard

Challenge: a new framework for image-text instruction data evolution improves MLLM performance . lack of high-quality instruction data remains a major bottleneck in ML modeling .
Approach: They propose a multimodal instruction data evolution framework that iteratively enhances data quality through fine-grained perception, cognitive reasoning, and interaction evolution.
Outcome: The proposed approach improves MLLM performance in nine vision-language tasks while using significantly less data.
Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to extract emotions and causes from unannotated text are pipelined, causing error propagation.
Approach: They propose to transform a task into a procedure of parsing-like directed graph construction . they propose to generate a directed graph with labeled edges based on a sequence of actions .
Outcome: The proposed method outperforms the state-of-the-art methods by 6.71% (p0.01) in F1 measure.
MCS: An In-battle Commentary System for MOBA Games (2022.coling-1)

Copied to clipboard

Challenge: In-battle commentary is an important component of live streaming of e-sports competitions and is applicable to a wide range of scenarios like combat information analysis and live streaming.
Approach: They propose a generative system for in-battle real-time commentary in mobile MOBA games and propose 'transform' method to convert match statistics and utterances into consistent encoding space.
Outcome: The proposed system is based on real-time match statistics and events and can be used for live streaming, e-sports commentary and combat information analysis.
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document .
Approach: They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document.
Outcome: The proposed model over-estimates tokens and makes it well-calibrated on common datasets.
Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences.
Approach: They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks.
Outcome: The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge.
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds.
Approach: They propose a framework for self-referential leakage detection for gray-box and black-box settings.
Outcome: The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines.
CINO: A Chinese Minority Pre-trained Language Model (2022.coling-1)

Copied to clipboard

Challenge: Existing multilingual pre-trained language models do not perform well on some low-resource languages.
Approach: They propose a multilingual pre-trained language model for Chinese minority languages . they collect documents from Wikipedia and construct two classification datasets .
Outcome: The proposed model outperforms baseline models on various classification tasks.
Structured Preference Optimization for Vision-Language Long-Horizon Task Planning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing vision-language planning methods struggle with long-horizon reasoning in dynamic environments due to the difficulty of training models to generate high-quality reasoning processes.
Approach: They propose a framework that enhances reasoning and action selection for long-horizon task planning through structured evaluation and optimized training.
Outcome: The proposed framework outperforms existing methods on short-horizon tasks but struggles with long-horizon reasoning in dynamic environments.
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)

Copied to clipboard

Challenge: Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios.
Approach: They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice.
Outcome: The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models .
Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment (2023.acl-long)

Copied to clipboard

Challenge: Existing speech-text pre-training methods are limited to one or two specific tasks, despite their success in speech-language processing tasks.
Approach: They propose a temporal position prediction task to capture the speech-text alignment . they use a textual dialog pre-training task to generalize a response selection task .
Outcome: The proposed model is superior in learning speech-text alignment and multi-turn dialog context.
LycheeCluster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing (2026.findings-acl)

Copied to clipboard

Challenge: Existing retrieval-based methods compromise semantic integrity through fixed-size chunking and suffer from inefficient linear scanning.
Approach: They propose a method that preserves local semantic coherence through boundary-aware chunking and constructs a recursive hierarchical index rooted in the triangle inequality.
Outcome: The proposed method achieves 3.6 end-to-end inference speedup with negligible degradation in model performance.
Sailor: Open Language Models for South-East Asia (2024.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) rely on English data for training, but are often not comparable across other languages.
Approach: They propose to develop a family of open language models for SEA languages . they use BPE dropout, aggressive data cleaning and deduplication to improve model robustness .
Outcome: The proposed models perform well across four benchmarks, including commonsense reasoning, question answering, reading comprehension and examination.
PiKGL: Leveraging Pruned Knowledge Graphs for Explainable Stance Detection (2026.tacl-1)

Copied to clipboard

Challenge: Experimental results demonstrate that a Pruned interpretable knowledge Graph Learning framework for explainable stance detection is state-of-the-art for social media stance prediction.
Approach: They propose a Pruned interpretable knowledge Graph Learning framework for explainable stance detection that incorporates commonsense knowledge and prunes redundant information to ensure precision and minimize noise.
Outcome: The proposed framework achieves state-of-the-art on three public datasets.
APT: Improving Specialist LLM Performance with Weakness Case Acquisition and Iterative Preference Training (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models often require domain-specific fine-tuning to address targeted tasks, which risks degrading their general capabilities.
Approach: They propose to use self-generated dis-preferred weakness data to enhance model performance with a targeted training approach that minimizes interference with existing knowledge base.
Outcome: The proposed approach ensures no reduction in generic capacity and achieves superior performance on downstream tasks compared to existing methods.
Synthesizing Text-to-SQL Data from Weak and Strong LLMs (2024.acl-long)

Copied to clipboard

Challenge: a capability gap exists between open-source and closed-source large language models (LLMs) . the adoption of closed-sourced LLMs introduces concerns pertaining to openness, privacy, and substantial costs.
Approach: They propose a synthetic data approach that combines strong and weak models for error information . they demonstrate the effectiveness of SENSE, a specialized text-to-SQL model .
Outcome: The proposed method enhances the domain generalization of text-to-SQL models and explores the potential of error data supervision through preference learning.
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Challenge: MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach: They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome: The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach: They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome: The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
OpenResearcher: Unleashing AI for Accelerated Scientific Research (2024.emnlp-demo)

Copied to clipboard

Challenge: Global scientific publications are growing annually by about 4%-5% (Pinedo et al., 2024).
Approach: They introduce an AI-assisted platform that answers diverse questions from researchers using Retrieval-Augmented Generation (RAG) they develop various tools to understand queries, search from the scientific literature, filter retrieved information, provide accurate and comprehensive answers, and self-refine answers.
Outcome: OpenResearcher is built on Retrieval-Augmented Generation (RAG) to integrate Large Language Models (LLMs) with up-to-date, domain-specific knowledge.
SeaPO: Strategic Error Amplification for Robust Preference Optimization of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for preference optimization of large language models use pairs of positive and negative samples, but the quality of positive samples may become similar during training, complicating preference learning.
Approach: SeaPO introduces error types commonly occurring in large language models to improve preference learning.
Outcome: SeaPO introduces error types into model Preference Optimization to improve model performance . negative samples are more erroneous than positive samples, and preference-based training mitigates errors .
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains.
Approach: They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore.
Outcome: The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore.
A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss (P18-1)

Copied to clipboard

Challenge: extractive models can obtain sentence-level attention with high ROUGE scores but less readable. abstractive models generate novel words and phrases not copied from the source text.
Approach: They propose to combine extractive and abstractive models to achieve a unified model that generates readable paragraphs with word-level attention.
Outcome: The proposed model achieves state-of-the-art ROUGE scores while being the most informative and readable summarization on the CNN/Daily Mail dataset in a solid human evaluation.
Bridging the Gap between Training and Inference: Multi-Candidate Optimization for Diverse Neural Machine Translation (2022.findings-naacl)

Copied to clipboard

Challenge: Existing diverse NMT models lack translation diversity due to a discrepancy between training and inference . despite the success of diverse NTM, there is still a lack of translation diversity .
Approach: They propose a multi-candidate optimization framework for diverse NMT to deal with this defect.
Outcome: The proposed framework is transparent to basic diverse NMT models, and universally makes better trade-off between diversity and quality.
A Knowledge Regularized Hierarchical Approach for Emotion Cause Analysis (D19-1)

Copied to clipboard

Challenge: Emotion cause analysis aims to identify the reasons behind emotions . previous models focus on learning architecture with local textual information .
Approach: They propose a method to extract emotion cause with hierarchical neural model and knowledge-based regularizations by sentiment lexicon and common knowledge.
Outcome: The proposed method outperforms baselines on two public datasets in different languages and outperformed competitive baselines by 2.08%.
Locality Preserving Sentence Encoding (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing word embeddings can be used to learn sentence embedds on the sentence level.
Approach: They propose a sentence embedding method that uses the inner product to compute semantic similarity between sentences.
Outcome: The proposed method encodes sentences better in the sense of semantic structures.
Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have achieved great success in various NLP tasks, but the vast model parameters pose challenges in downstream fine-tuning.
Approach: They propose a task-agnostic prompting strategy that analyzes each dialogue utterance before task execution to enhance LLMs' comprehension in multi-turn dialogues.
Outcome: The proposed strategy outperforms other zero-shot prompts and matches or exceeds efficacy of few-shot ones.
A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for conditional inference on joint textual and visual clues lack multimodal context reasoning capability.
Approach: They propose a multi-modal context reasoning approach that embeds textual semantics and objective image information into the pretrained language model to perform context reasoning.
Outcome: The proposed approach improves on two data sets and shows 4.8% gain on the PMR.
Socratic Human Feedback (SoHF): Expert Steering Strategies for LLM Code Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly used for generating code solutions, but struggle with complex programming problems without human guidance.
Approach: They use the “Socratic Feedback” paradigm to map observed feedback strategies to five stages of Socratic Questioning to identify failures in LLMs.
Outcome: The proposed models solved 74% of the problems that the models initially failed to solve on their own.
Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis (2022.coling-1)

Copied to clipboard

Challenge: Existing studies in Multimodal Sentiment Analysis lack a mechanism to understand complex relations between different modalities.
Approach: They propose a hierarchical graph contrastive learning framework for multimodal sentiment analysis that explores the relationships between modality representations.
Outcome: The proposed framework outperforms the state-of-the-art in multimodal sentiment analysis on two benchmark datasets.
Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion (2025.coling-main)

Copied to clipboard

Challenge: Empirical evidence suggests that LLMs perform worse than conventional KGC approaches.
Approach: They propose a filter-then-generate paradigm and a multiple-choice question format to harness the capability of LLMs while mitigating the issue casused by hallucinations.
Outcome: The proposed method achieves substantial performance gain compared to existing state-of-the-art methods.
COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning (2025.findings-naacl)

Copied to clipboard

Challenge: Existing datasets for Chinese instruction tuning are not well-aligned with Chinese users’ interaction patterns.
Approach: They propose to use Chinese instruction tuning datasets to improve instruction fine-tuning for Chinese users.
Outcome: The proposed dataset shows that Chinese models achieve competitive performance in diverse benchmarks.
LIME: Less Is More for MLLM Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs.
Approach: They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding.
Outcome: The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities.
Step-GRPO: Internalizing Dynamic Early Exit for Efficient Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Large reasoning models that use long chain-of-thought excel at problem-solving but waste computational resources.
Approach: They propose a framework that internalizes dynamic early-exit capabilities directly into the model.
Outcome: The proposed framework reduces token consumption by 32.0% on a Qwen3-8B model compared to the vanilla model .
Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network (2022.acl-long)

Copied to clipboard

Challenge: Existing studies on multimodal sarcasm detection using textual and visual information have been limited to text-only approaches.
Approach: They propose to construct a cross-modal graph for each multi-modal instance to explicitly draw the ironic relations between textual and visual modalities.
Outcome: The proposed model achieves state-of-the-art in multi-modal sarcasm detection.
A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text (2023.acl-long)

Copied to clipboard

Challenge: Pretrained Vision-Language Models (VLMs) have achieved remarkable performance in image retrieval from text, but their performance drops drastically when confronted with linguistically complex texts.
Approach: They propose an end-to-end Neural Divide-and-Conquer Reasoning framework for linguistically complex texts that they struggle to comprehend.
Outcome: The proposed framework significantly improves performance in complex image-text reasoning problem.
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks (2023.acl-long)

Copied to clipboard

Challenge: Existing datasets suffer from a lack of fine-grained annotations, such as the toxic type and expressions with indirect toxicity.
Approach: They propose a benchmark model to detect toxic language by incorporating lexical features into a Chinese dataset to facilitate fine-grained annotations.
Outcome: The proposed model is based on insulting vocabulary containing implicit profanity and is able to detect toxic language with lexical features.
Confusion is the Final Barrier: Rethinking Jailbreak Evaluation and Investigating the Real Misuse Threat of LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have been developed to deal with real-world crimes, but it remains unclear whether they internalize authentic knowledge or are forced to simulate toxic language patterns.
Approach: They construct knowledge-intensive Q&A to investigate misuse threats of Large Language Models in terms of dangerous knowledge possession, harmful task planning utility, and harmfulness judgment robustness.
Outcome: The findings raise concerns that jailbreak success is often attributable to a hallucination loop between jailbroken LLM and judger LLM .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations