Papers by Yi Lin

45 papers
Rethinking Data Selection at Scale: Random Selection is Almost All You Need (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results .
Approach: They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method .
Outcome: The proposed methods outperform random selection on large datasets on large data pools.
Soft Language Clustering for Multilingual Model Pre-training (2023.acl-long)

Copied to clipboard

Challenge: Multilingual pre-trained language models have demonstrated impressive (zero-shot) cross-lingual transfer abilities, however, their performance is hindered when the target language has distant typology from the source language or when pre-training data is limited in size.
Approach: They propose a method that contextually retrieves prompts as flexible guidance for encoding instances conditionally.
Outcome: The proposed method improves on the XTREME task and also for low-resource languages in unsupervised sentence retrieval.
Summarising Historical Text in Modern Languages (2021.eacl-main)

Copied to clipboard

Challenge: Historical text summarisation is a routine for historians and digital humanities researchers but has never been automated.
Approach: They propose a model that can be trained even with no cross-lingual data and further benchmark it against state-of-the-art algorithms.
Outcome: The proposed model outperforms standard cross-lingual benchmarks on historical text summarisation task and identifies distinctness and value of the dataset.
Exploring Mode Connectivity for Pre-trained Language Models (2022.emnlp-main)

Copied to clipboard

Challenge: Recent years have witnessed the prevalent application of pre-trained language models (PLMs) in NLP. From the perspective of parameter space, PLMs provide generic initialization, starting from which high-performance minima could be found.
Approach: They investigate the geometric connections of different minima through the lens of mode connectivity, which measures whether two minima can be connected with a low-loss path.
Outcome: The proposed model can be used to find low-loss paths between two minima, and to understand how their mode connectivity affects their task knowledge.
Knowledge Inheritance for Pre-trained Language Models (2022.naacl-main)

Copied to clipboard

Challenge: Existing large-scale pre-trained language models are mainly trained from scratch individually, ignoring that many well-taught PLMs are available.
Approach: They propose a pre-training framework called knowledge inheritance and propose auxiliary supervision to efficiently learn larger PLMs.
Outcome: The proposed framework can be used to train large-scale language models with huge parameters and a large dataset can be adapted to domain adaptation and knowledge transfer.
DocMMIR: A Framework for Document Multi-modal Information Retrieval (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing multi-modal information retrieval models lack a comprehensive exploration of document-level retrieval . existing models suffer from the absence of cross-domain datasets at this granularity.
Approach: They propose a multi-modal document retrieval framework to unify diverse document formats and domains with a comprehensive retrieval scenario.
Outcome: The proposed framework improves document retrieval performance on a large multimodal dataset.
FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point (2025.findings-acl)

Copied to clipboard

Challenge: Auto-regressive decoding is a memory-bound job, meaning decoding performance is limited by the bandwidth rather than the computational capabilities of the GPU.
Approach: They propose a framework that supports lossless weight-only quantization inference and validate it on Qwen and LLaMA Models.
Outcome: The proposed framework achieves the highest efficiency with lossless accuracy on Qwen and LLaMA Models across various modalities.
CogToM: A Comprehensive Theory of Mind Benchmark inspired by Human Cognition for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Large Language Models (LLMs) are limited to false belief tasks, highlighting bottlenecks in specific dimensions.
Approach: They propose a benchmark to evaluate Large Language Models' Theory of Mind capabilities . they evaluate 8000 bilingual instances across 46 paradigms and validated by 49 human annotators .
Outcome: The proposed benchmark reveals performance heterogeneities and bottlenecks in 22 representative models.
Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling (D19-1)

Copied to clipboard

Challenge: Existing techniques for relevance and semantic matching cannot be easily adapted to the other.
Approach: They propose a model that incorporates a hybrid encoder module, a relevance matching module and co-attention mechanisms that capture context-aware semantic relatedness.
Outcome: The proposed model incorporates a hybrid encoder module, a relevance matching module and co-attention mechanisms that capture context-aware semantic relatedness.
Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting (2021.acl-long)

Copied to clipboard

Challenge: Existing QG systems perform substantially worse in answering multi-hop questions than single-hop ones.
Approach: They propose a framework that progressively increases question difficulty through step-by-step rewriting under the guidance of an extracted reasoning chain.
Outcome: The proposed framework increases question difficulty through step-by-step rewriting under the guidance of an extracted reasoning chain.
Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talk (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be prohibitive in terms of feasibility, time, and resources.
Approach: They propose a method for training large language models by enabling "self-talk" they propose supervised fine-tuning of LLMs to improve quality of dialogues .
Outcome: The proposed method generates training data via "self-talk" of LLMs that can be refined and utilized for supervised fine-tuning.
Multimodal Sarcasm Target Identification in Tweets (2022.acl-long)

Copied to clipboard

Challenge: Existing methods to detect sarcasm target with text lacking context are not sufficient and complete.
Approach: They propose a multi-modal sarcasm target identification task that performs both textual and visual detection.
Outcome: The proposed model can perform textual target labeling and visual target detection.
Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems (2021.naacl-demos)

Copied to clipboard

Challenge: Traditional goal-oriented dialogue systems require annotations which are hard to obtain for every new domain, limiting scalability.
Approach: They propose a data-driven approach to building goal-oriented dialogue systems . they use a seed dialogue simulator to generate annotated conversations instead of collecting annotations .
Outcome: The proposed system improves turn-level action signature prediction accuracy by 50% . the system is scalable, extensible and data efficient .
DoTAT: A Domain-oriented Text Annotation Tool (2022.acl-demo)

Copied to clipboard

Challenge: DoTAT is a domain-oriented text annotation tool that can reduce the time for event annotation by 19.7% . the tool supports multi-person collaborative process with automatically merging and review .
Approach: They propose a domain-oriented text annotation tool called DoTAT . it provides multi-person collaborative process with automatic merging and review .
Outcome: The proposed tool can reduce the time for event annotation by 19.7% compared with existing tools.
Integrating Structural Semantic Knowledge for Enhanced Information Extraction Pre-training (2024.emnlp-main)

Copied to clipboard

Challenge: Existing pre-training methods focus on exploiting textual knowledge, which limits scalability and versatility of resulting models.
Approach: They propose a pre-training framework that integrates structural semantic knowledge via contrastive learning.
Outcome: The proposed framework outperforms state-of-the-art pre-training methods across multiple tasks.
Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMs (2025.coling-main)

Copied to clipboard

Challenge: Existing solutions to alleviate hallucination have considered utilizing LLMs’ inherent reasoning abilities to alleviating hallucinism, such as self-correction and diverse sampling methods.
Approach: They propose a counterfactual multi-agent debate framework that predetermines LLMs' stances to override their inherent biases for answer inspection.
Outcome: Extensive experiments on four datasets of three tasks demonstrate the superiority of the proposed framework over existing methods.
AutoPKG: An Automated Framework for Dynamic E-commerce Product-Attribute Knowledge Graph Construction (2026.findings-acl)

Copied to clipboard

Challenge: Product attribute extraction in e-commerce is bottlenecked by ontologies that are inconsistent, incomplete, and costly to maintain.
Approach: They propose a multi-agent Large Language Model framework that constructs a Product-attribute Knowledge Graph from multimodal product content.
Outcome: The proposed framework achieves 0.953 WKE for product types, 0.724 WKEs for attribute keys, and 0.531 edge-level accuracy for value assertions after canonicalization on a large real-world marketplace catalog dataset from Lazada (Alibaba).
RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System (2021.naacl-demos)

Copied to clipboard

Challenge: We present a new information extraction system that can construct temporal event graphs from news documents.
Approach: They propose a temporal event graph extraction system that can extract news documents . they extend the system from sentence-level event extraction to cross-document cross-media event extraction .
Outcome: The proposed system can extract temporal event graphs from news documents in multiple languages and multiple data modalities.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Can LLMs Hear the Dogwhistle? (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles.
Approach: They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices .
Outcome: The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts.
LOFT: Scalable and More Realistic Long-Context Evaluation (2025.findings-naacl)

Copied to clipboard

Challenge: Long-context language models (LCLMs) can be used to perform tasks traditionally reliant on external tools like retrieval systems or databases.
Approach: They propose a benchmark to evaluate LCLMs' performance on in-context retrieval and reasoning tasks using a set of tokens.
Outcome: The proposed model outperforms state-of-the-art retrieval and RAG systems on in-context retrieval tasks while still requiring prompting strategies.
TLoRA: Task-aware Low Rank Adaptation of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing low-rank Adaptation (LoRA) methods address only one factor, often at the cost of increased training complexity or reduced practical efficiency.
Approach: They propose a low-rank Adaptation framework that optimizes initialization and resource allocation at the outset of training.
Outcome: The proposed framework performs excellently across various tasks while reducing the number of trainable parameters.
A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for fake news detection focus on fact-checked reports, resulting in limited coverage and debunking delays.
Approach: They propose a Coarse-to-fine Cascaded Evidence-Distillation neural network for explainable fake news detection based on raw reports . they use hierarchical encoders and cascaded selectors to select most explainable sentences for verdicts on top of selected top-K reports based upon raw reports.
Outcome: The proposed model outperforms baseline detection methods and generates high-quality explanations from diverse evaluation perspectives.
Unsupervised Graph-Text Mutual Conversion with a Unified Pretrained Language Model (2023.acl-long)

Copied to clipboard

Challenge: Existing unsupervised approaches for learning knowledge graphs require multiple modules and require entity information or relation type for training.
Approach: They propose a method that uses a unified pretrained language model to achieve fully unsupervised graph-text mutual conversion for the first time.
Outcome: The proposed method outperforms state-of-the-art methods for G2T and T2G tasks by fine-tuning only one pretrained model.
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation (2021.naacl-demos)

Copied to clipboard

Challenge: a new framework to digest relevant biomedical knowledge is needed to combat COVID-19 . quantity of research results is a bottleneck, and false information promoted in publications .
Approach: a team of researchers has developed a framework to extract multimedia knowledge elements from scientific literature to combat COVID-19.
Outcome: a new framework extracts fine-grained multimedia knowledge elements from scientific literature . it provides detailed contextual sentences, subfigures, and knowledge subgraphs as evidence . the framework is based on a case study of drug repurposing .
MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generation (2026.acl-short)

Copied to clipboard

Challenge: Automated 3D radiology report generation suffers from clinical hallucinations and lacks the iterative verification characteristic of clinical workflows.
Approach: They propose a multi-agent framework that emulates the professional hierarchy of radiology departments and assigns specialized roles to distinct agents.
Outcome: The proposed framework outperforms state-of-the-art models in clinical fidelity and linguistic accuracy on the RadGenome-ChestCT dataset.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
R-Tuning: Instructing Large Language Models to Say ‘I Don’t Know’ (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for instruction tuning force the model to complete a sentence no matter whether it knows the knowledge or not.
Approach: They propose a new approach to tuning large language models to refrain from answering questions beyond its parametric knowledge by identifying the disparity in parametric and parametric information.
Outcome: The proposed approach improves a model’s ability to answer known questions and refrain from answering unknown questions.
RelCLIP: Adapting Language-Image Pretraining for Visual Relationship Detection via Relational Contrastive Learning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing visual relationship detection models only use numeric ids of relation labels for training, but ignore semantic correlation between labels.
Approach: They propose a visual Relationship prediction framework that transfers natural language knowledge from Contrastive Language-Image Pre-training models to enhance the relationship prediction.
Outcome: The proposed framework improves visual relationship prediction by matching semantic correlations with relation triplets.
PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent (2025.coling-main)

Copied to clipboard

Challenge: Existing research on propaganda detection does not capture the motives behind the content or its broader impact.
Approach: They propose a framework that dissects propaganda into techniques, arousal appeals, and underlying intent.
Outcome: The proposed framework improves performance in a wide range of scenarios and can be used to identify and categorize propaganda techniques.
RAVR: Reference-Answer-guided Variational Reasoning for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Experiments show that reinforcement learning (RL) can refine the reasoning abilities of large language models (LLMs) but requires a key prerequisite: the model must already be able to generate high-utility reasoning paths with non-negligible probability.
Approach: They propose a framework that uses answer-conditioned reasoning as a variational surrogate for question-only reasoning.
Outcome: Experiments on 11 benchmarks and 3 models show that RAVR reduces hesitation, strengthens conclusion consolidation, and promotes problem-specific strategies in reasoning.
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Existing studies study sentiment and emotion separately and do not fully exploit the complementary knowledge behind the two.
Approach: They propose a multimodal sentiment knowledge-sharing framework that unifies MSA and ERC tasks from features, labels, and models.
Outcome: The proposed framework achieves consistent improvements on four public benchmark datasets on MOSI, MOSEI, MELD, and IEMOCAP.
Gloss-Free End-to-End Sign Language Translation (2023.acl-long)

Copied to clipboard

Challenge: a study of sign language translation without gloss annotations focuses on the problem of gloss annotation . gloss annotation is hard to acquire, especially in large quantities, and limits the domain coverage of translation datasets .
Approach: They propose a gloss-free end-to-end sign language translation framework to solve this problem . gloss annotations are hard to acquire, especially in large quantities, they argue .
Outcome: The proposed framework improves sign language translation performance on large-scale datasets . gloss annotations are hard to acquire, especially in large quantities .
Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems (2021.naacl-main)

Copied to clipboard

Challenge: Existing goal-oriented dialogue datasets focus on identifying slots and values, but in reality, customer service agents follow multi-step procedures derived from explicit company policies.
Approach: They propose to use a fully-labeled dataset to study customer service dialogue systems in real-world scenarios.
Outcome: The proposed dataset outperforms existing models but still lacks 50.8% absolute accuracy to reach human-level performance on the dataset.
CLIO: Role-interactive Multi-event Head Attention Network for Document-level Event Extraction (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for document-level event extraction struggle due to two intrinsic challenges: nested arguments and multiple events.
Approach: They propose a role-interactive multi-event head attention network to solve two challenges . they map different events to multiple subspaces and then determine whether the current event exists .
Outcome: The proposed model improves on two widely used DEE datasets on the Internet.
UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision (2026.acl-long)

Copied to clipboard

Challenge: Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis.
Approach: They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge.
Outcome: The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks.
Supervised Optimism Correction: Be Confident When LLMs Are Sure (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated remarkable success across diverse tasks such as instruction following, code generation, and medical diagnosis.
Approach: They propose a supervised fine-tuning-based auxiliary loss for Q-value estimations during supervised refinement.
Outcome: The proposed method outperforms beam search on GSM8K, MATH, and GAOKAO on reasoning benchmarks.
Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Chain-of-thought (CoT) prompting is a technique to enhance the reasoning abilities of Large language models (LLMs) however, the reasoning chains of demonstrations are observed to be prone to errors, which can lead to incorrect reasoning during inference.
Approach: They propose an iterative bootstrapping technique to enhance the reasoning abilities of Large language models (LLMs) by generating a series of reasoning steps to obtain the answer, and using the reasoning chains as exemplars to demonstrate the task.
Outcome: The proposed method improves the performance of Large language models (LLMs) on three reasoning tasks on ten datasets.
Target-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation (2023.emnlp-main)

Copied to clipboard

Challenge: a recent study defines a conversation target from the system side to proactively steer conversations toward predefined targets or accomplish specific system-side goals.
Approach: They propose a dataset curation framework that automatically curations a large-scale personalized dialogue dataset using a role-playing approach.
Outcome: The proposed dataset is of high quality and could contribute to exploring personalized target-oriented dialogue.
Continual Relation Learning via Episodic Memory Activation and Reconsolidation (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to learn incessantly emerging novel relations are overfitting the few memorized examples of old relations, causing confusion among existing relations.
Approach: They introduce episodic memory activation and reconsolidation (EMAR) to continual relation learning.
Outcome: The proposed method outperforms state-of-the-art models in catastrophic forgetting old relations.
Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Parameter-Efficient Tuning (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing delta tuning algorithms freeze most of the parameters and only optimize minimal adaptive parameters.
Approach: They propose to decompose DETs into a unified optimization subspace and conduct optimization within the subspace.
Outcome: The proposed DETs achieve comparable performance to the original DET and can be transferred to another DET with non-trivial performance.
Feasible is Not Enough: Cost-Aware Optimal Tool-Chain Planning on Multi-Solution Tool Graphs (2026.findings-acl)

Copied to clipboard

Challenge: Existing tools and benchmarks often form tool learning (TL) as a single-solution setting . exploring large-scale TG is computationally expensive, especially under constrained context budgets.
Approach: They propose a framework for learning optimal TL policies over large tool graphs . they train a reinforcement learning agent to acquire transferable expansion skills .
Outcome: The proposed framework improves task success and solution optimality by 46.21% and 66.34% on multiSoTLBench.
Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding (2024.findings-acl)

Copied to clipboard

Challenge: Existing autoregressive models generate tokens sequentially and are memory-bound, resulting in a memory-based inference stage that is memory-limited.
Approach: They propose an approach to accelerate the inference speed of large language models with billions of parameters by integrating semi-autoregressive inference and speculative decoding capabilities.
Outcome: The proposed approach has demonstrated inference speedups of 2.7x-4.0x on humanEval-X while maintaining output quality.
Ensuring Safe and High-Quality Outputs: A Guideline Library Approach for Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Guide-Align is a guideline-oriented approach to augment the safety and quality of Large Language Models.
Approach: They propose a guideline-oriented method to augment the safety and quality of large language models.
Outcome: The proposed method outperforms existing methods on three benchmarks and shows significant improvements in security and quality.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations