Papers by Lin Tan

27 papers
ReFSQL: A Retrieval-Augmentation Framework for Text-to-SQL Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods that align natural language with SQL Language underestimate inherent structural characteristics of SQL and lead to structure errors.
Approach: They propose a retrieval-argument framework that aligns natural language with SQL Language and trains one encoder-decoder-based model to fit all questions.
Outcome: The proposed framework improves accuracy and robustness of text-to-SQL generation on five datasets.
Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation with GPT2 (2021.acl-srw)

Copied to clipboard

Challenge: Experimental results show that pre-trained language model GPT2 can generate better continuations by learning to generate the in the fine-tuning stage.
Approach: They conduct experiments on an English essay dataset using Chinese-GPT2 . they find that the model can generate better continuations by learning to generate the in the fine-tuning stage.
Outcome: The pre-trained language model GPT2 can generate better continuations by learning to generate the in the fine-tuning stage.
Can Language Models Replace Programmers for Coding? REPOCOD Says ‘Not Yet’ (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for code generation use short completions, synthetic examples, or focus on limited scale repositories, failing to represent real-world coding tasks.
Approach: They propose a Python code-generation benchmark that contains 980 whole-function generation tasks with realistic dependencies from 11 popular projects.
Outcome: The proposed benchmarks are short completions, synthetic examples, or focus on limited scale repositories, failing to represent real-world coding tasks.
SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learning (2025.acl-industry)

Copied to clipboard

Challenge: Empirical studies show that SingaKids provides effective dialogic teaching, benefiting learners at different performance levels.
Approach: They propose a dialogic tutor designed to facilitate language learning through picture description tasks.
Outcome: Empirical studies show that SingaKids provides effective dialogic teaching, benefiting learners at different performance levels.
Bit-Flip Error Resilience in LLMs: A Comprehensive Analysis and Defense Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped.
Approach: They propose a novel defense strategy to mitigate bit-flip errors (BFEs) they propose bfe protection and a self-correction mechanism to minimize performance degradation .
Outcome: The proposed defense strategy minimizes performance degradation while significantly improving robustness against BFEs.
Don’t Change Me! User-Controllable Selective Paraphrase Generation (2021.eacl-main)

Copied to clipboard

Challenge: a new technique allows paraphrase generation to be user-controlled . a user looking for cheap hotels in New York would not find the other answer helpful .
Approach: They propose a method that provides a user with explicit tags that can be placed around any arbitrary segment of text to mean "don't change me!" they propose allowing user-controllable paraphrase generation by fine-tuning model that exhibits this behavior .
Outcome: The proposed technique is language agnostic and tested in English and Chinese.
SParC: Cross-Domain Semantic Parsing in Context (P19-1)

Copied to clipboard

Challenge: Xu et al., 2017): a dataset for cross-domain semantic parsing in context with 4,298 question sequences.
Approach: They present a dataset for cross-domainSemanticParsing inContext that consists of 4,298 coherent question sequences.
Outcome: The proposed dataset demonstrates that it has greater semantic diversity and can be generalized to unseen domains due to its cross-domain nature and the unseened databases at test time.
Enhancing Zero-shot and Few-shot Stance Detection with Commonsense Knowledge Graph (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for stance detection are not applicable to zero-shot and few-shot scenarios.
Approach: They propose a model that integrates commonsense knowledge into a stance detection model.
Outcome: The proposed model outperforms state-of-the-art methods on zero-shot and few-shot stance detection tasks.
DART: Open-Domain Structured Data Record to Text Generation (2021.naacl-main)

Copied to clipboard

Challenge: Data-to-text annotations can be costly when dealing with tables with nontrivial structures.
Approach: They propose a procedure for extracting semantic triples from tables that encodes their structures by exploiting table headers and table title.
Outcome: The proposed method exploits the semantic dependencies between table headers and title to extract semantic triples from tables.
AgentAsk: Multi-Agent Systems Need to Ask (2026.acl-long)

Copied to clipboard

Challenge: Multi-agent systems fail to consistently outperform strong single-a agent baselines due to error propagation at inter-aggent message handoffs.
Approach: They propose an edge-level error taxonomy that identifies four main errors in multi-agent interactions as data gaps, signal corruption, referential drift and capacity gaps as primary sources of failure.
Outcome: The proposed module outperforms existing systems on five benchmarks and is architecture-agnostic.
FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognition (2021.findings-emnlp)

Copied to clipboard

Challenge: Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence.
Approach: They propose a fast correction model that takes multiple ASR candidates as input for better correction accuracy.
Outcome: The proposed model can reduce the word error rate (WER) with multiple candidates by 3.2% and 2.6%.
WAFFLE: Fine-tuning Multi-Modal Model for Automated Front-End Development (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown promise in generating source code, but two major challenges persist in UI-to-HTML code generation: (1) effectively representing HTML’s hierarchical structure for LLMs; and (2) bridging the gap between the visual nature of UI designs and the text-based format of HTML code.
Approach: They propose a structure-aware attention mechanism that uses a contrastive fine-tuning approach to align LLMs’ understanding of UI images and HTML code.
Outcome: The proposed model outperforms existing methods on the WebSight-Test and Design2Code benchmarks.
Consultant Decoding: Yet Another Synergistic Mechanism (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have attracted widespread attention and adoption across diverse domains due to their exceptional performance and robust generalization abilities.
Approach: They propose a synergetic mechanism for Consultant Decoding (CD) that achieves a 2.5-fold increase in inference speed compared to the target model while maintaining comparable generation quality.
Outcome: The proposed mechanism achieves 2.5-fold increase in inference speed while maintaining comparable generation quality (100% of the target model’s performance).
Expressing Visual Relationships via Language (P19-1)

Copied to clipboard

Challenge: Current studies on image captioning focus on single image, but there are no effective models for generating relational captions for two images.
Approach: They propose a language-guided image editing dataset that contains real image pairs with corresponding editing instructions.
Outcome: The proposed model outperforms baseline and existing methods on two datasets.
TriPlay-RL: Tri-Role Self-Play Reinforcement Learning for LLM Safety Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to safety alignment of large language models rely on costly manual annotations or human review.
Approach: They propose a closed-loop reinforcement learning framework called TriPlay-RL that enables iterative collaboration among three roles with near-zero manual annotation.
Outcome: The proposed framework achieves 20%–50% improvement in adversarial effectiveness while preserving high output diversity while achieving 10%–30% gains in safety performance without degrading general reasoning capability.
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing QA frameworks that use event-centric reasoning are lacking.
Approach: They propose a novel QA model with contrastive learning and invertible event transformation . they use an invertable transformation matrix to project event vectors into a common event embedding space .
Outcome: The proposed model achieves 8.4% gain in token-level F1 score and 3.0% gain in Exact Match score on the ESTER dataset.
daDPO: Distribution-Aware DPO for Distilling Conversational Abilities (2025.findings-acl)

Copied to clipboard

Challenge: Knowledge distillation (KD) with Direct Preference Optimization (DPO) has emerged as a promising approach to enhance the conversational abilities of smaller models using a larger teacher model.
Approach: They propose a framework that integrates the teacher's distributional information into DPO distillation while preserving theoretical guarantees.
Outcome: The proposed framework outperforms existing methods in restoring performance for pruned models and enhancing smaller models within the same LLM family.
End-to-End Open-Domain Question Answering with BERTserini (N19-4)

Copied to clipboard

Challenge: a new open-domain question answering system integrates best practices from IR with a BERT-based reader to identify answers from a large corpus of Wikipedia articles.
Approach: They propose an end-to-end question answering system that integrates BERT with an IR reader.
Outcome: The proposed system improves on a standard benchmark test collection.
Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction (2022.emnlp-main)

Copied to clipboard

Challenge: Text error correction methods usually use the source (incorrect) sentence as encoder input and generate the target (correct) sentences through the decoder.
Approach: They propose a method to correct errors in text sequences by randomly masking out the correct tokens in the source sentence.
Outcome: The proposed method improves accuracy on Mandarin and English datasets with autoregressive and non-autoregressive generation models.
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence.
Approach: They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics .
Outcome: The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate .
Taming the Real-world Complexities in CPT E/M Coding with Large Language Models (2025.emnlp-industry)

Copied to clipboard

Challenge: Evaluation and Management (E/M) coding is performed by physicians and trained human coders who review clinical encounter notes and electronic health record data to assign appropriate codes.
Approach: They propose a framework that automates evaluation and management coding tasks using the Current Procedural Terminology (CPT) taxonomy.
Outcome: The proposed framework achieves an increase in coding accuracy of more than 36% over a commercial CPT E/M coding system and almost 5% over our strongest single-prompt baseline.
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases (D19-1)

Copied to clipboard

Challenge: CoSQL is a corpus for building cross-domain, general-purpose database querying dialogue systems.
Approach: They present a corpus for building cross-domain, general-purpose database querying dialogue systems . they use a Wizard-of-Oz collection of 3k turns plus 10k+ annotated SQL queries .
Outcome: The proposed corpus is based on a Wizard-of-Oz dataset of 3k dialogues querying 200 complex DBs spanning 138 domains.
Detecting Customer Complaint Escalation with Recurrent Neural Networks and Manually-Engineered Features (N19-2)

Copied to clipboard

Challenge: e-commerce companies often have the option of escalating complaints by filing grievances with a government authority . this is detrimental to an ecommerce company, but this problem is challenging to solve by integrating recurrent neural networks with manually-engineered features.
Approach: They propose a model that integrates recurrent neural networks with manually-engineered features to identify cases where the customer expresses such an intent.
Outcome: The proposed model outperforms baseline models and provides better recall and triage for specialized agents.
Reimagining Retrieval Augmented Language Models for Answering Queries (2023.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are expensive to train, deploy, and maintain, both financially and in terms of environmental impact.
Approach: They present a reality check on large language models and compare their predictions to retrieval-augmented language models.
Outcome: The proposed models fare better on question answering tasks and have become the foundation of impressive demos like Chat-GPT.
More Data or Better Data? A Critical Analysis of Data Selection and Synthesis for Mathematical Reasoning (2025.emnlp-industry)

Copied to clipboard

Challenge: Despite various proposed data construction methods, their practical utility in real-world pipelines remains underexplored.
Approach: They conduct a comprehensive analysis of open-source datasets and data synthesis techniques for mathematical reasoning under a unified pipeline designed to mirror training and deployment scenarios.
Outcome: The proposed pipelines mirror training and deployment scenarios and are suitable for industrial applications.
ECO v1: Towards Event-Centric Opinion Mining (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies on event-centric opinion mining focus on entity-centric opinions . entity-centered opinions focus on sentimental polarity of events, while event-centered ones focus on content .
Approach: They propose to perform event-centric opinion mining on event-argument structure and expression categorizing theory and benchmark it against a pioneer corpus.
Outcome: The proposed task is feasible and challenging, and the results are beneficial for future studies.
ReSURE: Regularizing Supervision Unreliability for Multi-turn Dialogue Fine-tuning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods address data quality via static prefiltering, which decouples quality control from training and fails to mitigate turn-level error propagation.
Approach: They propose an adaptive learning method that dynamically down-weights unreliable supervision without explicit filtering.
Outcome: Experiments on single-source and mixed-quality datasets show improved stability and response quality.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations