Papers by Patrick Zhang

14 papers
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)

Copied to clipboard

Challenge: Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data.
Approach: They propose a framework that imposes strong typing constraints and incorporates key relationships from schema.
Outcome: The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider.
Fast and Accurate Factual Inconsistency Detection Over Long Documents (2023.emnlp-main)

Copied to clipboard

Challenge: Generative AI models exhibit remarkable potential, however, hallucinations across various tasks present a significant challenge, particularly for longer inputs.
Approach: They propose a task-agnostic model that uses large text chunks to condition over long texts and employ a novel algorithm to explain its decisions through relevant source sentence retrieval.
Outcome: The proposed model outperforms existing methods on benchmarks and a new long-form dialogue dataset and surpasses competitive systems in efficiency and model explanation evaluations.
Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Prediction (2021.acl-long)

Copied to clipboard

Challenge: Open-domain question answering is a task to answer questions using passages with diverse topics.
Approach: They propose a model that aggregates evidence from multiple passages to adaptively predict a single answer or a set of question-answer pairs for ambiguous questions.
Outcome: The proposed model achieves state-of-the-art performance on AmbigQA dataset and shows competitive performance on NQ-Open and TriviaQA.
Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks for learning Large Language Models (LLMs) require adaptive data processing and low-rank adjustment to improve accuracy and fine-tuning speed.
Approach: They propose a fisher information-based adaptive federated curriculum learning framework with two novel methods to improve FL fine-tuning process.
Outcome: The proposed framework improves performance and fine-tuning speed compared with baseline approaches.
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit (2023.acl-demo)

Copied to clipboard

Challenge: ESPnet-ST-v2 is a revamp of the open-source spoken language translation toolkit . it supports offline speech-to-text translation (ST), simultaneous speech- to-text (SST), and offline speech to-speech (S2ST)
Approach: They propose to revamp the open-source ESPnet-ST toolkit to support offline speech-to-text translation, simultaneous speech- to-text and offline speech to-speech translation.
Outcome: The updated version of ESPnet-ST supports offline speech-to-text translation (ST), simultaneous speech- to-text (SST), and offline speech to-speech translation (S2ST).
Benchmarking Diverse-Modal Entity Linking with Generative Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing models for diverse-mode entity linking (EL) work well on per modality configurations, but it is more challenging to design a unified model for diverse modality.
Approach: They propose a generative diverse-modal model that integrates text, image and table . they propose combining a multimodal encoder-decoder paradigm with a fine-tuning GDMM .
Outcome: The proposed model outperforms state-of-the-art models by 8.51 F1 on average for diverse-modal EL.
Improving Cross-task Generalization of Unified Table-to-text Models with Compositional Task Configurations (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for multitask learning typically use a dataset name as input prefix, which limits the effectiveness of multitask training.
Approach: They propose compositional task configurations, a set of prompts prepended to the encoder to improve cross-task generalization of unified models.
Outcome: The proposed model outperforms the UnifiedSKG baseline by noticeable margins in both in-domain and zero-shot settings.
FIDELITY: Fine-grained Interpretable Distillation for Effective Language Insights and Topic Yielding (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for topic modeling generate contextually specific and semantically intuitive topics, especially in dynamic environments and low-resource languages.
Approach: They propose a hybrid method that combines topic modeling and text summarization to produce fine-grained, semantically rich, and contextually relevant output.
Outcome: FIDELITY outperforms traditional models in topic diversity, similarity, and ability to process new, unseen documents.
Improving Factual Consistency of Abstractive Summarization via Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that about 30% of summaries generated by neural text summarization suffer from fact fabrication.
Approach: They propose an automatic evaluation metric to measure factual consistency and a learning algorithm that maximizes the metric during model training.
Outcome: The proposed method improves factual consistency and overall quality of summarization models.
Mitigating Hallucinations in LM-Based TTS Models via Distribution Alignment Using GFlowNets (2025.emnlp-main)

Copied to clipboard

Challenge: Existing mitigation strategies for Text-to-Speech systems require excessive training resources or inference latency.
Approach: They propose a GFlOwNet-guided distribution AlignmenT framework that mitigates hallucinations without relying on massive resources or inference latency.
Outcome: The proposed framework reduces over 50% character error rates and lowers uncertainty by up to 58% on challenging test cases.
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages (2024.emnlp-main)

Copied to clipboard

Challenge: Southeast Asia (SEA) is home to over 1,300 indigenous languages and 671 million people . prevailing AI models suffer from a significant lack of representation of texts, images, and audio datasets from SEA .
Approach: They propose to provide a resource center that provides standardized corpora in nearly 1,000 SEA languages across three modalities.
Outcome: a new benchmark assesses the quality of AI models on 36 SEA languages across 13 tasks . the results highlight the importance of SEA as a culturally diverse region .
Choosing Transfer Languages for Cross-Lingual Learning (P19-1)

Copied to clipboard

Challenge: Cross-lingual transfer is a useful tool for improving performance of natural language processing (NLP) on low-resource languages.
Approach: They propose to use cross-lingual transfer to improve accuracy of low-resource languages . they build models that consider features to perform prediction on such languages based on ranking problem .
Outcome: The proposed model predicts good transfer languages much better than baselines considering single features in isolation.
Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge (2023.findings-acl)

Copied to clipboard

Challenge: Open-ended Visual Question Answering (VQA) requires models to reason over visual and natural language inputs using world knowledge.
Approach: They propose a new VQA pipeline that deploys a generate-then-select strategy guided by world knowledge for the first time.
Outcome: The proposed pipeline expands the knowledge coverage from in-domain training data by 4.1% on OK-VQA, without additional computation cost.
What Really Matters for Table LLMs? A Meta-Evaluation of Model and Data Effects (2026.findings-eacl)

Copied to clipboard

Challenge: a series of paradigm shifts have come with distinct characteristics and challenges associated with table modeling.
Approach: They propose to replicate four table LLMs by instruction-tuning three foundation models on four existing datasets.
Outcome: The results show that base model choice plays a more dominant role than training data itself.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations