Papers by Zhihong Chen

42 papers
Word Graph Guided Summarization for Radiology Findings (2021.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on introducing salient word information to general text summarization framework to guide selection of key content in radiology findings.
Approach: They propose a method for automatic impression generation using word graphs and a Word Graph guided Summarization model to capture critical words and their relations.
Outcome: The proposed method is validated on two datasets, OPENI and MIMIC-CXR.
Code-Switching Can be Better Aligners: Advancing Cross-Lingual SLU through Representation-Level and Prediction-Level Alignment (2024.acl-short)

Copied to clipboard

Challenge: Existing code-switching-based cross-lingual spoken language understanding frameworks are limited to low-resource languages.
Approach: They propose a cross-lingual spoken language understanding framework that leverages both code-switched and original sentences to achieve multi-level alignment.
Outcome: The proposed framework can achieve multi-level alignment on two benchmarks across ten languages.
Graph Enhanced Contrastive Learning for Radiology Findings Summarization (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for automating impression generation have limited the relationship between extra knowledge and the original findings.
Approach: They propose a framework for automating impression generation that exploits extra knowledge and original findings . they propose combining key words and their relations to extract critical information .
Outcome: The proposed framework exploits extra knowledge and the original findings in an integrated way . the state-of-the-art results on two datasets confirm the effectiveness of the proposed method .
Learning to Match Representations is Better for End-to-End Task-Oriented Dialog System (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing systems for task-oriented dialogue lack belief states as supervisory signals.
Approach: They propose a method for knowledge retrieval driven by matching representations . they use a matching signal extractor to extract matching representation between contexts and entities .
Outcome: Experiments on three standard benchmarks show that the proposed method performs better than existing approaches.
Can We Trust AI Doctors? A Survey of Medical Hallucination in Large Language and Large Vision-Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Hallucination is a critical challenge for large language models and large vision-language models (LVLMs) however, dedicated research on medical hallucinations remains unexplored.
Approach: They provide a unified perspective on medical hallucination for both LLMs and LVLMs, and delve into its causes.
Outcome: The proposed models have demonstrated impressive performance on a variety of medical benchmarks.
GREEN: Generative Radiology Report Evaluation and Error Notation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing automated evaluation metrics fail to consider factual correctness or are limited in their interpretability.
Approach: They propose a radiology report evaluation metric that leverages natural language understanding of language models to identify and explain clinically significant errors.
Outcome: The proposed method demonstrates higher correlation with expert error counts and higher alignment with expert preferences when compared to previous methods.
Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding (2024.findings-emnlp)

Copied to clipboard

Challenge: Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP.
Approach: They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens.
Outcome: The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs.
Improving Radiology Summarization with Radiograph and Anatomy Prompts (2023.findings-acl)

Copied to clipboard

Challenge: Recent studies focus on automatic impression generation, but this task is time-consuming and in high demand.
Approach: They propose to use an anatomy-enhanced multimodal model to generate automatic impressions by combining radiology images with textual features.
Outcome: The proposed model achieves state-of-the-art on two benchmark datasets and compares with existing models.
Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multimodal intent detection have two limitations: (i) close entanglement of multimodal semantics with modal structures; (ii) insufficient learning of causal effects of semantic and modality-specific information on the final predictions.
Approach: They propose a Dual-oriented Disentangled Network with Counterfactual Intervention model that decouples semantics-oriented and modality-oriented representations and a Counterfective Intervention Module that applies causal inference to understand causal effects by injecting confounders.
Outcome: The proposed model overcomes key limitations in existing systems by effectively disentangling and utilizing modality-specific and multimodal semantic information.
Cross-modal Memory Networks for Radiology Report Generation (2021.acl-long)

Copied to clipboard

Challenge: Medical imaging reports are essential in clinical practice, and generating the reports is beneficial to reduce the burden of radiologists.
Approach: They propose to use a shared memory to enhance the encoder-decoder framework for radiology report generation.
Outcome: The proposed model can generate more accurate reports on two widely used datasets.
HuatuoGPT, Towards Taming Language Model to Be a Doctor (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases.
Approach: They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage.
Outcome: The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources.
On the Difference of BERT-style and CLIP-style Text Encoders (2023.findings-acl)

Copied to clipboard

Challenge: Masked language modeling is one of the most popular pretraining recipes in natural language processing.
Approach: They analyze BERT-style and CLIP-style text encoders from three experiments . they show that CLIP style encoder is equipped with synesthesia for the cross-modal association .
Outcome: The proposed models outperform BERT-style models on vision-centric text understanding tasks, but have synesthesia for the cross-modal association, similar to the senses of humans.
Enhancing Code-Switching for Cross-lingual SLU: A Unified View of Semantic and Grammatical Coherence (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models rely on annotated training data, limiting their scalability to low-resource languages.
Approach: They propose a method termed SoGo for zero-shot cross-lingual SLU that uses keywords as substitution options to extract keywords and a token-level alignment strategy to ensure grammatical coherence.
Outcome: The proposed method improves zero-shot cross-lingual SLU across nine languages on MultiATIS++.
LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Graph-based Retrieval-Augmented Generation (GraphRAG) is a new approach to document retrieval, but it is not suitable for legal reasoning.
Approach: They propose a framework for reliable legal reasoning that structures knowledge as relational graphs and uses a multi-agent system to verify validity.
Outcome: The proposed framework outperforms existing GraphRAG models in accurate and trustworthy legal analysis.
RadGraph-XL: A Large-Scale Expert-Annotated Dataset for Entity and Relation Extraction from Radiology Reports (2024.findings-acl)

Copied to clipboard

Challenge: RadGraph-XL is an expert-annotated dataset for structured clinical data extraction.
Approach: They propose a large-scale, expert-annotated dataset for clinical entity and relation extraction using radiology reports.
Outcome: The proposed model outperforms existing methods by up to 52% and outperfies GPT-4 in this domain.
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)

Copied to clipboard

Challenge: Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization .
Approach: They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume.
Outcome: Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency.
Towards Unified Spoken Language Understanding Decoding via Label-aware Compact Linguistics Representations (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for intent detection and slot filling decoders could result in misaligned predictions for both tasks.
Approach: They propose a method that leverages label embeddings to jointly guide the decoding process.
Outcome: The proposed method outperforms existing methods on two single- and multi-intent SLU benchmarks and can be incorporated into existing models.
AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet relying on extensive manual labeling to provide procedural feedback remains a significant impediment.
Approach: They propose a self-supervised framework that decomposes complex problems into manageable subquestions with a controllable granularity switch and sequentially applies reinforcement learning to iteratively improve the subquest solver.
Outcome: The proposed framework improves performance on mathematical and commonsense reasoning tasks over SOTA.
Toward Expanding the Scope of Radiology Report Summarization to Multiple Anatomies and Modalities (2023.acl-short)

Copied to clipboard

Challenge: Existing studies are limited to a single modality and a chest X-ray, making it difficult to replicate results or compare approaches.
Approach: They propose a dataset to generate an impression section of a radiology report . they propose to use three new modalities and seven new anatomies to evaluate their models .
Outcome: The proposed model is based on the MIMIC-III and MIMIC CXR datasets and evaluates their clinical efficacy via RadGraph, a factual correctness metric.
What are the Generator Preferences for End-to-end Task-Oriented Dialog System? (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to improve the accuracy of entity retrieval are not effective.
Approach: They propose a framework that improves the performance of task-oriented dialogue systems by obtaining fine-grained matching information between contexts and entities and extracting the entity attribute shift matrix as preference signals.
Outcome: The proposed framework outperforms existing methods and improves the quality of the dialogue.
DGLF: A Dual Graph-based Learning Framework for Multi-modal Sarcasm Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection neglect high-order relationships and underestimate high-frequency messages.
Approach: They propose a Dual Graph-based Learning Framework to capture inter-modal inconsistencies . they propose combining a hypergraph and a vanilla graph to achieve enhanced propagation .
Outcome: The proposed model outperforms existing state-of-the-art methods on two benchmark datasets.
Automated Structured Radiology Report Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing models struggle to produce consistent, clinically meaningful reports and standard evaluation metrics fail to capture the nuances of radiological interpretation.
Approach: They propose to reformulate free-text radiology reports into a standardized format, ensuring clarity, consistency, and structured clinical reporting.
Outcome: The proposed task reformulates free-text radiology reports into a standardized format, ensuring clarity, consistency, and structured clinical reporting.
MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation methodologies for multimodal large language models are limited in evaluating objective queries without considering real-world user experiences.
Approach: They propose to evaluate multimodal large language models with per-sample criteria using potent MLLM as the judge.
Outcome: The proposed evaluation paradigm shows that it can be used to evaluate multimodal large language models with per-sample criteria.
Relevance Is a Guiding Light: Relevance-aware Adaptive Learning for End-to-end Task-oriented Dialogue System (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to training task-oriented dialogue systems struggle with the Distractive Attributes Problem (DAP) Existing methods struggle to deal with false but similar knowledge (hard negative entities)
Approach: They propose a two-stage training framework that eliminates hard negatives step-by-step and aligns retrieval with generation.
Outcome: The proposed method eliminates hard negatives step-by-step and aligns retrieval with generation.
Zero-Shot Spoken Language Understanding via Large Language Models: A Preliminary Study (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown promising results in zero-shot settings, which motivates us to explore prompt-based methods.
Approach: They propose a two-stage framework which transforms the SLU task into a question-answering problem by directly prompting LLMs.
Outcome: The proposed framework can be built by directly prompting LLMs to understand user needs without training data.
CycleOIE: A Low-Resource Training Framework For Open Information Extraction (2025.coling-main)

Copied to clipboard

Challenge: Open Information Extraction (OpenIE) models rely heavily on large amounts of annotated data.
Approach: They propose a training framework that maximizes data efficiency through a cycle-consistency mechanism.
Outcome: The proposed approach improves the quality of training data by curating low-quality datasets annotated by a large language model.
Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent work has proposed to improve relevance modeling by having large language models actively involved in retrieval, i.e., to guide retrieval with generation.
Approach: They propose to have large language models actively involved in retrieval to guide retrieval with generation.
Outcome: The proposed method synergizes retrieval and generation in an iterative manner, and can generate better results in subsequent iterations.
MCLF: A Multi-grained Contrastive Learning Framework for ASR-robust Spoken Language Understanding (2023.findings-emnlp)

Copied to clipboard

Challenge: Trending ASR-robust SLU systems have seen impressive improvements through global contrastive learning, but they can easily lead to severe semantic changes.
Approach: They propose a two-stage multi-grained contrastive learning framework to improve ASR robustness . they first adapt pre-trained language models to downstream SLU datasets and then fine-tune it on the corresponding dataset.
Outcome: The proposed framework improves on four datasets and four BERT-like backbone models.
Generating Radiology Reports via Memory-driven Transformer (2020.emnlp-main)

Copied to clipboard

Challenge: Medical imaging reports are time-consuming and can be error-prone for inexperienced radiologists.
Approach: They propose to generate radiology reports with memory-driven Transformer using relational memory and memory-based conditional layer normalization.
Outcome: The proposed method outperforms existing models on IU X-Ray and MIMIC-CXR . it generates long reports with medical terms and meaningful image-text attention mappings .
CMB: A Comprehensive Medical Benchmark in Chinese (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) provide a great breakthrough in medicine, says a new study . existing studies on LLMs leverage subjective evaluation, but evaluation in medicine is professional .
Approach: They propose a localized medical benchmark in Chinese rooted in native Chinese . they propose to use traditional Chinese medicine to evaluate large-scale LLMs .
Outcome: a new benchmark is developed to evaluate large-scale LLMs in china . the proposed model is rooted in the native Chinese linguistic and cultural framework .
Enhancing Code Generation Performance of Smaller Models by Distilling the Reasoning Ability of LLMs (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made significant advances in code generation through the ‘Chain-of-Thought’ prompting technique.
Approach: They propose a framework which aims to transfer LLMs’ reasoning capabilities to smaller models through distillation.
Outcome: The proposed framework improves the smaller model's code generation performance by over 130% on the APPS benchmark.
Syntax Matters: Towards Spoken Language Understanding via Syntax-Aware Attention (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on SLU systems have focused on integrating syntactic information into language models.
Approach: They propose a model where attention scopes are constrained based on syntactic relationships.
Outcome: The proposed model improves on three datasets and can be integrated into other language models to further boost their performance.
CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback (2025.acl-long)

Copied to clipboard

Challenge: Radiologists are a crucial role in translating medical images into actionable reports . however, the field faces staffing shortages and increasing workloads .
Approach: They propose an automated pipeline for preference feedback focusing on chest X-ray radiology report generation (RRG) method leverages publicly available datasets containing pairs of images and radiologist-written reference reports with reference-based metrics, or Judges.
Outcome: The proposed pipeline achieves state-of-the-art CheXbert scores on the MIMIC-CXR dataset while on average maintaining robust performance across six additional image perception and reasoning tasks.
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)

Copied to clipboard

Challenge: Significant concerns emerge when addressing cultural sensitivity and local values.
Approach: They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models.
Outcome: The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks.
Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for process-oriented math reward models rely on manual annotation.
Approach: They propose a process-oriented math process reward model called Math-shepherd which assigns a reward score to each step of math problem solutions.
Outcome: The proposed model breaks the bottleneck of manual supervision in two scenarios.
Game on Tree: Visual Hallucination Mitigation via Coarse-to-Fine View Tree and Game Theory (2024.emnlp-main)

Copied to clipboard

Challenge: Large vision-language models produce unfaithful visual hallucinations, also known as visual halluinations, which hinders their application in multimodal understanding and decision-making.
Approach: They propose a plug-and-play train-free decoding algorithm for mitigating visual hallucinations . they leverage visual information to construct a coarse-to-fine visual view tree .
Outcome: The proposed algorithm reduces visual hallucinations (VH) by leveraging visual information to construct a coarse-to-fine visual view tree (CFTree)
MoE-SLU: Towards ASR-Robust Spoken Language Understanding via Mixture-of-Experts (2024.findings-acl)

Copied to clipboard

Challenge: Spoken language understanding (SLU) is a crucial task in task-oriented dialogue systems.
Approach: They propose an ASR-Robust SLU framework based on the mixture-of-experts technique to generate additional transcripts from clean transcripts and use it to weigh the representations of the generated transcripts, ASR transcripts .
Outcome: The proposed framework achieves state-of-the-art on three benchmark SLU datasets.
Exploring the Potential of Dense Information in Multimodal Alignment (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to enhance captions have limitations such as insufficient detail and excessive hallucinations, resulting in compromised alignment and masking the true potential of dense information.
Approach: They propose a pipeline that generates highly detailed captions for images that facilitates in-depth analysis of the potential for dense information in multimodal alignment.
Outcome: The proposed pipeline significantly improves multimodal alignment and compositional reasoning abilities, surpassing hard negative samples.
Explainable and Sparse Representations of Academic Articles for Knowledge Exploration (2020.coling-main)

Copied to clipboard

Challenge: a system for summarizing academic articles by concept tagging has shown great coverage and high accuracy of concept identification.
Approach: They propose to transform tagged concepts into sparse vectors as representations of academic documents.
Outcome: The proposed system can be applied to a broader class of applications.
A Survey on Foundation Language Models for Single-cell Biology (2025.acl-long)

Copied to clipboard

Challenge: Existing single-cell foundation language models are based on pre-trained and large language models.
Approach: They review the development of single-cell foundation language models . they discuss data tokenization strategies and pre-training paradigms .
Outcome: The proposed models have shown remarkable performance in a variety of single-cell data analysis tasks.
SciConceptMiner: A system for large-scale scientific concept discovery (2021.acl-demo)

Copied to clipboard

Challenge: SciConceptMiner is a self-supervised system for the capture of scientific concepts . the system is scalable to the size of documents and the number of topics it can model .
Approach: They propose a self-supervised system for the automatic capture of scientific concepts from academic publications and semi-structured data.
Outcome: The proposed system achieves high accuracy (94.7%) with more than 740K scientific concepts.
Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs).
Approach: They propose a general framework to compensate for the deficiency of contextualized knowledge by querying large language models from various perspectives.
Outcome: The proposed framework improves knowledge graph completion (KGC) by querying large language models from various perspectives.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations