Papers by Zhihong Chen
Copied to clipboard
| Challenge: | Existing studies focus on introducing salient word information to general text summarization framework to guide selection of key content in radiology findings. |
| Approach: | They propose a method for automatic impression generation using word graphs and a Word Graph guided Summarization model to capture critical words and their relations. |
| Outcome: | The proposed method is validated on two datasets, OPENI and MIMIC-CXR. |
Copied to clipboard
| Challenge: | Existing code-switching-based cross-lingual spoken language understanding frameworks are limited to low-resource languages. |
| Approach: | They propose a cross-lingual spoken language understanding framework that leverages both code-switched and original sentences to achieve multi-level alignment. |
| Outcome: | The proposed framework can achieve multi-level alignment on two benchmarks across ten languages. |
Copied to clipboard
| Challenge: | Existing methods for automating impression generation have limited the relationship between extra knowledge and the original findings. |
| Approach: | They propose a framework for automating impression generation that exploits extra knowledge and original findings . they propose combining key words and their relations to extract critical information . |
| Outcome: | The proposed framework exploits extra knowledge and the original findings in an integrated way . the state-of-the-art results on two datasets confirm the effectiveness of the proposed method . |
Copied to clipboard
| Challenge: | Existing systems for task-oriented dialogue lack belief states as supervisory signals. |
| Approach: | They propose a method for knowledge retrieval driven by matching representations . they use a matching signal extractor to extract matching representation between contexts and entities . |
| Outcome: | Experiments on three standard benchmarks show that the proposed method performs better than existing approaches. |
Copied to clipboard
| Challenge: | Hallucination is a critical challenge for large language models and large vision-language models (LVLMs) however, dedicated research on medical hallucinations remains unexplored. |
| Approach: | They provide a unified perspective on medical hallucination for both LLMs and LVLMs, and delve into its causes. |
| Outcome: | The proposed models have demonstrated impressive performance on a variety of medical benchmarks. |
Copied to clipboard
| Challenge: | Existing automated evaluation metrics fail to consider factual correctness or are limited in their interpretability. |
| Approach: | They propose a radiology report evaluation metric that leverages natural language understanding of language models to identify and explain clinically significant errors. |
| Outcome: | The proposed method demonstrates higher correlation with expert error counts and higher alignment with expert preferences when compared to previous methods. |
Copied to clipboard
| Challenge: | Medical Information Extraction (MIE) tasks are a fundamental component of medical NLP. |
| Approach: | They propose an alternative adaptive constraint strategy to adjust the scale and scope of contrastive tokens. |
| Outcome: | The proposed approach selectively enhances the identification and classification capabilities while minimizing the influence of other inherent abilities in LLMs. |
Copied to clipboard
| Challenge: | Recent studies focus on automatic impression generation, but this task is time-consuming and in high demand. |
| Approach: | They propose to use an anatomy-enhanced multimodal model to generate automatic impressions by combining radiology images with textual features. |
| Outcome: | The proposed model achieves state-of-the-art on two benchmark datasets and compares with existing models. |
Copied to clipboard
| Challenge: | Existing methods for multimodal intent detection have two limitations: (i) close entanglement of multimodal semantics with modal structures; (ii) insufficient learning of causal effects of semantic and modality-specific information on the final predictions. |
| Approach: | They propose a Dual-oriented Disentangled Network with Counterfactual Intervention model that decouples semantics-oriented and modality-oriented representations and a Counterfective Intervention Module that applies causal inference to understand causal effects by injecting confounders. |
| Outcome: | The proposed model overcomes key limitations in existing systems by effectively disentangling and utilizing modality-specific and multimodal semantic information. |
Copied to clipboard
| Challenge: | Medical imaging reports are essential in clinical practice, and generating the reports is beneficial to reduce the burden of radiologists. |
| Approach: | They propose to use a shared memory to enhance the encoder-decoder framework for radiology report generation. |
| Outcome: | The proposed model can generate more accurate reports on two widely used datasets. |
Copied to clipboard
| Challenge: | Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases. |
| Approach: | They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage. |
| Outcome: | The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources. |
Copied to clipboard
| Challenge: | Masked language modeling is one of the most popular pretraining recipes in natural language processing. |
| Approach: | They analyze BERT-style and CLIP-style text encoders from three experiments . they show that CLIP style encoder is equipped with synesthesia for the cross-modal association . |
| Outcome: | The proposed models outperform BERT-style models on vision-centric text understanding tasks, but have synesthesia for the cross-modal association, similar to the senses of humans. |
Copied to clipboard
| Challenge: | Existing models rely on annotated training data, limiting their scalability to low-resource languages. |
| Approach: | They propose a method termed SoGo for zero-shot cross-lingual SLU that uses keywords as substitution options to extract keywords and a token-level alignment strategy to ensure grammatical coherence. |
| Outcome: | The proposed method improves zero-shot cross-lingual SLU across nine languages on MultiATIS++. |
Copied to clipboard
| Challenge: | Graph-based Retrieval-Augmented Generation (GraphRAG) is a new approach to document retrieval, but it is not suitable for legal reasoning. |
| Approach: | They propose a framework for reliable legal reasoning that structures knowledge as relational graphs and uses a multi-agent system to verify validity. |
| Outcome: | The proposed framework outperforms existing GraphRAG models in accurate and trustworthy legal analysis. |
Copied to clipboard
| Challenge: | RadGraph-XL is an expert-annotated dataset for structured clinical data extraction. |
| Approach: | They propose a large-scale, expert-annotated dataset for clinical entity and relation extraction using radiology reports. |
| Outcome: | The proposed model outperforms existing methods by up to 52% and outperfies GPT-4 in this domain. |
Copied to clipboard
| Challenge: | Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization . |
| Approach: | They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. |
| Outcome: | Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency. |
Copied to clipboard
| Challenge: | Existing methods for intent detection and slot filling decoders could result in misaligned predictions for both tasks. |
| Approach: | They propose a method that leverages label embeddings to jointly guide the decoding process. |
| Outcome: | The proposed method outperforms existing methods on two single- and multi-intent SLU benchmarks and can be incorporated into existing models. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet relying on extensive manual labeling to provide procedural feedback remains a significant impediment. |
| Approach: | They propose a self-supervised framework that decomposes complex problems into manageable subquestions with a controllable granularity switch and sequentially applies reinforcement learning to iteratively improve the subquest solver. |
| Outcome: | The proposed framework improves performance on mathematical and commonsense reasoning tasks over SOTA. |
Copied to clipboard
| Challenge: | Existing studies are limited to a single modality and a chest X-ray, making it difficult to replicate results or compare approaches. |
| Approach: | They propose a dataset to generate an impression section of a radiology report . they propose to use three new modalities and seven new anatomies to evaluate their models . |
| Outcome: | The proposed model is based on the MIMIC-III and MIMIC CXR datasets and evaluates their clinical efficacy via RadGraph, a factual correctness metric. |
Copied to clipboard
| Challenge: | Existing methods to improve the accuracy of entity retrieval are not effective. |
| Approach: | They propose a framework that improves the performance of task-oriented dialogue systems by obtaining fine-grained matching information between contexts and entities and extracting the entity attribute shift matrix as preference signals. |
| Outcome: | The proposed framework outperforms existing methods and improves the quality of the dialogue. |
Copied to clipboard
| Challenge: | Existing methods for multimodal sarcasm detection neglect high-order relationships and underestimate high-frequency messages. |
| Approach: | They propose a Dual Graph-based Learning Framework to capture inter-modal inconsistencies . they propose combining a hypergraph and a vanilla graph to achieve enhanced propagation . |
| Outcome: | The proposed model outperforms existing state-of-the-art methods on two benchmark datasets. |
Copied to clipboard
| Challenge: | Existing models struggle to produce consistent, clinically meaningful reports and standard evaluation metrics fail to capture the nuances of radiological interpretation. |
| Approach: | They propose to reformulate free-text radiology reports into a standardized format, ensuring clarity, consistency, and structured clinical reporting. |
| Outcome: | The proposed task reformulates free-text radiology reports into a standardized format, ensuring clarity, consistency, and structured clinical reporting. |
Copied to clipboard
| Challenge: | Existing evaluation methodologies for multimodal large language models are limited in evaluating objective queries without considering real-world user experiences. |
| Approach: | They propose to evaluate multimodal large language models with per-sample criteria using potent MLLM as the judge. |
| Outcome: | The proposed evaluation paradigm shows that it can be used to evaluate multimodal large language models with per-sample criteria. |
Copied to clipboard
| Challenge: | Existing approaches to training task-oriented dialogue systems struggle with the Distractive Attributes Problem (DAP) Existing methods struggle to deal with false but similar knowledge (hard negative entities) |
| Approach: | They propose a two-stage training framework that eliminates hard negatives step-by-step and aligns retrieval with generation. |
| Outcome: | The proposed method eliminates hard negatives step-by-step and aligns retrieval with generation. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown promising results in zero-shot settings, which motivates us to explore prompt-based methods. |
| Approach: | They propose a two-stage framework which transforms the SLU task into a question-answering problem by directly prompting LLMs. |
| Outcome: | The proposed framework can be built by directly prompting LLMs to understand user needs without training data. |
Copied to clipboard
| Challenge: | Open Information Extraction (OpenIE) models rely heavily on large amounts of annotated data. |
| Approach: | They propose a training framework that maximizes data efficiency through a cycle-consistency mechanism. |
| Outcome: | The proposed approach improves the quality of training data by curating low-quality datasets annotated by a large language model. |
Copied to clipboard
| Challenge: | Recent work has proposed to improve relevance modeling by having large language models actively involved in retrieval, i.e., to guide retrieval with generation. |
| Approach: | They propose to have large language models actively involved in retrieval to guide retrieval with generation. |
| Outcome: | The proposed method synergizes retrieval and generation in an iterative manner, and can generate better results in subsequent iterations. |
Copied to clipboard
| Challenge: | Trending ASR-robust SLU systems have seen impressive improvements through global contrastive learning, but they can easily lead to severe semantic changes. |
| Approach: | They propose a two-stage multi-grained contrastive learning framework to improve ASR robustness . they first adapt pre-trained language models to downstream SLU datasets and then fine-tune it on the corresponding dataset. |
| Outcome: | The proposed framework improves on four datasets and four BERT-like backbone models. |
Copied to clipboard
| Challenge: | Medical imaging reports are time-consuming and can be error-prone for inexperienced radiologists. |
| Approach: | They propose to generate radiology reports with memory-driven Transformer using relational memory and memory-based conditional layer normalization. |
| Outcome: | The proposed method outperforms existing models on IU X-Ray and MIMIC-CXR . it generates long reports with medical terms and meaningful image-text attention mappings . |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) provide a great breakthrough in medicine, says a new study . existing studies on LLMs leverage subjective evaluation, but evaluation in medicine is professional . |
| Approach: | They propose a localized medical benchmark in Chinese rooted in native Chinese . they propose to use traditional Chinese medicine to evaluate large-scale LLMs . |
| Outcome: | a new benchmark is developed to evaluate large-scale LLMs in china . the proposed model is rooted in the native Chinese linguistic and cultural framework . |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made significant advances in code generation through the ‘Chain-of-Thought’ prompting technique. |
| Approach: | They propose a framework which aims to transfer LLMs’ reasoning capabilities to smaller models through distillation. |
| Outcome: | The proposed framework improves the smaller model's code generation performance by over 130% on the APPS benchmark. |
Copied to clipboard
| Challenge: | Existing studies on SLU systems have focused on integrating syntactic information into language models. |
| Approach: | They propose a model where attention scopes are constrained based on syntactic relationships. |
| Outcome: | The proposed model improves on three datasets and can be integrated into other language models to further boost their performance. |
Copied to clipboard
| Challenge: | Radiologists are a crucial role in translating medical images into actionable reports . however, the field faces staffing shortages and increasing workloads . |
| Approach: | They propose an automated pipeline for preference feedback focusing on chest X-ray radiology report generation (RRG) method leverages publicly available datasets containing pairs of images and radiologist-written reference reports with reference-based metrics, or Judges. |
| Outcome: | The proposed pipeline achieves state-of-the-art CheXbert scores on the MIMIC-CXR dataset while on average maintaining robust performance across six additional image perception and reasoning tasks. |
Copied to clipboard
| Challenge: | Significant concerns emerge when addressing cultural sensitivity and local values. |
| Approach: | They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. |
| Outcome: | The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks. |
Copied to clipboard
| Challenge: | Existing methods for process-oriented math reward models rely on manual annotation. |
| Approach: | They propose a process-oriented math process reward model called Math-shepherd which assigns a reward score to each step of math problem solutions. |
| Outcome: | The proposed model breaks the bottleneck of manual supervision in two scenarios. |
Copied to clipboard
| Challenge: | Large vision-language models produce unfaithful visual hallucinations, also known as visual halluinations, which hinders their application in multimodal understanding and decision-making. |
| Approach: | They propose a plug-and-play train-free decoding algorithm for mitigating visual hallucinations . they leverage visual information to construct a coarse-to-fine visual view tree . |
| Outcome: | The proposed algorithm reduces visual hallucinations (VH) by leveraging visual information to construct a coarse-to-fine visual view tree (CFTree) |
Copied to clipboard
| Challenge: | Spoken language understanding (SLU) is a crucial task in task-oriented dialogue systems. |
| Approach: | They propose an ASR-Robust SLU framework based on the mixture-of-experts technique to generate additional transcripts from clean transcripts and use it to weigh the representations of the generated transcripts, ASR transcripts . |
| Outcome: | The proposed framework achieves state-of-the-art on three benchmark SLU datasets. |
Copied to clipboard
| Challenge: | Existing methods to enhance captions have limitations such as insufficient detail and excessive hallucinations, resulting in compromised alignment and masking the true potential of dense information. |
| Approach: | They propose a pipeline that generates highly detailed captions for images that facilitates in-depth analysis of the potential for dense information in multimodal alignment. |
| Outcome: | The proposed pipeline significantly improves multimodal alignment and compositional reasoning abilities, surpassing hard negative samples. |
Copied to clipboard
| Challenge: | a system for summarizing academic articles by concept tagging has shown great coverage and high accuracy of concept identification. |
| Approach: | They propose to transform tagged concepts into sparse vectors as representations of academic documents. |
| Outcome: | The proposed system can be applied to a broader class of applications. |
Copied to clipboard
| Challenge: | Existing single-cell foundation language models are based on pre-trained and large language models. |
| Approach: | They review the development of single-cell foundation language models . they discuss data tokenization strategies and pre-training paradigms . |
| Outcome: | The proposed models have shown remarkable performance in a variety of single-cell data analysis tasks. |
Copied to clipboard
| Challenge: | SciConceptMiner is a self-supervised system for the capture of scientific concepts . the system is scalable to the size of documents and the number of topics it can model . |
| Approach: | They propose a self-supervised system for the automatic capture of scientific concepts from academic publications and semi-structured data. |
| Outcome: | The proposed system achieves high accuracy (94.7%) with more than 740K scientific concepts. |
Copied to clipboard
| Challenge: | Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs). |
| Approach: | They propose a general framework to compensate for the deficiency of contextualized knowledge by querying large language models from various perspectives. |
| Outcome: | The proposed framework improves knowledge graph completion (KGC) by querying large language models from various perspectives. |