Papers by Zhen Zhao
Copied to clipboard
| Challenge: | Aspect-oriented Fine-grained Opinion Extraction (AFOE) aims to extract aspect terms and opinion terms from review text in the form of opinion pairs or opinion triplets. |
| Approach: | They propose a grid-based AFOE tagging scheme to address the task in an end-to-end fashion only with one unified grid tracking task. |
| Outcome: | The proposed tagging scheme outperforms baselines and achieves state-of-the-art performance. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are gaining popularity due to their lack of knowledge hallucination and lack of a coherent model. |
| Approach: | They propose a self-supervised quantized representation method to compress KG structural and semantic knowledge into discrete codes that align the format of language sentences. |
| Outcome: | The proposed framework outperforms existing unsupervised methods producing more distinguishable codes on KG link prediction and triple classification tasks. |
Copied to clipboard
| Challenge: | a number of tools are used to perform complex tasks, but the tool utilization process can cause errors. |
| Approach: | They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks. |
| Outcome: | The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios. |
Copied to clipboard
| Challenge: | Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets. |
| Approach: | They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets. |
| Outcome: | The proposed platform improves label consistency of Chinese NER datasets. |
Copied to clipboard
| Challenge: | Named entity recognition (NER) systems focus on improving model performance, ignoring the need to quantify model uncertainty. |
| Approach: | They propose to introduce two uncertainty-guided loss terms to the conventional EDL and a series of uncertainty-guiding training strategies to solve these challenges. |
| Outcome: | The proposed method achieves better OOV/OOD detection performance and generalization ability on OOV entities compared to state-of-the-art methods. |
Copied to clipboard
| Challenge: | Existing methods to model event associations struggle with semantic ambiguity and embedding bias. |
| Approach: | They propose a Semantic and Sentiment Dual-enhanced Generative Model to address these issues . it leverages two types of script event information to enhance the generative model . |
| Outcome: | The proposed model captures both global and local sentiments of events through its sentiment awareness mechanism. |
Copied to clipboard
| Challenge: | Existing approaches to learn relations from labeled data overlook task interference in continual learning and memory requirements for different relations. |
| Approach: | They propose a framework to learn new relations from limited labeled data while preserving knowledge about previously learned relations. |
| Outcome: | The proposed framework is more practical and comprehensive for real-world scenarios. |
Copied to clipboard
| Challenge: | Recent approaches to annotate data focus on labeling, but lack holistic process control . a novel system that integrates task assignment, data annotation, and quality/cost management is needed . |
| Approach: | They propose a multi-agent system that integrates task assignment, data annotation, and quality/cost management. |
| Outcome: | The proposed system automates human management by using a collaborative multi-agent system. |
Copied to clipboard
| Challenge: | Existing methods for relation triplet extraction rely on labeled data and are limited in their applicability. |
| Approach: | They propose a two-agent game approach to deliberate and debate unseen relations by two agents, a generator and an extractor. |
| Outcome: | The proposed method outperforms baseline methods by 6%-16% in F1 scores. |
Copied to clipboard
| Challenge: | Existing work mainly utilizes image information to improve the performance of MABSA task. |
| Approach: | They propose a multimodal Aspect-based Sentiment Analysis task that uses image information to improve model performance. |
| Outcome: | The proposed framework outperforms state-of-the-art work on three sub-tasks of MABSA. |
Copied to clipboard
| Challenge: | Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped. |
| Approach: | They propose a novel defense strategy to mitigate bit-flip errors (BFEs) they propose bfe protection and a self-correction mechanism to minimize performance degradation . |
| Outcome: | The proposed defense strategy minimizes performance degradation while significantly improving robustness against BFEs. |
Copied to clipboard
| Challenge: | Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient. |
| Approach: | They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve. |
| Outcome: | The proposed approach improves on three SLT datasets conducted under the gloss-free setting. |
Copied to clipboard
| Challenge: | Content analysis is labor-intensive and time-consuming process that requires multiple rounds of manual annotation, domain expert discussion, and rule-based refinement. |
| Approach: | They propose a multi-agent framework that effectively Simulates Content Analysis via Large language model (LLM) ag Ents. |
| Outcome: | The proposed framework achieves human-approximated performance across various content analysis tasks. |
Copied to clipboard
| Challenge: | Scientific research relies on accurate information retrieval from literature to support analytical decisions. |
| Approach: | They propose a task that automates fine-grained information retrieval *faithfully* grounded in the provided content in response to research-driven queries. |
| Outcome: | The proposed agent achieves 13.2% higher cross-domain accuracy than state-of-the-art RAG and research-agent baselines across seven backbone LLMs. |
Copied to clipboard
| Challenge: | Existing implementations that modify the code of the backbone PTMs and hard-code specific delta tuning methods for each PTM have limited the practicality and flexibility of delta tuning. |
| Approach: | They propose an open-source library that provides a plug-and-play implementation of delta tuning methods for pre-trained models. |
| Outcome: | The proposed methods eliminate the need to modify the backbone PTMs’ code, making OpenDelta compatible with different, even novel PTM. |
Copied to clipboard
| Challenge: | Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool. |
| Approach: | They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images . |
| Outcome: | The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are quantized to lower precision to reduce memory cost and latency in inference. |
| Approach: | They propose a quantized zeroth-order framework for fine-tuning Large Language Models (LLMs) using low-precision forward passes. |
| Outcome: | The proposed method achieves comparable results to first-order methods in FP8 and superior accuracy in INT8 and INT4 training. |
Copied to clipboard
| Challenge: | Existing methods for prompt tuning for Large Language Models find backdoor attacks to be significant in data-rich scenarios. |
| Approach: | They propose a backdoor attacks through contrastive-enhanced machine unlearning in data-limited scenarios . they use a machine un learning method to capture precise backdoor patterns . |
| Outcome: | The proposed method captures precise backdoor patterns without association between triggers and backdoors, reducing side effects. |
Copied to clipboard
| Challenge: | Existing methods to determine sentiment polarity of opinion target are inconsistent and lack visual attention. |
| Approach: | They propose a framework which can exploit adjective-noun pairs extracted from images to improve visual attention and sentiment prediction capability of the TMSC task. |
| Outcome: | The proposed framework outperforms state-of-the-art on two public datasets. |
Copied to clipboard
| Challenge: | Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors. |
| Approach: | They propose a metacognitive framework that enables step-level error detection and self-correction in Large Language Model based multi-agent systems (MAS) . |
| Outcome: | The proposed framework outperforms baselines on the Who When benchmark and delivers consistent gains on AgentErrorBench. |
Copied to clipboard
| Challenge: | Existing studies focus on what to generate but ignore what not to generate . a template-agnostic method boosts original learning and reduces mistakes simultaneously . |
| Approach: | They propose a template-agnostic method to control the token-level generation . they introduce Monte Carlo dropout to understand the built-in uncertainty of pre-trained language models . |
| Outcome: | The proposed method boosts original learning and reduces mistakes simultaneously on four public datasets. |
Copied to clipboard
| Challenge: | Existing benchmarks rarely isolate how much visual information contributes to reasoning . a growing collection of benchmarks has catalyzed rapid progress in multimodal reasoning - but how much it contributes remains unclear . |
| Approach: | They propose a university-level multimodal mathematical reasoning benchmark to quantify the effect of visual input. |
| Outcome: | The proposed benchmark disentangles and quantifies the effect of visual input on multimodal reasoning models. |
Copied to clipboard
| Challenge: | Existing methods to eliminate hallucinations require expensive human annotation . hallucination in multimodal large language models poses unique challenges for current research . |
| Approach: | They propose a fine-grained unlearning framework that performs gradient ascent to eliminate hallucinations without paired data. |
| Outcome: | The proposed method reduces hallucinations while preserving quality with modest computational overhead. |
Copied to clipboard
| Challenge: | Existing methods for ACD use label information of aspect categories to detect aspect categories . but, they still suffer from noise problems due to lack of supervised data . |
| Approach: | They propose a Label-Driven Denoising Framework to alleviate noise problems for ACD subtask . they use the label information of each aspect to generate a better prototype . |
| Outcome: | The proposed framework improves the performance of the multi-label few-shot Aspect Category Detection task. |
Copied to clipboard
| Challenge: | RealBench is the first Chinese multimodal multi-image dataset . the dataset contains 9393 samples and 69910 images . |
| Approach: | They propose to create a Chinese multimodal multi-image dataset using 21 models . they use closed-source models that support multi-inputs as well as open-source visual and video models a . |
| Outcome: | The first Chinese multimodal multi-image dataset contains 9393 samples and 69910 images. |
Copied to clipboard
| Challenge: | Entity linking is a fundamental task in natural language processing, says nigel kilgstrom . existing corpora for entity linking in china are lacking and deficient, he says . kilsmstrom: a new method for entity disambiguation can be developed for Chinese . |
| Approach: | They build a Chinese corpus of multi-domain long text for entity linking . they evaluate the difficulty of documents with respect to entity linking using a measure . |
| Outcome: | The proposed corpus is based on 100 documents from diverse domains and is publicly accessible. |
Copied to clipboard
| Challenge: | PlotGen-Bench evaluates vision-language models' ability to generate executable visualization code from plots under realistic and complex visualization requirements. |
| Approach: | They propose a benchmark to evaluate plot-to-code generation in vision-language models . they use Matplot, Matplos, Mat3D, Mat4D, and Mat4E to evaluate their performance . |
| Outcome: | The proposed benchmark covers 9 major categories, 30 subcategories, and 3 core tasks . it covers 2D, 3D and animated plots across 5 widely used visualization libraries. |
Copied to clipboard
| Challenge: | Recent work on grounding dialogue agents with knowledge documents has sparked increased attention . hand-labeling data to that end is time-consuming and many datasets lack knowledge annotations . |
| Approach: | They propose a reciprocal learning approach to optimize a knowledge retriever and a response ranker for knowledge-grounded response retrieval without ground-truth knowledge labels. |
| Outcome: | The proposed model outperforms previous state-of-the-art methods on two public benchmarks. |
Copied to clipboard
| Challenge: | Existing methods to detect causal relationships in unstructured texts ignore trivial knowledge which may prejudice performance. |
| Approach: | They propose a pipeline to build a commonsense-aware pre-trained model which integrates reliable task-specific knowledge from commonsens graphs. |
| Outcome: | The proposed pipeline integrates reliable task-specific knowledge from commonsense graphs. |
Copied to clipboard
| Challenge: | PersLEARN is a tool designed to facilitate the cultivation of scientific perspectives . junior researchers struggle to identify the perspectives reflected in the literature and struggle to develop their own viewpoints. |
| Approach: | They propose a tool to facilitate the cultivation of scientific perspectives by interacting with a prompt-based model and allowing students to develop their own perspectives explicitly. |
| Outcome: | The proposed tool outperforms baseline approaches across multiple domains of literature from different perspectives. |
Copied to clipboard
| Challenge: | Text2SQL is a task that translates natural language into SQL statements. |
| Approach: | They propose a task that translates natural language into SQL statements. |
| Outcome: | The proposed task enables users to convert natural language into SQL statements. |
Copied to clipboard
| Challenge: | Existing Large Language Models struggle to maintain emotionally consistent and psychologically plausible character personalities. |
| Approach: | They propose a framework that enhances LLMs’ ability to generate authentic personality-driven dialogues through stochastic emotional transitions. |
| Outcome: | The proposed framework achieves 93.3% emotional accuracy on the RAPD dataset and significantly outperforms existing approaches. |
Copied to clipboard
| Challenge: | Tool-Integrated Reasoning (TIR) is a tool that can be used to solve complex tasks. |
| Approach: | They propose a hardware-aware TIR-efficiency metric that unifies internal reasoning and external tool-use costs while explicitly accounting for non-reusable KV-Cache and long-tool-response scenarios. |
| Outcome: | The proposed metric explains wall-clock latency significantly better than token-count metric in a simulated high-concurrency industrial setting. |
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting has been shown to be effective in eliciting structured reasoning from large language models (LLMs). |
| Approach: | They propose a data distribution lens to understand when and why CoT reasoning fails . they propose 'data-based' training that trains LLMs from scratch . |
| Outcome: | The proposed model enables models to generate reasoning trajectories that approximate those observed during training. |
Copied to clipboard
| Challenge: | Existing methods for multimodal sentiment detection do not consider token-level feature fusion. |
| Approach: | They propose a method for multimodal sentiment detection using a combination of text and image to encode and fuse token-level features. |
| Outcome: | The proposed method can fuse multimodal features with token-level features on three publicly available multimodal datasets. |
Copied to clipboard
| Challenge: | Existing visual large language models pre-assume a fixed resolution for downstream tasks, leading to sub-optimal performance. |
| Approach: | They propose a formula to determine the optimal resolution for a given vision-language task . they then propose 'parameter-efficient' fine-tuning technique to extend the visual input resolution . |
| Outcome: | The proposed method is based on rigorous experiments on vision-language tasks. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios . |
| Approach: | They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios. |
| Outcome: | The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm. |
Copied to clipboard
| Challenge: | Mixture of Experts (MoE) models use homogeneous experts with diverse capacities, resulting in a lack of expert specialization and parameter utilization. |
| Approach: | They propose a framework where experts differ in size and possess diverse capacities . they propose HMoE to encourage frequent activation of smaller experts . |
| Outcome: | The proposed framework outperforms homogeneous homogenous MoE models on evaluation benchmarks and achieves lower loss rate with fewer activated parameters. |
Copied to clipboard
| Challenge: | Existing ASTE datasets are limited in their ability to represent real-world scenarios, hindering progress in this area. |
| Approach: | They propose a new ASTE dataset that is manually annotated to better fit real-world scenarios by providing more diverse and realistic reviews. |
| Outcome: | The proposed dataset is manually annotated to better fit real-world scenarios. |
Copied to clipboard
| Challenge: | Contemporary document ranking methods focus on transforming documents into passages to handle long inputs, but intensive query-irrelevant content may lead to harmful distraction and high query latency. |
| Approach: | They propose a fine-grained attention alignment approach to jointly optimize a cascade document ranking model. |
| Outcome: | Experiments on MS MARCO and TREC DL show that the proposed method is effective in document ranking tasks. |
Copied to clipboard
| Challenge: | Existing methods to translate natural language descriptions into visualization queries focus on spoken languages, not sign languages. |
| Approach: | They propose a sign language interface that enables the DHH community to engage more fully with data analysis. |
| Outcome: | The proposed interface can be used by the deaf and hard-of-hearing community. |
Copied to clipboard
| Challenge: | Recent work on language models with curated feedback provides promising alternatives to RLHF . multiple responses can be ranked by reward models or AI feedback, but there is no study on directly fitting upon a list of responses. |
| Approach: | They propose a method that aligns language models with curated human feedback . they propose SLiC and DPO as promising alternatives to traditional RLHF . |
| Outcome: | The proposed method outperforms DPO and SLiC on several preference alignment tasks with curated and real rankwise preference data. |
Copied to clipboard
| Challenge: | Retrieval-Augmented Generative (RAG) models enhance Large Language Models (LLMs) by integrating external knowledge bases. |
| Approach: | They propose to exploit openness of RAG models by injecting deceptive content into the retrieval database, intentionally changing the model’s behavior. |
| Outcome: | The proposed model can be exploited through crafted content uploads with access to the retriever. |
Copied to clipboard
| Challenge: | Existing approaches to domain adaptation only use reliable pseudo instances, i.e., pseudo instances with high prediction confidence, to retrain the model. |
| Approach: | They propose a domain adversarial learning enhanced self-training framework that uses meta-learning to estimate the importance of each pseudo instance and a meta constructor to construct the meta-validation set. |
| Outcome: | The proposed framework reduces label noise and preserves hard examples while maintaining accuracy. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are pre-trained on vast datasets composed of billions of tokens harvested from diverse text sources. |
| Approach: | They propose a data engineering method to refine the pretraining corpus through data rating, tagging and editing. |
| Outcome: | The proposed method improves the quality of the pretraining corpus by enhancing 100 billion tokens of the training corpus. |
Copied to clipboard
| Challenge: | a large computational cost for attention computation in large language models is a major obstacle . |
| Approach: | They propose a convolution-like structure for attention computation using convolution matrices . they then propose an efficient approximation method to approximate the attention matrix . |
| Outcome: | The proposed method achieves nearly linear time complexity in n1+o(1) time. |
Copied to clipboard
| Challenge: | Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis. |
| Approach: | They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge. |
| Outcome: | The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks. |
Copied to clipboard
| Challenge: | Aspect-level sentiment classification aims to detect the sentiment polarity of a given opinion target in a sentence. |
| Approach: | They propose a novel attention transfer network which can exploit attention from document-level sentiment datasets to improve the attention capability of the aspect-level classification task. |
| Outcome: | The proposed method outperforms state-of-the-art methods on two ASC benchmark datasets. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) has evolved from flat to overlapped and discontinuous . NER is a text recognition task that recognizes mentions that represent entities in text . |
| Approach: | They propose a two-stage span-based framework to solve a unified NER task using two stages . they extract entity spans, classify over all entity span pairs and combine them to train two stages. |
| Outcome: | The proposed framework beats all the current competitive baselines on eight benchmark datasets, obtaining the best performance of unified NER. |
Copied to clipboard
| Challenge: | Existing LLMs demonstrate powerful capabilities between tasks, but can they make sequential decisions? |
| Approach: | They propose to evaluate sequential decision-making capability of large language models (LLMs) using novel metrics based Monte Carlo methods. |
| Outcome: | The proposed benchmark improves sequential decision-making performance compared to the vanilla LLM player. |
Copied to clipboard
| Challenge: | Mainstream research in natural language processing has focused on high-resource and modern languages. |
| Approach: | They propose a task-anchored benchmark for Manchu–Classical Chinese translation . they use a parallel corpus of 16,627 sentence pairs to evaluate the model . |
| Outcome: | The proposed benchmarks show that linguistic differences influence performance and broader language coverage facilitate low-resource transfer. |
Copied to clipboard
| Challenge: | Existing work on event extraction (EE) is pipelined or uses a joint structure but does not utilize information interactions among event triggers, event arguments, and argument roles. |
| Approach: | They propose to exploit role information of arguments in an event and devise a Hierarchical Policy Network to perform joint EE. |
| Outcome: | The proposed system outperforms existing methods and is more powerful for sentences with multiple events. |
Copied to clipboard
| Challenge: | Existing knowledge base question answering methods are limited by syntactic constraints and are prone to structural deviations that render queries unexecutable. |
| Approach: | They propose a framework that reframes semantic parsing as an iterative reasoning process driven by execution feedback. |
| Outcome: | The proposed method achieves significant improvements in query executability and answer accuracy on the WebQSP and CWQ datasets. |
Copied to clipboard
| Challenge: | Existing evaluation methods rely on rule-based matching with shallow semantic understanding or adopt LLM-as-a-Judge approaches that incur high cost and latency while offering limited error interpretability. |
| Approach: | They propose a curriculum learning based hierarchical framework for QA task evaluation that supports quick scoring and fine-grained error analysis. |
| Outcome: | The proposed framework outperforms baseline methods on quick scoring and error analysis tasks while being 25 faster. |
Copied to clipboard
| Challenge: | Existing approaches to name entity recognition neglect distribution skewness and pseudo-label bias . despite promising results, current approaches neglect these problems . |
| Approach: | They propose a framework that optimizes an adaptively reweighted contrastive loss to handle class skewness and pseudo-label bias. |
| Outcome: | The proposed framework outperforms existing methods on multiple benchmarks. |
Copied to clipboard
| Challenge: | Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions. |
| Outcome: | The proposed framework improves generalization and realism of large language models under complex and irregular table conditions. |
Copied to clipboard
| Challenge: | Graph representation learning has garnered significant attention due to its broad applications in various domains, such as recommendation systems and social network analysis. |
| Approach: | They propose to use a generative language model to map input-output pairs to explanations reflecting the model’s decision-making process to generate a model that generates pseudo-labels that capture the model's decisions from saliency-based explanations. |
| Outcome: | Extensive experiments show that GraphNarrator produces human-preferred explanations that are faithful, concise, and human-like. |
Copied to clipboard
| Challenge: | low-resource language corpora in professional domains like medicine hinder cross-lingual domain adaptation of pre-trained large language models. |
| Approach: | They examine how linguistic features affect performance on a Japanese–English medical knowledge benchmark. |
| Outcome: | The proposed model can leverage English-language resources in medical domains while ensuring sufficient coverage of language-specific expressions in a target language. |
Copied to clipboard
| Challenge: | Existing methods for large language models adopt query-driven iterative reasoning from a local perspective, limiting efficiency and accuracy for complex multi-hop tasks. |
| Approach: | They propose a multi-view instructed adaptive reasoning of LLM on Knowledge Graphs that allows LLMs to plan, evaluate, and adapt reasoning paths from a global perspective. |
| Outcome: | The proposed model overcomes the limitations of local exploration by enabling LLMs to plan, evaluate, and adapt reasoning paths from a global perspective. |
Copied to clipboard
| Challenge: | Low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency. |
| Approach: | They evaluate HiFloat (HiF8 and HiF4), a family of floating-point formats tailored for Ascend NPUs. |
| Outcome: | The proposed formats excel with high-variance data and are compatible with state-of-the-art quantization frameworks. |