Papers by Fubang Zhao
Low-Resource Comparative Opinion Quintuple Extraction by Data Augmentation with Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Comparative Opinion Quintuple Extraction (COQE) aims to predict comparative opinion quintuples from comparative sentences. |
| Approach: | They propose a low-resource approach to extract comparative opinion quintuples from comparative sentences . they propose augmentation using ChatGPT and a data-centric approach . |
| Outcome: | The proposed approach improves the existing pipeline-based method and achieves state-of-the-art results. |
Evolving Knowledge Distillation with Large Language Models and Active Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the direct use of large language models for text generation and labeling, without fully exploring their potential to comprehend the target task and acquire valuable knowledge. |
| Approach: | They propose to distill the knowledge of large language models into smaller models by generating annotated data. |
| Outcome: | The proposed method improves the performance of small domain models while enhancing the ability of large language models. |
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)
Copied to clipboard
Chengyuan Liu, Fubang Zhao, Yangyang Kang, Jingyuan Zhang, Xiang Zhou, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples. |
| Approach: | They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE. |
| Outcome: | The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas. |
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
Chengyuan Liu, Yangyang Kang, Shihang Wang, Lizhi Qing, Fubang Zhao, Chao Wu, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | a recent study shows that performance on general tasks decreases after Large Language Models are fine-tuned on domain-specific tasks. |
| Approach: | They propose a general capability integration approach to integrate general capabilities and domain knowledge within a single instance. |
| Outcome: | The proposed method improves performance on domain-specific tasks by integrating general capabilities and domain knowledge. |
LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordination (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on learning and enhancing large language models to understand and generate natural language. |
| Approach: | They propose a computational bionic memory mechanism equipped with a parameter-efficient fine-tuning schema to personalize medical assistants. |
| Outcome: | The proposed method can enhance the response with aware of previous mistakes for new queries during a dialogue session, but the training costs are prohibitive. |
STINMatch: Semi-Supervised Semantic-Topological Iteration Network for Financial Risk Detection via News Label Diffusion (2023.emnlp-main)
Copied to clipboard
Xurui Li, Yue Qin, Rui Zhu, Tianqianjin Lin, Yongming Fan, Yangyang Kang, Kaisong Song, Fubang Zhao, Changlong Sun, Haixu Tang, Xiaozhong Liu
| Challenge: | Commercial news provides rich semantics and timely information for automated financial risk detection. |
| Approach: | They propose a semi-supervised Semantic-Topological Iteration Network, STINMatch, along with a news-enterprise knowledge graph to endorse the risk detection enhancement. |
| Outcome: | The proposed model outperforms existing models in terms of generalization and semantics and annotation. |
PDAMeta: Meta-Learning Framework with Progressive Data Augmentation for Few-Shot Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text data augmentation methods can not ensure the diversity and quality of the generated data, which leads to sub-optimal performance. |
| Approach: | They propose a meta-learning framework with progressive data augmentation for few-shot text classification using prompt-based data augmented by attention-based methods. |
| Outcome: | The proposed framework outperforms state-of-the-art models and shows better robustness on four public few-shot text classification datasets. |
Adjacency List Oriented Relational Fact Extraction via Adaptive Multi-task Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models for relational fact extraction do not analyze the output data structure from the perspective of graph representation flexibility and heterogeneity. |
| Approach: | They propose a relational fact extraction model based on graph-oriented analytical perspective that outperforms other models. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets and shows that it is flexible and space-efficient. |