Papers by Yichun Zhao
Probe Then Retrieve and Reason: Distilling Probing and Reasoning Capabilities into Smaller Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent research efforts have focused on distilling Large Language Models into Small Language Model (SLMs) however, the results of CoT distillation are inadequate for knowledge-intensive reasoning tasks. |
| Approach: | They propose a retrieval-based framework which distills question probing and reasoning capabilities from Large Language Models into SLMs. |
| Outcome: | The proposed framework improves probing and reasoning capabilities of large language models in knowledge-intensive reasoning tasks. |
TransAdv: A Translation-based Adversarial Learning Framework for Zero-Resource Cross-Lingual Named Entity Recognition (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition are limited by noise in translation . Existing approaches to named entities recognition are mainly based on labeled data . |
| Approach: | They propose a framework to mitigate lexical and syntactic errors of translated data . they propose to use multi-level adversarial learning and multi-model knowledge distillation to mitigate noise . |
| Outcome: | The proposed framework mitigates lexical and syntactic errors of translated data . it achieves competitive performance to state-of-the-art models . |
A Multi-Task Dual-Tree Network for Aspect Sentiment Triplet Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods are poor at detecting complicated relations between aspects and opinions . detecting unclear boundaries of multi-word aspects and opinion is also a challenge . |
| Approach: | They propose a multi-task dual-tree network to extract triplets from a given sentence . they employ a constituency tree and a modified dependency tree to enhance the interaction . |
| Outcome: | The proposed model extracts triplets from a given sentence, and it is effective on four datasets. |