Papers by Junhao Feng
Well Begun Is Half Done: An Implicitly Augmented Generative Framework with Distribution Modification for Hierarchical Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Hierarchical Text Classification (HTC) is a challenging task which aims to extract the labels in a tree structure corresponding to a given text. |
| Approach: | They propose an explicit-agmented-generativ-e framework with distribution modification for hierarchical text classification. |
| Outcome: | The proposed framework improves on the initial distributions of tail classes and avoids misinterpreting predictions on unbalanced data. |
SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025.coling-main)
Copied to clipboard
Yuchun Fan, Yongyu Mu, YiLin Wang, Lei Huang, Junhao Ruan, Bei Li, Tong Xiao, Shujian Huang, Xiaocheng Feng, Jingbo Zhu
| Challenge: | Large language models (LLMs) have demonstrated significant improvements in reasoning abilities, but these improvements are primarily focused on English, leading to inferior performance in non-English scenarios. |
| Approach: | They propose a multilingual reasoning alignment approach that fine-tunes the layers responsible for multilingual comprehension in one stage. |
| Outcome: | The proposed method fine-tunes 6 of the 9 layers responsible for multilingual comprehension, while reducing training time by 4.1-11.9 compared to the two-stage method. |
Joint Constrained Learning with Boundary-adjusting for Emotion-Cause Pair Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Emotion-Cause Pair Extraction (ECPE) aims to identify the document’s emotion clauses and corresponding cause clauses. |
| Approach: | They propose a constrained learning framework with boundary-adjusting for Emotion-Cause Pair Extraction that summarizes prior rules and forces the model to take them into consideration in optimization. |
| Outcome: | The proposed framework achieves competitive results compared with state-of-the-art methods on unbalanced data and proves robustness on unbalancing data. |
Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference (2023.acl-long)
Copied to clipboard
Junhao Zheng, Qianli Ma, Shengjie Qiu, Yue Wu, Peitian Ma, Junlong Liu, Huawen Feng, Xichen Shang, Haibin Chen
| Challenge: | Existing studies attribute catastrophic forgetting to fine-tuning, and they retain pre-trained knowledge indiscriminately without identifying what knowledge is transferable. |
| Approach: | They propose a unified objective for fine-tuning to retrieve the causality back from pre-trained data and use it to mitigate negative transfer while preserving knowledge. |
| Outcome: | The proposed method outperforms state-of-the-art fine-tuning methods on commonsense QA datasets and can be implemented as a plug-in module to inflate the performance of existing QA models. |
Rethinking Multimodal Entity and Relation Extraction from a Translation Point of View (2023.acl-long)
Copied to clipboard
| Challenge: | Special attention is paid to the cross-modal misalignment in text-image datasets which may mislead the learning. |
| Approach: | They propose a multimodal back-translation method which uses diffusion-based generative models for pseudo-paralleled pairs and a divergence estimator to construct a high-resource corpora as a bridge for low-ressource learners. |
| Outcome: | The proposed method outperforms 14 state-of-the-art methods in both entity and relation extraction tasks. |