Papers by Huawen Feng
Well Begun Is Half Done: An Implicitly Augmented Generative Framework with Distribution Modification for Hierarchical Text Classification (2024.lrec-main)
Copied to clipboard
| Challenge: | Hierarchical Text Classification (HTC) is a challenging task which aims to extract the labels in a tree structure corresponding to a given text. |
| Approach: | They propose an explicit-agmented-generativ-e framework with distribution modification for hierarchical text classification. |
| Outcome: | The proposed framework improves on the initial distributions of tail classes and avoids misinterpreting predictions on unbalanced data. |
WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models (2025.acl-long)
Copied to clipboard
Huawen Feng, Pu Zhao, Qingfeng Sun, Can Xu, Fangkai Yang, Lu Wang, Qianli Ma, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang
| Challenge: | Recent code large language models have demonstrated impressive performance on code-related tasks. |
| Approach: | They propose a paradigm that learns from expert battles to address these limitations . they create an arena where leading LLMs challenge each other with evaluations . |
| Outcome: | The proposed model improves on existing models by leveraging expert battles . it achieves state-of-the-art performance even without relying on proprietary models . |
Joint Constrained Learning with Boundary-adjusting for Emotion-Cause Pair Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Emotion-Cause Pair Extraction (ECPE) aims to identify the document’s emotion clauses and corresponding cause clauses. |
| Approach: | They propose a constrained learning framework with boundary-adjusting for Emotion-Cause Pair Extraction that summarizes prior rules and forces the model to take them into consideration in optimization. |
| Outcome: | The proposed framework achieves competitive results compared with state-of-the-art methods on unbalanced data and proves robustness on unbalancing data. |
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization (2024.findings-emnlp)
Copied to clipboard
Huawen Feng, Yan Fan, Xiong Liu, Ting-En Lin, Zekun Yao, Yuchuan Wu, Fei Huang, Yongbin Li, Qianli Ma
| Challenge: | Recent advances in news summarization have created problems with “hallucinations” that are factually inconsistent with the source text. |
| Approach: | They propose to disentangle LLMs’ propensities to generate faithful and fake content by adopting a probing-based specific training method to improve their capacity of distinguishing two types of propensity. |
| Outcome: | The proposed method disentangles LLMs’ propensities to generate faithful and fake content and improves their ability to distinguish between two types of propensity. |
Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference (2023.acl-long)
Copied to clipboard
Junhao Zheng, Qianli Ma, Shengjie Qiu, Yue Wu, Peitian Ma, Junlong Liu, Huawen Feng, Xichen Shang, Haibin Chen
| Challenge: | Existing studies attribute catastrophic forgetting to fine-tuning, and they retain pre-trained knowledge indiscriminately without identifying what knowledge is transferable. |
| Approach: | They propose a unified objective for fine-tuning to retrieve the causality back from pre-trained data and use it to mitigate negative transfer while preserving knowledge. |
| Outcome: | The proposed method outperforms state-of-the-art fine-tuning methods on commonsense QA datasets and can be implemented as a plug-in module to inflate the performance of existing QA models. |
It’s Better to Teach Fishing than Giving a Fish: An Auto-Augmented Structure-aware Generative Model for Metaphor Detection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to identify metaphors use contextual information extracted by transformers for classifications directly. |
| Approach: | They propose to use structure information extraction to transform the classification task into a keywords-extraction task and to use it to expand the limited datasets. |
| Outcome: | The proposed model obtains competitive results compared with state-of-the-art methods . |