Papers by Huan Deng
Rethinking Diverse Human Preference Learning through Principal Component Analysis (2025.findings-acl)
Copied to clipboard
| Challenge: | Decomposed Reward Models extract diverse human preferences from binary comparisons without fine-grained annotations. |
| Approach: | They propose a decomposed reward model that extracts diverse human preferences from binary comparisons without fine-grained annotations. |
| Outcome: | The proposed approach extracts diverse human preferences from binary comparisons without fine-grained annotations. |
ReasonBERT: Pre-trained to Reason with Distant Supervision (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing pre-training methods only harvest learning signals from local contexts of naturally occurring texts . ReasonBert provides a method for reasoning over long-range relations and multiple, possibly hybrid contexts. |
| Approach: | They propose a method that augments language models with the ability to reason over long-range relations and multiple, possibly hybrid contexts. |
| Outcome: | The proposed method significantly improves sample efficiency over strong baselines. |
Iteratively Prompt Pre-trained Language Models for Chain of Thought (2022.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) internalize a great amount of knowledge, but have been shown incapable of recalling this knowledge to solve complex & multi-step reasoning tasks. |
| Approach: | They propose an iterative prompting framework which progressively elicits relevant knowledge from PLMs for multi-step inference. |
| Outcome: | The proposed prompting framework outperforms existing prompting methods on three datasets involving multi-step reasoning. |
Refusal-Aware Red Teaming: Exposing Inconsistency in Safety Evaluations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) require rigorous safety evaluations to be effective. |
| Approach: | They propose a red teaming framework that detects internal model refusals and contrasts them with judgments from an external safety evaluator to generate test cases that expose such discrepancies. |
| Outcome: | The proposed framework outperforms existing reinforcement learning-based approaches in generating diverse test cases and achieves a substantially higher discovery rate of refusal gaps. |
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters (2023.acl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). |
| Approach: | They propose to use Chain-of-Thought (CoT) prompting to encourage the LLM to generate intermediate rationales for solving a problem by providing a series of reasoning steps in the demonstrations. |
| Outcome: | The proposed model can generate coherent lines of reasoning even with invalid demonstrations while still generating coherent lines during inference. |
MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Application (2026.acl-long)
Copied to clipboard
Xueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang, Yueru He, Yang Ren, Mingyang Jiang, Vincent Jim Zhang, Yuqing Guo, Jeff Zhao, Huan He, Yi Han, Yun Feng, Yuechen Jiang, Yupeng Cao, Haohang Li, Yangyang Yu, Xiaoyu Wang, Penglei Gao, Shengyuan Lin, Keyi Wang, Shanshan Yang, Yilun Zhao, Zhiwei Liu, Peng Lu, Jerry Huang, Suyuchen Wang, Triantafillos Papadopoulos, Polydoros Giannouris, Efstathia Soufleri, Nuo Chen, Zhiyang Deng, Heming Fu, Yijia Zhao, Mingquan Lin, Meikang Qiu, Kaleb E Smith, Arman Cohan, Xiao-Yang Liu, Jimin Huang, Guojun Xiong, Alejandro Lopez-Lira, Xi Chen, Junichi Tsujii, Jian-Yun Nie, Sophia Ananiadou, Qianqian Xie
| Challenge: | Existing evaluations of LLMs in finance are text-only, monolingual, and largely saturated by current models. |
| Approach: | They propose a multilingual and multimodal benchmark for evaluating LLMs in real financial contexts. |
| Outcome: | The first expert-annotated multilingual and multimodal benchmark is released . it evaluates 21 leading LLMs and shows they perform better in multilingual settings . |
Structure-Grounded Pretraining for Text-to-SQL (2021.naacl-main)
Copied to clipboard
Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, Oleksandr Polozov, Huan Sun, Matthew Richardson
| Challenge: | STRUG is a weakly supervised structure-based pretraining framework for text-to-SQL . it can be used to learn to capture text-table alignment in a given database schema . |
| Approach: | They propose a weakly supervised structure-grounded pretraining framework for text-to-SQL that can effectively learn to capture text-table alignment based on a parallel text-tab corpus. |
| Outcome: | The proposed framework outperforms BERTLARGE and BERTLAGE on all text-to-SQL alignment settings. |
Exploring Chain of Thought Style Prompting for Text-to-SQL (2023.emnlp-main)
Copied to clipboard
| Challenge: | In-context learning with large language models (LLMs) has recently caught increasing attention due to its superior few-shot performance on various tasks. |
| Approach: | They propose a new chain of thought prompting method that enhances LLMs’ reasoning ability through chain of thinking prompting, including the original chain-of-thought prompting and least-to-most prompting. |
| Outcome: | The proposed method brings 5.2 and 6.5 point absolute gains on the Spider development set and the Spider Realistic set, respectively, compared to the standard prompting method without reasoning steps; 2.4 and 1.5 point absolute gain, versus the least-to-most prompting. |
Reinforced Dynamic Reasoning for Conversational Question Generation (P19-1)
Copied to clipboard
| Challenge: | Empirical results on the recently released CoQA dataset demonstrate the effectiveness of our method . large-scale highquality conversational question answering datasets such as CoQA and QuAC can help train models to answer sequential questions. |
| Approach: | They propose a task called Conversational Question Generation which generates a question based on a passage and a conversation history to generate the next question. |
| Outcome: | The proposed method is based on a question-answering style conversation dataset . it can be used to generate meaningful questions on QA and SQuAD datasets . |
Leveraging 2-hop Distant Supervision from Table Entity Pairs for Relation Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing methods to construct noisy labeled data for relation extraction (RE) are expensive and lacks the labeling capability. |
| Approach: | They propose a 2-hop DS strategy to enhance distantly supervised relation extraction (RE) by combining sentences that mention entities that are linked to each other. |
| Outcome: | The proposed method outperforms baselines on a benchmark dataset by a substantial margin. |