Papers by Hua Qin
Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | a high prompt sensitivity has been widely accepted as a core limitation of large language models . a recent study suggests that prompt senescence may be an artifact of evaluation processes . |
| Approach: | They examine whether prompt sensitivity is an inherent weakness or an artifact of evaluation . they find that heuristic evaluation methods overlook semantically correct responses . large language models have achieved remarkable success across a wide range of tasks . |
| Outcome: | The proposed model is more robust to prompt templates than previously thought . the authors show that prompt sensitivity may be an artifact of evaluation rather than a flaw . |
EoT: Evolution of Thoughts for Complex Reasoning Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies focus on ensuring behavior fidelity, factuality or reliability in generated reasoning processes, but they neglect the simultaneous optimization of all three aspects for each thought. |
| Approach: | They propose a thought assessment method that is sensitive to knowledge and LLM behaviors . they use three scorers to evaluate each thought by considering domain context, semantic alignment, and behavior impact. |
| Outcome: | The proposed framework outperforms advanced approaches in knowledge-based complex tasks. |
A Versatile Adaptive Curriculum Learning Framework for Task-oriented Dialogue Policy Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing training paradigms for dialogue policy learning with brute-force random sampling are expensive and lack reliable evaluation of difficulty scores. |
| Approach: | They propose a flexible adaptive curriculum learning framework that integrates curriculum learning with a generic global curriculum. |
| Outcome: | The proposed framework improves learning performance and efficiency on three public dialogue datasets. |
FormNetV2: Multimodal Graph Contrastive Learning for Form Document Information Extraction (2023.acl-long)
Copied to clipboard
Chen-Yu Lee, Chun-Liang Li, Hao Zhang, Timothy Dozat, Vincent Perot, Guolong Su, Xiang Zhang, Kihyuk Sohn, Nikolay Glushnev, Renshen Wang, Joshua Ainslie, Shangbang Long, Siyang Qin, Yasuhisa Fujii, Nan Hua, Tomas Pfister
| Challenge: | Existing approaches that extend the mask language modeling to other modalities require careful multi-task tuning, complex reconstruction target designs, or additional pre-training data. |
| Approach: | They propose a centralized multimodal graph contrastive learning strategy to unify self-supervised pre-training for all modalities in one loss. |
| Outcome: | The proposed model achieves state-of-the-art performance on FUNSD, CORD, SROIE and Payment benchmarks with a more compact model size. |