Papers by Hongyang Chen
ParaSuite: Boosting LLM Reasoning via Paradox Resolution (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for paradox research focus on checking basic logical consistency and not reflective reasoning. |
| Approach: | They propose a pipeline dedicated to paradox research that automates data synthesis, evaluation, and training. |
| Outcome: | The proposed pipeline improves paradoxical and general STEM reasoning. |
When Evolution Strategy Meets Language Models Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Autoregressive language models with pretraining often display limited capability in effectively following instructions. |
| Approach: | They propose an on-policy approach to optimize models by harnessing the principle of biological evolution, namely survival of the fittest. |
| Outcome: | The proposed method can achieve superior performance in various tasks and comparable performance in the human alignment task. |
SEP-MLDC: A Simple and Effective Paradigm for Multi-Label Document Classification (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods focus on optimizing document features, overlooking the potential of high-quality label features to enhance classification performance. |
| Approach: | They propose a multi-label document classification paradigm that utilizes large language models to expand the label content and generate pseudo-samples for the tail categories. |
| Outcome: | The proposed method significantly outperforms state-of-the-art models. |
Long-form Hallucination Detection with Self-elicitation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for hallucination detection tend to decompose text into isolated statements, unable to understand contextual semantics. |
| Approach: | They propose a framework to leverage self-generated thoughts derived from prior statements as catalysts to elicit the expression of intrinsic knowledge and understand contextual semantics. |
| Outcome: | The proposed framework enables self-elicitation to elicit expressions of knowledge and understand semantics. |
Third-Person Appraisal Agent: Simulating Human Emotional Reasoning in Text with Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Emotional reasoning is essential for improving human-AI interactions, especially in mental health support and empathetic systems. |
| Approach: | They propose a third-person appraisal agent that simulates human-like emotional reasoning through three phases: Primary Appraisal, Secondary Appraisals, and Reappraisal. |
| Outcome: | The proposed model outperforms baseline LLMs in various emotional reasoning tasks, demonstrating superior generalization and interpretability. |
SCOPE: Boosting LLM Efficiency with Scoped Position Encoding (2026.acl-long)
Copied to clipboard
| Challenge: | Positional encodings are fundamental to Transformers, but explicit methods like RoPE can degrade under length extrapolation and incur extra arithmetic and memory-access overhead. |
| Approach: | They propose a framework that reimagines structured sparsity as an intrinsic position encoding mechanism. |
| Outcome: | The proposed framework reduces the number of attention FLOPs by 8x compared to RoPE on LLaMA-3-8B architectures while reducing training and inference latency. |