Papers by Chenhao Huang

9 papers
TreeBoN: Enhancing Inference-Time Alignment with Speculative Tree-Search and Best-of-N Sampling (2025.findings-emnlp)

Copied to clipboard

Challenge: Best-of-N (BoN) sampling generates multiple responses and selects the best one, achieving improved performance but with a high computational cost.
Approach: They propose a framework that integrates a speculative tree-search strategy into Best-of-N (BoN) Sampling.
Outcome: The proposed framework outperforms Best-of-N (BoN) sampling but has high computational cost . tree-search strategy reduces computational overhead while maintaining high output quality .
Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models (2025.acl-demo)

Copied to clipboard

Challenge: Existing interpretation methods only support tasks with specific inputs, limiting their practical applications.
Approach: They propose an extensible module that matches different input data with interpretation methods and consolidates the interpreting outputs.
Outcome: The proposed module can match different input data with interpretation methods and consolidate the interpreting outputs.
Governance in Motion: Co-evolution of Constitutions and AI models for Scalable Safety (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences lack flexibility . static alignment preferences lack the ability to correct misaligned behaviors as they emerge .
Approach: They propose a framework that enables dynamic and continuous alignment of large language models with human preferences.
Outcome: The proposed framework improves safety and accuracy of a 7B model with human annotations.
Revisiting the Negative Data of Distantly Supervised Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for relation extraction with distant supervision generate plenty of training samples but noisy labels and imbalanced training data cause problems.
Approach: They propose a method that automatically labels a sentence with relational triples from a knowledge base.
Outcome: The proposed method outperforms existing methods even with false positive samples.
Can MLLMs Understand the Deep Implication Behind Chinese Images? (2025.acl-long)

Copied to clipboard

Challenge: MLLMs perform poorly on traditional culture images, indicating limitations in understanding high-level semantics and lacking a deep knowledge base of Chinese traditional culture.
Approach: They propose to use Chinese images to assess MLLMs' higher-order perception and understanding of Chinese visual content.
Outcome: The proposed model incorporates images that represent Chinese traditional culture, such as famous Chinese traditional paintings, to ensure the authenticity of the Chinese context.
Parsing Natural Language into Propositional and First-Order Logic with Dual Reinforcement Learning (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to parse natural language into structured logical expressions have limitations due to paucity of labeled data.
Approach: They propose a scoring model to automatically learn a model-based reward . they also propose introducing a Chinese-PL/FOL dataset to compensate for paucity of labeled data .
Outcome: The proposed model outperforms competitors on several datasets.
LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Current medical benchmarks have limitations in question design, data sources and evaluation methods.
Approach: They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records .
Outcome: The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios.
Lost in the Context: Insufficient and Distracted Attention to Contexts in Preference Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing reward models concatenate contexts and responses, but they often ignore crucial segments of the context that are important for evaluating the response quality.
Approach: They propose a reward model that evaluates the response quality based on a given context and assigns a rewards reward.
Outcome: The proposed framework significantly improves preference modeling by increasing attention to relevant information within the context and achieves better generalizability.
VRPO: Rethinking Value Modeling for Robust RL under Noisy Supervision in LLM Post-Training (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning (RL) in real-world environments often suffers from ambiguous or incomplete supervision.
Approach: They propose a framework that enhances value modeling for robust RL in LLM post-training by integrating auxiliary losses guided by entropy and perplexity from a frozen language model and variational information bottleneck.
Outcome: The proposed framework outperforms baselines on multi-turn dialogue, math reasoning, and science QA with rule-based and model-based rewards.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations