Papers by Jiaqi Huang

9 papers
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition (2025.acl-long)

Copied to clipboard

Challenge: Creating lyrics and melodies in symbolic format requires expert knowledge of melody and an advanced understanding of lyrics.
Approach: They introduce SongComposer, a music-specialized large language model that can create symbolic lyrics and melodies following instructions.
Outcome: The proposed model outperforms existing models in symbolic song composition tasks.
Reframe Your Life Story: Interactive Narrative Therapist and Innovative Moment Assessment with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to mental health support lack realism and capture therapeutic progression over time.
Approach: They propose a framework that simulates expert narrative therapists by planning therapeutic stages, guiding reflection levels, and generating contextually appropriate responses through retrieval-augmentation.
Outcome: The proposed framework outperforms standard methods in quality and depth on 260 simulated clients and 230 human participants.
LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated better safety performance in high-resource languages than in low-resourced languages.
Approach: They propose language-agnostic semantic alignment (LASA) which anchors safety alignment directly in semantic bottlenecks.
Outcome: The proposed approach significantly improves safety across all languages: average attack success rate drops from 24.7% to 2.8% on LLaMA-3.1-8B-Instruct and remains within 3–4% across Qwen2.5 and Qwend3 Instruct models (7B–32B).
Training-Free Adaptive Speculative Decoding via Linguistic Priors (2026.findings-acl)

Copied to clipboard

Challenge: Speculative decoding (SPD) is a promising technique to accelerate Large Language Models (LLMs). current approaches neglect the inherent heterogeneity of natural language and fail to distinguish between semantically-rich content and structurally-predictable syntax.
Approach: They propose a training-free framework that leverages linguistic priors to enable adaptive drafting and verification.
Outcome: The proposed framework significantly accelerates inference without additional training.
Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) are increasingly deployed in socially consequential settings . attribution under visual confounding is a central challenge in measuring social bias .
Approach: They propose a face-only counterfactual evaluation paradigm that isolates demographic effects while preserving real-image realism.
Outcome: The proposed paradigm isolates demographic effects while preserving real-image realism.
PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods to improve factuality of large language models (LLMs) rely on human-engineered instructions.
Approach: They propose a retrieval-augmented generation framework that trains the model with distractor-aware QA pairs mixing gold evidence with subtle distractor passages and instills reasoning-centric habits that make the LLM plan, rationalize, and synthesize without extensive human engineered instructions.
Outcome: The proposed framework outperforms state-of-the-art solutions across 12 open-book RAG QA benchmarks and is being deployed in production.
BrainLoc: Brain Signal-Based Object Detection with Multi-modal Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: BrainLoc is a lightweight object detection model guided by fMRI signals.
Approach: They propose a brain-based object detection model guided by fMRI signals . they employ a multi-modal alignment strategy that enhances fmr feature extraction .
Outcome: The proposed model improves fMRI-based object detection accuracy and convenience.
OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference (2025.acl-long)

Copied to clipboard

Challenge: Existing open-source multi-modal large language models (MLLMs) focus on enhancing foundational capabilities, leaving a significant gap in human preference alignment.
Approach: They propose a dataset of 200K high-quality training samples featuring diverse images, complex questions, and varied response formats to improve MLLMs’ alignment with human preferences.
Outcome: The proposed dataset of 200K high-quality training samples improves human preference alignment while maintaining or enhancing performance on standard VQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations