Papers by Jiahui Gao

14 papers
DetGPT: Detect What You Need via Reasoning (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in the field of computer vision have enabled more effective and sophisticated interactions between humans and machines.
Approach: They propose a reasoning-based object detection paradigm that leverages state-of-the-art multi-modal models and open-vocabulary object detectors to perform reasoning within the context of the user’s instructions and the visual scene.
Outcome: The proposed method enables users to interact with the system using natural language instructions, allowing for a higher level of interactivity.
Look Less, Reason More: Rollout-Guided Adaptive Pixel-Space Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Recent work has shown promise by incorporating pixel-level visual information into the reasoning process, enabling VLMs to access high-resolution visual details during their thought process.
Approach: They propose a framework that dynamically determines necessary pixel-level operations based on the input query.
Outcome: The proposed model achieves 73.4% accuracy on HR-Bench 4K while maintaining a tool usage ratio of only 20.1%, improving accuracy and reducing tool usage by 66.5% compared to the previous methods.
Pointing to a Llama and Call it a Camel: On the Sycophancy of Multimodal Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal large language models exhibit a pronounced form of visual sycophantic behavior when they process image inputs.
Approach: They propose a technique that allows multimodal large language models to engage in reflective reasoning and determine whether a user’s instruction is misleading or corrective.
Outcome: The proposed model resists misleading instructions but is stubborn even if it is wrong.
Soft Orthogonal Low-Rank Adaptation for Knowledge Sharing in Large Language Model Continual Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for continual learning (CL) are designed to mitigate catastrophic forgetting while neglecting knowledge sharing across tasks.
Approach: They propose a framework that facilitates knowledge transfer while mitigating catastrophic forgetting by assigning task-specific parameter subspaces to new tasks . they then leverage attribution scores to evaluate task similarity and employ soft orthogonality between task- specific subspace .
Outcome: The proposed framework facilitates knowledge transfer while mitigating catastrophic forgetting.
Learning to Edit: Aligning LLMs with Knowledge Editing (2024.acl-long)

Copied to clipboard

Challenge: Existing knowledge editing techniques rely on memorizing updated knowledge, impeding LLMs from effectively combining the new knowledge with their inherent knowledge when answering questions.
Approach: They propose a Learning to Edit framework that equips LLMs with the ability to apply updated knowledge to input questions through a two-phase process .
Outcome: The proposed framework outperforms existing methods in knowledge editing tasks and compares it with four benchmarks and two LLM architectures.
ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom (2025.emnlp-main)

Copied to clipboard

Challenge: Large vision-language models often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.
Approach: They propose a visual reasoning framework that decouples vision-reasoning capabilities and multi-run proactive perception.
Outcome: The proposed framework outperforms existing models on benchmarks for open-source and closed-source models with 13.2% performance gain.
ZeroGen: Efficient Zero-shot Learning via Dataset Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to generate training data with pre-trained language models have been found effective in various scenarios.
Approach: They propose an unsupervised zero-shot learning method that generates a dataset from scratch and trains a tiny task model under supervision of the synthesized dataset.
Outcome: The proposed method is annotated-free and efficient, but can provide useful insights from the perspective of data-free model-agnostic knowledge distillation and unreferenced text generation evaluation.
ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing text-to-SQL models are limited to SQLite due to dataset limitations . data generated through static prompting is noisy and unreliable, authors say .
Approach: They propose a text-to-SQL framework with execution-driven, agentic bootstrapping . ExeSQl bridges the dialect gap in text- to-Sql, achieving average improvements .
Outcome: ExeSQL bridges the dialect gap in text-to-SQl, with average improvements of 15.2%, 10.38%, and 4.49% over GPT-4o on PostgreSQLE, MySQL, and Oracle.
Shaping the Safety Boundaries: Understanding and Defending Against Jailbreaks in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Understanding how jailbreaking works remains limited, hindering the development of effective defense strategies.
Approach: They propose a new mechanism that adaptively constrains activations within the safety boundary and propose 'Activation Boundary Defense' to enhance its effectiveness.
Outcome: The proposed defense achieves an average Defense Success Rate (DSR) of over 98% against various jailbreak attacks, with less than 2% impact on the model’s general capabilities.
From Discrimination to Generation: Low-Resource Intent Detection with Language Model Instruction Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies fine-tune discriminative models on specific defined intent classes, preventing them from being directly adopted to new intent domains.
Approach: They propose to use a pre-trained generative intent model to detect new intents from different domains with no parameter updates.
Outcome: The proposed model outperforms baselines that need further fine-tuning or domain-specific samples.
Clear Up Confusion: Iterative Differential Generation for Fine-grained Intent Detection with Contrastive Feedback (2025.coling-main)

Copied to clipboard

Challenge: Recent studies on fine-grained intent detection have focused on collecting large-scale and high-quality samples via crowdsourcing resulting in data scarcity.
Approach: They propose an iterative differential generation framework with contrastive feedback to generate high-quality pseudo samples and accurately capture the crucial nuances in target class distribution.
Outcome: The proposed framework generates high-quality pseudo samples and captures crucial nuances in target class distribution.
Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios (2024.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on simple synthesized queries that do not reflect real-world complexity, thereby offering limited perspectives in evaluating tool utilization.
Approach: They propose a benchmark to evaluate LLMs’ ability in tool utilization within real-world scenarios.
Outcome: The proposed benchmark improves LLMs’ ability in tool utilization within real-world scenarios and eliminates the restriction of pre-defined toolset.
Mixture of insighTful Experts (MoTE): The Synergy of Reasoning Chains and Expert Mixtures in Self-Alignment (2025.acl-long)

Copied to clipboard

Challenge: Recent studies show that reasoning abilities contribute significantly to model safety, while integrating Mixture-of-Experts (MoE) architectures can further enhance alignment.
Approach: They propose a framework that synergistically combines reasoning chains and expert mixtures to improve self-alignment.
Outcome: The proposed framework improves model safety, jailbreak resistance, and over-refusal capabilities, achieving performance comparable to OpenAI’s state-of-the-art o1 model.
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent work on dataset-generation-based zero-shot learning has shown promising results by training a task-specific model with a dataset synthesized from large pre-trained language models (PLMs).
Approach: They propose a progressive zero-shot dataset generation framework which leverages feedback from the task-specific model to guide the generation of new training data via in-context examples.
Outcome: The proposed framework achieves on-par or superior performance with only 1% synthetic dataset size, when compared to baseline methods without in-context feedback.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations