Papers by Guoqiang Chen

13 papers
D2-RAG: Dual-Decision Retrieval-Augmented Generation via Multi-Dimensional Uncertainty and Utility-Aware Decoding (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) mitigates hallucinations in large language models by incorporating external knowledge.
Approach: They propose a dual-decision retrieval-augmented generation that integrates multi-dimensional uncertainty estimation to decide whether to retrieve and employs adaptive contrastive decoding to handle retrieved contexts of varying quality.
Outcome: The proposed model outperforms baselines on four medical question-answering datasets while suppressing interference from noisy contexts.
Repo4QA: Answering Coding Questions via Dense Retrieval on GitHub Repositories (2022.coling-1)

Copied to clipboard

Challenge: Stack Overflow and GitHub are open source communities that are gaining popularity . developers need to raise programming questions in coding forums and navigate to GitHub repositories .
Approach: They propose a questionrepository matching task that bridges the gap between repositories and real-world coding questions.
Outcome: The proposed model outperforms state-of-the-art methods on coding questions and repositories . it can find suitable coding repositoriels and bridge the gap between them .
AgentV-RL: Scaling Reward Modeling with Agentic Verifier (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve LLM reasoning are limited in complex domains and lack external grounding makes verifiers unreliable on computation-intensive tasks.
Approach: They propose a framework that transforms reward modeling into a multi-turn, tool-augmented deliberative process.
Outcome: The proposed framework surpasses state-of-the-art ORMs by 25.2% under parallel and sequential TTS.
JointCoder: Exploring Automated ICD Coding on Real-World Chinese EHRs with a Multi-Agent Framework (2026.acl-demo)

Copied to clipboard

Challenge: Existing automated ICD coding systems face several fundamental challenges due to the limited availability of publicly available Chinese ICD datasets.
Approach: They propose to use a Chinese ICD coding dataset and a multi-agent framework to reformulate ICD as a joint disease-procedure coding task.
Outcome: The proposed system outperforms state-of-the-art methods on real-world Chinese ICD coding datasets and 1.7B-parameter models.
FedCoT: Federated Chain-of-Thought Distillation for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as a transformative force in artificial intelligence, demonstrating exceptional proficiency across various tasks.
Approach: They propose a federated framework for the Chain-of-Thought distillation of knowledge from LLMs to SLMs, while adhering to privacy requirements.
Outcome: The proposed framework ensures secure knowledge transfer from an LLM on a high-powered server to an SLM on resource-constrained client while adhering to privacy requirements.
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation (2025.acl-long)

Copied to clipboard

Challenge: Knowledge distillation (KD) compresses large language models into lightweight versions called student models.
Approach: They propose to align the entire feature dynamics between teacher and student models by using two additional loss terms to achieve this.
Outcome: The proposed method matches the entire feature dynamics between teacher and student models rather than just the final states.
CompileAgent: Automated Real-World Repo-Level Compilation with Tool-Integrated LLM-based Agent System (2025.acl-long)

Copied to clipboard

Challenge: CompileAgent is the first LLM-based agent framework dedicated to repo-level compilation.
Approach: They propose a LLM-based agent framework dedicated to repo-level compilation.
Outcome: The proposed method significantly improves compilation success rate, ranging from 10% to 71%.
DCE-LLM: Dead Code Elimination with Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Dead code can obscure logical errors and be exploited for obfuscation in malware.
Approach: They propose a framework for automated dead code elimination using a codeBERT model with an attribution-based line selector.
Outcome: Experimental results show that DCE-LLM outperforms existing tools for dead code elimination . dead code can obscure logical errors and be exploited for obfuscation in malware .
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models (2025.coling-main)

Copied to clipboard

Challenge: Recent research in large language models (LLMs) has focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on transferring knowledge from server-based LLM to small language models at downstream clients.
Approach: They propose a parameter-efficient federated mutual knowledge transfer framework for large and small language models that allows for token alignment and selective knowledge transfer between client-side LLMs and a server-side SLM.
Outcome: The proposed framework enhances the performance of both LLMs and SLMs with clients' unique domain insights while preserving the server's LLM and client's unique domain insight.
FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning Large Language Models (LLMs) suffer from a performance bottleneck . Existing approaches like Offsite-Tuning (OT) secure the LLMs IP .
Approach: They propose a framework that replaces weak adapters with a unified, powerful Proxy Small Language Model (SLM) they propose 'resource-friendly' compression and 'robust optimization' to handle data heterogeneity.
Outcome: Experiments show that FedProxy outperforms OT and centralized fine-tuning methods.
Co-Eval: Augmenting LLM-based Evaluation with Machine Metrics (2025.emnlp-main)

Copied to clipboard

Challenge: Existing LLMs suffer from biases and misalignment due to limited functional understanding and knowledge gaps.
Approach: They introduce a framework that leverages a criteria planner model and optimized machine metrics to enhance the scalability and fairness of LLM-based evaluation.
Outcome: The proposed framework reduces biases and improves alignment with human preferences, with gains of up to 0.324 in Spearman correlation.
IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing (2024.emnlp-industry)

Copied to clipboard

Challenge: Unlike professional Business-to-Consumer (B2C) e-commerce platforms, consumer-to consumer (C2C), is mainly targeting individual sellers.
Approach: They develop an intelligent product listing tool that generates product descriptions using various product attributes such as category, brand, color, condition, etc.
Outcome: The proposed tool outperforms the base model in domain-specific tasks while producing less hallucination.
Think Earlier, Not Longer: Prompt Optimization via Reducing Unhealthy Exploration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve reasoning performance ignore the presence of unhealthy exploration that increases token usage without contributing to effective problem-solving.
Approach: They propose an entropy-dynamics-aware prompt optimization framework that trains a lightweight optimizer to generate concise clarifications.
Outcome: The proposed framework reduces ambiguity-induced early-stage uncertainty while preserving the model's reasoning capabilities.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations