Papers by Chao Qu

8 papers
Self-Criticism: Aligning Large Language Models with their Understanding of Helpfulness, Honesty, and Harmlessness (2023.emnlp-industry)

Copied to clipboard

Challenge: Recent studies have shown that large language models are useful, honest, harmless (HHH) however, RLHF requires high hardware resources and human efforts.
Approach: They propose a framework that allows LLMs to align themselves with HHH . they use IF and reinforcement learning from human feedback to fine-tune their models .
Outcome: The proposed framework achieves similar performance to RLHF and human-generated models with a minimal alignment tax.
ULMR: Unlearning Large Language Models via Negative Response and Model Parameter Average (2024.emnlp-industry)

Copied to clipboard

Challenge: Large language models (LLMs) have attracted significant interest from the research community due to their broad applicability in many language-oriented tasks.
Approach: They propose a framework which uses pre-training datasets to rewrite instructions and generate negative responses to preserve the performance of the original LLM.
Outcome: The proposed framework can erase the pre-training data while maintaining the performance of the original model.
SQL-ASTRA: Alleviating Sparse Feedback in Agentic SQL via Column-Set Matching and Trajectory Aggregation (2026.findings-acl)

Copied to clipboard

Challenge: Agentic SQL is a framework for multiturn agent learning, but it is limited to single-turn paradigms.
Approach: They propose a framework that provides a universal two-tiered reward mechanism for credit assignment . they propose 'Aggregated Trajectory Reward' to resolve multi-turn credit assignment.
Outcome: The proposed framework outperforms SOTA Arctic-Text2SQL-R1-7B on BIRD and Spider 2.0 using identical models.
Deploying Multi-task Online Server with Large Language Model (2025.coling-industry)

Copied to clipboard

Challenge: In the industry, numerous natural language processing tasks are deployed online . traditional approaches tackle each task separately by its own network and pipeline .
Approach: They propose a three-stage multi-task learning framework for large language models . it involves task filtering, fine-tuning on high-resource tasks, and finally fine- tuning on all tasks .
Outcome: The proposed framework reduces up to 90% of overhead while reducing latency and resource usage.
PILLOW: Enhancing Efficient Instruction Fine-tuning via Prompt Matching (2023.emnlp-industry)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) has been used to adapt Large Language Models to a variety of tasks, but it requires substantial computational resources to perform.
Approach: They propose a low-rank adaptive learning approach that leverages LoRA's in-context learning capability through prompt matching via reinforcement learning in resource-constrained environments.
Outcome: The proposed model improves LoRA performance on evaluation metrics and utilises consumer-grade GPU resources.
To Code or not to Code? Adaptive Tool Integration for Math Language Models via Expectation-Maximization (2025.findings-acl)

Copied to clipboard

Challenge: Existing tools that integrate chain-of-thought reasoning and code execution lack metacognitive awareness to integrate tools.
Approach: They propose a framework that synergizes structured exploration with off-policy RL optimization to create a cycle between metacognitive tool-use decisions and evolving capabilities.
Outcome: The proposed framework improves over 11% on MATH500 and 9.4% on AIME without o1-like CoT.
SaFER: A Robust and Efficient Framework for Fine-tuning BERT-based Classifier with Noisy Labels (2023.acl-industry)

Copied to clipboard

Challenge: Existing noise-handling methods could not improve performance of BERT on noisy datasets . existing methods could only improve performance on noisy data, authors say .
Approach: They propose a fine-tuning framework for BERT-based text classifiers that combats label noises without access to clean data for training or validation.
Outcome: The proposed framework achieves superior performance on multiple text classification benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations