Papers by Jing Gu
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)
Copied to clipboard
Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip Yu, Wenpeng Yin
| Challenge: | a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities . |
| Approach: | They present a comparative analysis to identify and distinguish LLM activities from human activities. |
| Outcome: | The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities. |
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA (2024.acl-long)
Copied to clipboard
Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Yang Zhao, Xinze Guan, Xin Wang
| Challenge: | Multipanel images are a common form of visual representations, and humans can achieve approximately 99% accuracy on these questions. |
| Approach: | They propose a benchmark that tests multipanel visual reasoning models with 6,600 triplets of questions, answers, and multipanel images. |
| Outcome: | The proposed benchmark features 6,600 triplets of questions, answers, and multipanel images that challenge state-of-the-art Multimodal Large Language Models (MLLMs) human users can attain approximately 99% accuracy on these questions, compared with previous benchmarks. |
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to building task-oriented dialog systems require a substantial amount of annotations and thus are labor-intensive. |
| Approach: | They propose a Pre-trainedRole Alternating Language model (PRAL) that is explicitly designed for task-oriented dialog tasks. |
| Outcome: | The proposed model outperforms or is on par with state-of-the-art models on task-oriented dialog tasks. |
FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing fact-checking evaluation methods rely on static datasets and classification metrics, which fail to evaluate justification production and uncover the nuanced limitations of LLMs. |
| Approach: | They propose a framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities by incorporating justification production alongside verdict prediction. |
| Outcome: | Experiments show that the framework differentiates among state-of-the-art LLMs, providing valuable insights into model strengths and limitations in model-centric fact-checking analysis. |
CoT-VTM: Visual-to-Music Generation with Chain-of-Thought Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for visual-to-music generation lack large-scale, high-quality visual-music paired datasets and lack of direct semantic correspondence between visuals and music. |
| Approach: | They propose a framework that distills Chain-of-Thought reasoning to enable visual-to-music generation without paired data. |
| Outcome: | The proposed framework achieves optimal performance on image-to-music and video-to music tasks. |
AlignBench: Benchmarking Chinese Alignment of Large Language Models (2024.acl-long)
Copied to clipboard
Xiao Liu, Xuanyu Lei, Shengyuan Wang, Yue Huang, Andrew Feng, Bosi Wen, Jiale Cheng, Pei Ke, Yifan Xu, Weng Lam Tam, Xiaohan Zhang, Lichao Sun, Xiaotao Gu, Hongning Wang, Jing Zhang, Minlie Huang, Yuxiao Dong, Jie Tang
| Challenge: | Effective evaluation of alignment for emerging Chinese LLMs is still significantly lacking, calling for real-scenario grounded, open-ended, challenging and automatic evaluations tailored for alignment. |
| Approach: | They propose a multi-dimensional benchmark for evaluating LLMs’ alignment in Chinese with 8 main categories, 683 real-scenario rooted queries and corresponding human verified references. |
| Outcome: | The benchmark uses a human-in-the-loop data curation pipeline, 683 real-scenario rooted queries and human verified references. |
Memformer: A Memory-Augmented Transformer for Sequence Modeling (2022.findings-aacl)
Copied to clipboard
| Challenge: | Experimental results show that Memformer uses 8.1x less memory space and 3.2x faster on inference. |
| Approach: | They propose an efficient neural network that utilizes an external dynamic memory to encode and retrieve past information. |
| Outcome: | The proposed model achieves comparable performance against baselines with 8.1x less memory space and 3.2x faster on inference. |
On the Transformer Growth for Progressive BERT Training (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods only conduct network growth in a single dimension, but compound growth operators are beneficial for multiple dimensions. |
| Approach: | They propose a method to train BERT progressively using a Transformer model and explore alternative growth operators in each dimension via controlled comparison. |
| Outcome: | The proposed method speeds up BERT pre-training by 73.6% and 82.2% for the base and large models respectively while achieving comparable performances. |
ChainCQG: Flow-Aware Conversational Question Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Current datasets for conversational question answering lack realistic, domain-specific training data. |
| Approach: | They propose a model that generates question-answer representations across dialogue turns . they use flow propagation training to improve conversational flow and fluidity . |
| Outcome: | The proposed model outperforms answer-aware and answer-unaware SOTA baselines significantly . it generates different types of questions with improved fluidity and coreference alignment. |
FrontCoder: Scaling Visual Fidelity in Front-End Code Generation (2026.findings-acl)
Copied to clipboard
Jun Feng, Jian Yang, Wei Zhang, Jing Wang, Keyi Chen, Xiaokun Yang, Weicheng Gu, Yihang Lou, Yan Bai, Xianglong Liu
| Challenge: | Existing work on front-end code generation fails to provide visual fidelity and rendering quality for front- end developers. |
| Approach: | They propose a three-stage pipeline to enhance front-end code generation capabilities in LLMs . they use synthetic data, quality-controlled supervised fine-tuning, and reinforcement learning . |
| Outcome: | The proposed model achieves competitive performance with frontier models while maintaining generation efficiency. |
DiffCoT: Diffusion-styled Chain-of-Thought Reasoning in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but is vulnerable to exposure bias and error accumulation. |
| Approach: | They propose a diffusion-styled CoT framework that reformulates CoT reasoning as an iterative denoising process. |
| Outcome: | The proposed framework outperforms existing methods on three multi-step CoT reasoning benchmarks. |
Pretraining Without Attention (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that state-space models (SSMs) outperform standard and deep learning for long-range sequence modeling. |
| Approach: | They propose a model that combines SSM layers with a multiplicative gating architecture that has been effective in simplified sequence modeling architectures. |
| Outcome: | The proposed model outperforms standard and standard sequence modeling architectures on speech generation and the long range arena benchmarks. |
DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models (2025.naacl-long)
Copied to clipboard
Jianyu Liu, Hangyu Guo, Ranjie Duan, Xingyuan Bu, Yancheng He, Shilong Li, Hui Huang, Jiaheng Liu, Yucheng Wang, Chenchen Jing, Xingwei Qu, Xiao Zhang, Pei Wang, Yanan Wu, Jihao Gu, Yangguang Li, Jianke Zhu
| Challenge: | Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data. |
| Approach: | They propose a method to disentangle risks through step-by-step reasoning within multimodal inputs. |
| Outcome: | The proposed approach improves safety alignment in MLLMs by fine-tuning and iterative Reinforcement Learning from AI feedback. |
Data Annealing for Informal Language Understanding Tasks (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that improve formal and informal language understanding tasks do not transfer to informal data directly. |
| Approach: | They propose a data annealing transfer learning procedure to bridge the performance gap on informal natural language understanding tasks. |
| Outcome: | The proposed procedure outperforms state-of-the-art models on three common tasks. |
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions (2022.acl-long)
Copied to clipboard
| Challenge: | Vision-and-Language Navigation (VLN) is a research topic that is gaining attention in the field of artificial intelligence. |
| Approach: | They propose to build an embodied agent that can communicate with humans in natural language and navigate in real 3D environments. |
| Outcome: | This paper reviews current studies in the emerging field of vision-and-language navigation . it highlights limitations and opportunities for future work . |
Variance-reduced First-order Meta-learning for Natural Language Processing Tasks (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies show that meta-learning can overfit to some specific adaptation when we have heterogeneous tasks. |
| Approach: | They propose to reduce the variance of the gradient estimator used in task adaptation by adding a new variance reduction term to the gradient estimation. |
| Outcome: | Experiments on few-shot text classification and multi-domain dialog state tracking show that the proposed method outperforms existing methods. |
R2H: Building Multimodal Navigation Helpers that Respond to Help Requests (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing dialog-based embodied datasets are not sufficient to develop intelligent navigation-helper agents capable of navigating users in unfamiliar areas. |
| Approach: | They introduce a novel benchmark, Respond to Help Requests, to promote the development of multi-modal navigation helpers capable of responding to requests for help . they also propose two approaches to construct the navigation-helper agent, including fine-tuning a task-oriented multi-mod response generation model that can see and respond, named SeeRee, and employing . a multi-module large language model in a zero-shot manner. |
| Outcome: | The proposed model outperforms the baseline model and the proposed model on two tasks based on human evaluations and automatic benchmarking. |