Papers by Qianqian Zhang

14 papers
MT-Video-Bench: A Holistic Video Understanding Benchmark for Evaluating Multimodal LLMs in Multi-Turn Dialogues (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for Multimodal Large Language Models (MLLMs) focus on single-turn question answering, overlooking the complexity of multi-turn dialogues in real-world scenarios.
Approach: They propose a video understanding benchmark for MLLMs in multi-turn dialogues that assesses six core competencies that focus on perceptivity and interactivity.
Outcome: The MT-Video-Bench evaluates 1,000 multi-turn dialogues from diverse domains and reveals significant performance discrepancies and limitations in handling multi-turned video dialogues.
Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research (2025.acl-demo)

Copied to clipboard

Challenge: Language agents powered by large language models (LLMs) have demonstrated remarkable capabilities in understanding, reasoning, and executing complex tasks.
Approach: They propose a flexible framework that addresses engineering overhead and insufficient evaluation frameworks for fair comparison.
Outcome: The proposed framework simplifies language agent development and establishes a foundation for reproducible agent research.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
CTC-based Non-autoregressive Speech Translation (2023.acl-long)

Copied to clipboard

Challenge: End-to-end speech translation (E2E ST) and non-autoregressive (NAR) generation are promising in language and speech processing for their advantages of less error propagation and low latency.
Approach: They develop a model that uses connectionist temporal classification to predict the source and target texts.
Outcome: The proposed model achieves an average BLEU score of 29.5 with a speed-up of 5.67.
Human or LLM as Standardized Patients? A Comparative Study in Medical Education (2026.acl-long)

Copied to clipboard

Challenge: Standardized patients (VSPs) are indispensable for clinical skills training but remain expensive and difficult to scale.
Approach: They propose a multi-agent VSP framework that separates case-grounded information disclosure from response generation to support stable, inquiry-conditioned patient behavior.
Outcome: The proposed framework more closely matches human SP behavior than existing VSPs, particularly in case consistency and controlled disclosure.
UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Existing legal benchmarks focusing on knowledge and logic evaluate LLMs on various tasks in legal domain, but few have explored the practical application of LLM by actual users.
Approach: They propose a Chinese user-centric legal benchmark that aims to assess the practical application of LLMs by real users.
Outcome: The proposed model outperforms existing models on various tasks in legal domain but does not outperfect ChatGPT.
Towards Interpretable Mental Health Analysis with Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing studies on large language models lack adequate evaluations and prompting strategies for explainability.
Approach: They evaluate the mental health analysis and emotional reasoning ability of large language models (LLMs) using 11 datasets across 5 tasks.
Outcome: The proposed model shows strong in-context learning ability but still has a significant gap with advanced task-specific methods.
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have expanded their potential applications in finance.
Approach: They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions.
Outcome: The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios.
Neural Sparse Topical Coding (P18-1)

Copied to clipboard

Challenge: Topic models with sparsity enhancement are effective at learning discriminative and coherent latent topics of short texts.
Approach: They propose a novel sparsity-enhanced topic model with back propagation that replaces the inference process with the back propagations, making it easy to explore extensions.
Outcome: The proposed model outperforms existing methods on Web Snippet and 20Newsgroups datasets.
ECON: On the Detection and Resolution of Evidence Conflicts (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that AI generated content is more likely to dominate search results, making it difficult to detect when compared to human-produced content.
Approach: They propose a method for generating diverse, validated evidence conflicts to simulate real-world misinformation scenarios.
Outcome: The proposed method enables the detection of conflicting information in real-world scenarios and shows that weaker models struggle with similar answer conflicts while stronger models show robust performance.
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs.
Approach: They propose a framework that integrates dialogue, reasoning, and personalized recommendation.
Outcome: Experiments across public benchmarks show state-of-the-art performance.
LAiW: A Chinese Legal Large Language Models Benchmark (2025.coling-main)

Copied to clipboard

Challenge: Xie et al., 2023) show that large language models (LLMs) can generate legal text, but lack the legal syllogism . legal experts are cautious about their practical application due to the opaque nature of the LLMs.
Approach: They propose a Chinese legal LLM benchmark structured around the legal syllogism . they evaluate LLMs across three levels of capability, each reflecting a more complex stage of legal .
Outcome: The proposed benchmark identifies that LLMs lack the legal syllogism, which hinders trust and understanding from legal experts.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations