Papers by Bin Zhu

32 papers
RETAIL: Towards Real-world Travel Planning for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing travel planning systems assume users provide explicit queries, limiting their practical utility.
Approach: They propose a dataset RETAIL which supports decision-making for implicit queries while covering explicit queries.
Outcome: The proposed model achieves a 1.0% pass rate, suggesting real-world travel planning remains challenging.
HiCoLoRA: Addressing Context-Prompt Misalignment via Hierarchical Collaborative LoRA for Zero-Shot DST (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to zero-shot Dialog State Tracking (zs-DST) are inadequate to generalize to new domains without extensive training.
Approach: They propose a framework that enhances zero-shot slot inference through robust prompt alignment.
Outcome: Experiments on multi-domain datasets show that HiCoLoRA outperforms baselines, achieving SOTA in zs-DST.
JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection (2022.acl-long)

Copied to clipboard

Challenge: Existing methods achieve promising performance in in-target stance detection when trained and tested on the same datasets.
Approach: They propose a joint contrastive learning framework to generalize stance features for unseen targets.
Outcome: The proposed framework achieves state-of-the-art on three benchmark datasets.
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)

Copied to clipboard

Challenge: Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations .
Approach: They propose a framework to synthesize complex charts and reliable reasoning data from scratch.
Outcome: Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models .
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs).
Approach: They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories.
Outcome: The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks.
Interesting Culture: Social Relation Recognition from Videos via Culture De-confounding (2025.findings-emnlp)

Copied to clipboard

Challenge: a culturally-specific cultural context can be used to train relationship recognition models . cultural confounding factors can be learned, limiting ability to recognize social relationships in different cultures.
Approach: They propose a culturally-based model that mitigates the influence of culture . they also construct a video social relation recognition dataset to facilitate discussion .
Outcome: The proposed model surpasses state-of-the-art methods on several datasets.
On the Vulnerability of Safety Alignment in Open-Access LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are susceptible to malicious exploitation, but are often rejected and limited harmfulness is limited.
Approach: They propose two types of reverse alignment techniques: reverse supervised fine-tuning (RSFT) and reverse preference optimization (RPO).
Outcome: The proposed methods can significantly enhance the success rate and harmfulness of jailbreak attacks, but they face high rejection rates and limited harmfulness.
Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Existing CodePre-trained models struggle to generalize due to superficial mapping from source code to labels instead of understanding the root causes of code vulnerabilities.
Approach: They propose a framework that integrates multi-task learning with Large Language Models to effectively mine deep-seated vulnerability features.
Outcome: The proposed framework surpasses seven state-of-the-art models in effectiveness, generalization, and robustness.
HiPrune: Hierarchical Attention for Efficient Token Pruning in Vision-Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for visual token pruning lack insight into the intrinsic property of the vision encoder . et al., 2017: 99.3% of task accuracy with only 1/3 of the tokens.
Approach: They propose a model-agnostic token pruning method that trains without training . they propose 'HiPrune' method which prunes visual tokens according to their attention .
Outcome: The proposed method achieves 99.3% of task accuracy with only 1/3 of the tokens . it reduces inference FLOPs by 58.7% and maintains 99.99% accuracy with 2/9 tokens.
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data (2024.findings-naacl)

Copied to clipboard

Challenge: i-Code V2 is one of the first models capable of generating natural language from any combination of Vision, Language, and Speech data.
Approach: They propose to create a model that can generate natural language from any combination of Vision, Language, and Speech data.
Outcome: i-Code V2 matches or outperforms state-of-the-art single- and dual-modality baselines on 7 multimodal tasks.
DarwinTOD: LLM-Driven Lifelong Self-evolution for Task-oriented Dialog Systems (2026.acl-long)

Copied to clipboard

Challenge: Continual learning approaches fail to achieve autonomy lifelong improvement in dynamic environments . current task-oriented dialog systems are static, unable to learn from ongoing interactions .
Approach: They propose a lifelong self-evolving dialog framework that integrates evolutionary computation and LLM driven self-improvement into a single framework.
Outcome: The proposed framework surpasses state-of-the-art methods and exhibits continuous performance gains throughout evolution.
Table-as-Search: Agentic Information Seeking is Table Completion (2026.findings-acl)

Copied to clipboard

Challenge: Current Information Seeking (InfoSeeking) agents struggle to maintain focus and coherence during long-horizon exploration, as tracking search states within one plain-text context is inherently fragile.
Approach: They propose a structured planning framework that reformulates the InfoSeeking task as a Table Completion task.
Outcome: The proposed framework outperforms state-of-the-art frameworks across three kinds of benchmarks, including multi-agent framework and commercial systems.
Spatiotemporal Sycophancy: Negation-Based Gaslighting in Video Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing Vid-LLMs lack robust mechanisms for maintaining grounded spatiotemporal beliefs under conversational feedback.
Approach: They propose a negation-based gaslighting evaluation framework and introduce a benchmark to investigate spatiotemporal sycophancy.
Outcome: The proposed framework evaluates state-of-the-art Vid-LLMs across video understanding tasks.
AC-EVAL: Evaluating Ancient Chinese Language Understanding in Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: AC-EVAL is a benchmark designed to assess the advanced knowledge and reasoning capabilities of LLMs within the context of ancient Chinese.
Approach: They propose a benchmark to assess the advanced knowledge and reasoning capabilities of LLMs in ancient Chinese.
Outcome: AC-EVAL aims to assess the comprehension of ancient Chinese texts . the benchmark covers 13 tasks covering historical facts, geography, social customs, art, philosophy, classical poetry and prose.
Exploring Robust Overfitting for Pre-trained Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Recent literature has revealed their vulnerability to crafted adversarial examples on a wide range of NLP tasks.
Approach: They propose to combine regularization methods with adversarial training to mitigate robust overfitting for pre-trained language models by scaling the model's loss.
Outcome: The proposed methods mitigate robust overfitting upon three top adversarial training methods and further promote adversarially robustness.
Beyond Single-View Detection: A Dual-Space Reasoning Framework for Interpretable Harmful Meme Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for identifying harmful memes rely on modal alignment or black-box classifiers . BPDMoE-Hate provides visual explanations for viewpoint selection and hierarchical structuring .
Approach: They propose a framework that conceptualizes harmful meme detection as a process of "viewpoint decoupling and hierarchical fusion" they propose BPDMoE-Hate, which generates adversarial binary perspectives via VLMs and incorporates an adaptive viewpoint gating to facilitate viewpoint selection.
Outcome: The proposed framework surpasses existing methods in performance and provides visual explanations for viewpoint selection and hierarchical structuring.
Improving Robustness of Language Models from a Geometry-aware Perspective (2022.findings-acl)

Copied to clipboard

Challenge: Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness.
Approach: They propose friendly adversarial data augmentation and geometry-aware adversarial training to achieve stronger robustness using fewer search steps.
Outcome: The proposed method can obtain stronger robustness using fewer steps than existing methods.
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to visual-language understanding lack unified tokenization for images and videos . lack of unified visual representations makes it difficult to learn multi-modal interactions from poor projection layers.
Approach: They propose to unify visual representation into the language feature space to advance the foundational LLM towards a unified LVLM.
Outcome: The proposed model outperforms Video-ChatGPT on image benchmarks and on 9 image benchmark benchmarks.
OSCBench: Benchmarking Object State Change in Text-to-Video Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on perceptual quality, text–video alignment, or physical plausibility, leaving a critical aspect of action understanding unexplored.
Approach: They introduce a benchmark specifically designed to assess OSC performance in T2V models.
Outcome: The proposed benchmark assesses the performance of open-source and proprietary T2V models on object state change (OSC) in the context of novel and compositional scenarios.
StraGo: Harnessing Strategic Guidance for Prompt Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for prompt optimization often lead to prompt drifting, wherein newly generated prompts canadversely impact previously successful cases while addressing failures.
Approach: They propose a method to mitigate prompt drifting by integrating in-context learning to formulate specific, actionable strategies for prompt optimization.
Outcome: The proposed approach mitigates prompt drifting by leveraging insights from both successful and failed cases to identify critical factors for achieving optimization objectives.
WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for Knowledge-Based Visual Question Answering rely on images as the retrieval key, and often overlook or misplace the role of Vision-Language Models (VLMs)
Approach: They propose a multi-modal RAG framework that assigns VLMs two specialized agents: a Refiner and an Inspector.
Outcome: Experiments on EVQA, InfoSeek, and M2KR show that the proposed framework achieves state-of-the-art performance with significant improvements in both retrieval accuracy and answer quality.
DocEE: A Large-Scale and Fine-grained Benchmark for Document-level Event Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing datasets focus on sentence-level event extraction, but document-level EE is limited due to the lack of large-scale and practical training and evaluation datasets.
Approach: They propose a document-level event extraction dataset with 27,000+ events and 180,000+ arguments.
Outcome: The proposed dataset includes 27,000+ events, 180,000+ arguments and large-scale manual annotations, fine-grained argument types and application-oriented settings.
DyBBT: Dynamic Balance via Bandit-inspired Targeting for Dialog Policy with Cognitive Dual Systems (2026.acl-long)

Copied to clipboard

Challenge: Task oriented dialog systems often rely on static exploration strategies that do not adapt to dynamic dialog contexts.
Approach: They propose a dialog policy learning framework that formalizes the exploration challenge through a structured cognitive state space C.
Outcome: The proposed framework achieves SOTA performance in success rate, efficiency, and generalization.
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective.
Approach: They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types.
Outcome: The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment.
AMPO: Automatic Multi-Branched Prompt Optimization (2024.emnlp-main)

Copied to clipboard

Challenge: Existing prompt engineering techniques are limited to producing single flow instructions, struggling with handling diverse patterns.
Approach: They propose an automatic prompt optimization method that iteratively develops a multi-branched prompt using failure cases as feedback.
Outcome: The proposed method achieves the best results across five tasks and demonstrates significant optimization efficiency due to adoption of a minimal search strategy.
HyperMR: Hyperbolic Hypergraph Multi-hop Reasoning for Knowledge-based Visual Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies on knowledge-based visual question answering (KBVQA) describe the semantic distance using the actual Euclidean distance between two nodes, which leads to distortion in modeling knowledge graphs with hierarchical and scale-free structure.
Approach: They propose to use the actual Euclidean distance between two nodes to solve a problem of hierarchical and free-scale knowledge graphs.
Outcome: Extensive experiments on the KVQA, PQ and PQL datasets demonstrate the effectiveness of HyperMR for strong-hierarchy knowledge graphs.
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice.
Approach: They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation.
Outcome: The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability .
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited.
Approach: They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments.
Outcome: Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning.
Maximal Clique Based Non-Autoregressive Open Information Extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Open Information Extraction (OpenIE) aims to discover textual facts from a given sentence.
Approach: They propose a non-autoregressive framework that generates a fact graph and a graph with an edge linking two nodes that belong to the same fact.
Outcome: The proposed framework outperforms current state-of-the-art methods on two benchmark datasets and significantly outperformed the existing ones.
SymbolicThought: Integrating Language Models and Symbolic Reasoning for Consistent and Interpretable Human Relationship Understanding (2026.acl-demo)

Copied to clipboard

Challenge: Existing methods for constructing character relationships from plain text are time-consuming and low in coverage.
Approach: They propose a human-in-the-loop framework that combines LLM-based extraction with symbolic reasoning.
Outcome: The proposed framework improves annotation accuracy and consistency while significantly reducing time cost.
Large Language Models are Better Reasoners with Self-Verification (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to solve complex natural language processing tasks require multiple steps to verify the answers.
Approach: They propose to use chain of thought prompting to solve reasoning tasks with large language models.
Outcome: The proposed method can improve reasoning performance on arithmetic, commonsense, and logical reasoning datasets.
From Outcomes to Processes: Guiding PRM Learning from ORM for Inference-Time Alignment (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences suffer from inconsistent scoring and suboptimal alignment.
Approach: They propose a dual-consistency framework that aligns partial sequences with human preferences.
Outcome: The proposed framework significantly reduces granularity discrepancies and improves GPT-4 evaluation scores.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations