Papers by Zhongyuan Wu

8 papers
ProvBench: A Benchmark of Legal Provision Recommendation for Contract Auto-Reviewing (2025.acl-long)

Copied to clipboard

Challenge: Contract review is labor-intensive, time-consuming, and costly . a benchmark is proposed to detect potential legal conflicts .
Approach: They propose a benchmark for legal provision recommendation and conflict detection for contract auto-reviewing which aims to recommend the legal provisions related to contract clauses and detect possible legal conflicts.
Outcome: The proposed task recommends legal provisions related to contract clauses and detects legal conflicts.
Empowering Character-level Text Infilling by Eliminating Sub-Tokens (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for character-level infilling relied on predicting sub-tokens, but this strategy was ineffective.
Approach: They propose a method to fill-in-the-mid with Starting and Ending character constraints that avoids predicting sub-tokens in inference.
Outcome: The proposed method surpasses existing methods and offers significant performance gains.
ReflectionCoder: Learning from Reflection Sequence for Enhanced One-off Code Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to enhance code generation performance include integrating compiler feedback.
Approach: They propose a method that integrates compiler feedback to improve one-off code generation performance.
Outcome: The proposed method improves one-off code generation performance on three benchmarks and can be applied to other domains that focus on final results and require long reasoning paths.
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to formalizing mathematical statements face limitations in accuracy, especially in the context of complex, highlevel problems that involve sophisticated mathematical reasoning.
Approach: They propose a CriticLean framework that elevates the role of the critic from a passive validator to an active learning component and introduce a benchmark to measure models’ ability to distinguish semantically correct from incorrect formalizations.
Outcome: The proposed framework outperforms open- and closed-source benchmarks and shows that it significantly outperformed existing models.
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding (2022.coling-1)

Copied to clipboard

Challenge: a new method for learning unsupervised sentence embeddings is proposed . unsup-SimCSE is biased because of the length information encoded into the sentence embeds .
Approach: They propose a new unsupervised sentence embedding method that uses dropout to obtain positive pairs from a pre-trained Transformer encoder.
Outcome: The proposed method outperforms the state-of-the-art unsup-SimCSE on a STS task.
RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval (2022.findings-emnlp)

Copied to clipboard

Challenge: sparse sampling of videos suffers from inter-modal redundancy and visual redundancies . et al., 2021) proposes to sparsestly sample frames from videos to alleviate temporal redundance .
Approach: They propose to use sparse sampling to alleviate temporal redundancy in videos . they propose to penalize high-redundant video patches and text tokens .
Outcome: The proposed method improves on four benchmark datasets.
Smoothed Contrastive Learning for Unsupervised Sentence Embedding (2022.coling-1)

Copied to clipboard

Challenge: Unsupervised contrastive sentence embedding models use InfoNCE loss function . increasing batch size leads to performance degradation when it exceeds threshold .
Approach: They propose a simple smoothing strategy upon the InfoNCE loss function to reduce the number of false-negative pairs in a batch without increasing the batch size.
Outcome: The proposed smoothing strategy improves unsupervised SimCSE on semantic similarity tasks.
InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on contrastive learning for sentence embeddings are weak . researchers have started to use contrastive training to learn better unsupervised sentences.
Approach: They propose an information-aggregated contrastive learning framework for learning unsupervised sentence embeddings.
Outcome: The proposed framework outperforms SimCSE on several benchmark datasets w.r.t the semantic text similarity task.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations