Papers by Wenzheng Zhang

8 papers
Understanding Hard Negatives in Noise Contrastive Estimation (2021.naacl-main)

Copied to clipboard

Challenge: Existing theoretical results in contrastive learning focus on unconditional negative distributions.
Approach: They propose a method where highest-scoring incorrect labels are chosen as negatives . they also propose 'hard negative mining' where negatives are used as negative examples .
Outcome: The proposed approach achieves strong results on the task of zero-shot entity linking.
Seq2seq is All You Need for Coreference Resolution (2023.emnlp-main)

Copied to clipboard

Challenge: Existing work on coreference resolution suggests task-specific models are necessary . a recent line of work that take an alternative approach leveraging advances in seq2seq-based models is needed .
Approach: They propose a pretrained seq2seq transformer to map an input document to a tagged sequence encoding the coreference annotation.
Outcome: The proposed model outperforms or matches the best coreference systems on an array of datasets.
pQuant: Towards Effective Low-Bit Language Models via Decoupled Linear Quantization-Aware Training (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for building efficient large language models with sub 2-bit weights are lacking in accuracy and scalability.
Approach: They propose a method that decouples parameters by splitting linear layers into two specialized branches.
Outcome: The proposed method achieves state-of-the-art performance in extremely low-bit quantization.
Synchronous Double-channel Recurrent Network for Aspect-Opinion Pair Extraction (2020.acl-main)

Copied to clipboard

Challenge: Existing studies focus on aspect-opinion relation detection, but neglect to recognize the relations between aspects and opinion expressions.
Approach: They propose a Synchronous Double-channel Recurrent Network to deal with AOPE task . they propose an opinion entity extraction unit, a relation detection unit, and a synchronization unit .
Outcome: The proposed system achieves state-of-the-art in opinion entity extraction . it is based on three datasets based upon SemEval 2014 and 2015 benchmarks .
Improving Multitask Retrieval by Promoting Task Specialization (2023.tacl-1)

Copied to clipboard

Challenge: despite its practical appeal, naive multitask retrieval lags behind task-specific retrieval.
Approach: They propose to train a multitask retriever that promotes task specialization . the model is highly performant on the KILT benchmark .
Outcome: The proposed model outperforms task-specific retrievals on the KILT benchmark . it learns parameters that are more task-specialized than naive retrieval without prompting or adaptive learning.
ImpRAG: Retrieval-Augmented Generation with Implicit Queries (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems treat retrieval and generation as separate processes, requiring explicit textual queries to connect them.
Approach: They propose a query-free RAG system that integrates retrieval and generation into a unified model.
Outcome: The proposed system can achieve 3.6-11.5 accuracy improvements on unseen tasks . it allows models to express their information needs without human-specified queries .
Hiring Now: A Skill-Aware Multi-Attention Model for Job Posting Generation (2020.acl-main)

Copied to clipboard

Challenge: Creating job requirements is a crucial step in the recruiting process, but it is difficult to specify the level of education, experience, relevant skills per the job description.
Approach: They propose a conditional text generation task to generate job requirements based on job descriptions . they use a hierarchical decoder to label the job description with multiple skills . a skill knowledge graph is constructed to capture the global prior knowledge about skills based upon the model .
Outcome: The proposed method is evaluated on real-world job posting data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations