Papers by Zhenyu Lei
Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-Training (2023.acl-long)
Copied to clipboard
| Challenge: | a new method for dialogue representation and understanding is proposed . pre-trained language models (PLMs) are inappropriate for dialogue understanding tasks . |
| Approach: | They propose a method that trains pre-trained language models to fit dialogues . they use a hierarchical segment-wise self-attention network to model dialogues more comprehensively . |
| Outcome: | The proposed method outperforms existing models and achieves a 3.3% improvement on average. |
LongReward: Improving Long-context Large Language Models with AI Feedback (2025.acl-long)
Copied to clipboard
Jiajie Zhang, Zhongni Hou, Xin Lv, Shulin Cao, Zhenyu Hou, Yilin Niu, Lei Hou, Yuxiao Dong, Ling Feng, Juanzi Li
| Challenge: | In recent years, significant advancements have been achieved in the development of long-context large language models (LLMs). |
| Approach: | They propose a method that utilizes an off-the-shelf LLM to provide rewards for long-context model responses from four human-valued dimensions: helpfulness, logicality, faithfulness, and completeness. |
| Outcome: | The proposed method improves models’ long-context performance and enhances their ability to follow short instructions. |
Learning from Diverse Reasoning Paths with Routing and Collaboration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies suggest that the reasoning abilities of large language models (LLMs) grows with model size and pre-training data. |
| Approach: | They propose to combine quality filtering, conditional routing, and cooperative peer teaching to transfer knowledge from powerful teacher models to compact and transparent students. |
| Outcome: | Experiments show that QR-Distill is superior to traditional methods. |
Harnessing Large Language Models for Disaster Management: A Survey (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, including their emerging role in mitigating threats to human life, infrastructure, and the environment during natural disasters. |
| Approach: | They propose a taxonomy that categorizes existing LLMs based on disaster phases and application scenarios to provide valuable insights for the research community and practitioners . |
| Outcome: | The proposed taxonomy categorizes existing LLMs based on disaster phases and application scenarios. |
BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistency (2023.acl-long)
Copied to clipboard
Zhenyu Lei, Herun Wan, Wenqian Zhang, Shangbin Feng, Zilong Chen, Jundong Li, Qinghua Zheng, Minnan Luo
| Challenge: | Existing methods to identify bots rely on text or networks alone . text-graph interactions and semantic consistency are essential improvements to combat bot evolution. |
| Approach: | They propose to combine text-graph interaction and semantic Consistency to model Twitter bots' behavior based on attention weights and a text-graphic interaction module to enable information exchange across modalities in the learning process. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on two widely adopted datasets and the results are consistent with previous work. |
KCD: Knowledge Walks and Textual Cues Enhanced Political Perspective Detection in News Media (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches focus on leveraging textual content to identify stances, while they fail to reason with background knowledge or leverage the rich semantic and syntactic textual labels in news articles. |
| Approach: | They propose a political perspective detection approach that leverages news text to enable multi-hop knowledge reasoning and incorporates textual cues as paragraph-level labels. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on two benchmark datasets. |
From Cross-Task Examples to In-Task Prompts: A Graph-Based Pseudo-Labeling Framework for In-context Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning (ICL) enables large language models to perform novel tasks without parameter updates by conditioning on a few input-output examples. |
| Approach: | They propose a cost-efficient two-stage pipeline that reduces reliance on LLMs for data labeling. |
| Outcome: | The proposed pipeline reduces reliance on LLMs for data labeling . it leverages readily available cross-task examples to prompt an LLM and pseudo-label a small set of target task instances. |
KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to infuse knowledge graphs with pre-trained LMs are limited by the input sequence length. |
| Approach: | They propose a language model that leverages knowledge in local, document-level, and global contexts for long document understanding. |
| Outcome: | The proposed model achieves state-of-the-art on three long document understanding tasks across 6 datasets/settings. |