Papers by Lidong Zhou
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | a new text generation dataset is needed to controllable text summarization, but it lacks the domain knowledge. |
| Approach: | They propose to use existing text generation datasets to leverage input and control signals . they propose to annotate each meta-review sentence manually with a control signal . |
| Outcome: | The proposed method can be used to control the structure of a text generation dataset . it can be applied to a variety of tasks, including a task with a large number of meta-review sentences . |
ConNER: Consistency Training for Cross-lingual Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing consistency training methods for named entity recognition (NER) are likely to violate the consistency hypothesis or focus on coarse-grain consistency. |
| Approach: | They propose a consistency training framework for cross-lingual named entity recognition that leverages unlabeled target-language data and dropout-based consistency training on labeled source-language datasets. |
| Outcome: | The proposed framework improves on translation-based consistency training on unlabeled target-language data and dropout-based consistent training on labeled source-language datasets. |
Enhancing Cross-lingual Prompting with Dual Prompt Augmentation (2023.findings-acl)
Copied to clipboard
| Challenge: | a recent study shows that prompting is superior for multilingual/cross-lingual problems . despite its effectiveness on English tasks, its potential for cross-lingual problem is under-explored . |
| Approach: | They propose a framework for prompting that can be used to augment cross-lingual prompts. |
| Outcome: | The proposed framework achieves 46.54% with only 16 English training examples per class, significantly better than fine-tuning. |
MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER (2022.acl-long)
Copied to clipboard
| Challenge: | Named entity recognition (NER) tasks have limited amount of labeled data . data augmentation methods suffer from token-label misalignment, which leads to unsatsifactory performance. |
| Approach: | They propose a data augmentation framework that explicitly injects NER labels into sentence context and generates high-quality augmented data with novel entities. |
| Outcome: | The proposed framework outperforms baseline methods on low-resource tasks. |
EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoning (2026.acl-long)
Copied to clipboard
Chuanrui Hu, Xingze Gao, Zuyi Zhou, Dannong Xu, Yi Bai, Xintong Li, Hui Zhang, Tong Li, Chong Zhang, Lidong Bing, Yafeng Deng
| Challenge: | Existing memory systems for LLMs store isolated records and retrieve fragments . Existing systems store isolated data and fragments, limiting their ability to consolidate evolving experience and resolve conflicts. |
| Approach: | They propose an engram-inspired memory operating system that implements an 'engram'-inspired lifecycle for computational memory. |
| Outcome: | Experiments on LoCoMo, LongMemEval, and PersonaMeM-v2 show that EverMemeOS outperforms state-of-the-art methods on memory-augmented reasoning tasks. |
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding (2021.acl-long)
Copied to clipboard
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
| Challenge: | Existing pre-training tasks for text and layout are effective in visually-rich document understanding tasks. |
| Approach: | They propose to combine pre-training tasks with a multi-modal model to model interaction between text, layout and image in a single multi-module framework. |
| Outcome: | The proposed model outperforms LayoutLM by a large margin on visual-rich document understanding tasks. |
Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to bridge the linguistic gap between self-training and monolingual named entity recognition (NER) however, due to sub-optimal performance on target languages, the pseudo labels are noisy and limit the overall performance. |
| Approach: | They propose to combine representation learning and pseudo label refinement in one coherent framework to improve self-training for cross-lingual named entity recognition (NER) |
| Outcome: | The proposed method improves cross-lingual named entity recognition (NER) on multiple transfer pairs. |