Papers by Zhengxuan Lu
Structured Episodic Event Memory (2026.acl-long)
Copied to clipboard
| Challenge: | Current approaches to memory in Large Language Models (LLMs) rely on static Retrieval-Augmented Generation (RAG) this lacks the cognitive organization necessary to model the dynamic and associative nature of long-term interaction. |
| Approach: | They propose a hierarchical framework that transforms interaction streams into structured Episodic Event Frames (EEFs) anchored by precise provenance pointers. |
| Outcome: | The proposed framework outperforms baseline approaches on LoCoMo and LongMemEval benchmarks. |
Causal Distillation for Language Models (2022.naacl-main)
Copied to clipboard
Zhengxuan Wu, Atticus Geiger, Joshua Rozner, Elisa Kreiss, Hanson Lu, Thomas Icard, Christopher Potts, Noah Goodman
| Challenge: | Distillation efforts have led to language models that are more compact and efficient without serious drops in performance. |
| Approach: | They propose to augment distillation with a third objective that encourages the student model to imitate the causal dynamics of the teacher through a distillation interchange intervention training objective (DIITO). |
| Outcome: | The proposed method lowers perplexity on the WikiText-103M corpus and improves on the GLUE benchmark, SQuAD, and CoNLL-2003. |