Papers by Daniel Zeng
LDM2: A Large Decision Model Imitating Human Cognition with Dynamic Memory Enhancement (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Extensive experiments conducted in two interactive environments have shown that our LDM2 outperforms the baselines in terms of both score and success rate. |
| Approach: | They propose a large decision model with memory that leverages a dynamic memory mechanism to construct dynamic prompts, guiding the LLMs in making proper decisions according to the faced state. |
| Outcome: | The proposed model outperforms baseline models in two interactive environments in terms of score and success rate. |
LAW: Legal Agentic Workflows for Custody and Fund Services Contracts (2025.coling-industry)
Copied to clipboard
William Watson, Nicole Cho, Nishan Srishankar, Zhen Zeng, Lucas Cecchi, Daniel Scott, Suchetha Siddagangappa, Rachneet Kaur, Tucker Balch, Manuela Veloso
| Challenge: | Currently, there are limited resources available to build a legal domain-specific Large Language Model (LLM) however, legal contracts are highly varied not only in terms of semantics but also accessibility. |
| Approach: | They propose a Large Language Model (LLM) that integrates multiple specialized agents and text agents to respond to user queries. |
| Outcome: | The proposed model outperforms the baseline model in complex tasks such as calculating a contract’s termination date by 92.9% points. |
Modeling Conceptual Attribute Likeness and Domain Inconsistency for Metaphor Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Metaphor detection aims to distinguish between metaphorical and literal expressions in text. |
| Approach: | They propose an attribute likeness and domain inconsistency learning framework for wordpair metaphor detection based on conceptual metaphor theory . they model attribute likeity with an attribute siamese network and devise a domain contrastive learning strategy to learn semantic inconsistentness of concepts in source and target domains . |
| Outcome: | The proposed framework outperforms existing word-pair and token-level methods on four datasets. |
HelpSteer3: Human-Annotated Feedback and Edit Data to Empower Inference-Time Scaling in Open-Ended General-Domain Tasks (2025.acl-long)
Copied to clipboard
Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Daniel Egert, Ellie Evans, Hoo-Chang Shin, Felipe Soares, Yi Dong, Oleksii Kuchaiev
| Challenge: | Inference-Time Scaling is critical to the success of recent models such as OpenAI o1 and DeepSeek R1 . however, many techniques require tasks to have answers that can be verified . |
| Approach: | They use data to train dedicated Feedback and Edit Models capable of inference-time scaling for open-ended tasks. |
| Outcome: | The proposed model can reach SoTA performance on Arena Hard at 92.7 as of 5 Mar 2025. |
Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have underscored their exceptional reasoning prowess with natural language understanding across a broad spectrum of tasks. |
| Approach: | They examine whether Large Language Models actively recall or retrieve their internal repositories of factual knowledge when faced with reasoning tasks. |
| Outcome: | The proposed model improves reasoning performance while suppressing it leads to notable degradation. |
HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM (2024.naacl-long)
Copied to clipboard
Zhilin Wang, Yi Dong, Jiaqi Zeng, Virginia Adams, Makesh Narsimhan Sreedhar, Daniel Egert, Olivier Delalleau, Jane Scowcroft, Neel Kant, Aidan Swope, Oleksii Kuchaiev
| Challenge: | Existing helpfulness preference datasets do not specify what makes some responses more helpful and others less helpful. |
| Approach: | They use a dataset that has annotated for correctness, coherence, complexity, and verbosity. |
| Outcome: | The dataset has annotations for correctness, coherence, complexity, and verbosity in addition to overall helpfulness of responses. |
Knowledge-Enhanced Natural Language Inference Based on Knowledge Graphs (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to natural language inference rely on semantic knowledge, but background knowledge is limited to a few specific types. |
| Approach: | They propose a Knowledge Graph-enhanced NLI model that leverages background knowledge stored in knowledge graphs to facilitate inference. |
| Outcome: | The proposed model can leverage background knowledge stored in knowledge graphs to perform the task. |
An LLM-Enabled Knowledge Elicitation and Retrieval Framework for Zero-Shot Cross-Lingual Stance Identification (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research is conducted in monolingual setting on English datasets, whereas in other low-resource languages, it lacks sufficient data for training quality stance detection models. |
| Approach: | They propose a knowledge elicitation and retrieval framework that leverages the capability of large language models for stance knowledge acquisition and matches the target language input to the most relevant stance information. |
| Outcome: | The proposed framework improves on multilingual datasets and competitive baselines. |
Evaluating Generalization Capability of Language Models across Abductive, Deductive and Inductive Logical Reasoning (2025.coling-main)
Copied to clipboard
| Challenge: | Recent research in language models (LMs) have demonstrated remarkable performance on many natural language tasks, yet to what extent LMs possess the capability of generalizing to unseen logical rules remains unclear. |
| Approach: | They propose to use a dataset to assess the generalization capabilities of LMs on ADI reasoning to assess their generalization abilities. |
| Outcome: | The proposed dataset shows that LMs perform poorly on ADI reasoning tasks and lacks generalization capabilities. |