Papers by Sha Li

43 papers
Be Your Own Red Teamer: Safety Alignment via Self-Play and Reflective Experience Replay (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have remarkable capabilities but are vulnerable to adversarial “jailbreak” attacks designed to bypass safety guardrails.
Approach: They propose to empower a large language model to be its own red teamer . safety self-play allows the model to act as both the Attacker and Defender .
Outcome: The proposed approach outperforms baselines trained on static adversarial datasets and establishes a new benchmark for proactive safety alignment.
GLEN: General-Purpose Event Detection for Thousands of Types (2023.emnlp-main)

Copied to clipboard

Challenge: ACE 2005 2 is the first large-scale event extraction dataset with 205K event mentions and 3,465 different types.
Approach: They propose to use the DWD Overlay to map PropBank rolesets to a large distantlysupervised training dataset with partial labels to make event extraction more accessible.
Outcome: The proposed model performs better than baselines including InstructGPT and ACE 2005 2 despite being 18 years old . key limitations of ACE include its small event ontology of 33 types, small dataset size of around 600 documents and restricted domain (with a significant portion concentrated on military conflicts).
The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Prediction (2021.emnlp-main)

Copied to clipboard

Challenge: Event schemas encode knowledge of stereotypical structures of events and their connections . previous work on event schema induction focuses on atomic events or linear temporal sequences .
Approach: They propose a Temporal Complex Event Schema: a graph-based schema representation that encompasses events, arguments, temporal connections and argument relations.
Outcome: The proposed model outperforms existing models on HITS@1 by 17.8%.
Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning (D18-1)

Copied to clipboard

Challenge: Existing dialog datasets rely on human labeling, which is expensive, limited in size, and in low coverage.
Approach: They propose a framework to automatically cluster dialogue intents and slots . they collect context features, leverage an autoencoder for feature assembly, and adapt a dynamic hierarchical clustering method for intent and slot labeling.
Outcome: The proposed framework can promote human labeling cost to a great extent and achieve good intent clustering accuracy (84.1%) it also provides reasonable and instructive slot labeling results.
ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing tools for detecting safety issues in LLMs are expensive and inefficient.
Approach: They propose an LLM-based safety detector which annotates the safety of queries and provides explanations for its decisions.
Outcome: The proposed detector outperforms baselines on four sets of query-response pairs and is effective as a safety evaluator for advanced LLMs.
Eider: Empowering Document-level Relation Extraction with Efficient Evidence Extraction and Inference-stage Fusion (2022.findings-acl)

Copied to clipboard

Challenge: Document-level relation extraction (DocRE) aims to extract semantic relations among entity pairs in a document.
Approach: They propose an evidence-enhanced framework that empowers document-level relation extraction (DocRE) Eider efficiently extracts evidence and effectively fuses extracted evidence in inference.
Outcome: The proposed framework outperforms state-of-the-art methods on three benchmark datasets.
The Reasoning Trap: How Enhancing LLM Reasoning Amplifies Tool Hallucination (2026.acl-long)

Copied to clipboard

Challenge: Recent studies suggest that strengthening reasoning often coincides with increased hallucination . however, no prior work has examined whether reasoning enhancement itself causes tool hallucinism .
Approach: They propose a diagnostic benchmark measuring tool hallucination in two failure modes . they demonstrate a causal relationship between enhancing reasoning and tool hallubulation .
Outcome: The proposed benchmark measures tool hallucination in two failure modes: no tool available, and (ii) only distractor tools available.
Human-in-the-loop Schema Induction (2023.acl-demo)

Copied to clipboard

Challenge: Existing approaches to event-centric natural language understanding (NLU) have been limited to linear and temporal ones.
Approach: They propose a human-in-the-loop schema induction system powered by GPT-3 . they show that it transfers to new domains more easily than previous approaches .
Outcome: The proposed system transfers to new domains more easily than previous approaches and reduces human curation.
EVEDIT: Event-based Knowledge Editing for Deterministic Knowledge Propagation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge editing approaches only operate on (subject, relation, object) triple . current methods are limited to (substance, relation) triple, causing low confidence in their answers.
Approach: They propose a task of event-based knowledge editing that pairs facts with event descriptions to improve model confidence.
Outcome: The proposed method improves model confidence by 55.6% while maintaining the naturalness of generation.
Document-Level Event Argument Extraction by Conditional Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing event extraction models have been limited to the sentence level . this formulation signifies a misalignment between the information seeking behavior and the informative seeking behavior.
Approach: They propose a document-level neural event argument extraction model by formulating the task as conditional generation following event templates.
Outcome: The proposed model achieves 7.6% F1 and 5.7% F1 over the best baseline on the document-level event extraction dataset WikiEvents and 9.3% F1 on the informative argument extraction task.
Code4Struct: Code Generation for Few-Shot Event Structure Prediction (2023.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) trained on a mixture of text and code have demonstrated impressive capability in translating natural language (NL) into structured code.
Approach: They propose to use programming language (PL) inheritance and type annotations to translate text into code to tackle structured prediction tasks.
Outcome: The proposed model outperforms existing models on 20-shot data by 29.5% absolute F1.
Instruct and Extract: Instruction Tuning for On-Demand Information Extraction (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models with instruction-following capabilities are not suitable for long-tail ad hoc extraction use cases for non-expert users.
Approach: They propose a task that follows instructions to extract the desired content from the associated text and present it in a structured tabular format.
Outcome: The proposed paradigm outperforms existing open-source models of similar size in terms of information extraction.
Open Relation and Event Type Discovery with Type Abstraction (2022.emnlp-main)

Copied to clipboard

Challenge: Conventional "closed-world" information extraction methods rely on human ontologies to define scope for extraction.
Approach: They propose a type abstraction approach where models are prompted to generalize and name the type . they use the similarity between inferred names to induce clusters .
Outcome: The proposed method is complementary to token representations on relation extraction and event extraction datasets.
RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System (2021.naacl-demos)

Copied to clipboard

Challenge: We present a new information extraction system that can construct temporal event graphs from news documents.
Approach: They propose a temporal event graph extraction system that can extract news documents . they extend the system from sentence-level event extraction to cross-document cross-media event extraction .
Outcome: The proposed system can extract temporal event graphs from news documents in multiple languages and multiple data modalities.
Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play (2024.emnlp-demo)

Copied to clipboard

Challenge: Complex news events require swift responses from government and society, authors say . relying on historical events to project the future is insufficient, they say - a simulator for complex news events is needed .
Approach: They propose a controllable complex news event simulator guided by event schema and user-provided assumptions . they incorporate a geo-diverse commonsense and cultural norm-aware knowledge enhancement component .
Outcome: The proposed simulator achieves higher coherence and appropriateness than existing models.
EpiGEN: An Efficient Multi-Api Code GENeration Framework under Enterprise Scenario (2024.lrec-main)

Copied to clipboard

Challenge: Existing approaches to large language models fail to meet expectations for code generation tasks . existing approaches are faced with drawbacks of high resource consumption and inadequate handling of multi-API tasks.
Approach: They propose an Efficient multi-Api code GENeration framework that uses private APIs to pre-train LLMs.
Outcome: The proposed framework shows good acceptability and readability on single-GPU tasks compared to fully fine-tuned LLMs with a larger number of parameters.
MACAROON: Training Vision-Language Models To Be Your Engaged Partners (2024.findings-emnlp)

Copied to clipboard

Challenge: Large vision-language models (LVLMs) generate detailed responses even when questions are ambiguous or unanswerable, leading to hallucinations and bias issues.
Approach: They propose a three-tiered hierarchy for questions of invalid, ambiguous, and personalizable nature to measure the proactive engagement capabilities of LVLMs.
Outcome: The proposed model generates contrastive response pairs for unlabeled questions, achieving 0.84 AAR, while maintaining comparable performance on general tasks.
RESIN-EDITOR: A Schema-guided Hierarchical Event Graph Visualizer and Editor (2023.emnlp-demo)

Copied to clipboard

Challenge: Existing IE tools for atomic events are limited when applied to such complex events.
Approach: They propose to use event schemas to guide the organization of complex events and to edit hierarchical graphs.
Outcome: The proposed tool outperforms existing IE visualization tools in both IE result analysis and general model improvements.
Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on single-turn scenarios, which might lack the ability to handle multi-turn interactions.
Approach: They propose a conversational agent that interleaves search and reasoning across turns and provides tailored rewards towards evolving user goals.
Outcome: The proposed agent interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training with tailored rewards towards evolving user goals.
A Unified Generative Framework for Bilingual Euphemism Detection and Identification (2024.findings-acl)

Copied to clipboard

Challenge: Existing euphemism datasets are only domain-specific or language-specific.
Approach: They propose a unified model to jointly conduct bilingual euphemism detection and identification tasks.
Outcome: The proposed model is effective and provides a new reference standard for euphemism detection and identification.
A Language-First Approach for Procedure Planning (2023.findings-acl)

Copied to clipboard

Challenge: Developing intelligent agents requires the ability to produce plans on the fly based on visual observations.
Approach: They propose a language-first procedure planning framework with a modularized design . they first align current and goal observations with corresponding steps and then use a pre-trained LM to predict intermediate steps.
Outcome: The proposed framework matches state-of-the-art procedures on COIN and CrossTask benchmarks.
LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts (2025.acl-long)

Copied to clipboard

Challenge: Current safety training focuses on teaching models to reject harmful queries, but recent research shows that adversarial attacks or jailbreak methods bypass these safety mechanisms.
Approach: They propose to use a new attack method to craft multi-turn toxic prompts that gradually lead LLMs to reveal unsafe content.
Outcome: The proposed method outperforms existing methods in diversity, effectiveness, and efficiency across aligned LLMs.
Defining a New NLP Playground (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent explosion of performance of large language models (LLMs) has changed the field more abruptly and seismically than any other shift in the field’s 80 year history.
Approach: They propose 20+ PhD-dissertation-worthy research directions to define a new NLP playground by combining theoretical analysis, new and challenging problems, learning paradigms and interdisciplinary applications.
Outcome: The proposed research will cover theoretical analysis, new and challenging problems, learning paradigms and interdisciplinary applications.
Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies show that fine-tuning with benign data can compromise safety of aligned LLMs.
Approach: They propose a Layer-Aware Representation Filtering method that detects safety-degrading layers within the LLM and leverages their representations to detect them.
Outcome: The proposed method can detect safety-degrading features in benign data and remove them from the model.
FanChuan: A Multilingual and Graph-Structured Benchmark For Parody Detection and Analysis (2025.findings-acl)

Copied to clipboard

Challenge: Parody is an emerging phenomenon on social media, where individuals imitate a role or position opposite to their own . limited available data and deficient diversity in current datasets hinder study of parody .
Approach: They build a dataset of parody users and annotated comments from both English and Chinese corpora to test parody detection and comment sentiment analysis.
Outcome: The proposed datasets provide richer contextual information, which is lacking in existing datasets.
LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Current medical benchmarks have limitations in question design, data sources and evaluation methods.
Approach: They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records .
Outcome: The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios.
Text2DB: Integration-Aware Information Extraction with Large Language Model Agents (2024.findings-acl)

Copied to clipboard

Challenge: Current methods for information extraction (IE) focus on integrating IE output with the database . a long-overlooked question is what counts as "relevant knowledge"
Approach: They propose a task that emphasizes integration of IE output and the database . they introduce a benchmark and an LLM agent framework for this task .
Outcome: The proposed task integrates IE output and the target database (or knowledge base) it meets common demands such as data infilling, row population, and column addition .
Dynamic Global Memory for Document-level Argument Extraction (2022.acl-long)

Copied to clipboard

Challenge: Recent work on document-level event argument extraction is restricted by sequence length constraints and ignores global context between events.
Approach: They propose to construct a document memory store to extract contextual event information and leverage it to implicitly and explicitly help with decoding of arguments for later events.
Outcome: The proposed framework outperforms prior methods and is more robust to adversarially annotated examples with constrained decoding design.
Towards Harmonized Uncertainty Estimation for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional capabilities in handling a wide range of downstream tasks.
Approach: They propose a method that employs a lightweight model trained on data aligned with the target LLM’s performance to adjust uncertainty scores.
Outcome: The proposed method achieves improvements of up to 60% over existing methods.
DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreak (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are susceptible to generating harmful content when prompted with carefully crafted inputs, a vulnerability known as LLM jailbreaking.
Approach: They propose an end-to-end generative approach for jailbreak rewriting inspired by diffusion models that uses a sequence-tosequence (seq2sequ) diffusion model as a generator, conditioning on the original prompt and guiding the denoising process with a novel attack loss.
Outcome: Experiments on Advbench and Harmbench show that the proposed method outperforms autoregressive jailbreak models across evaluation metrics including ASR, fluency, diversity and diversity.
From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design (2026.acl-industry)

Copied to clipboard

Challenge: LaySPA equips large language models (LLMs) with explicit and interpretable spatial reasoning for content-aware graphic layout design.
Approach: They propose a reinforcement learning framework that equips large language models (LLMs) with explicit spatial reasoning for content-aware graphic layout design.
Outcome: Experiments show that LaySPA outperforms larger LLMs in structural validity and visual quality while requiring fewer annotated samples.
OpenPI-C: A Better Benchmark and Stronger Baseline for Open-Vocabulary State Tracking (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on state tracking assumes both entities and state space are known, which limits their applicability.
Approach: They propose a two-stage model that refines the state change prediction conditioned on entities predicted from the first stage.
Outcome: The proposed model improves on the cleaned dataset and the evaluation metric on the proposed model.
How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have focused on dialogue simulation while overlooking human behavior simulation, which is crucial for digital twins.
Approach: They propose to integrate persona metadata into LLMs and use it to iteratively infer contextually appropriate behaviors within dynamic scenarios.
Outcome: The proposed model is based on 15,846 distinct behaviors across 1,001 unique personas and incorporates persona metadata to iteratively infer appropriate behaviors within dynamic scenarios.
ASETF: A Novel Method for Jailbreak Attack on LLMs through Translate Suffix Embeddings (2024.emnlp-main)

Copied to clipboard

Challenge: Attaching suffixes to harmful instructions can hack the defense of Large language models (LLMs) However, due to the unreadable of adversarial suffix, it can be relatively easily penetrated by common defense methods such as perplexity filters.
Approach: They propose an algorithm to embed adversarial suffixes into coherent and understandable text to attack Large language models (LLMs) using a Advbench dataset.
Outcome: The proposed approach reduces the computation time of adversarial suffixes and achieves a much better attack success rate than existing techniques.
HAUNTATTACK: When Attack Follows Reasoning as a Shadow (2026.findings-acl)

Copied to clipboard

Challenge: Emerging Large Reasoning Models (LRMs) excel in mathematical and reasoning tasks, showcasing remarkable capabilities.
Approach: They propose a framework that embeds harmful instructions into reasoning questions . they evaluate 11 LRMs and observe an average attack success rate of over 70% .
Outcome: The proposed framework improves reasoning models by 13 percentage points over baseline.
Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verification (2023.acl-long)

Copied to clipboard

Challenge: Recent methods for event schema induction use information extraction systems to construct event graph instances from documents . compared to the previous state-of-the-art closed-domain schema inducing model, human assessors were able to cover 10% more events when translating the schemas into coherent stories .
Approach: They propose to treat event schemas as commonsense knowledge that can be derived from large language models.
Outcome: The proposed method simplifies the schema induction process and improves readability.
Bigger Data or Fairer Data? Augmenting BERT via Active Sampling for Educational Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Pretrained Language Models (PLMs) encode bias against protected groups in the representations they learn, which may harm the prediction fairness of downstream models.
Approach: They propose to quantify the awareness that a pretrained language model (BERT) has regarding people’s protected attributes and augment it to enhance prediction fairness of downstream models.
Outcome: The proposed method improves fairness and accuracy of models by inhibiting the awareness of protected attributes in the PLMs.
The Law of Knowledge Overshadowing: Towards Understanding, Predicting and Preventing LLM Hallucination (2025.findings-acl)

Copied to clipboard

Challenge: Hallucination is a persistent challenge in large language models where even with rigorous quality control, models often generate distorted facts.
Approach: They propose a new framework to quantify factual hallucinations by modeling knowledge overshadowing.
Outcome: The proposed framework improves model factuality on Overshadow (27.9%), MemoTrap (13.1%) and NQ-Swap (18.3%).
Be a Multitude to Itself: A Prompt Evolution Framework for Red Teaming (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have gained increasing attention for their capacity to generate harmful content.
Approach: They propose a scalable evolution framework to evolve red teaming prompts across breadth and depth dimensions, facilitating automatic generation of numerous high-quality and diverse red team prompts.
Outcome: The proposed framework surpasses existing red teaming methods on attack success rate and diversity.
Non-Sequential Graph Script Induction via Multimedia Grounding (2023.acl-long)

Copied to clipboard

Challenge: Existing scripts for everyday tasks are presented in a linear manner, which does not reflect the flexibility displayed by people executing tasks in real life.
Approach: They propose to use loosely aligned videos to train a non-sequential graph script induction task by using a multimodal framework to ground procedural videos to WikiHow textual steps.
Outcome: The proposed model outperforms the WikiHow linear baseline by 48.76% . it can predict future steps given a partial step sequence and generate explicit graph scripts .
Enhancing Knowledge Selection for Grounded Dialogues via Document Semantic Graphs (2022.naacl-main)

Copied to clipboard

Challenge: Existing conversation models treat knowledge selection as a sentence ranking problem where each sentence is handled individually, ignoring the internal semantic connection between sentences.
Approach: They propose to automatically convert background knowledge documents into document semantic graphs and perform knowledge selection over such graphs.
Outcome: The proposed model improves on the knowledge selection task and the response generation task on HollE and generalizes on unseen topics in WoW.
Open-Vocabulary Argument Role Prediction For Event Extraction (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on event extraction depend on pre-defined argument roles . despite great progress, many studies still rely on hand-crafted ontologies .
Approach: They propose an unsupervised framework for customizing argument roles for event extraction . they propose a human-annotated event extraction dataset with 143 customized argument roles .
Outcome: The proposed framework outperforms existing methods on an event extraction dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations