Papers by Shaobo Liu

7 papers
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis (2022.findings-acl)

Copied to clipboard

Challenge: Recent studies show that pre-trained language models can fill in the missing factual words in cloze-style prompts such as ”Dante was born in [MASK]” .
Approach: They propose to quantitatively measure and evaluate the word-level patterns that PLMs depend on to generate the missing factual words.
Outcome: The proposed model fills in the missing factual words in cloze-style prompts by relying on effective clues or shortcut patterns.
Conditional Dichotomy Quantification via Geometric Embedding (2025.acl-long)

Copied to clipboard

Challenge: Existing methods that rely on semantic similarity fail to capture the nuanced oppositional dynamics essential for these applications.
Approach: They propose a task that formalizes the measurement of conditional dichotomy by using a dichotomian framework.
Outcome: The proposed framework provides carefully constructed datasets covering debate, defeasible inference, and causal reasoning scenarios.
Exploiting Contextual Information via Dynamic Memory Network for Event Detection (D18-1)

Copied to clipboard

Challenge: Existing methods for event detection only process context once . a multi-hop mechanism to capture contextual information improves performance .
Approach: They propose to use dynamic memory network to capture contextual information . they propose to model event triggers by identifying word or phrase which most represents it .
Outcome: The proposed model achieves best F1 score compared to the state-of-the-art models.
Disentangle-based Continual Graph Representation Learning (2020.emnlp-main)

Copied to clipboard

Challenge: Existing graph embedding methods overlook streaming nature of incoming data in real-world applications.
Approach: They propose a disentangle-based continual graph representation learning framework inspired by the human’s ability to learn procedural knowledge.
Outcome: The proposed framework outperforms state-of-the-art continual graph representation learning framework and alleviate catastrophic forgetting problem.
FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosure (2026.acl-demo)

Copied to clipboard

Challenge: FinReporting is an agentic workflow for localized cross-jurisdiction financial reporting . existing approaches assume a single-market setting and overlook structural differences across jurisdictions .
Approach: They propose a workflow that decomposes financial reporting into auditable stages . they use Large Language Models to extract and summarize corporate disclosures .
Outcome: The proposed system decomposes reporting into auditable stages . it improves consistency and reliability under heterogeneous reporting regimes.
Pre-training Language Models with Deterministic Factual Knowledge (2022.emnlp-main)

Copied to clipboard

Challenge: Existing studies show that Pre-trained Language Models fail to capture factual knowledge robustly.
Approach: They propose to let PLMs learn the deterministic relationship between context and masked content to improve their ability to capture factual knowledge.
Outcome: The proposed methods improve accuracy and consistency of factual knowledge capturing and boost performance of other knowledge-intensive tasks.
MelTrim: Coarse-to-Fine Data Pruning for Speech Classification (2026.findings-acl)

Copied to clipboard

Challenge: Unlike image or text classification, speech classification tasks are particularly challenging due to the difficulty in capturing the acoustic, semantic, and contextual representations.
Approach: They propose a dataset pruning method that coarsely filters redundant samples using DBSCAN clustering on Mel-Frequency Cepstral Coefficients (MFCC) features.
Outcome: The proposed method achieves 49.5% improvement in WA on the MEAD dataset and 41.9% reduction in EER on speaker identification tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations