Papers by Pingyi Hu

2 papers
RESF: Regularized-Entropy-Sensitive Fingerprinting for Black-Box Tamper Detection of Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for tamper detection rely on model stability, not inherently stochastic models.
Approach: They propose a hypothesis-testing method for black-box tamper detection for LLMs . they propose regularized entropy-sensitive fingerprinting to enable efficient fingerprinting .
Outcome: The proposed method achieves 98.80% detection accuracy under challenging conditions . it is based on a first-order surrogate for KL divergence to identify prompts most responsive to parameter perturbations.
ESF: Efficient Sensitive Fingerprinting for Black-Box Tamper Detection of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly utilized in diverse applications, including code generation, legal document analysis, medical diagnosis, and decision-making.
Approach: They propose a fingerprinting method tailored for black-box tamper detection of large language models.
Outcome: The proposed method detects tampering with a 99.2% detection rate using 5 fingerprint samples across state-of-the-art LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations