Papers with EBM
Triple-Hybrid Energy-based Model Makes Better Calibrated Natural Language Understanding Models (2023.eacl-main)
Copied to clipboard
| Challenge: | In-distribution (ID) miscalibration and out-of-difference (OOD) detection are main concerns for pre-trained language models. |
| Approach: | They propose a triple-hybrid EBM which combines the benefits of classifier, conditional generative model and marginal generative models altogether. |
| Outcome: | The proposed model outperforms previous methods in terms of ID calibration and OOD detection by a large margin while maintaining competitive accuracy. |
Transferable Direct Prompt Injection via Activation-Guided MCMC Sampling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show superior cross-model transferability . Prompt injection attacks are among the most critical threats . |
| Approach: | They propose an activations-guided prompt injection attack framework to address the impracticality of existing white-box/gray-box methods and the poor transferability of black-box approaches. |
| Outcome: | The proposed framework achieves 49.6% success rate and 34.6% improvement over human-crafted prompts on five mainstream LLMs. |
Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing calibration methods rescale posterior distributions of classifiers after training. |
| Approach: | They propose to use a noise contrastive estimation technique to train an energy-based model during finetuning of pretrained text encoders. |
| Outcome: | The proposed model can reach a better calibration competitive to strong baselines with little or no loss in accuracy. |
Natural Language Processing in Support of Evidence-based Medicine: A Scoping Review (2025.findings-acl)
Copied to clipboard
| Challenge: | Evidence-based medicine (EBM) is at the forefront of modern healthcare, emphasizing the use of the best available scientific evidence to guide clinical decisions. |
| Approach: | They propose to investigate the use of Natural Language Processing (NLP) techniques to identify, appraise, synthesize, apply, and disseminate evidence in EBM. |
| Outcome: | The proposed methods support the five fundamental steps of EBM—Ask, Acquire, Appraise, Apply, and Assess. |
Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy (2026.acl-long)
Copied to clipboard
Eric Hanchen Jiang, Weixuan Ou, Run Liu, Shengyuan Pang, Guancheng Wan, Ranjie Duan, Wei Dong, Kai-Wei Chang, XiaoFeng Wang, Ying Nian Wu, Xinfeng Li
| Challenge: | Existing safety alignment techniques prioritize mitigating harmful responses at the expense of overcautious behavior, leading models to incorrectly refuse benign requests. |
| Approach: | They propose a fine-tuning free framework to improve safety and reduce false refusals by dynamic, inference-time intervention. |
| Outcome: | The proposed framework raises compliance on the ORB-H benchmark from 57.3% to 82.6% while maintaining the baseline safety performance. |