Papers by Jackie Ma
MADE: A Living Benchmark for Multi-Label Text Classification with Uncertainty Quantification of Medical Device Adverse Events (2026.acl-long)
Copied to clipboard
| Challenge: | Existing MLTC benchmarks are saturated and may be affected by training data contamination. |
| Approach: | They propose a machine learning benchmark based on medical device adverse event reports . they establish baselines across 20 encoder- and decoder-only models . |
| Outcome: | The proposed benchmarks show that small fine-tuned models achieve the strongest head-to-tail accuracy while maintaining competitive UQ. |
From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguards (2024.findings-acl)
Copied to clipboard
Khaoula Chehbouni, Megha Roshan, Emmanuel Ma, Futian Wei, Afaf Taik, Jackie Cheung, Golnoosh Farnadi
| Challenge: | Recent advances in large language models have also introduced additional safety risks and raised concerns regarding their detrimental impact on already marginalized populations. |
| Approach: | They propose to use LLMs to evaluate their safety responses on already mitigated biases by evaluating models on already encoded assumptions. |
| Outcome: | The proposed model can encode harmful assumptions, but it can also be harmful for certain demographic groups. |