Papers by Emre Kazim
From Text to Emoji: How PEFT-Driven Personality Manipulation Unleashes the Emoji Potential in LLMs (2025.findings-naacl)
Copied to clipboard
Navya Jain, Zekun Wu, Cristian Enrique Munoz Villalobos, Airlie Hilliard, Xin Guan, Adriano Koshiyama, Emre Kazim, Philip Colin Treleaven
| Challenge: | Methods like prompt-based In-Context Knowledge Editing and gradient-based Model Editor Networks (MEND) show irregularity and variability; IKE depends on the prompt, leading to variability and sensitivity; MEND yields inconsistent and gibberish outputs. |
| Approach: | They employ Opinion QA Based Parameter-Efficient Fine-Tuning (PEFT) to manipulate the Big Five personality traits: Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism. |
| Outcome: | The proposed methods show that they are more accurate than prompt-based IKE and gradient-based MEND outputs. |
LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Libraries (2025.acl-srw)
Copied to clipboard
Zekun Wu, Seonglae Cho, Umar Mohammed, Cristian Enrique Munoz Villalobos, Kleyton Da Costa, Xin Guan, Theo King, Ze Wang, Emre Kazim, Adriano Koshiyama
| Challenge: | Open-source AI libraries present significant, underexamined risks spanning security, licensing, maintenance, supply chain integrity, and regulatory compliance. |
| Approach: | They propose a system that leverages large language models and agentic workflows to perform deep, evidence-based evaluations of open-source AI libraries. |
| Outcome: | The proposed system covers up to 88% of OpenSSF Scorecard checks and uncovers 19 additional risks per library. |
SAGED: A Holistic Bias-Benchmarking Pipeline for Language Models with Customisable Fairness Calibration (2025.coling-main)
Copied to clipboard
Xin Guan, Nate Demchak, Saloni Gupta, Ze Wang, Ediz Ertekin Jr., Adriano Koshiyama, Emre Kazim, Zekun Wu
| Challenge: | Existing benchmarks for large language models fail to detect bias due to limited scope, contamination, and lack of a fairness baseline. |
| Approach: | They propose a benchmarking pipeline to detect biases in large language models . they use metrics for max disparity, impact ratio, and bias concentration to analyze disparity . |
| Outcome: | SAGED(bias) is the first holistic benchmarking pipeline to address biases in large language models. |