Papers by Philip Quirke
TinySQL: A Progressive Text-to-SQL Dataset for Mechanistic Interpretability Research (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL datasets are too complex and noisy for rigorous interpretability analysis. |
| Approach: | They propose text-to-SQL generation as an ideal task to study mechanistic interpretability . they use edge attribution patching and sparse autoencoders to identify minimal circuits . |
| Outcome: | The proposed task combines the formal structure of toy tasks with real-world complexity. |
Make Mechanistic Interpretability Auditable: A Call to Develop Guidelines via Continuous Collaborative Reviewing (2026.acl-long)
Copied to clipboard
Michael Lan, Narmeen Fatimah Oozeer, Chaithanya Bandi, Philip Quirke, Austin Meek, Fazl Barez, Amir Abdullah
| Challenge: | a recent paper found conflicting conclusions for the same behavior in a neural network . authors propose auditing MI itself is essential for its application in AI safety, industry, and governance . |
| Approach: | They propose to develop a system that can audit experiments to ensure validity . authors propose to generalize good practices found on platform into expert-verified guidelines . |
| Outcome: | a new review system could be developed that can be standardized and audited . authors argue that auditing MI is essential for its application in AI safety, industry, and governance . |