Papers by Andrew Halterman
Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence (2021.findings-acl)
Copied to clipboard
| Challenge: | a new corpus-level evaluation approach for event extraction is needed in social science applications . human annotations are often required to extract the actions of political actors and actors . a novel corpus evaluation approach can guide creation of similar social science-oriented resources . |
| Approach: | They propose a corpus-based approach to event extraction that integrates corpus evaluation with real-world social science . they use human annotations to read and label every document for mentions of police activity events . |
| Outcome: | The proposed method can guide creation of similar social-science-oriented resources in the future. |
Few-Shot Upsampling for Protest Size Detection (2021.findings-acl)
Copied to clipboard
| Challenge: | a common task in social science is "upsampling" coarse document labels to finegrained labels . a new task is proposed for "up-samping" coarse labels to more detailed information . |
| Approach: | They propose a task for "upsampling" coarse document labels to finegrained labels or spans . they use a question answering format to provide fine-grained label information . |
| Outcome: | The proposed method outperforms a pre-trained model on a small set of examples but is weaker on fewer examples. |
What is a protest anyway? Codebook conceptualization is still a first-order concern in LLM-era classification (2026.acl-long)
Copied to clipboard
| Challenge: | generative large language models (LLMs) are used extensively for text classification in computational social science . conceptualization of categories to classify and using LLM predictions can tempt analysts to skip conceptualization altogether. |
| Approach: | They argue that LLMs can tempt analysts to skip conceptualization altogether . they argue that conceptualization failures induce downstream inferential bias . |
| Outcome: | The proposed model can tempt analysts to skip conceptualization altogether . the proposed model is a first-order concern in the LLM-era . |