Papers by Adrian Benton
Improving Informally Romanized Language Identification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Latin script is often used to informally write languages with non-Latin native scripts, resulting in high spelling variability. |
| Approach: | They propose to improve methods used to synthesize training sets to incorporate natural spelling variations into training sets. |
| Outcome: | The proposed method improves test F1 from the reported 74.7% (using a pretrained neural model) to 85.4% (using the linear classifier trained solely on synthetic data). |
Weakly Supervised Headline Dependency Parsing (2022.findings-emnlp)
Copied to clipboard
| Challenge: | English news headlines have unique syntactic properties documented in linguistics literature since the 1930s. |
| Approach: | They propose to provide the first news headline corpus of annotated syntactic dependency trees to evaluate existing NLP parsers on news headlines. |
| Outcome: | The proposed method improves performance across different news outlets, but is moderated by constructions idiosyncratic to outlet. |
Towards Realistic Few-Shot Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that few-shot relation classification models can be used to extract any relation of interest from a collection of text with only a few example instances. |
| Approach: | They propose to modify the training routine to encourage models to better discriminate between relations involving similar entity types. |
| Outcome: | The proposed models outperform human models on relation extraction tasks while relying on entity type information. |
Cross-Register Projection for Headline Part of Speech Tagging (2021.emnlp-main)
Copied to clipboard
| Challenge: | Part of speech (POS) tagging models are underperforming on headlines due to differences in the register of English news headlines and long-form text. |
| Approach: | They propose to annotate news headlines with POS tags by projecting predicted tags from corresponding sentences in news bodies. |
| Outcome: | The proposed model reduces errors by 23% and 19% on a newly-annotated corpus of over 5,248 English news headlines from the Google sentence compression corpus. |
Diversity-Aware Batch Active Learning for Dependency Parsing (2021.naacl-main)
Copied to clipboard
| Challenge: | a high annotation cost for dependency parsers is a challenge . batch active learning (AL) is based on batch mode, which is more efficient for annotators to label in bulk. |
| Approach: | They propose to reduce the number of labeled examples needed to train a strong dependency parser using batch active learning. |
| Outcome: | The proposed approach improves on an English newswire corpus by enforcing diversity in the sampled batches. |
Updated Headline Generation: Creating Updated Summaries for Evolving News Stories (2022.acl-long)
Copied to clipboard
| Challenge: | Existing systems that generate headlines for updated articles are not as efficient as static ones. |
| Approach: | They propose a task where a system generates a headline for an updated article, considering both the previous article and headline. |
| Outcome: | The proposed model produces headlines judged by humans to be as factual as gold headlines while making fewer unnecessary edits compared to a standard headline generation model. |
Deep Dirichlet Multinomial Regression (N18-1)
Copied to clipboard
| Challenge: | supervised topic models can incorporate arbitrary document-level features to inform topic priors, but their ability to model corpora is limited by the representation and selection of these features. |
| Approach: | They propose a generative topic model that simultaneously learns document feature representations and topics. |
| Outcome: | The proposed model outperforms DMR and LDA on three datasets and human subjects judge it more representative of associated document features. |