Papers by Brian Chiang
Efficiency through Auto-Sizing: Notre Dame NLP’s Submission to the WNGT 2019 Efficiency Task (D19-56)
Copied to clipboard
| Challenge: | Notre Dame Natural Language Processing group applied auto-sizing to the Transformer network to reduce the number of parameters in the model. |
| Approach: | They investigated the impact of auto-sizing on the Transformer network by applying a method to inducing sparsity in parameters. |
| Outcome: | The proposed method eliminated more than 25% of the model’s parameters while suffering a decrease of only 1.1 BLEU. |
Intersectional Stereotypes in Large Language Models: Dataset and Analysis (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on intersectional stereotypes focus on broader, individual categories . current studies focus on single-group stereotypes, such as racial bias against African Americans . |
| Approach: | They propose to use a dataset of intersectional stereotypes curated with the ChatGPT model to analyze propagation in three contemporary LLMs. |
| Outcome: | The proposed dataset enables analysis of stereotype propagation in three contemporary LLMs. |
PILA: A Historical-Linguistic Dataset of Proto-Italic and Latin (2024.lrec-main)
Copied to clipboard
| Challenge: | Historical linguists hypothesize systems of sound change to explain the evolution of language over time, but the evidence is limited. |
| Approach: | They propose a dataset that consists of roughly 3,000 pairs of forms from Proto-Italic and Latin. |
| Outcome: | The proposed dataset enables historical linguists to enhance other datasets by enhancing them with the existing datasets. |
Algorithms for Weighted Pushdown Automata (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing dynamic programming algorithms for PDAs often resort to a PDA-to-CFG conversion. |
| Approach: | They propose to use a pushdown automaton to reduce the space requirements by a factor of |Gamma| or the runtime by reducing the number of states. |
| Outcome: | The proposed algorithms reduce the space requirements by a factor of |Gamma| or reduce the runtime by fewer states. |