Papers by Alexander Wong
LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution (2022.acl-long)
Copied to clipboard
| Challenge: | Lexical substitution is the task of generating meaningful substitutes for a word in a given textual context. |
| Approach: | They propose an end-to-end lexical substitution framework based on contextual embedding models that can identify highly-accurate substitute candidates. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding models on LS07 and CoInCo benchmark datasets by at least 2% over existing embeddable models. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus (2021.naacl-main)
Copied to clipboard
| Challenge: | Contextual word embedding models do not take into account structured expert domain knowledge from a knowledge base. |
| Approach: | They propose a contextual embedding model that integrates domain knowledge during the pre-training process via a novel knowledge augmentation strategy. |
| Outcome: | The proposed model outperforms existing domain-specific models on common named-entity recognition (NER) and clinical natural language inference tasks. |