Papers by Mingye Gao
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning (2024.findings-naacl)
Copied to clipboard
Tianhua Zhang, Jiaxin Ge, Hongyin Luo, Yung-Sung Chuang, Mingye Gao, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, James Glass
| Challenge: | Existing methods for surfacing symbolic reasoning capabilities are limited to narrow tasks . arithmetic computations are unnatural to perform in pure language space, and hence present difficulties for LLMs. |
| Approach: | They propose a natural language embedded program framework for solving symbolic reasoning tasks. |
| Outcome: | The proposed framework improves on strong baselines across math and symbolic reasoning, text classification, question answering, and instruction following tasks. |
Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks (2024.findings-emnlp)
Copied to clipboard
Jack Gallifant, Shan Chen, Pedro Moreira, Nikolaj Munch, Mingye Gao, Jackson Pond, Leo Anthony Celi, Hugo Aerts, Thomas Hartvigsen, Danielle Bitterman
| Challenge: | Medical knowledge is context-dependent and requires consistent reasoning across various natural language expressions of semantically equivalent phrases. |
| Approach: | They create a robustness dataset to evaluate performance differences on medical benchmarks . they swap brand and generic drug names using physician expert annotations based on medical terminology . |
| Outcome: | The proposed model shows a consistent performance drop of 1-10% on medical benchmarks. |
Cooperative Self-training of Machine Reading Comprehension (2022.naacl-main)
Copied to clipboard
| Challenge: | Pretrained language models provide high-quality contextualized word embeddings, but training question answering models requires large amounts of annotated data for specific domains. |
| Approach: | They propose a framework for automatically generating more non-trivial question-answer pairs to improve model performance. |
| Outcome: | The proposed framework outperforms state-of-the-art (SOTA) pretrained language models and transfer learning approaches on standard question-answering benchmarks. |