Papers by James Zhao
LiDARR: Linking Document AMRs with Referents Resolvers (2025.acl-demo)
Copied to clipboard
Jon Cai, Kristin Wright-Bettner, Zekun Zhao, Shafiuddin Rehan Ahmed, Abijith Trichur Ramachandran, Jeffrey Flanigan, Martha Palmer, James Martin
| Challenge: | Abstract Meaning Representation (AMR) is a formalism for semantic representation of natural language text. |
| Approach: | They propose a web tool for semantic annotation at the document level using Abstract Meaning Representation (AMR) it integrates an AMR-to-surface alignment model and a coreference resolution model into the tool . |
| Outcome: | The proposed tool simplifies the creation of knowledge graphs from natural language documents . it integrates an AMR-to-surface alignment model and coreference resolution model . |
Automatic Model Selection with Large Language Models for Reasoning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Chain-of-Thought and Program-Aided Language Models offer different strengths and weaknesses. |
| Approach: | They propose a model selection method that uses a large language model to select between two different reasoning methods. |
| Outcome: | The proposed method shows significant performance improvements across eight reasoning datasets with Codex, ChatGPT, and GPT-4. |
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)
Copied to clipboard
Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Wenfei Zhou, James Coady, David Peng, Yujie Qiao, Luke Benson, Lucy Sun, Alexander Wardle-Solano, Hannah Szabó, Ekaterina Zubova, Matthew Burtell, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Alexander Fabbri, Wojciech Kryscinski, Semih Yavuz, Ye Liu, Xi Lin, Shafiq Joty, Yingbo Zhou, Caiming Xiong, Rex Ying, Arman Cohan, Dragomir Radev
| Challenge: | Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity. |
| Approach: | They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models. |
| Outcome: | The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models. |
FANTAstic SEquences and Where to Find Them: Faithful and Efficient API Call Generation through State-tracked Constrained Decoding and Reranking (2024.findings-emnlp)
Copied to clipboard
Zhuoer Wang, Leonardo Ribeiro, Alexandros Papangelis, Rohan Mukherjee, Tzu-Yen Wang, Xinyan Zhao, Arijit Biswas, James Caverlee, Angeliki Metallinou
| Challenge: | Existing supervised and in-context learning approaches suffer from high training costs, poor data efficiency, and generated API calls that can be unfaithful to the API documentation and the user’s request. |
| Approach: | They propose an output-side optimization approach that uses state-tracked constrained decoding and a lightweight model as the discriminator to rerank the beam-searched candidate generations of the large language model. |
| Outcome: | The proposed approach outperforms existing supervised and in-context learning approaches in the DSTC8 and API Bank datasets in terms of call generation accuracy, inference efficiency, and context efficiency. |
Building a Broad Infrastructure for Uniform Meaning Representations (2024.lrec-main)
Copied to clipboard
Julia Bonn, Matthew J. Buchholz, Jayeol Chun, Andrew Cowell, William Croft, Lukas Denk, Sijia Ge, Jan Hajič, Kenneth Lai, James H. Martin, Skatje Myers, Alexis Palmer, Martha Palmer, Claire Benet Post, James Pustejovsky, Kristine Stenzel, Haibo Sun, Zdeňka Urešová, Rosa Vallejos, Jens E. L. Van Gysel, Meagan Vigus, Nianwen Xue, Jin Zhao
| Challenge: | This paper reports the first release of the UMR data set for six languages . it includes annotations for six different languages that vary greatly in terms of their linguistic properties and resource availability. |
| Approach: | They report the first release of the UMR data set for six languages . they describe on-going efforts to enlarge the data set and extend it to other languages - including Navajo, Navájo, and Sanapaná . |
| Outcome: | The first release of the UMR data set includes annotations for six languages . the language dataset is available for free and can be extended to other languages if needed . |
InstructCoder: Instruction Tuning Large Language Models for Code Editing (2024.acl-srw)
Copied to clipboard
| Challenge: | InstructCoder is the first instruction-tuning dataset designed to adapt LLMs for general-purpose code editing. |
| Approach: | They propose to use Large Language Models to edit code based on user instructions . they use a dataset to adapt LLMs to general-purpose code editing . |
| Outcome: | The proposed model can significantly improve code editing performance compared to proprietary models . the proposed model is based on a human-written execution-based benchmark . |
Beyond Benchmarks: Building a Richer Cross-Document Event Coreference Dataset with Decontextualization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing datasets for Cross-Document Event Coreference (CDEC) are small and lacking diversity. |
| Approach: | They propose a new approach leveraging large language models to decontextualize event mentions by simplifying the document-level annotation task to sentence pairs with enriched context. |
| Outcome: | The proposed approach improves the quality of the dataset and generalizability of the model. |
Prompt Optimization via Adversarial In-Context Learning (2024.acl-long)
Copied to clipboard
Do Long, Yiran Zhao, Hannah Brown, Yuxi Xie, James Zhao, Nancy Chen, Kenji Kawaguchi, Michael Shieh, Junxian He
| Challenge: | Existing methods to optimize prompts for in-context learning are based on adversarial learning and are computationally efficient and extensible to other LLMs and tasks. |
| Approach: | They propose a method to optimize prompts for in-context learning by a generator and a discriminator. |
| Outcome: | The proposed method improves state-of-the-art prompt optimization techniques on 13 generation and classification tasks including summarization, arithmetic reasoning, machine translation, data-to-text generation, and the MMLU and big-bench hard benchmarks. |
M2PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning (2024.emnlp-main)
Copied to clipboard
Taowen Wang, Yiyang Liu, James Liang, Junhan Zhao, Yiming Cui, Yuning Mao, Shaoliang Nie, Jiahao Liu, Fuli Feng, Zenglin Xu, Cheng Han, Lifu Huang, Qifan Wang, Dongfang Liu
| Challenge: | Multimodal Large Language Models (MLLMs) exhibit remarkable performance across a wide range of domains. |
| Approach: | They propose a multimodal prompt tuning approach for efficient instruction tuning of MLLMs. |
| Outcome: | The proposed approach shows superior performance on multimodal evaluation datasets compared to state-of-the-art methods. |
Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
Yijia Xiao, Wanjia Zhao, Junkai Zhang, Yiqiao Jin, Han Zhang, Zhicheng Ren, Renliang Sun, Haixin Wang, Guancheng Wan, Pan Lu, Xiao Luo, Yu Zhang, James Zou, Yizhou Sun, Wei Wang
| Challenge: | Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models. |
| Approach: | This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy . |
| Outcome: | The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications. |
Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on human judgment to assess data accuracy and visual communication, which is costly and unscalable. |
| Approach: | They propose a framework that leverages Visual Question Answering (VQA) models to automate the evaluation of LLM-generated data visualizations. |
| Outcome: | The proposed framework assesses data representation quality and communicative clarity of charts using two leading VQA benchmark datasets, ChartQA and PlotQA, with visualizations generated by OpenAI’s GPT-3.5 Turbo and Meta’s Llama 3.1 70B-Instruct models. |