Papers by Frank Xu
End-to-End Graph-Based TAG Parsing with Neural Networks (N18-1)
Copied to clipboard
| Challenge: | Using BiLSTMs, highway connections, and character-level CNNs, we propose a graph-based Tree Adjoining Grammar (TAG) parser. |
| Approach: | They propose a graph-based Tree Adjoining Grammar parser that uses BiLSTMs, highway connections, and character-level CNNs. |
| Outcome: | The proposed parser outperforms the previously reported best by more than 2.2 LAS and UAS points. |
How is BERT surprised? Layerwise detection of linguistic anomalies (2021.acl-long)
Copied to clipboard
| Challenge: | a number of studies have shown that transformer-based language models detect when a word is anomalous in context, but likelihood scores do not tell the cause of the anomaly. |
| Approach: | They propose to use Gaussian models for density estimation at intermediate layers of three language models to evaluate grammaticality. |
| Outcome: | The proposed method on BLiMP shows that language models employ different mechanisms to detect different types of linguistic anomalies. |
LLM-Enhanced Self-Evolving Reinforcement Learning for Multi-Step E-Commerce Payment Fraud Risk Detection (2025.acl-industry)
Copied to clipboard
| Challenge: | e-commerce payment fraud detection is a new area for reinforcement learning (RL) and Large Language Models (LLMs). |
| Approach: | They propose to integrate reinforcement learning (RL) with Large Language Models (LLMs) by framing transaction risk as a multi-step Markov Decision Process (MDP), RL optimizes risk detection across multiple payment stages. |
| Outcome: | The proposed approach improves fraud detection accuracy and demonstrates zero-shot capability. |
An unsupervised framework for tracing textual sources of moral change (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on moral sentiment classification and temporal inference of moral sentiment have not quantified the origins of these changes. |
| Approach: | They propose an unsupervised framework for tracing textual sources of moral change toward entities through time. |
| Outcome: | The proposed framework captures fine-grained human moral judgments and identifies coherent source topics of moral change triggered by historical events. |
Neural reality of argument structure constructions (2022.acl-long)
Copied to clipboard
| Challenge: | lexicalist linguistic theories assume argument structure is predictable from meaning of verbs . construction grammarians propose argument structure constructions distinct from verbs. |
| Approach: | They adapt psycholinguistic studies to probe for the existence of argument structure constructions in Transformer-based language models. |
| Outcome: | The proposed method could be used to probe argument structure constructions in LMs . the study shows that LM learners prefer grouping by construction over verb grouping . |
Word class flexibility: A deep contextualized approach (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on word class flexibility have been fraught with difficulties in quantifying it accurately and at scale. |
| Approach: | They propose a method to quantify word class flexibility in 37 languages using contextualized word embeddings. |
| Outcome: | The proposed method builds on recent work in contextualized word embeddings to quantify semantic shift between word classes and uncovers shared tendencies in class flexibility across languages. |
Hierarchical Prompting Assists Large Language Model on Web Navigation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models struggle on processing complicated observations in interactive decision making tasks. |
| Approach: | They propose a hierarchical prompting approach that constructs an action-aware observation and a Summarizer prompt. |
| Outcome: | The proposed method outperforms the current state-of-the-art prompting mechanism by 6.2% on task success rate. |
Active Retrieval Augmented Generation (2023.emnlp-main)
Copied to clipboard
Zhengbao Jiang, Frank Xu, Luyu Gao, Zhiqing Sun, Qian Liu, Jane Dwivedi-Yu, Yiming Yang, Jamie Callan, Graham Neubig
| Challenge: | Generative language models (LMs) have a tendency to hallucinate and create inaccurate output. |
| Approach: | They propose a method which iteratively uses a prediction of the upcoming sentence to anticipate future content. |
| Outcome: | The proposed method achieves superior or competitive performance on all tasks . iteratively uses a prediction of the upcoming sentence to anticipate future content . |