Papers by Kuan-Hao Huang
What’s Missing in Vision-Language Models? Probing Their Struggles with Causal Order Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing benchmarks often include a mixture of reasoning questions, making it difficult to truly assess VLMs’ causal reasoning abilities. |
| Approach: | They propose two new benchmarks specifically designed to isolate and rigorously evaluate VLMs’ causal reasoning abilities. |
| Outcome: | The proposed benchmarks show that vision-language models perform poorly on causal reasoning tasks, often only marginally surpassing random guessing. |
DEGREE: A Data-Efficient Generation-Based Event Extraction Model (2022.naacl-main)
Copied to clipboard
I-Hung Hsu, Kuan-Hao Huang, Elizabeth Boschee, Scott Miller, Prem Natarajan, Kai-Wei Chang, Nanyun Peng
| Challenge: | Existing models for event extraction require expensive human annotations. |
| Approach: | They propose a data-efficient event extraction model that formulates event extraction as a conditional generation problem. |
| Outcome: | The proposed model can be trained with only a few labeled examples. |
Contextual Label Projection for Cross-Lingual Structured Prediction (2024.naacl-long)
Copied to clipboard
| Challenge: | Prior work favors simplified label translation or relying on word-level alignments for label projection. |
| Approach: | They propose a novel approach CLaP which translates text to target language and performs *contextual translation* on the labels using the translated text as the context. |
| Outcome: | The proposed approach improves translation accuracy on two prediction tasks and shows 2.4 F1 improvement for EAE and 1.4 F1 for named entity recognition. |
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained multilingual language encoders do not precisely align words and phrases across languages. |
| Approach: | They propose a learning strategy for training robust models by drawing connections between adversarial examples and failure cases of zero-shot cross-lingual transfer. |
| Outcome: | The proposed model can achieve good performance even if representations of different languages are not aligned well. |
Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairs (2021.eacl-main)
Copied to clipboard
| Challenge: | Paraphrase generation requires many annotated paraphrase pairs, which are expensive to obtain. |
| Approach: | They propose a model that learns to disentangle the semantics and syntax of a sentence from unannotated texts. |
| Outcome: | The proposed model learns to disentangle the semantics and syntax of a sentence from a collection of unannotated texts. |
Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis (2024.findings-eacl)
Copied to clipboard
| Challenge: | Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. |
| Approach: | They propose a metric to detect spurious tokens and a family of regularization methods to mitigate spurious correlations in text classification. |
| Outcome: | The proposed method prevents spurious clusters and significantly improves the robustness of classifiers without auxiliary data. |
ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Paraphrase generation is a long-standing task in natural language processing (NLP). |
| Approach: | They propose to generate large-scale syntactically diverse paraphrase datasets by abstract meaning representation back-translation. |
| Outcome: | The proposed dataset is syntactically more diverse than existing datasets while maintaining good semantic similarity. |
PIP: Parse-Instructed Prefix for Syntactically Controlled Paraphrase Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing fine-tuning methods for this task are costly and require updating the parameters of the entire model to adapt to the newly included syntax information. |
| Approach: | They propose a method to instruct model’s encoder prefix to capture syntax-related knowledge by direct initiation and indirect optimization. |
| Outcome: | The proposed methods are 10 times more efficient and learnable than existing methods. |
GENEVA: Benchmarking Generalizability for Event Argument Extraction with Hundreds of Event Types and Argument Roles (2023.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarking datasets for Event Argument Extraction (EAE) cover less than 40 event types and 25 entity-centric argument roles. |
| Approach: | They propose to use a large and diverse EAE ontology to create a semantic role labeling dataset for EAE that incorporates 115 events and 220 argument roles. |
| Outcome: | The proposed ontology concludes with 115 events and 220 argument roles, with a significant portion of roles not being entities. |
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a large pre-trained language model can cause computational burdens in inference time due to multiple forward passes. |
| Approach: | They propose a method to learn fixed text representations with source tasks . they learn a task-specific prefix for each source task independently and combine them . |
| Outcome: | The proposed method improves generalizability of representations with source tasks. |
AMPERE: AMR-Aware Prefix for Generation-Based Event Argument Extraction Model (2023.acl-long)
Copied to clipboard
| Challenge: | Existing generation-based EAE models focus on problem re-formulation and prompt design without incorporating additional information that has been shown to be effective for classification-based models. |
| Approach: | They propose to incorporate AMR into generation-based EAE models by generating AMR-aware prefixes for every layer of the generation model. |
| Outcome: | The proposed model generates AMR-aware prefixes for every layer of the generation model and improves the generation. |
TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extraction (2024.findings-acl)
Copied to clipboard
Kuan-Hao Huang, I-Hung Hsu, Tanmay Parekh, Zhiyu Xie, Zixuan Zhang, Prem Natarajan, Kai-Wei Chang, Nanyun Peng, Heng Ji
| Challenge: | Recent studies suggest that event extraction evaluations may not accurately reflect the true performance. |
| Approach: | They propose a standardized, fair, and reproducible benchmark for event extraction . they use standardized scripts and splits for 16 datasets spanning eight domains . |
| Outcome: | The proposed benchmarks show that they struggle to achieve satisfactory performance. |
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models for zero-shot cross-lingual event argument extraction are based on pre-trained generative language models. |
| Approach: | They propose to use pre-trained generative language models to generate sentences that fill in a template with arguments extracted from the input passage. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on zero-shot cross-lingual EAE. |
Adaptive Helpfulness–Harmlessness Alignment with Preference Vectors (2026.eacl-long)
Copied to clipboard
Ren-Wei Liang, Chin Ting Hsu, Chan-Hung Yu, Saransh Agrawal, Shih-Cheng Huang, Chieh-Yen Lin, Shang-Tse Chen, Kuan-Hao Huang, Shao-Hua Sun
| Challenge: | Existing approaches to balancing helpfulness and harmlessness suffer from performance conflicts, limited controllability, and poor extendability. |
| Approach: | They propose a framework that allows users to control their own preferences and dynamically merge them at test time. |
| Outcome: | The proposed framework improves helpfulness without conservatism and smooth control over preference trade-offs. |
Examining Gender Bias in Languages with Grammatical Gender (D19-1)
Copied to clipboard
| Challenge: | Existing studies on gender bias in word embeddings focus on English . however, these studies cannot be extended to languages with morphological agreement on gender . |
| Approach: | They propose new metrics to evaluate gender bias in word embeddings of English and Spanish . they extend existing approaches to mitigate gender bias while preserving original embeddables . |
| Outcome: | The proposed methods reduce gender bias while preserving the original embeddings. |
Unsupervised Syntactically Controlled Paraphrase Generation with Abstract Meaning Representations (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to syntactically controlled paraphrase generation require annotated paraphrase pairs for training and are costly to extend to new domains. |
| Approach: | They propose to leverage Abstract Meaning Representations (AMR) to improve the performance of unsupervised syntactically controlled paraphrase generation. |
| Outcome: | The proposed model generates more accurate syntactically controlled paraphrases, both quantitatively and qualitatively, compared to the existing unsupervised approaches. |
TAGPRIME: A Unified Framework for Relational Structure Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing models for natural language processing (NLP) do not address common tasks. |
| Approach: | They propose to take a unified view of all the tasks and introduce a model that appends priming words about the condition to the input text. |
| Outcome: | The proposed model is based on ten datasets across five different languages and covers ten tasks that cover ten languages. |
Event Detection from Social Media for Epidemic Prediction (2024.naacl-long)
Copied to clipboard
Tanmay Parekh, Anh Mac, Jiarui Yu, Yuxuan Dong, Syed Shahriar, Bonnie Liu, Eric Yang, Kuan-Hao Huang, Wei Wang, Nanyun Peng, Kai-Wei Chang
| Challenge: | Social media is an easy-to-access platform providing timely updates about societal trends and events. |
| Approach: | They propose a framework to extract epidemic-related events from social media posts to provide early warnings. |
| Outcome: | The proposed framework can detect epidemic events for three unseen epidemics of Monkeypox, Zika, and Dengue while existing models fail miserably. |
Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models have been successful on a wide range of NLP tasks . however, contextual representations from pre-trated models contain entangled semantic and syntactic information. |
| Approach: | They propose a semantic sentence embedding model that disentangles semantics and syntax from pre-trained models. |
| Outcome: | The proposed model outperforms state-of-the-art models on unsupervised semantic similarity tasks. |
Generating Sports News from Live Commentary: A Chinese Dataset for Sports Game Summarization (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing methods to generate sports summarization tasks are laborintensive and infeasible. |
| Approach: | They propose a Chinese dataset for sports game summarization and a model that consists of a selector and rewriter to evaluate the correctness of generated sports summaries. |
| Outcome: | The proposed model performs better on ROUGE and the two designed scores. |