Papers by Hang Yang

31 papers
DORE: Document Ordered Relation Extraction based on Generative Framework (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing generative methods do not fit document-level relation extraction tasks where there are multiple entities and relational facts.
Approach: They propose to generate a symbolic and ordered sequence from relation matrix which is easier to learn and introduce several negative sampling strategies to improve the performance with balanced signals.
Outcome: The proposed method can improve the performance of the generative DocRE models on four datasets.
Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have demonstrated the potential of large language models (LLMs) for automatic error detection in math word problems (MWPs).
Approach: They propose a framework that generates adaptive reference solutions using LLMs to enhance error detection by reducing conformity bias in MWPs.
Outcome: The proposed framework mitigates the performance gap between conventional and alternative solutions in MWPs, especially when combined with reasoning-enhancing techniques like chain-of-thought prompting.
MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have improved generation and reasoning capabilities compared to traditional BERT-sized models due to massive number of parameters and extensive pre-training on vast textual corpora.
Approach: They propose a unified post-hoc adapter for test-time adaptation of large language models . they propose to fine-tune only a small BERT-sized adapter to rank candidate LLMs .
Outcome: The proposed adapter improves performance on four biomedical tasks without requiring computational resources or sharing data with third parties.
Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for aspect category sentiment analysis do not necessarily occur in a sentence.
Approach: They propose a Beta Distribution-guided aspect-aware graph construction based on external knowledge . they use aspect-related words as the pivots to derive aspect-relevant weights .
Outcome: The proposed approach outperforms the state-of-the-art methods on 6 benchmark datasets.
Debiasing the Fine-Grained Classification Task in LLMs with Bias-Aware PEFT (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to mitigate label biases such as retraining, post-hoc adjustment, and parameter-efficient fine-tuning fail to address prediction propensity and discriminative ability biase.
Approach: They propose a bias-aware optimization framework that incorporates two distinct label balance constraints with a PEFT strategy targeting an intermediate layer to mitigate this issue.
Outcome: The proposed approach outperforms or matches the performance of full-parameter fine-tuning and LoRA, achieving superior results with lower perplexity.
EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records (2024.emnlp-main)

Copied to clipboard

Challenge: EHRAgent enables clinicians to interact with EHRs using natural language . reliance on rule-based conversion systems often necessitates additional training or effort from data engineers.
Approach: They propose a large language model agent that generates and executes code in natural language to facilitate clinicians in directly interacting with EHRs.
Outcome: The proposed agent outperforms the strongest baseline by up to 29.6% in success rate on three real-world EHR datasets.
A Sequence-to-Sequence Approach to Dialogue State Tracking (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for dialogue state tracking are still challenging, but they are improving . a new approach to dialogue state monitoring is proposed, called Seq2Seq-DU .
Approach: They propose a new dialogue state tracking module that formalizes DST as a sequence-to-sequence problem.
Outcome: The proposed method outperforms existing methods on benchmark datasets in different settings.
RankPrompt: Step-by-Step Comparisons Make Language Models Better Reasoners (2024.lrec-main)

Copied to clipboard

Challenge: Existing solutions to reasoning tasks require extensive human annotations or fail in scenarios with inconsistent responses.
Approach: They propose a new method that enables LLMs to self-rank their responses without additional resources.
Outcome: The proposed method improves reasoning performance of ChatGPT and GPT-4 with 13% improvement over existing methods.
Document-Level Relation Extraction via Pair-Aware and Entity-Enhanced Representation Learning (2022.coling-1)

Copied to clipboard

Challenge: Existing document-level relation extraction methods are sparse in relational entity pairs and the representation of entity pairs is insufficient.
Approach: They propose a Pair-Aware and Entity-Enhanced(PAEE) model to solve two challenges . they propose predicting potential relational entity pairs and assembling directional entity pairs .
Outcome: The proposed model can obtain state-of-the-art performance on four benchmark datasets . it can predict potential relational entity pairs and assemble directional entity pairs .
How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models excel at capturing semantic correlations within utterance embeddings but fail to determine specific causal relationships.
Approach: They propose to incorporate i.i.d. noise terms into conversation process to build a structural causal model . they propose to use unstructured conversation data to facilitate deep learning .
Outcome: The proposed approach can be implemented in unstructured conversation data and a synthetic dataset that includes i.i.d. noise.
Collective Event Detection via a Hierarchical and Bias Tagging Networks with Gated Multi-level Attention Mechanisms (D18-1)

Copied to clipboard

Challenge: Existing approaches to ACE event detection treat multiple events in one sentence as independent ones and recognize them separately.
Approach: They propose a hierarchical and bias tagging network framework to detect multiple events in one sentence collectively and a gated multi-level attention mechanism to automatically extract and fuse the sentence-level and document-level information.
Outcome: The proposed framework outperforms state-of-the-art methods on a 2005 ACE dataset.
TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization (2024.naacl-long)

Copied to clipboard

Challenge: Existing LLMs hallucinate significant amounts of factual errors in the dialogue domain, regardless of the model’s size.
Approach: They propose to evaluate topic-focused dialogue summarization by using large language models (LLMs) they use human annotations to evaluate factual consistency and explain factually inconsistent sentences.
Outcome: The proposed evaluation benchmark on topic-focused dialogue summarization shows that existing LLMs hallucinate significant amounts of factual errors regardless of the model’s size.
DCFEE: A Document-level Chinese Financial Event Extraction System based on Automatically Labeled Training Data (P18-4)

Copied to clipboard

Challenge: Existing methods to extract events from documents are limited due to the high cost of labeling . Experimental results demonstrate the effectiveness of a document-level Chinese financial event extraction system.
Approach: They propose a document-level Chinese financial event extraction framework which detects event mentions and extracts events from financial news.
Outcome: The proposed system detects event mentions and extracts events from financial news . it can generate large scale labeled data and extract events from entire document .
Quantifying Semantic Emergence in Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluation methods for large language models (LLMs) focus on coarse-grained text, not providing interpretations for the behavior of finergrained tokens.
Approach: They propose a quantitative metric to measure large language models’ ability to extract semantics from input tokens.
Outcome: The proposed metric compares the entropy reduction observed for a sequence of tokens and individual tokens.
Are Large Language Models (LLMs) Good Social Predictors? (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing studies suggest that Large Language Models can generate human-like responses, but it is unclear how well they work and where the plausible predictions derive from.
Approach: They propose to use LLMs to generate human-like responses by mutability and accessibility of social inputs to perform a social prediction task.
Outcome: The proposed model performs well in three realistic settings and a novel social prediction task.
XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser (2025.coling-main)

Copied to clipboard

Challenge: Document AI parsing semi-structured image form is a key information extraction task.
Approach: They propose a multimodal and multilingual semi-structured FORM PARSER which integrates SER and relation extraction into a unified framework.
Outcome: The proposed framework achieves up to 1.79% improvement on RE tasks in multilingual and zero-shot settings.
AutoBreach: Universal and Adaptive Jailbreaking with Efficient Wordplay-Guided Optimization via Multi-LLMs (2025.findings-naacl)

Copied to clipboard

Challenge: Existing jailbreak research exhibits limitations in universality, validity, and efficiency . Existing methods for jailbreaking LLMs have limited validity and effectiveness .
Approach: They propose a black-box approach that uses wordplay-guided mapping rule sampling to create universal adversarial prompts.
Outcome: The proposed method efficiently identifies security vulnerabilities across various LLMs, achieving an average success rate of over 80% with fewer than 10 queries.
Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibration (2026.acl-short)

Copied to clipboard

Challenge: Existing methods for listwise reranking exhibit intrinsic position bias . existing methods are constrained by an inherent trade-off between efficiency and flexibility .
Approach: They propose a training-free framework that mechanically decouples positional bias from ranking decisions.
Outcome: a training-free framework decouples position bias from ranking decisions . evaluations show it outperforms training-based methods and outperformed expensive methods .
Toward Optimal LLM Alignments Using Two-Player Games (2025.findings-emnlp)

Copied to clipboard

Challenge: Alignment of large language models (LLM) is a process that ensures the model’s responses to user prompts align with human intentions and social values.
Approach: They propose an alignment method based on a two-agent game consisting of an adversarial agent and a defensive agent.
Outcome: The proposed method improves on a two-agent game with an adversarial agent and a defensive agent.
Reconstructing Event Regions for Event Extraction via Graph Attention Networks (2020.aacl-main)

Copied to clipboard

Challenge: Existing approaches for event extraction focus on sentence-level event extraction, but they lack a broader view of the document context.
Approach: They build graphs with candidate event filler extractions enriched by sentential embeddings as nodes and use graph attention networks to identify event regions in a document and aggregate event information.
Outcome: The proposed method performs well on two languages and shows that it is faster than previous methods.
BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Proving (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to theorem proving in large language models rely on value functions and/or Monte Carlo Tree Search (MCTS), but the potential of simpler methods like Best-First Tree Search remains underexplored.
Approach: They propose a scalable expert iteration framework that implements strategic data filtering at each expert iteration round, excluding problems solvable via beam search node expansion to focus on harder cases.
Outcome: The proposed framework achieves a state-of-the-art score of 72.95 on the MiniF2F test set and challenges the perceived necessity of complex tree search methods.
Red Teaming Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, but they introduce safety and reliability risks, such as CoT-hijacking and prompt-induced inefficiencies.
Approach: They propose a unified benchmark to assess the trustworthiness of Large Reasoning Models.
Outcome: The proposed benchmark evaluates truthfulness, safety and efficiency on 26 models.
Extending Complex Logical Queries on Uncertain Knowledge Graphs (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on logical queries on knowledge graphs overlook the incompleteness of KGs.
Approach: They propose an ML-based approach to answer soft queries on uncertain knowledge . they propose to use forward inference and backward calibration to avoid catastrophic errors .
Outcome: The proposed method ensures there are no catastrophic cascading errors while maintaining the same complexity as state-of-the-art inference algorithms for first-order queries.
Document-level Event Extraction via Parallel Prediction Networks (2021.acl-long)

Copied to clipboard

Challenge: Document-level event extraction (DEE) is indispensable when events are described throughout a document.
Approach: They propose a document-level event extraction model that can extract structured events from a text in parallel.
Outcome: The proposed model outperforms current state-of-the-art methods on a document-level event extraction task.
HSCodeComp: A Realistic and Expert-level Agent Benchmark for Hierarchical Rule Application (2026.acl-long)

Copied to clipboard

Challenge: Existing agent benchmarks neglect hierarchical rule application in real-world domains . a critical gap persists in numerous real-life professional domains where decision-making is governed by expert-written rules.
Approach: They propose a benchmark requiring agents to assign a unique 10-digit Harmonized System (HS) Code to products by aligning their fuzzy attributes with strict tariff classification rules.
Outcome: The proposed benchmarks lack hierarchical rule application capability in real-world domains . the proposed benchmark is based on e-commerce and is open-source .
SeaLLMs - Large Language Models for Southeast Asia (2024.acl-demos)

Copied to clipboard

Challenge: Existing large language models favor high-resource languages, such as English, at the expense of low-resourced and regional languages.
Approach: They propose a series of language models that specifically focuses on Southeast Asian languages.
Outcome: SeaLLM models outperform ChatGPT-3.5 in non-Latin languages by large margins . linguistic disparity impedes access to state-of-the-art AI technologies for non-English-speaking populations .
DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: DiMo-GUI is a training-free framework for GUI grounding that splits input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models.
Approach: They propose a training-free framework for GUI grounding that leverages two core strategies: dynamic visual grounding and modality-aware optimization.
Outcome: The proposed framework splits the input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models.
Personalized Question Answering with User Profile Generation and Compression (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models are prone to providing “midguy” answers regardless of users’ knowledge background, thereby failing to meet each user’s personalized needs.
Approach: They propose to generate personalized answers with LLMs based on users’ past question-answering records.
Outcome: The proposed method generates personalized answers based on user's past question-answering records.
GA-S3: Comprehensive Social Network Simulation with Group Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing social network simulations focus on discrete events or system dynamics instead of elucidating underlying mechanisms or causal relationships.
Approach: They propose a Social network simulation system that leverages newly designed Group Agents to make intelligent decisions regarding various online events.
Outcome: The proposed system can make intelligent decisions regarding online events at a manageable cost.
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way (2023.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly pivotal in a wide range of tasks . however, the resources required for training these models necessitate efficient solutions .
Approach: They propose a library that facilitates collaborative training of large language models . they use 3D parallelism, parameter-efficient fine-tuning methods and optimizers .
Outcome: The proposed library has proven superior training efficiency in comparison with prevalent solutions in pre-training and fine-tuning scenarios.
Evaluating Large Language Models on Wikipedia-Style Survey Generation (2024.findings-acl)

Copied to clipboard

Challenge: Recent studies have shown that large language models can perform well in general tasks, but their effectiveness and limitations in domainspecific tasks remain unclear.
Approach: They examine the proficiency of Large Language Models (LLMs) in generating succinct survey articles specific to the niche field of NLP in computer science.
Outcome: The LLMs perform better in generating succinct survey articles specific to the niche field of NLP in computer science, compared to human-authored surveys, but they exhibit bias in evaluation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations