Papers by Jiaxin Wang

48 papers
Learning Task Decomposition to Assist Humans in Competitive Programming (2024.acl-long)

Copied to clipboard

Challenge: Using language models (LMs) to solve complex problems, humans might struggle to understand and repair flawed ones.
Approach: They propose to automatically decompose complex problems into simpler pieces that correspond to specific subtasks and measure their assistive value.
Outcome: The proposed method enables non-experts to solve 33.3% more problems and speeds them up by 3.3x .
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations (2020.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that pre-trained text encoders can perform many NLP tasks with less resource.
Approach: They propose a BERT-based Chinese text encoder enhanced by n-gram representations . they show reasonable performance when ZEN is trained on a small corpus .
Outcome: The proposed encoder incorporates the comprehensive information of both the character sequence and words or phrases it contains.
On LLM-Based Scientific Inductive Reasoning Beyond Equations (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research on inductive reasoning models emphasizes rule design without grounding them in specific scenarios.
Approach: They propose to use LLMs to learn underlying patterns from limited examples in entirely new environments.
Outcome: The proposed benchmark evaluates the inductive reasoning abilities of large language models in scientific settings.
On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions (2025.findings-emnlp)

Copied to clipboard

Challenge: Conceptualization is a fundamental element of human cognition and plays a pivotal role in generalizable reasoning.
Approach: They propose to categorize different types of conceptualizations into four levels based on the types of instances being conceptualized.
Outcome: The proposed categorization of different types of conceptualizations into four levels based on the types of instances being conceptualized .
Memorization, Emergence, and Explaining Reversal Failures: A Controlled Study of Relational Semantics in LLMs (2026.acl-long)

Copied to clipboard

Challenge: Autoregressive LLMs perform well on relational tasks that require linking entities via relational words, but it is unclear whether they learn the logical semantics of such relations or whether left-to-right order bias is involved.
Approach: They propose a framework that generates text from symmetric/inverse triples and trains autoregressive models from scratch.
Outcome: The proposed framework generates text from symmetric/inverse triples, trains autoregressive models from scratch, and evaluates memorization, logical inference, and in-context generalization to unseen entities.
Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) often experience “contextual hallucination” where they prioritize self-generated content over input context, leading to a disregard for pertinent details.
Approach: They propose a method that dynamically adjusts attention maps to enhance contextual relevance by using a trained classifier to identify attention maps likely to induce hallucinations.
Outcome: The proposed approach reduces hallucinations across open-source models on summarization and open-book QA tasks.
Is Reference Necessary in the Evaluation of NLG Systems? When and Where? (2024.naacl-long)

Copied to clipboard

Challenge: Despite recent advances in reference-free metrics, it has not been well understood when and where they can be used as an alternative to reference-based metrics.
Approach: They propose to use reference-free metrics to evaluate NLG systems . they find they have a higher correlation with human judgment and greater sensitivity to deficiencies in language quality .
Outcome: The proposed metrics exhibit higher correlation with human judgment and greater sensitivity to deficiencies in language quality.
On-policy Reinforcement Fine-tuning with Offline reward for Multi-step Embodied Planning (2026.acl-long)

Copied to clipboard

Challenge: Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and verbal goals.
Approach: They propose an On-policy Reinforcement fine-tuning framework with offline rewards for Embodied Task Planning that preserves generalization benefits of RFT while addressing costly interaction and sparse rewards.
Outcome: The proposed framework outperforms closed-source and online-RL methods on EmbodiedBench, a recent benchmark for interactive embodied tasks.
VisPCO: Visual Token Pruning Configuration Optimization via Budget-Aware Pareto-Frontier Learning for Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for visual token pruning rely on predefined configurations without determining whether they achieve optimal performance.
Approach: They propose a framework that formulates visual token pruning as a Pareto configuration optimization problem to automatically identify optimal configurations.
Outcome: The proposed framework approximates the empirical Pareto frontier obtained through grid search and generalizes well across pruning methods and VLM architectures.
RepEval: Effective Text Evaluation with LLM Representation (2024.emnlp-main)

Copied to clipboard

Challenge: Traditional metrics for automatic text evaluation are tailored to specific tasks, while LLM-based evaluation metrics are costly.
Approach: They propose a metric that leverages projections of LLM representations for evaluation.
Outcome: The proposed metric exhibits higher correlation with human judgments than previous methods on 14 datasets.
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability.
Approach: They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality.
Outcome: The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks.
Can LLMs Hear the Dogwhistle? (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles.
Approach: They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices .
Outcome: The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts.
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference (2022.findings-acl)

Copied to clipboard

Challenge: Previously, it's common to disregard it as noise or as a sign of poor-quality data, as their annotations are heavily based on personal experience and opinions.
Approach: They propose to capture the human disagreement distribution from the perspective of model calibration.
Outcome: The proposed model can achieve competitive performance when well-calibrated, on divergence scores between predictive probability and the true human opinion distribution, and the accuracy.
KnowShiftQA: How Robust are RAG Systems when Textbook Knowledge Shifts in K-12 Education? (2025.acl-short)

Copied to clipboard

Challenge: Existing knowledge discrepancies between textbooks and large language models can undermine RAG systems' performance.
Approach: They propose to use a dataset to test RAG system robustness against knowledge discrepancies.
Outcome: The proposed dataset shows that RAG systems suffer performance degradation when faced with knowledge discrepancies.
Improving Low-Resource Sequence Labeling with Knowledge Fusion and Contextual Label Explanations (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to sequence labeling are limited due to the scarcity of domain-specific data and semantic distribution biases in domain-based contexts.
Approach: They propose a framework that integrates an LLM-based knowledge enhancement workflow with a span-based Knowledge Fusion for Rich and Efficient Extraction model.
Outcome: The proposed model achieves state-of-the-art performance on multiple domain-specific sequence labeling datasets and is highly efficient.
MeepleLM: A Virtual Playtester Simulating Diverse Subjective Experiences (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have expanded the role of board games as creative co-designers . however, current systems lack the capacity to offer constructive critique grounded in the emergent user experience .
Approach: They propose a large language model that internalizes persona-specific reasoning patterns to accurately simulate the subjective feedback of diverse player archetypes.
Outcome: The proposed model outperforms commercial models in community alignment and critique quality.
GR1: Reinforcement-Enhanced LLM for Geoscience Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have demonstrated RL's substantial capacity to enhance multi-step reasoning beyond what supervised instruction tuning achieves.
Approach: They propose a framework that converts multimodal questions into descriptive text . they propose RL-enhanced geoscience reasoning that can be fine-tuned to a text-only level .
Outcome: The proposed framework improves accuracy and accuracy on multimodal questions while preserving answerability and difficulty.
INarIG: Iterative Non-autoregressive Instruct Generation Model For Word-Level Auto Completion (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing models for word-level autocompletion (WLAC) only use human typed sequences as prefixes in decoding module.
Approach: They propose a novel iterative nonautoregressive instruct generation model for WLAC task . it uses human typed sequences and iterating decoding with subwords to fully utilize input information.
Outcome: The proposed model is more competent in dealing with low-frequency words, and achieves state-of-the-art results on the WMT22 and benchmark datasets.
LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Modern large language models (LLMs) employ diverse logical inference mechanisms for reasoning.
Approach: They analyze the comparative dynamics of inductive (System 1) versus abductive/deductive (system 2) inference in large language models by using a controlled analogical reasoning environment and a MCQ/free-text task format.
Outcome: The proposed methods can significantly scale LLM reasoning.
CMMaTH: A Chinese Multi-modal Math Skill Evaluation Benchmark for Foundation Models (2025.coling-main)

Copied to clipboard

Challenge: Large language models excel in various language tasks, while large multimodal models effectively handle visual-language problems.
Approach: They propose to use a multimodal multimodal model evaluation benchmark to evaluate model performance in Chinese K12 classrooms.
Outcome: The proposed model evaluation tool is integrated with the CMMaTH dataset.
InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles (2025.emnlp-main)

Copied to clipboard

Challenge: Recent large language models (LLMs) have demonstrated strong reasoning abilities across complex mathematical and scientific domains.
Approach: They propose a framework to assess whether LLMs can capture and apply personalized reasoning styles in social deduction games.
Outcome: The proposed framework evaluates LLMs on the game Avalon and shows that they can capture and apply individualized reasoning styles.
Enhancing Transformers for Generalizable First-Order Logical Entailment (2025.acl-long)

Copied to clipboard

Challenge: Moreover, transformers have demonstrated proficiency in logical reasoning over natural language.
Approach: They propose a logic-aware architecture that improves the performance in generalizable first-order logical entailment by combining distribution shifts and unseen knowledge.
Outcome: The proposed architecture outperforms methods designed specifically for knowledge graph query answering on a dataset with a large dataset.
Re-TASK: Revisiting LLM Tasks from Capability, Skill, and Knowledge Perspectives (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to solving complex tasks with large language models (LLMs) fail to decompose tasks accurately or execute subtasks effectively.
Approach: They propose a Chain-of-Learning (CoL) paradigm that highlights task dependencies on specific capability items, further broken down into their constituent knowledge and skill components.
Outcome: The proposed model improves Yi-1.5-9B and Llama3-Chinese-8B for legal tasks by 45.00% and 24.50% on different domains.
View Dialogue in 2D: A Two-stream Model in Time-speaker Perspective for Dialogue Summarization and beyond (2022.coling-1)

Copied to clipboard

Challenge: Existing models for dialogue summarization focus on document summarizing on time and speaker-centered points, but this approach is limited in understanding the dialogue.
Approach: They propose a 2D view of dialogue based on a time-speaker perspective where the time and speaker streams of dialogue can be obtained as strengthened input.
Outcome: The proposed model outperforms existing models on the QMSum dataset and improves summary faithfulness and human evaluation.
Query2Particles: Knowledge Graph Reasoning with Particle Embeddings (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods to answer complex logical queries on incomplete knowledge graphs with missing edges are needed to solve the problem.
Approach: They propose a query embedding method that encodes queries and entities to the same embeddable space and then selects the answer entities based on similarities .
Outcome: The proposed method can answer complex logical queries on incomplete knowledge graphs with missing edges.
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach: They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome: The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Does Memory Need Graphs? A Unified Framework and Empirical Analysis for Long-Term Dialog Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing literature on dialog memory systems is inconsistent on their effectiveness . empirical findings on graph structures are difficult to attribute to specific design choices .
Approach: They propose a framework that decomposes dialog memory systems into core components . they conduct stage-wise experiments on LongMemEval and HaluMeM, and compare implementation details .
Outcome: The proposed framework compares graph-based and non-graph memory architectures on long-term dialog memory systems.
Text Style Transfer Back-Translation (2023.acl-long)

Copied to clipboard

Challenge: Current methods require large amount of bilingual training data, which is challenging and sometimes impossible task.
Approach: They propose a method to modify the style of inputs by modifying the source side of BT data.
Outcome: The proposed method significantly improves translation quality against popular BT benchmarks on high-resource and low-resourced language pairs.
When Phrases Meet Probabilities: Enabling Open Relation Extraction with Cooperating Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing clustering-based open relation extraction methods use pre-trained language models . embeddings from language models are high-dimensional and anisotropic, so there is a gap .
Approach: They propose a framework that makes two LLMs work collaboratively to achieve clustering.
Outcome: The proposed framework outperforms existing methods by 1.4%3.13% on different datasets.
MPBench: A Comprehensive Multimodal Reasoning Benchmark for Process Errors Identification (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks of large language models focus on error detection, neglecting other scenarios like reasoning search.
Approach: et al. propose a multi-task, multimodal benchmark to assess effectiveness of PRMs . step correctness, answers aggregation and reasoning process search are evaluated . ethical principles of MPBench are based on a set of evaluation paradigms based in a text-based benchmark .
Outcome: a new benchmark assesses the effectiveness of large language models (LLMs) in multiple scenarios . it uses three evaluation paradigms to assess the effectiveness and compares them with existing models . a the proposed model improves reasoning accuracy by providing stepwise feedback for multi-step reasoning results .
POTATO: The Portable Text Annotation Tool (2022.emnlp-demos)

Copied to clipboard

Challenge: POTATO is a free, fully open-sourced annotation system that supports labeling many types of text and multimodal data.
Approach: They propose to use POTATO to design and deploy complex annotation tasks.
Outcome: The proposed annotation system improves labeling speed and productivity over two tasks.
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)

Copied to clipboard

Challenge: Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges .
Approach: They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions.
Outcome: The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset .
Advancing Abductive Reasoning in Knowledge Graphs through Complex Logical Hypothesis Generation (2024.acl-long)

Copied to clipboard

Challenge: Abductive reasoning is the process of making educated guesses to provide explanations for observations.
Approach: They propose a task of complex logical hypothesis generation to generate a complex logique hypothesis that can explain a set of observations.
Outcome: The proposed model generates logical hypotheses closer to the reference hypothesis, but not better on unseen observations.
Incremental Transformer: Efficient Encoder for Incremented Text Over MRC and Conversation Tasks (2025.coling-main)

Copied to clipboard

Challenge: Existing encoders that encode incremented inputs have to re-encode the whole text to obtain the encoding of the extended input.
Approach: They propose an efficient encoder dedicated for faster encoding of incremented input . it takes only added input as input but attends to cached representations of original input a lower layer .
Outcome: The proposed encoder achieves 6.2x speedup over current encoders . it takes only added input as input but attends to cached representations of original input .
MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for acquiring large-scale intentions generate product-centric intentions without product images and incur high costs for scalability.
Approach: They propose a multimodal framework that allows Large Vision-Language Models to infer purchase intentions from multimodal product metadata and prioritize human-centric ones.
Outcome: The proposed framework shows that it is robust to different prompts and superior to previous methods.
Benchmarking for Domain-Specific LLMs: A Case Study on Academia and Beyond (2025.findings-emnlp)

Copied to clipboard

Challenge: Comp-Comp is an iterative benchmarking framework grounded in the principles of comprehensiveness and compactness.
Approach: They propose a benchmark framework that incorporates the principle of comprehensiveness and compactness.
Outcome: The proposed framework is domain-agnostic and adaptable to a wide range of specialized fields.
From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents.
Approach: They introduce a foundational three-level taxonomy to delineate their escalating autonomy and evolving responsibilities within the research lifecycle.
Outcome: The proposed frameworks provide a conceptual architecture and strategic foresight to navigate and shape the future of AI-driven scientific discovery.
Enough Coin Flips Can Make LLMs Act Bayesian (2025.acl-long)

Copied to clipboard

Challenge: Large language models exhibit the ability to generalize given few-shot examples in their input prompt, an emergent capability known as in-context learning.
Approach: They investigate whether large language models use in-context learning to generalize given few-shot examples in their input prompt.
Outcome: The proposed model can generalize given few-shot examples in their input prompt, an emergent capability known as in-context learning.
Large Language Models Can Self-Improve (2023.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have excellent performance in various tasks, but fine-tuning requires extensive supervision.
Approach: They propose to use a pre-trained Large Language Model to generate rationale-augmented answers for unlabeled questions and fine-tune the LLM using those self-generated solutions as target outputs.
Outcome: The proposed approach improves the general reasoning ability of a 540B-parameter LLM without any ground truth label.
IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches that distill intentions from LMs fail to generate meaningful and human-centric intentions applicable in real-world E-commerce contexts.
Approach: They propose a double-task multiple-choice question answering benchmark to evaluate LMs' comprehension of purchase intentions in E-commerce.
Outcome: The proposed benchmark consists of 4,360 carefully curated problems across three difficulty levels, constructed using an automated pipeline to ensure scalability on large E-commerce platforms.
CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning (2024.acl-long)

Copied to clipboard

Challenge: Existing approaches to generalize commonsense reasoning lack instantiated knowledge and require pre-built concept taxonomies and annotations.
Approach: They propose a framework that iteratively performs contextualized conceptualization and instantiation over commonsense knowledge bases by instructing large language models to generate both types of knowledge with critic filtering.
Outcome: Empirical results show that distilling CANDLE on student models provides benefits across three downstream tasks.
MatchPrompt: Prompt-based Open Relation Extraction with Semantic Consistency Guided Clustering (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for open relation extraction (OpenRE) focus on labeled and pre-defined instances, which are costly to acquire in reality.
Approach: They propose a framework that can extract relations without pre-defined types from open-domain corpus with efficient knowledge transfer from a few pre-determined relational instances.
Outcome: The proposed framework achieves the new SOTA results for OpenRE on different datasets.
Intention Knowledge Graph Construction for User Intention Relation Modeling (2026.eacl-long)

Copied to clipboard

Challenge: Existing knowledge graphs focus on connecting intentions but lacks the ability to model the relationships between different intentions.
Approach: They propose a framework to automatically generate an intention knowledge graph, capturing connections between user intentions.
Outcome: The proposed model outperforms state-of-the-art methods and shows its utility.
TRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for multihop Knowledge Graph Question Answering (KGQA) treat each reasoning step independently and fail to leverage experience from prior explorations, leading to fragmented reasoning and redundant exploration.
Approach: They propose a framework that unifies LLM-driven contextual reasoning with exploration prior integration to enhance coherence and robustness of multihop KGQA.
Outcome: Extensive experiments on multiple KGQA benchmarks show that TRACE outperforms state-of-the-art methods.
FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discovery (2023.findings-acl)

Copied to clipboard

Challenge: Existing intention-based studies on recommendation tasks are limited and use models to implicitly model the intention memberships.
Approach: They propose a framework that leverages the generation power of large language models and human-in-the-loop annotation to semi-automatically construct the intention knowledge graph.
Outcome: The proposed framework can model e-commerce knowledge and have many potential applications.
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs.
Approach: They propose a framework that integrates dialogue, reasoning, and personalized recommendation.
Outcome: Experiments across public benchmarks show state-of-the-art performance.
Asymmetric Relational-Geometry Driven Universal Adversarial Perturbations for Vision-Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing universal adversarial perturbation (UAP) methods suffer from limited cross-model transferability in black-box scenarios.
Approach: They propose an optimization-based framework that learns universal perturbations under an asymmetric relational-geometry driven objective.
Outcome: The proposed framework outperforms state-of-the-art models in black-box transfer settings.
Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training (2021.emnlp-main)

Copied to clipboard

Challenge: Named entity recognition models require abundant high-quality annotations to train . distant supervision may induce incomplete and noisy labels, making supervised learning ineffective.
Approach: They propose a noise-robust learning scheme for training named entity recognition models using only distantly-labeled data and a self-training method that uses contextualized augmentations created by pre-trained language models.
Outcome: The proposed method outperforms existing supervised NER models on three datasets by significant margins.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations