Papers by Xiaomeng Wang

12 papers
Learning Personalized Alignment for Evaluating Open-ended Text Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Traditional evaluation metrics rely heavily on lexical similarity with human-written references, showing poor correlation with human judgments and failing to account for alignment with the diversity of human preferences.
Approach: They propose an interpretable evaluation framework that evaluates alignment with specific human preferences by providing detailed comments and fine-grained scoring.
Outcome: The proposed framework outperforms GPT-4 in Kendall correlation and accuracy with zero-shot reviewers.
Towards Rationality in Language and Multimodal Agents: A Survey (2025.naacl-long)

Copied to clipboard

Challenge: despite advances in language and multimodal agents, large language models lack rationality . despite their progress, large-scale models lack real-world grounding and feedback mechanisms .
Approach: They propose to build more rational language and multimodal agents . they also examine what criteria define rationality in intelligent systems .
Outcome: This paper assesses the state-of-the-art in language and multimodal agents . it also outlines open challenges and future research directions .
Typographic Attacks in a Multi-Image Setting (2025.naacl-long)

Copied to clipboard

Challenge: Large Vision-Language Models are susceptible to typographic attacks, which are misclassifications caused by an attack text that is added to an image.
Approach: They propose a multi-image setting for studying typographic attacks by leveraging the difficulty of the target image, the strength of the attack text, and text-image similarity.
Outcome: The proposed approach improves success rates by 21% over random, non-specific methods on the CLIP model while maintaining stealth in a multi-image scenario.
Zuo Zhuan Ancient Chinese Dataset for Word Sense Disambiguation (2022.naacl-srw)

Copied to clipboard

Challenge: Word Sense Disambiguation (WSD) is a core task in natural language processing . ancient Chinese has rarely been used in WSD tasks due to lack of a dataset .
Approach: They annotate ancient Chinese text Zuo Zhuan using a copyright-free dictionary . they apply a method to find the most appropriate sense in a context using k-NN .
Outcome: The proposed dataset will be available on GitHub.
SYNTHIA: Novel Concept Design with Affordance Composition (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on concept design using text-to-image models have enabled rapid ideation of novel visual concepts.
Approach: They propose a framework for generating novel, functionally coherent designs based on desired affordances by decomposing concepts into parts and affordance . they also develop a curriculum learning scheme that fine-tunes T2I models to progressively learn affordance composition while maintaining visual novelty.
Outcome: The proposed framework outperforms state-of-the-art models for novelty and functional coherence in human evaluation.
Fine-Grained Data Ordering Improves Fine-Tuning for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Prior work focused on data preprocessing, focusing on filtering and cleaning data . a study aimed to improve fine-grained scheduling of data order in epochs .
Approach: They propose a fine-grained scheduling method of data order in epochs to fill this gap . they define data difficulty based on relevance between data and model .
Outcome: The proposed method improves on pre-training and small-scale fine-tuning experiments 2.4% over baselines.
ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research has focused on optimizing general-purpose large language models to downstream tasks . however, these approaches inherently introduce data dependency, which hinders generalization and reusability.
Approach: They propose an algorithm that localizes the most task-sensitive attention heads and prunes by restricting attention training updates to these heads, thereby reducing alignment costs.
Outcome: The proposed algorithm achieves 2% performance improvement over baselines on three tasks while localizing the most task-sensitive attention heads.
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)

Copied to clipboard

Challenge: Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL).
Approach: They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
Outcome: The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners (2024.emnlp-main)

Copied to clipboard

Challenge: a new hypothesis-testing framework is developed to assess whether large language models possess genuine reasoning abilities or primarily depend on token bias.
Approach: They propose a framework to assess whether large language models have genuine reasoning abilities or primarily depend on token bias.
Outcome: The proposed framework outlines a list of hypotheses where token biases are readily identifiable . the results suggest that most LLMs still struggle with logical reasoning .
CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for instruction tuning rely on expensive human-annotated seed data or powerful external teacher models.
Approach: They propose a framework that achieves fully seed-free instruction tuning by employing a dual self-training loop where two models are bootstrapped solely from raw, unlabeled text.
Outcome: The proposed framework outperforms seed-driven back-translation baselines and achieves comparable performance to strongly supervised methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations