Papers by Zihao Li

51 papers
Feature Extraction and Steering for Enhanced Chain-of-Thought Reasoning in Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) can solve reasoning and mathematical problems using the Chain-of-Thought technique, but require costly and long CoT data and fine-tuning.
Approach: They propose a method that uses Sparse Autoencoders to extract interpretable features from vanilla CoT and use them to steer the LLM's internal states.
Outcome: The proposed method uses Sparse Autoencoders (SAEs) to extract interpretable features from vanilla CoT and steer the LLM's internal states during generation.
DisCo_Speech: Controllable Zero-Shot Speech Generation with A Disentangled Speech Codec (2026.acl-long)

Copied to clipboard

Challenge: DisCo-Speech is a zero-shot controllable text-to-speech framework . standard codecs entangle timbre and prosody, which hinders independent control in continuation-based LMs.
Approach: They propose a disentangled speech codec and an LM-based generator to solve this problem . they propose fusion and reconstruction that merges content and prosody into unified tokens .
Outcome: DisCo-Speech achieves competitive voice cloning and superior zero-shot prosody control.
Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques.
Approach: They propose a method that uses Extended Chain-of-Thought (EFT) to reduce the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning.
Outcome: The proposed method reduces the number of output tokens by nearly 40% while maintaining the accuracy of the reasoning.
PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions (2025.findings-emnlp)

Copied to clipboard

Challenge: Current physics benchmarks focus on text-only inputs or only on problem-solving . current physics reasoning benchmarks neglect critical intermediate steps of variable identification and process formulation.
Approach: a new benchmark evaluates multimodal large language models in physics reasoning . the benchmark measures variables, process formulations, and solution derivation .
Outcome: PhysicsArena is the first multimodal physics reasoning benchmark . it evaluates MLLMs across three critical dimensions: variable identification, process formulation, and solution derivation.
LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing (2024.emnlp-main)

Copied to clipboard

Challenge: a comparative analysis of paper (meta-)reviews by large language models (LLMs) aims to identify and distinguish LLMs from human activities .
Approach: They present a comparative analysis to identify and distinguish LLM activities from human activities.
Outcome: The proposed analysis aims to improve recognition of instances when someone implicitly uses LLMs for reviewing activities.
RippleCOT: Amplifying Ripple Effect of Knowledge Editing in Language Models via Chain-of-Thought In-Context Learning (2024.findings-emnlp)

Copied to clipboard

Challenge: et al., 2022: ripple effect challenges knowledge editing for large language models.
Approach: They propose a method to improve the accuracy of large language models by integrating Chain-of-Thought reasoning into the ICL editing approach.
Outcome: RIPPLE-COT outperforms the state-of-the-art on the ripple effect, with gains ranging from 7.8% to 87.1%.
Enabling Stroke-Level Structural Analysis of Hieroglyphic Scripts without Language-Specific Priors (2026.findings-acl)

Copied to clipboard

Challenge: Existing structural analysis methods for hieroglyphic scripts are script-specific and labor-intensive.
Approach: They propose a hieroglyphic Stroke Analyzer framework that captures character-internal structures and semantics without handcrafted data.
Outcome: The proposed framework captures character-internal structures and semantics without priors . it can be used to generalize hieroglyphic scripts across languages .
CharacterCraft: Bridging the Literature-Reality Dialogue Gap for Practical Role-Playing Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing dialogue datasets have a bias between query distributions and real-world user language usage.
Approach: They propose a framework for Chinese role-playing and a robust evaluation method . they propose specialized Chinese dialogue extraction model and specialized memory retrieval module .
Outcome: The proposed framework extracts character dialogue from novels and ensures high data quality.
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) represent significant strides toward artificial general intelligence (AGI).
Approach: They introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics.
Outcome: The framework reveals intrinsic patterns and mechanisms of LLMs in non-English languages, with Hungarian serving as an example.
Defense Against Prompt Injection Attack by Leveraging Attack Techniques (2025.acl-long)

Copied to clipboard

Challenge: Recent attacks leverage LLMs’ instruction-following abilities and their inabilities to distinguish instructions injected in the data content.
Approach: They invert the intention of prompt injection methods to develop novel defense methods based on previous training-free attack methods by repeating the attack process with the original input instruction rather than the injected instruction.
Outcome: The proposed methods outperform existing defense approaches, achieving state-of-the-art results.
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation.
Approach: They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments .
Outcome: The proposed model enables high-fidelity generation of synthetic user conversation.
A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives (2024.emnlp-main)

Copied to clipboard

Challenge: Pretrained language models (PLMs) display impressive performances and have captured the attention of the NLP community.
Approach: They propose to compare multilingual pretraining objectives in a controlled methodological environment with multilingual models.
Outcome: The proposed model outperforms existing models in 6 languages and demonstrates that multilingual translation is an effective pretraining objective under the right conditions.
MMedAgent: Learning to Use Medical Tools with Multi-modal Agent (2024.findings-emnlp)

Copied to clipboard

Challenge: Multi-modal Large Language Models (MLLMs) exhibit limited generality and often fall short when compared to specialized models.
Approach: They propose a multi-modal medical agent that picks the most suitable medical tools based on user inputs.
Outcome: The proposed agent performs better than open-source models and the closed-source model, GPT-4o.
A Neural-Symbolic Approach to Natural Language Understanding (2022.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models have enabled deep neural networks to perform natural language understanding tasks, but their performance can drastically deteriorate when logical reasoning is needed.
Approach: They propose a framework for NLU based on analogical reasoning based upon neural processing and logical reasoning using both neural and symbolic processing.
Outcome: The proposed framework outperforms state-of-the-art methods on two NLU tasks, question answering (QA) and natural language inference (NLI).
Eliciting Implicit Acoustic Styles from Open-domain Instructions to Facilitate Fine-grained Controllable Generation of Speech (2025.emnlp-main)

Copied to clipboard

Challenge: Current work relies on pre-defined rules or templates to control the style of speech.
Approach: They propose to use open-domain instructions to generate speech with the acoustic style that meets users’ needs based on their instructions.
Outcome: The proposed model can be used to generate speech with the acoustic style that meets users’ needs based on open-domain instructions.
Generative Music Models’ Alignment with Professional and Amateur Users’ Expectations (2025.findings-acl)

Copied to clipboard

Challenge: Recent years have witnessed rapid advances in text-to-music generation using large language models.
Approach: They propose a task to align AI-generated music with human expressions . they use a dataset of over 1.5 million songs to analyze their content .
Outcome: The proposed framework outperforms baseline models and facilitates end-to-end generation of songs audio.
SIFT: Grounding LLM Reasoning in Contexts via Stickers (2025.findings-emnlp)

Copied to clipboard

Challenge: Using a new approach, we can improve the pass@1 accuracy of LLM reasoning in large language models.
Approach: They propose a method that leverages increasing inference-time compute to ground LLM reasoning in contexts.
Outcome: The proposed approach improves pass@1 accuracy of DeepSeek-R1 on AIME2024 from 78.33% to **85.67%** and that on Aime2025 from 69.8% to **77.33%**.
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching (2026.acl-long)

Copied to clipboard

Challenge: Existing routing methods rely on direct mapping from queries to models based on surface-level features, leading to poor generalizability on out-of-distribution data.
Approach: They propose a new routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs.
Outcome: The proposed framework improves matching accuracy while lowering inference costs . it decouples linguistic surface forms from task-intrinsic requirements .
Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed the rise of reasoningintensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers.
Approach: They propose a large-small LLM collaboration framework that synergizes large and small language models to achieve high-quality reasoning with significantly reduced computational cost.
Outcome: The proposed framework outperforms the mentor LLM while preserving the benefits of the thinking paradigm of LLMs.
Tackling Long-Tailed Relations and Uncommon Entities in Knowledge Graph Completion (D19-1)

Copied to clipboard

Challenge: Recent studies have focused on the large proportion of infrequent relations which have been ignored by previous studies.
Approach: They propose a meta-learning framework that aims at handling infrequent relations with few-shot learning and uncommon entities by using textual descriptions.
Outcome: The proposed framework outperforms existing methods when dealing with infrequent relations and uncommon entities.
Learning to Translate by Translating: Stabilizing the Dual Loop via Semantic-Aware Self-Evolution (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been successful in machine translation, but lack of high-quality parallel corpora and cost constrain scalability.
Approach: They propose an LLM-driven dual-learning framework that enables autonomous translation . they employ a robust semantic-aware reward function that balances adequacy with reconstruction fidelity .
Outcome: The proposed model outperforms larger models on benchmarks and achieves parity with state-of-the-art supervised baselines on mainstream benchmarks.
Too Good to be Bad: On the Failure of LLMs to Role-Play Villains (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly tasked with creative generation, but their ability to portray non-prosocial, antagonistic personas remains largely unexamined.
Approach: They propose a moral alignment benchmark to test the safety of large language models . they find that models struggle with traits directly antithetical to safety principles .
Outcome: The proposed model fails to accurately portray morally ambiguous or villainous characters . the model fails most with traits directly antithetical to safety principles .
Reinforcement Learning on Pre-Training Data (2026.acl-long)

Copied to clipboard

Challenge: Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings.
Approach: They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data.
Outcome: Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base.
Thinking Economically: A Hierarchical Framework for Adaptive-Complexity Reasoning in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing efficiency methods for Chain-of-Thought (CoT) generate excessively long rationales without commensurate accuracy gains.
Approach: They propose a training framework that operationalizes this principle through coarse-to-fine budgeting.
Outcome: Experiments on GSM8K and MATH500 show that HAB surpasses standard CoT in accuracy and reduces token usage, achieving stronger performance-efficiency trade-off than baselines.
A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated capabilities for generating content that could be deemed harmful.
Approach: They conduct a comprehensive analysis of existing studies on jailbreaking LLMs and their defense techniques.
Outcome: The proposed techniques underperform existing white-box attacks and include special tokens significantly affects the likelihood of successful attacks.
CAST: Achieving Stable LLM-based Text Analysis for Data Analytics (2026.findings-acl)

Copied to clipboard

Challenge: Text analysis of tabular data relies on two core operations: summarization for corpus-level theme extraction and tagging for row-level labeling.
Approach: They propose a framework that enhances output stability by constraining the model’s latent reasoning trajectory.
Outcome: The proposed framework improves stability by constraining the model's latent reasoning trajectory.
Model Unlearning via Sparse Autoencoder Subspace Guided Projections (2025.emnlp-main)

Copied to clipboard

Challenge: Existing unlearning strategies lack interpretability or fail to provide robust defense against adversarial prompts.
Approach: They propose a framework that leverages SAE features to drive targeted updates in the model’s parameter space.
Outcome: The proposed framework reduces harmful knowledge accuracy by 3.22% compared to baselines and improves adversarial robustness under jailbreak prompts.
LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Modern large language models (LLMs) employ diverse logical inference mechanisms for reasoning.
Approach: They analyze the comparative dynamics of inductive (System 1) versus abductive/deductive (system 2) inference in large language models by using a controlled analogical reasoning environment and a MCQ/free-text task format.
Outcome: The proposed methods can significantly scale LLM reasoning.
Scaling Low-Resource MT via Synthetic Data Generation with LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: a recent study has shown that LLM-generated synthetic data can improve low-resource machine translation performance . traditional data augmentation techniques like back-translation preserve the human-written target and synthesize the other .
Approach: They construct a document-level synthetic corpus from English Europarl and extend it via pivoting to 147 additional language pairs.
Outcome: The proposed model can significantly improve low-resource machine translation performance even when noisy.
Enhancing Transformers for Generalizable First-Order Logical Entailment (2025.acl-long)

Copied to clipboard

Challenge: Moreover, transformers have demonstrated proficiency in logical reasoning over natural language.
Approach: They propose a logic-aware architecture that improves the performance in generalizable first-order logical entailment by combining distribution shifts and unseen knowledge.
Outcome: The proposed architecture outperforms methods designed specifically for knowledge graph query answering on a dataset with a large dataset.
AudioStealer: Extracting Audio Prompts via Shapley Value-Guided Query Search (2026.findings-acl)

Copied to clipboard

Challenge: prompt stealing is a new form of attack that aims to reconstruct high-value prompts that guide music generation.
Approach: They propose a method to steal music prompts from audio domains using a black-box attack framework.
Outcome: The proposed method recovers prompts with high textual consistency to the ground truth while maintaining strong perceptual similarity to the target recordings.
MMSearch-R1: Incentivizing LMMs to Search (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to deploying large multimodal models rely on rigid pipelines . Existing methods such as retrieval-augmented generation and prompt engineered search rely only on rigid knowledge sources.
Approach: They propose a framework that enables LMMs to perform on-demand, multi-turn search in real-world Internet environments.
Outcome: The proposed model outperforms existing models while reducing search calls by over 30%.
GLIMPSE: Do Large Vision-Language Models Truly Think With Videos or Just Glimpse at Them? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing video benchmarks often resemble image-based questions with scans of only a few key frames, without deep temporal reasoning.
Approach: They propose a video benchmark to assess whether large vision-language models can genuinely think with videos rather than perform superficial frame-level analysis.
Outcome: The proposed benchmark consists of 3,269 videos and over 4,342 highly visual-centric questions across 11 categories, including Trajectory Analysis, Temporal Reasoning, and Forensics Detection.
Mnemis: Dual-Route Retrieval on Hierarchical Graphs for Long-Term LLM Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for retrieving historical messages are based on similarity-based mechanisms.
Approach: They propose a system that integrates System-1 similarity search with a complementary System-2 mechanism, termed Global Selection.
Outcome: The proposed framework achieves state-of-the-art on long-term memory benchmarks and 93.9 on LoCoMo and 91.6 on LongMemEval-S.
CODIS: Benchmarking Context-dependent Visual Comprehension for Multimodal Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Multimodal large language models have demonstrated promising results in a variety of tasks that combine vision and language.
Approach: They propose a benchmark to assess the ability of models to use contextual information in free-form text to enhance visual comprehension.
Outcome: The proposed model fails to extract and utilize contextual information to improve understanding of images.
Not All Voices Are Rewarded Equally: Probing and Repairing Reward Models across Human Diversity (2025.findings-emnlp)

Copied to clipboard

Challenge: Using real-world datasets, we conduct the most comprehensive study to date, auditing various state-of-the-art reward models across nine sensitive attributes, including age, gender, ethnicity, etc.
Approach: They propose a method to mitigate group disparities in reward modeling by using real-world data.
Outcome: The proposed method is based on a population-based dataset with nine demographic attributes, including gender, ethnicity, age, gender, and ethnicity.
Breaking the Reasoning Barrier A Survey on LLM Complex Reasoning through the Lens of Self-Evolution (2025.findings-acl)

Copied to clipboard

Challenge: OpenAI's O1 and subsequent projects like DeepSeek R1 have significantly advanced research on complex reasoning in LLMs.
Approach: They analyze existing reasoning studies from the perspective of self-evolution and summarize O1-like works from open-source projects like DeepSeek R1 and Kimi-k1.5.
Outcome: The proposed models are based on open-source models and pioneer advanced methodologies like Scaling Reinforcement Learning (RL).
Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structure (2020.coling-main)

Copied to clipboard

Challenge: Multiparty dialog applications such as discourse parsing and meeting summarization are now mainstream research.
Approach: They propose to annotate a machine reading comprehension dataset with discourse structure built over multiparty dialog using a modified Segmented Discourse Representation Theory (SDRT) style.
Outcome: The proposed dataset contributes large-scale discourse dependency annotations in a modified Segmented Discourse Representation Theory (SDRT) style for all of its multiparty dialogs, and achieves only 67.7% F1 on Molweni’s questions, a 20+% significant drop as compared against its SQuAD 2.0 performance.
SegTune: Structured and Fine-Grained Control for Song Generation (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in neural song generation have enabled high-quality synthesis from lyrics and global textual prompts.
Approach: They propose a framework that allows users to specify local musical descriptions aligned to song segments.
Outcome: The proposed framework outperforms baselines in musicality and controllability.
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents.
Approach: They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution.
Outcome: The proposed framework enables agents to tackle unseen software-developing tasks more effectively.
Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Memory Editing (ME) has emerged as an efficient method to modify erroneous facts or inject new knowledge into Large Language Models (LLMs).
Approach: They propose to evaluate LLMs with single edit only and parameter-modifying ME with parameter-preserving ME.
Outcome: The proposed method can maintain LLMs’ fundamental capabilities but struggles to accurately recall edited knowledge presented in a different format.
RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarking (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) integrates knowledge from tables with an external knowledge base to improve the answer relevance and accuracy.
Approach: They propose a table-corpora-aware RAG framework called T-RAG to integrate external knowledge into Large Language Models (LLMs) they then develop a multi-table question answering benchmark called MultiTableQA which spans 3 different task types, 57,193 tables, and 23,758 questions in total.
Outcome: The proposed framework achieves state-of-the-art accuracy, recall, and runtime performance, with improvements of up to 9.4%.
JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse (2025.findings-acl)

Copied to clipboard

Challenge: Visual Language Action models have shown promise in decision-making tasks, but have been neglected in previous work .
Approach: They propose a new paradigm for visual language action models that enhances the foundation model prior to action-specific tuning by first post-training it on a curated set of visual and linguistic tasks using self-supervised learning.
Outcome: The proposed model outperforms the best agent baseline on a diverse set of atomic tasks and surpasses imitation learning-based policies in Minecraft.
Trucidator: Document-level Event Factuality Identification via Hallucination Enhancement and Cross-Document Inference (2025.coling-main)

Copied to clipboard

Challenge: Document-level event factuality identification (DEFI) assesses the veracity degree to which an event mentioned in a document has happened.
Approach: They propose a document-level event factuality identification framework with hallucination features . they propose factualusion corpus that integrates both genuine and hallucinous false information .
Outcome: The proposed framework outperforms baselines in document event factuality identification.
Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision? (2025.acl-long)

Copied to clipboard

Challenge: Graph Neural Networks (GNNs) with CLIP pipeline are difficult because of the scarcity of labeled data and text supervision, different levels of downstream tasks, and conceptual gaps between domains.
Approach: They propose a multi-modal prompt learning paradigm to adapt pre-trained GNNs to downstream tasks with weak text supervision.
Outcome: The proposed model can generalize graphs to unseen classes with weak text supervision.
Test-Time Scaling of Reasoning Models for Machine Translation (2026.eacl-long)

Copied to clipboard

Challenge: Using TTS, Reasoning Models (RMs) are able to perform tasks such as math and coding with limited results.
Approach: They evaluate 12 Reasoning Models across a diverse suite of MT benchmarks, examining three scenarios: direct translation, forced-reasoning extrapolation, and post-editing.
Outcome: The proposed approach improves translation quality on three domains, with inconsistent results for general-purpose RMs and performance plateauing.
GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing evaluation frameworks focus on English and a handful of high-resource languages, thereby overlooking the realistic performance of large language models in multilingual and lower-resourced scenarios.
Approach: They propose a unified and lightweight framework that integrates 27 benchmarks under a standard ISO 639-3 language identifier system to enable seamless incorporation of new benchmarks.
Outcome: The proposed framework integrates 27 benchmarks under a standard ISO 639-3 language identifier system, allowing for seamless incorporation of new benchmarks.
Data-Centric Continual Pre-training for 500+ Languages: A New Bilingual Translation Corpus and Multilingual Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models pre-trained on massive data have promoted multilingual natural language processing (NLP).
Approach: They construct a bilingual translation corpus with 2,500 language pairs and develop a suite of four models with parallel data.
Outcome: The proposed model suites are evaluated across 7 tasks and 12 benchmarks.
Efficient Sparse Attention needs Adaptive Token Release (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide array of text-centric tasks, however, their ‘large’ scale introduces significant computational and storage challenges, particularly in managing the key-value states of the transformer, which limits their wider applicability.
Approach: They propose to release resources from caches and rebuild key-value states by a lightweight controller module to approximate an ideal top-K sparse attention.
Outcome: The proposed method achieves a significant throughput improvement of 221.8% over full attention and a model with 7 billion tokens.
Activation-Guided Local Editing for Jailbreaking Attacks (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for jailbreaking Large Language Models (LLMs) are limited and produce incoherent or unreadable inputs.
Approach: They propose a two-stage framework that performs a one-shot, scenario-based generation of context and rephrases the original malicious query to obscure its harmful intent.
Outcome: The proposed framework achieves state-of-the-art Attack Success Rate, with gains of up to 37.74% over the strongest baseline, and excellent transferability to black-box and large-scale models.
Token-level Preference Self-Alignment Optimization for Multi-style Outline Controllable Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing attempts to outline generation are limited by response pair requirements and substantial computation costs.
Approach: They propose a token-level preference self-alignment optimization for outline controllable generation that extends the Bradley-Terry model from pair-wise to list-wise comparison.
Outcome: The proposed method outperforms existing methods by 19.28% in performance while requiring only 56.25% training time.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations