Papers by Jun Fang

18 papers
DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) decoding in large language models is latency-bounded by strictly sequential token generation.
Approach: They propose a diffusion-based drafter that proposes multi-token candidates and then verifies them in parallel by the target model.
Outcome: The proposed drafter generates multi-token proposals in a single forward pass while remaining compatible with standard AR verifiers.
Thinking with DistilQwen: A Tale of Four Distilled Reasoning and Reward Model Series (2025.emnlp-industry)

Copied to clipboard

Challenge: In the rapidly evolving landscape of large language models, the need for efficient reasoning models has become increasingly urgent.
Approach: They extend the Qwen model family by introducing four model series specifically designed for industrial applications.
Outcome: The proposed models outperform previous models in multiple benchmarks and provide scalable training and inference functionality on the Alibaba Cloud PAI platform.
Spiral of Silence in Large Language Model Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing theories of Spiral of Silence do not apply to large language models .
Approach: They propose an evaluation framework for examining SoS in large language models . they consider four controlled conditions that vary the availability of "History" and "Persona" signals .
Outcome: The proposed framework examines the SoS-like dynamics in large language models . it shows that history and persona together produce strong majority dominance .
Enhancing Reasoning Abilities of Small LLMs with Cognitive Alignment (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to distill chain-of-thought (CoT) results from large language reasoning models (LRMs) to small models are ineffective and require substantial amount of annotated data.
Approach: They propose a Critique-Rethink-Verify system for training small language reasoning models that can be critiquized according to the cognitive capabilities of smaller models.
Outcome: The proposed system outperforms other methods on challenging reasoning benchmarks.
LEGO-ABSA: A Prompt-based Task Assemblable Unified Generative Framework for Multi-task Aspect-based Sentiment Analysis (2022.coling-1)

Copied to clipboard

Challenge: Existing generative methods focus on a single task at a time.
Approach: They propose a unified generative multi-task framework that can solve multiple ABSA tasks . they propose to control the type of task prompts consisting of multiple element prompts .
Outcome: The proposed framework achieves state-of-the-art results in almost all ABSA tasks and competitive results in task transfer scenarios.
Infinity-Parser: Layout-Aware Reinforcement Learning with High-quality Document Parsing Dataset (2026.findings-acl)

Copied to clipboard

Challenge: Existing supervised fine-tuning methods struggle to generalize across document types, leading to poor performance.
Approach: They propose layoutRL, a reinforcement learning framework that optimizes layout understanding through composite rewards integrating normalized edit distance, paragraph count accuracy, and reading order preservation.
Outcome: The proposed model outperforms specialized document parsing systems and general-purpose vision-language models on a broad range of document types, languages, and structural complexities.
TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack (2022.emnlp-main)

Copied to clipboard

Challenge: Existing adversarial models rely on keyword matching and ignore relevant contextual relations for answer prediction.
Approach: They propose to use keyword matching to attack model with two biases that rely on a perturbed answer sentence and a distracting answer sentence to misguide model.
Outcome: The proposed method produces fluent and grammatical adversarial contexts while maintaining gold answers.
D-Artemis: A Deliberative Cognitive Framework for Mobile GUI Multi-Agents (2026.findings-acl)

Copied to clipboard

Challenge: Graphical User Interface (GUI) agents aim to automate a wide spectrum of human tasks by emulating user interaction.
Approach: They propose a deliberative framework that leverages a fine-grained tip retrieval mechanism to inform its decision-making process.
Outcome: The proposed framework achieves SOTA among open-source general models on AndroidWorld and ScreenSpot-V2 . it leverages a fine-grained, app-specific tip retrieval mechanism to inform its decision-making process .
Listening Like Humans: Semantics-Guided Noise-Robust Multimodal Speech Recognition (2026.acl-long)

Copied to clipboard

Challenge: Severe acoustic degradation results in unreliable ASR outputs . et al., 2024b): critical concerns regarding reliability and fairness of ASR .
Approach: They propose a multimodal framework that reframes ASR as semantics-guided speech reconstruction.
Outcome: The proposed framework achieves an average reduction in WER while also attaining 98.71% BERTScore and 96.7% USE over advanced baselines.
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment.
Approach: They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge.
Outcome: The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses.
GROLE: Instance-Level Group Relative Optimization for LoRA Experts in Incremental Learning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models demonstrate remarkable zero-shot generalization, but adapting to downstream tasks requires continual fine-tuning.
Approach: They propose a method that incrementally constructs a pool of frozen, task-specific LoRA experts.
Outcome: The proposed approach outperforms state-of-the-art methods in task-free and blurred-boundary settings.
Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications (2022.coling-1)

Copied to clipboard

Challenge: BackDoor Attack (BDA) study aims to train a poisoned model with clean data and some trigger-embedded instances to perform normally on normal inputs.
Approach: They propose to train a poisoned model with clean and poisonest inputs . they propose to use triggers to predict those poisonets as target labels .
Outcome: The proposed model can predict P2P dynamically without human intervention.
Dual-Reasoner: Bridging Interleaved Atomicity and Streaming Latency via Thinking-while-Talking (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to integrate Chain-of-Thought into spoken dialogue models incur prohibitive latency.
Approach: They propose a Streaming Masking Mechanism to ensure uninterrupted audio streaming . they use a quadruple-constraint system to reconstruct logical atomicity .
Outcome: Experimental results show that Dual-Reasoner improves speech generation performance with low latency.
UniGeM: Unifying Data Selection and Mixing via Geometric Exploration and Mining (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) scaling is limited by data quality and domain mixing and instance selection are two separate problems.
Approach: They propose a framework that unifies mixing and selection without training proxy models or relying on external reference datasets.
Outcome: The proposed framework achieves 2.0 data efficiency over a random baseline and further improves overall performance compared to SOTA methods in reasoning-heavy evaluations and multilingual generalization.
Leveraging AMR Graph Structure for Better Sequence-to-Sequence AMR Parsing (2024.lrec-main)

Copied to clipboard

Challenge: Recent studies on AMR parsing often regard this task as a seq2seq translation problem.
Approach: They propose to translate AMR graphs into AMR token sequences in pre-processing and recover AMR from sequences after decoding.
Outcome: The proposed approach outperforms baseline and achieves 85.5 0.1 and 84.2 0.2 Smatch scores on AMR 2.0 and AMR 3.0.
GUICourse: From General Vision Language Model to Versatile GUI Agent (2025.acl-long)

Copied to clipboard

Challenge: Graphical User Interfaces (GUIs) are a pivotal medium for human-computer interaction.
Approach: They propose a series of datasets for training visual-based GUI agents using general VLMs.
Outcome: The proposed GUICourse datasets show that even a small-sized GUI agent performs better on GUI tasks.
Train in Vain: Functionality-Preserving Poisoning to Prevent Unauthorized Use of Code Datasets (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for dataset poisoning require full-dataset poison, which breaks code compilability.
Approach: They propose a functionality-preserving poisoning approach that injects short, compilable weak-use fragments into executed code paths.
Outcome: The proposed method contaminates 10% of the dataset while maintaining 100% compilability and functional correctness.
Reasoning with OmniThought: A Large CoT Dataset with Verbosity and Cognitive Difficulty Annotations (2026.acl-long)

Copied to clipboard

Challenge: Existing resources often fail to provide extensive reasoning problems with coherent CoT processes distilled from multiple teacher models.
Approach: They propose a large-scale dataset featuring 2 million CoT processes generated by multiple powerful LRMs.
Outcome: The proposed dataset features 2 million CoT processes and is validated by multiple powerful LRMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations