Papers by Ting Ye

8 papers
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Recent research has focused on pushing weight-only quantization to extremely low-bit due to numerical representation limitations.
Approach: They propose a vector-based quantization approach that pushes LLMs to extremely low-bit . they propose scalar-based weight quantization that reduces memory requirements and optimizes storage costs .
Outcome: The proposed method reduces model quantization perplexity by 0.01-0.34 on LLaMA-2, 0.38-0.68 on mistral-7B, 4.41-7.34, on llaMA-3 on QA tasks on average.
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach: They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome: The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches treat instruction-based text editing as a generic text generation problem. Existing methods either over-edit or fail to apply modifications consistently.
Approach: They propose a framework that processes each editing request to best align with it.
Outcome: The proposed framework achieves 9% improvement over the state-of-the-art model.
Shadow-Activated Backdoor Attacks on Multimodal Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing backdoor attacks on Multimodal Large Language Models are less applicable to open-ended conversations with users.
Approach: They propose a shadow-activated backdoor attack scenario where attackers inject malicious content into the responses of MLLMs when the responses explicitly relate to the shadowed object.
Outcome: The proposed framework achieves the desired behaviors by constructing a poisoned dataset and implementing an attention-regularized tuning strategy.
FastSeq: Make Sequence Generation Faster (2021.acl-demo)

Copied to clipboard

Challenge: Transformer-based models have made tremendous impact in natural language generation, but inference speed is still a bottleneck due to large model size and intensive computing involved in auto-regressive decoding process.
Approach: They propose an attention cache optimization, an efficient algorithm for detecting repeated n-grams, and an asynchronous generation pipeline with parallel I/O to accelerate sequence generation without loss of accuracy.
Outcome: The proposed framework can accelerate the sequence generation by 4x to 9x with a simple one-line code change for a set of widely used and diverse models.
AutoVecCoder: Teaching LLMs to Generate Explicitly Vectorized Code (2026.findings-acl)

Copied to clipboard

Challenge: Current development practices face a dichotomy between automation and performance.
Approach: They propose a framework to empower LLMs with the capability of automated explicit vectorization.
Outcome: The proposed framework achieves state-of-the-art performance on the SSE and AVX subsets of SimdBench.
Process-Supervised Reinforcement Learning for Code Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing reinforcement learning strategies based on outcome supervision have shown effectiveness in code generation tasks, but their effectiveness in the field of code generation remains limited.
Approach: They propose a method that uses a teacher model to mutate and refactor statements and a compiler to automatically label them.
Outcome: The proposed method improves performance in complex code generation tasks.
Query-aware Multi-modal based Ranking Relevance in Video Search (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing relevance ranking methods focus on text modality, incapable of fully exploiting cross-modal cues present in video.
Approach: They propose a QUery-Aware pre-training model with multi-modality that integrates video tag information as alignment targets and enhances ranking optimization method based on ordinal regression.
Outcome: The proposed model significantly improves video search performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations