Papers by Ting Hu

30 papers
R2A-TLS: Reflective Retrieval-Augmented Timeline Summarization with Causal-Semantic Integration (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods struggle to capture coherent event narratives due to fragmented descriptions . Existing approaches accumulate noise through iterative retrieval strategies that lack relevance evaluation.
Approach: They propose a reflective retrieval-augmented timeline summarization with Causal-Semantic Intergration approach for open-domain timeline summarizing .
Outcome: The proposed approach outperforms the best prior published approaches.
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for Referring Expression Comprehension (REC) lack specific domain abilities for precise local visual perception and visual-language alignment.
Approach: They propose a framework for Parameter-Efficient Transfer Learning to localize a visual region via natural language using a prior-guided prior.
Outcome: The proposed framework achieves the best accuracy compared to the current methods with only 1.41% tunable backbone parameters.
Lil: Less is Less When Applying Post-Training Sparse-Attention Algorithms in Long-Decode Stage (2026.findings-acl)

Copied to clipboard

Challenge: Prior work typically decomposes inference into prefill and decode stages, with the decode stage dominating total latency.
Approach: They propose an algorithm that detects threshold where information loss exceeds information gain during sparse decoding to reduce token consumption by up to 90% and a marginal accuracy degradation of less than 2%.
Outcome: The proposed algorithm reduces token consumption by 90% with a marginal accuracy degradation of less than 2% across reasoning-intensive benchmarks.
IFlyEA: A Chinese Essay Assessment System with Automated Rating, Review Generation, and Recommendation (2021.acl-demo)

Copied to clipboard

Challenge: Automated Essay Assessment (AEA) aims to judge students’ writing proficiency in an automatic way.
Approach: They propose to use Chinese AEA system IFlyEssayAssess to evaluate essays written by native Chinese students from primary and junior schools.
Outcome: The proposed system provides application services for essay scoring, review generation, recommendation, and explainable analytical visualization.
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing role-play fine-tuning techniques improve role adaptability but may degrade safety performance, especially for villainous characters.
Approach: They propose safety-aware Role-Play Fine-Tuning (SaRFT) to balance role-playing capabilities and safety.
Outcome: The proposed method outperforms state-of-the-art baselines under both LoRA and full-parameter fine-tuning settings.
Cross-Lingual Machine Reading Comprehension (D19-1)

Copied to clipboard

Challenge: Existing work on machine reading comprehension task is focused on English, but there are few efforts on other languages due to the lack of large-scale training data.
Approach: They propose a cross-lingual machine reading comprehension task for other languages . they propose cloze-style reading comprehension and various neural network approaches .
Outcome: The proposed model improves reading comprehension performance of Chinese datasets over state-of-the-art systems by a large margin over existing systems.
Adversarial Training for Machine Reading Comprehension with Virtual Embeddings (2021.starsem-1)

Copied to clipboard

Challenge: Neural networks are vulnerable to adversarial examples that have been mixed with certain perturbations.
Approach: They propose a novel adversarial training method that perturbs the embedding matrix instead of word vectors to differentiate the roles of passages and questions.
Outcome: The proposed method is effective universally and further improves the performance of MRC tasks.
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research.
Approach: They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication.
Outcome: The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication.
MPO: Multilingual Safety Alignment via Reward Gap Optimization (2025.acl-long)

Copied to clipboard

Challenge: Existing preference learning methods for safety alignment are monolingual and struggle with noisy multilingual data.
Approach: They propose a multilingual reward gaP optimization approach that leverages the well-aligned safety capabilities of the dominant language to improve safety alignment across multiple languages.
Outcome: Extensive experiments on three LLMs, LLaMA-3.1, Gemma-2 and Qwen2.5, validate MPO’s efficacy in multilingual safety alignment without degrading general multilingual utility.
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach: They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome: The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Best Student Forcing: A Simple Training Mechanism in Adversarial Language Generation (2020.lrec-1)

Copied to clipboard

Challenge: Language models trained with Maximum Likelihood Estimation (MLE) have been considered as a mainstream solution in Natural Language Generation (NLG) however, they are reportedly suffering from training instability and mode collapse, and therefore outperform conventional MLE models.
Approach: They propose a method to improve Generative Adversarial Nets (GANs) using best student forcing and discriminators to increase training stability and sample diversity.
Outcome: The proposed techniques outperform MLE models and outperformed existing approaches in terms of sample diversity and training stability.
CharBERT: Character-aware Pre-trained Language Model (2020.coling-main)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) construct word representations at subword level with Byte-Pair Encoding (BPE) or its variations . but these methods split a word into subword units and make it incomplete and fragile .
Approach: They propose a character-aware pre-trained language model to tackle OOV problems . they construct contextual word embedding for each token from sequential character representations .
Outcome: The proposed model improves on the existing models on multiple NLP benchmarks.
IFlyLegal: A Chinese Legal System for Consultation, Law Searching, and Document Analysis (D19-3)

Copied to clipboard

Challenge: Legal Tech is a system that performs legal consulting, multi-way law searching, and legal document analysis using deep contextual representations and various attention mechanisms.
Approach: They propose a Chinese legal system that performs legal consulting, multi-way law searching, and legal document analysis using deep contextual representations and various attention mechanisms.
Outcome: The proposed system performs legal consulting, multi-way law searching, and legal document analysis by exploiting techniques such as deep contextual representations and various attention mechanisms.
Dataset for the First Evaluation on Chinese Machine Reading Comprehension (L18-1)

Copied to clipboard

Challenge: Existing reading comprehension datasets are mostly in English .
Approach: They propose a Chinese reading comprehension dataset to add diversity to existing reading comprehension data . proposed dataset contains cloze-style reading comprehension and user query reading comprehension .
Outcome: The proposed dataset is based on a Chinese reading comprehension dataset . it includes two types of cloze-style and user query reading comprehension . the proposed dataset hosted the 1st Evaluation on Chinese Machine Reading Comprehension (CMRC-2017)
Neural Multitask Learning for Simile Recognition (D18-1)

Copied to clipboard

Challenge: Simile is a special type of metaphor, where comparators such as like and as are used to compare two objects.
Approach: They propose a neural network framework for simile sentence classification, simile component extraction and language modeling.
Outcome: The proposed framework outperforms rule-based and feature-based approaches in simile sentence classification and simile component extraction tasks.
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (2020.coling-main)

Copied to clipboard

Challenge: Using cloze-style reading comprehension, Chinese machine reading comprehension datasets are becoming more and more popular . a new task is proposed to fill the right candidate sentence into the passage with several blanks .
Approach: They propose a Chinese task to fill the right candidate sentence into a passage with blanks . they build a dataset to evaluate the difficulty of the task and make fake candidates .
Outcome: The proposed task fills the right candidate sentence into the passage with blanks . the proposed dataset contains over 100K blanks within over 10K passages based on Chinese narrative stories .
Don’t Miss the Potential Customers! Retrieving Similar Ads to Improve User Targeting (2021.findings-emnlp)

Copied to clipboard

Challenge: a method for user targeting is developed to identify online users to whom an ad should be targeted.
Approach: They propose a method for automatic augmentation of positive and negative clickthrough data for user targeting models.
Outcome: The proposed method can increase positive and negative instances of positive training instances on two datasets.
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing (2020.acl-demos)

Copied to clipboard

Challenge: Large pre-trained language models have hundreds of millions of parameters and take several gigabytes of memory to train and inference.
Approach: They propose an open-source knowledge distillation toolkit designed for natural language processing that provides a set of predefined distillation methods and can be extended with custom code.
Outcome: The proposed method is comparable with or even higher than the public distilled BERT models with similar numbers of parameters.
Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression (2026.acl-long)

Copied to clipboard

Challenge: Recent methods to reduce the KV cache size fail to identify crucial KVs for generation while excluding others accurately, resulting in severe information loss.
Approach: They propose an intention-aware KV cache eviction method that identifies and retains crucial KVs according to the attention distribution of intention, which semantically reflects the user’s goal and determines which part of the context is relevant.
Outcome: The proposed method can maintain the model performance while reducing the KV cache size from 128K to 2K, leading to a 6.3x increase in decoding speed and 7.8x enhancement in memory efficiency compared to the default setting.
A Span-Extraction Dataset for Chinese Machine Reading Comprehension (D19-1)

Copied to clipboard

Challenge: Existing reading comprehension datasets are mostly in English . MRC is a new field of research that aims to comprehend the context of articles and answer the questions based on them.
Approach: They propose a Span-Extraction dataset for Chinese machine reading comprehension to add language diversities to existing reading comprehension datasets.
Outcome: The proposed dataset is composed of 20,000 real questions annotated on Wikipedia paragraphs by human experts.
Is Graph Structure Necessary for Multi-hop Question Answering? (2020.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on multi-hop question answering across multiple documents or paragraphs.
Approach: They propose a graph neural network to deal with graph structure in textual multi-hop reasoning . they propose 'self-attention' and propose removing entire graph structure may not hurt the final results .
Outcome: The proposed model shows that graph-attention or the entire graph structure can be replaced by self-attention . hotpotQA is a widely used benchmark for multi-hop question answering .
FastSeq: Make Sequence Generation Faster (2021.acl-demo)

Copied to clipboard

Challenge: Transformer-based models have made tremendous impact in natural language generation, but inference speed is still a bottleneck due to large model size and intensive computing involved in auto-regressive decoding process.
Approach: They propose an attention cache optimization, an efficient algorithm for detecting repeated n-grams, and an asynchronous generation pipeline with parallel I/O to accelerate sequence generation without loss of accuracy.
Outcome: The proposed framework can accelerate the sequence generation by 4x to 9x with a simple one-line code change for a set of widely used and diverse models.
Revisiting Pre-Trained Models for Chinese Natural Language Processing (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing pre-trained language models have shown tremendous improvements across various NLP tasks.
Approach: They propose to revisit Chinese pre-trained language models to examine their effectiveness in a non-English language and release the Chinese pretrained model series to the community.
Outcome: The proposed model improves on RoBERTa in several ways, especially the masking strategy that adopts MLM as correction (Mac).
Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing supervised fine-tuning (SFT) fails to address these issues, as it trains models on single gold-standard responses without modeling nuanced strategy trade-offs.
Approach: They propose a two-stage framework that optimizes strategy selection preferences at each dialogue turn.
Outcome: The proposed framework improves strategy selection preferences at each dialogue turn.
AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender (2025.emnlp-main)

Copied to clipboard

Challenge: Activation steering offers training-free defense but relies on fixed steering coefficients, resulting in suboptimal protection and increased false rejections of benign inputs.
Approach: They propose an adaptive activation steering method that dynamically adjusts model behavior based on input characteristics.
Outcome: The proposed method outperforms baseline methods across multiple jailbreak attacks with minimal impact on utility.
Path Spuriousness-aware Reinforcement Learning for Multi-Hop Knowledge Graph Reasoning (2023.eacl-main)

Copied to clipboard

Challenge: Multi-hop reasoning is a common approach for query answering, but can be biased to spurious paths which coincidentally lead to the correct answer with poor explanation.
Approach: They propose a method that quantitatively estimates to what extent a path is spurious by a metric called Path Spuriousness (PS) they propose KG reasoning, which infers new facts along existing paths in KGs.
Outcome: The proposed model significantly improves the agent’s ability to prevent spurious paths while keeping comparable to state-of-the-art performance.
Conversational Word Embedding for Retrieval-Based Dialog System (2020.acl-main)

Copied to clipboard

Challenge: Existing word embedding methods for retrieval-based dialog systems are based on co-occurrence statistics and train them based upon the same co-existence statistics.
Approach: They propose a conversational word embedding method which uses the conversation pairs post, reply, and 'reply' they introduce a word alignment model from statistical machine translation and train it on word-level and sentence-level.
Outcome: The proposed method improves the quality of the selected response on retrieval-based dialog systems.
Few-Shot Representation Learning for Out-Of-Vocabulary Words (P19-1)

Copied to clipboard

Challenge: Existing methods for learning word embedding assume there are enough occurrences for each word in the corpus to accurately estimate the representation of words.
Approach: They propose to fit a representation function to predict an oracle embedding vector based on limited contexts.
Outcome: The proposed model outperforms existing methods in constructing an accurate embedding for OOV words and improves downstream tasks when the embeddable is utilized.
Dynamic Connected Networks for Chinese Spelling Check (2021.findings-acl)

Copied to clipboard

Challenge: Chinese spelling check (CSC) is a task to detect and correct spelling errors in Chinese text.
Approach: They propose a new architecture which generates Chinese characters via a Pinyin Enhanced Candidate Generator and then utilizes an attention-based network to model the dependencies between two adjacent Chinese characters.
Outcome: The proposed method achieves state-of-the-art performance on three human-annotated datasets.
SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks fail to capture scenarios in which vulnerabilities are introduced by humans . we evaluate 5 popular code agents supported by 5 LLMs on SecureVibeBench .
Approach: They propose a benchmarking tool that compares 105 C/C++ secure coding tasks . they use real-world open-source vulnerabilities and a comprehensive evaluation tool .
Outcome: The proposed benchmarks show that code agents struggle to produce correct and secure code . the best performing agent produces merely 23.8% correct and secured solutions .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations