Papers by Ting Peng

9 papers
Lil: Less is Less When Applying Post-Training Sparse-Attention Algorithms in Long-Decode Stage (2026.findings-acl)

Copied to clipboard

Challenge: Prior work typically decomposes inference into prefill and decode stages, with the decode stage dominating total latency.
Approach: They propose an algorithm that detects threshold where information loss exceeds information gain during sparse decoding to reduce token consumption by up to 90% and a marginal accuracy degradation of less than 2%.
Outcome: The proposed algorithm reduces token consumption by 90% with a marginal accuracy degradation of less than 2% across reasoning-intensive benchmarks.
SC-LSTM: Learning Task-Specific Representations in Multi-Task Learning for Sequence Labeling (N19-1)

Copied to clipboard

Challenge: Multi-task learning (MTL) has been studied for sequence labeling tasks . auxiliary tasks are selected specifically to improve performance of a target task .
Approach: They propose a shared-cell long-short-term memory cell which contains shared parameters that can learn from all tasks and task-specific parameters that could learn task-related information.
Outcome: The proposed model can learn from all tasks and task-specific parameters.
ORANGE: Text-video Retrieval via Watch-time-aware Heterogeneous Graph Contrastive Learning (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for text-video retrieval focus on informative representations and delicate matching mechanisms, but real-world scenarios often involve brief, ambiguous queries and low-quality videos.
Approach: They propose a novel method to learn informative embeddings for queries and videos . they use a watch-time-aware contrastive learning paradigm to capture dependencies .
Outcome: The proposed method is effective in a real-world video-search service.
Task-oriented Dialogue System for Automatic Diagnosis (P18-2)

Copied to clipboard

Challenge: Existing methods to identify phenotypes using electronic health records (EHRs) are expensive and difficult to transfer models from one disease to another.
Approach: They propose a task-oriented dialogue system framework to make diagnosis for patients automatically, which can converse with patients to collect additional symptoms beyond their self-reports.
Outcome: The proposed system can collect additional symptoms from conversation and improve disease identification accuracy.
MDC-Bench: A Multidisciplinary Causal Benchmark Based on Causal Structures for Evaluating Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing causal datasets focus on the commonsense domain, but LLMs perform poorly when answering complex questions.
Approach: They propose a multidisciplinary causal evaluation benchmark to assess LLMs' knowledge and skills.
Outcome: The proposed model improves in domain specialization, structural diversity, and task complexity.
Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have revealed that chain-of-thought prompting significantly enhances LLM’s reasoning capabilities, which attracts widespread attention from both academics and industry.
Approach: They propose to summarize advanced methods through a taxonomy that offers novel perspectives.
Outcome: The proposed method delineates the challenges and future directions, thereby shedding light on future research.
SemRegex: A Semantics-Based Approach for Generating Regular Expressions from Natural Language Specifications (D18-1)

Copied to clipboard

Challenge: Existing approaches to generate programs from natural language do not address program aliasing . semantically equivalent programs may have many syntactically different forms .
Approach: They propose a semantics-based approach to generate regular expressions from natural language.
Outcome: The proposed approach improves on three public datasets.
Knowledge Transfer in Incremental Learning for Multilingual Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing studies focus on overcoming catastrophic forgetting on original language pairs while lacking encouragement to learn new knowledge from incremental learning.
Approach: They propose a knowledge transfer method that can adapt original MNMT models to diverse incremental language pairs by flexibly introducing knowledge from external models into original models, which encourages the models to learn new language pairs.
Outcome: The proposed method outperforms baselines on multiple languages while maintaining performance on original language pairs.
Query-aware Multi-modal based Ranking Relevance in Video Search (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing relevance ranking methods focus on text modality, incapable of fully exploiting cross-modal cues present in video.
Approach: They propose a QUery-Aware pre-training model with multi-modality that integrates video tag information as alignment targets and enhances ranking optimization method based on ordinal regression.
Outcome: The proposed model significantly improves video search performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations