Papers by Haoyu Ma

11 papers
TC–RAG: Turing–Complete RAG’s Case study on Medical LLM Systems (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to RAG neglect system state variables, resulting in poor performance and erroneous knowledge accumulation.
Approach: They propose a framework that incorporates a Turing Complete System to manage state variables and manage retrieval halting.
Outcome: The proposed framework improves on seven real-world healthcare datasets and shows that it is more accurate than existing methods.
Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to enhance multilingual reasoning capabilities rely on costly multilingual training or employ prompting with external translation tools.
Approach: They propose a training-free inference-time method to enhance multilingual reasoning capabilities via Representation Engineering without additional training data or tools.
Outcome: The proposed method outperforms existing methods on four reasoning benchmarks in English and Thai and Swahili.
Not All Tokens Matter: Towards Efficient LLM Reasoning via Token Significance in Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) often produce unnecessarily long explanations that reduce efficiency.
Approach: They propose a length-aware reward that selectively penalizes insignificance tokens . they also propose 'dynamic length control' that encourages more detailed reasoning .
Outcome: The proposed method reduces response length while maintaining correctness, the authors show . it selectively penalizes insignificance tokens while maintaining accuracy .
Knowledge-Guided Paraphrase Identification (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for paraphrase identification (PI) are limited due to lack of professional knowledge.
Approach: They propose to leverage Wikipedia knowledge to accurately identify paraphrases by mining outline knowledge of given sentences from Wikipedia.
Outcome: The proposed framework outperforms state-of-the-art models on two public datasets: PARADE and clinicalSTS2019.
Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment (2023.acl-long)

Copied to clipboard

Challenge: Existing speech-text pre-training methods are limited to one or two specific tasks, despite their success in speech-language processing tasks.
Approach: They propose a temporal position prediction task to capture the speech-text alignment . they use a textual dialog pre-training task to generalize a response selection task .
Outcome: The proposed model is superior in learning speech-text alignment and multi-turn dialog context.
Hierarchy-Aware Global Model for Hierarchical Text Classification (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for hierarchical text classification are limited and lack holistic structural information.
Approach: They propose a hierarchy-aware global model with two variants that learn hierarchy-based label embeddings through an encoder and conduct inductive fusion of label-alike text features.
Outcome: The proposed model improves on three benchmark datasets.
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems.
Approach: They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems.
Outcome: The proposed approach achieves significant performance improvements over the state-of-the-art methods.
Detecting Continuously Evolving Scam Calls under Limited Annotation: A LLM-Augmented Expert Rule Framework (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to detect scam calls rely on labeled data and assume static distribution of scam narratives.
Approach: They propose a method leveraging large language models to detect continuously evolving scam calls . scammers continuously evolve their tactics, making these methods less effective .
Outcome: The proposed approach is based on large language models to detect continuously evolving scam calls.
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have achieved great success in various NLP tasks, but the vast model parameters pose challenges in downstream fine-tuning.
Approach: They propose a task-agnostic prompting strategy that analyzes each dialogue utterance before task execution to enhance LLMs' comprehension in multi-turn dialogues.
Outcome: The proposed strategy outperforms other zero-shot prompts and matches or exceeds efficacy of few-shot ones.
GMN: Generative Multi-modal Network for Practical Document Information Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Document Information Extraction (DIE) has attracted increasing attention due to its various advanced applications in the real world.
Approach: They propose a multi-modal generation method without predefined label categories for real-world scenarios using a spatial encoder and modal-aware mask module.
Outcome: The proposed method can deal with complex documents that are hard to serialize into sequential order.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations