Papers by Haotian Lin

8 papers
Syntax-guided Localized Self-attention by Constituency Syntactic Distance (2022.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have shown that Transformers is implicitly learning syntactic information from data, albeit is highly dependent on the quality and scale of the training data.
Approach: They propose a syntax-guided localized self-attention model that allows directly incorporating grammar structures from an external constituency parser.
Outcome: The proposed model improves translation performance on a variety of datasets, from small to large datasets and with different source languages.
Applying BERT to Document Retrieval with Birch (D19-3)

Copied to clipboard

Challenge: Birch is an open-source document retrieval system that integrates with the Anserini information retrieval toolkit to demonstrate end-to-end search over large document collections.
Approach: They propose to integrate Anserini with a BERT-based document ranking model that provides an end-to-end open-source search engine.
Outcome: The proposed system outperforms existing approaches to document retrieval and question answering on standard newswire and social media test collections.
Interactive Learning for LLM Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing multi-agent learning approaches foster collaboration among Large Language Models (LLMs) yet they still rely on re-executing the MAS during inference.
Approach: They propose a co-learning framework that integrates Dynamic Interaction and Perception Calibration to enhance LLMs' independent problem-solving ability.
Outcome: The proposed framework integrates Dynamic Interaction and Perception Calibration to improve LLMs' independent problem-solving ability.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Cross-Domain Modeling of Sentence-Level Evidence for Document Retrieval (D19-1)

Copied to clipboard

Challenge: Existing test collections provide only document-level relevance judgments, and documents exceed the length that BERT was designed to handle.
Approach: They propose to aggregate sentence-level evidence to rank news articles using BERT . they also leverage passage-level relevance judgments available in other domains to fine-tune BERT models that capture cross-domain notions of relevance.
Outcome: The proposed model aggregates sentence-level evidence to rank documents on three standard test collections.
ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction (2026.findings-acl)

Copied to clipboard

Challenge: Empirical evaluations on state-of-the-art MLLMs reveal a significant performance gap . ML models lack the fine-grained cross-modal reasoning required to bridge visual discontinuities.
Approach: They propose a benchmark that renders fragmented documents directly from Markdown to facilitate evaluation of VRDU tasks.
Outcome: The proposed benchmark renders fragmented documents directly from Markdown.
Grammar-Based Code Representation: Is It a Worthy Pursuit for LLMs? (2025.findings-acl)

Copied to clipboard

Challenge: Existing research demonstrates the effectiveness of grammar-based code representations in small-scale models, showing their ability to reduce syntax errors and enhance performance.
Approach: They develop a series of billion-scale grammar-based code representations that incorporate grammar rules into the code generation process.
Outcome: Experiments on HumanEval and MBPP show that grammar-based representations reduce syntax errors and improve performance even in billion-scale models.
DebugBench: Evaluating Debugging Capability of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated exceptional coding capabilities, but their debugging capabilities remain relatively unexplored.
Approach: They propose a debugging benchmark consisting of 4,253 LLMs with four major bug categories and 18 minor types in C++, Java, and Python.
Outcome: The proposed benchmark covers four major bug categories and 18 minor types in C++, Java, and Python.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations