Papers by Leslie Huang

2 papers
Distillation of encoder-decoder transformers for sequence labelling (2023.findings-eacl)

Copied to clipboard

Challenge: despite the strong trend in NLP to explore the use of large language models, there is still limited work evaluating prompting and decoding mechanisms for SL tasks.
Approach: They propose a hallucination-free framework for sequence tagging that is especially suited for distillation.
Outcome: The proposed framework performs well across multiple sequence labelling datasets and in a few-shot learning scenario.
GovScape: A Public Multimodal Search System for 70 Million Pages of Government PDFs (2026.acl-demo)

Copied to clipboard

Challenge: Efforts over the past three decades have produced web archives containing billions of webpage snapshots and petabytes of data.
Approach: They propose a public search system that supports multimodal searches across 10,015,993 federal government PDFs from the 2020 End of Term crawl.
Outcome: The proposed system supports multimodal searches across 10,015,993 federal government PDFs from the 2020 End of Term crawl (70,958,487 total PDF pages) significant compute cost for GovScape’s pre-processing pipeline for 10 million PDFs was approximately 1,500, equivalent to 47,000 PDF pages per dollar spent on compute.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations