Papers by Hongyi Cai

3 papers
MergeIT: From Selection to Merging for Efficient Instruction Tuning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for instruction tuning rely on LLMs to score instruction quality . existing methods rely only on Llms to rank instruction quality, but this approach is expensive and time-consuming .
Approach: They propose a novel LLM-based Merging strategy for better Instruction Tuning that shifts the focus from selection to synthesis.
Outcome: The proposed method reduces time and computational cost while preserving diversity and reducing redundancy.
Towards Explainable Chinese Native Learner Essay Fluency Assessment: Dataset, Tasks, and Method (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing GEC datasets in Chinese fail to consider specific grammatical error types and overlook cross-sentence grammamatical errors.
Approach: They propose to use Chinese essay fluency assessment to assess essay fluencies along with coarse and fine-grained errors and corrections to improve explainability.
Outcome: The proposed dataset encapsulates essay fluency scores along with both coarse and fine-grained errors and corrections.
Low-Confidence Gold: Refining Low-Confidence Samples for Efficient Instruction Tuning (2025.findings-emnlp)

Copied to clipboard

Challenge: Low-Confidence Gold (LCG) is a new filtering framework for Large Language Models that curates high-quality subsets while preserving data diversity.
Approach: They propose a new filtering framework that employs centroid-based clustering and confidence-guided selection for identifying valuable instruction pairs.
Outcome: The proposed framework improves performance on a subset of 6K samples while maintaining data diversity.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations