Papers by Jiecao Chen

5 papers
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge distillation models are not optimized for dealing with pairs (or tuples) of texts.
Approach: They propose a framework for distilling fast and accurate models on text pair tasks using a scalable end-to-end training strategy.
Outcome: Empirical studies on academic and real-world e-commerce benchmarks show the proposed framework can achieve speedups of over 350x and minimal quality drop relative to the cross-attention teacher BERT model.
Transforming Sequence Tagging Into A Seq2Seq Task (2022.emnlp-main)

Copied to clipboard

Challenge: Pretrained, large, generative language models have had great success in a wide range of sequence tagging and structured prediction tasks.
Approach: They propose to use a new format for casting input text sentences and their output labels into the input and target of a Seq2Seq model and introduce it to test their hypothesis.
Outcome: The proposed format shows to be both simpler and more effective and devoid of hallucination.
Beyond the Context Window: Scaling Agentic RL via End-to-end Optimized Context Compression (2026.acl-long)

Copied to clipboard

Challenge: Existing reinforcement learning pipelines suffer from degraded instruction following, excessive rollout costs, and strict context limits.
Approach: They propose a reinforcement learning (RL) fine-tuning of large language model (LLM) agents for long-horizon multi-turn tool use where context length quickly becomes a bottleneck.
Outcome: The proposed framework improves the success rate while maintaining the same or even lower working context length compared to baselines.
Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)

Copied to clipboard

Challenge: Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use.
Approach: They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools.
Outcome: The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities.
ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Use (2025.acl-long)

Copied to clipboard

Challenge: Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models.
Approach: They propose a dataset that provides rigorous evaluation of multi-hop tool use.
Outcome: The proposed model achieves 49.04% accuracy across five model families.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations