Papers by Ke Yi
SILO-BENCH: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems (2026.acl-long)
Copied to clipboard
Yuzhe Zhang, Feiran Liu, Yi Shan, Xinyi Huang, Xin Yang, Yueqi Zhu, Xuxin Cheng, Cao Liu, Ke Zeng, Terry Jingchen Zhang, Wenyuan Jiang
| Challenge: | Existing benchmarks conflate coordination ability with role-based priors. |
| Approach: | They propose a role-free benchmark for evaluating free-form collaboration under information silos. |
| Outcome: | The proposed benchmark systematically probes coordination capabilities under information silos using 54 configurations and 3 frontier LLMs. |
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments (2025.acl-long)
Copied to clipboard
| Challenge: | Quantization has shown promise for Large Language Models, but current methods require lengthy training to alleviate quantization loss. |
| Approach: | They propose to decouple weights and incorporate Low-Rank adapters to reduce weight sharing . they validate the approach on LLaMA2 families and Mistral on downstream evaluation . |
| Outcome: | The proposed approach shows high performance while reducing deployment time faced with multiple scenarios. |
FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point (2025.findings-acl)
Copied to clipboard
Ke Yi, Jianwei Zhang, Zhiying Xu, Xinlong Yang, Yang Zhou, Minmin Sun, Zengke Liu, Tong Zhang, Junyang Lin, Jingren Zhou
| Challenge: | Auto-regressive decoding is a memory-bound job, meaning decoding performance is limited by the bandwidth rather than the computational capabilities of the GPU. |
| Approach: | They propose a framework that supports lossless weight-only quantization inference and validate it on Qwen and LLaMA Models. |
| Outcome: | The proposed framework achieves the highest efficiency with lossless accuracy on Qwen and LLaMA Models across various modalities. |
Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement (2025.coling-main)
Copied to clipboard
Chenkai Sun, Ke Yang, Revanth Gangi Reddy, Yi Fung, Hou Pong Chan, Kevin Small, ChengXiang Zhai, Heng Ji
| Challenge: | Existing research has focused on enhancing the retrieval stage and optimizing the representation of the database. |
| Approach: | They propose a framework to improve generalization across task contexts and collaborative refinement to bridge knowledge gaps among users. |
| Outcome: | The proposed framework improves generalization across task contexts and collaborative refinement to bridge knowledge gaps among users. |
Learning to Maximize Mutual Information for Chain-of-Thought Distillation (2024.findings-acl)
Copied to clipboard
| Challenge: | Knowledge distillation is a technique of transferring knowledge from large, complex models to smaller ones. |
| Approach: | They propose a method utilizing chain-of-thought distillation to transfer knowledge from large, complex models to smaller ones by maximizing mutual information of the representation features of the two tasks. |
| Outcome: | The proposed method outperforms the state-of-the-art knowledge distillation method on four datasets. |
Gloss-Free End-to-End Sign Language Translation (2023.acl-long)
Copied to clipboard
| Challenge: | a study of sign language translation without gloss annotations focuses on the problem of gloss annotation . gloss annotation is hard to acquire, especially in large quantities, and limits the domain coverage of translation datasets . |
| Approach: | They propose a gloss-free end-to-end sign language translation framework to solve this problem . gloss annotations are hard to acquire, especially in large quantities, they argue . |
| Outcome: | The proposed framework improves sign language translation performance on large-scale datasets . gloss annotations are hard to acquire, especially in large quantities . |
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)
Copied to clipboard
Yu Zou, Yan Chen, Lida He, Qi Zhou, Xiaorui Zhou, Aixi Zhong, Yi Wang, Wei Li, Qingyu Wang, Jiatao Li, Wei Gong, Jialei Zeng, Jingmei Zhao, Ke Jiang, Qing Li
| Challenge: | Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge. |
| Approach: | They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage. |
| Outcome: | The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold. |
Entriever: Energy-based Retriever for Knowledge-Grounded Dialog Systems (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge retrieval methods fail to account for interrelationship between knowledge pieces . however, current methods fail in a situation where multiple knowledge pieces are relevant . |
| Approach: | They propose an energy-based retriever that directly models the candidate retrieval results as a whole instead of modeling the knowledge pieces separately. |
| Outcome: | The proposed retriever outperforms the baseline energy-based retriever in knowledge retrieval tasks. |
CharacterGLM: Customizing Social Characters with Large Language Models (2024.emnlp-industry)
Copied to clipboard
Jinfeng Zhou, Zhuang Chen, Dazhen Wan, Bosi Wen, Yi Song, Jifan Yu, Yongkang Huang, Pei Ke, Guanqun Bi, Libiao Peng, JiaMing Yang, Xiyao Xiao, Sahand Sabour, Xiaohan Zhang, Wenjing Hou, Yijia Zhang, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang
| Challenge: | Character-based dialogue systems (CharacterDial) allow users to customize social characters for social interactions. |
| Approach: | They will collect a large-scale Chinese corpus of characters with diverse categories and behaviors and develop CharacterGLM models to address these challenges. |
| Outcome: | Experiments show that CharacterGLM outperforms most popular open- and closed-source LLMs and performs comparable to GPT-4. |