Papers by Jiasheng Ye
AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling (2024.acl-long)
Copied to clipboard
Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yu-Gang Jiang, Xipeng Qiu
| Challenge: | Existing language models that use discrete representations for unified processing of various modalities are limited to text generation and do not include multimodal output. |
| Approach: | They propose a multimodal language model that utilizes discrete representations for unified processing of various modalities. |
| Outcome: | The proposed model can be trained stably without any alterations to existing models or training paradigms. |
LLM can Achieve Self-Regulation via Hyperparameter Aware Generation (2024.findings-acl)
Copied to clipboard
Siyin Wang, Shimin Li, Tianxiang Sun, Jinlan Fu, Qinyuan Cheng, Jiasheng Ye, Junjie Ye, Xipeng Qiu, Xuanjing Huang
| Challenge: | Existing decoding strategies and hyperparameters may not be optimal for each sample. |
| Approach: | They propose a model that auto-regulates decoding strategies and hyperparameters . this approach eliminates the need for extensive manual tuning, they argue . |
| Outcome: | The proposed model eliminates the need for extensive manual tuning, offering a more autonomous, self-regulate model behavior. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
Energy-based Unknown Intent Detection with Data Manipulation (2021.findings-acl)
Copied to clipboard
| Challenge: | Unknown intent detection aims to identify the out-of-distribution (OOD) utterance whose intent has never appeared in the training set. |
| Approach: | They propose a framework to generate high-quality OOD utterances with importance weighTs (GOT) their framework is fine-tuned to detect out-of-distribution utterrances . |
| Outcome: | The proposed framework can achieve state-of-the-art results on two benchmark datasets. |