Papers by Jiajie Xiao
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding (2024.acl-long)
Copied to clipboard
Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
| Challenge: | Large language models (LLMs) can only handle texts a few thousand tokens long, limiting their applications on longer sequence inputs, such as books, reports, and codebases. |
| Approach: | They propose a bilingual, multi-task benchmark for long context understanding that extends context windows and more sophisticated memory mechanisms to improve models' long context capabilities. |
| Outcome: | The proposed model outperforms open-source models but struggles on longer contexts. |
Improving Precancerous Case Characterization via Transformer-based Ensemble Learning (2022.emnlp-industry)
Copied to clipboard
Yizhen Zhong, Jiajie Xiao, Thomas Vetterli, Mahan Matin, Ellen Loo, Jimmy Lin, Richard Bourgon, Ofer Shapira
| Challenge: | Application of natural language processing (NLP) to cancer pathology reports has been focused on detecting cancer cases, ignoring precancerous cases. |
| Approach: | They developed transformer-based deep neural network NLP models to perform the CRC phenotyping with the goal of extracting precancerous lesion attributes and distinguishing cancer and precancirous cases. |
| Outcome: | The proposed model achieves 0.914 macro-F1 scores for classifying patients into negative, non-advanced adenoma, advanced adénoma and CRC. |