Papers with ChatGLM
An Empirical Study of Instruction-tuning Large Language Models in Chinese (2023.findings-emnlp)
Copied to clipboard
| Challenge: | emergence of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI) however, the closed source of LLMs coupled with the requirement for massive computing resources has deterred researchers from reaching the LLM training stage. |
| Approach: | They propose to use Chinese instruction-tuning LLMs as a cookbook for customizing LLM models that can better respond to Chinese instructions. |
| Outcome: | The proposed LLM can be used to customize Chinese LLMs that can better respond to Chinese instructions. |
ChatASU: Evoking LLM’s Reflexion to Truly Understand Aspect Sentiment in Dialogues (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on interactive ASU ignore the coreference issue for opinion targets while this phenomenon is ubiquitous in interactive scenarios especially dialogues, limiting the ASU performance. |
| Approach: | They propose a Chat-based Aspect Sentiment Understanding task that integrates various NLP tasks with the chat paradigm and propose 'trusted self-reflexion' approach with ChatGLM as backbone to address aspect coreference issue. |
| Outcome: | The proposed task outperforms state-of-the-art baselines and shows that it is highly effective. |
ChatUIE: Exploring Chat-based Unified Information Extraction Using Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models have shown impressive performance in general chat, but their domain-specific capabilities have certain limitations. |
| Approach: | They propose a unified information extraction framework built upon ChatGLM that incorporates domain-specific modeling to extract structured information from natural language. |
| Outcome: | The proposed framework significantly improves the performance of information extraction tasks with a slight decrease in chatting ability. |
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline (2024.findings-emnlp)
Copied to clipboard
Yifan Xu, Xiao Liu, Xinghan Liu, Zhenyu Hou, Yueyan Li, Xiaohan Zhang, Zihan Wang, Aohan Zeng, Zhengxiao Du, Zhao Wenyi, Jie Tang, Yuxiao Dong
| Challenge: | Large language models (LLMs) have shown excellent mastering of human language but struggle in real-world applications that require mathematical problem-solving. |
| Approach: | They propose a pipeline to train a general Math-Critique model from the LLM itself to provide feedback signals and employ rejective fine-tuning and direct preference optimization over the Llm's own generations for data collection. |
| Outcome: | The proposed pipeline outperforms existing LLMs that could be two times larger. |
Linguistic Rule Induction Improves Adversarial and OOD Robustness in Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) do not perform satisfactorily in OOD and adversarial robustness evaluations. |
| Approach: | They propose to use linguistic rule induction to fine-tune large language models with linguistic rules to achieve better adversarial and OOD robustness. |
| Outcome: | The proposed model achieves comparable or better results with GPT-3.5 and GPT-4 on various adversarial and OOD robustness evaluations. |
MoZIP: A Multilingual Benchmark to Evaluate Large Language Models in Intellectual Property (2024.lrec-main)
Copied to clipboard
Shiwen Ni, Minghuan Tan, Yuelin Bai, Fuqiang Niu, Min Yang, Bowen Zhang, Ruifeng Xu, Xiaojun Chen, Chengming Li, Xiping Hu
| Challenge: | Large language models (LLMs) have demonstrated impressive performance in various natural language processing tasks. |
| Approach: | They propose a benchmark for the evaluation of large language models in the IP domain . they also propose supervised multilingual large language model called MoZi . |
| Outcome: | The proposed model outperforms four well-known LLMs on the MoZIP benchmark . the most powerful ChatGPT does not reach the passing level . |