Papers by Jingming Liu
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future (2023.emnlp-main)
Copied to clipboard
Linyi Yang, Yaoxian Song, Xuan Ren, Chenyang Lyu, Yidong Wang, Jingming Zhuo, Lingqiao Liu, Jindong Wang, Jennifer Foster, Yue Zhang
| Challenge: | Existing literature on the generalization of machine learning models to out-of-distribution data is lacking. |
| Approach: | They propose to present the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding. |
| Outcome: | The proposed survey provides the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding. |
Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data (N19-1)
Copied to clipboard
| Challenge: | Neural machine translation systems have become state-of-the-art approaches for Grammatical Error Correction (GEC) task. |
| Approach: | They propose a copy-augmented architecture for the Grammatical Error Correction task by copying unchanged words from the source sentence to the target sentence. |
| Outcome: | The proposed architecture outperforms all recently published state-of-the-art results by a large margin. |
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work uses sentences within the same batch as negatives, which suffers from easy negatives. |
| Approach: | They propose to align sentence representations from different languages into a unified embedding space . they adapt MoCo to further improve the quality of alignment . |
| Outcome: | The proposed model achieves state-of-the-art on several tasks. |
SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Text-based methods lag behind graph embedding-based approaches for knowledge graph completion (KGC) |
| Approach: | They propose three types of negatives to improve contrastive learning to improve learning efficiency. |
| Outcome: | The proposed model outperforms embedding-based methods on several benchmark datasets. |
Denoising based Sequence-to-Sequence Pre-training for Text Generation (D19-1)
Copied to clipboard
| Challenge: | PoDA pre-trains encoders and decoders by denoising noise-corrupted text . Unlike encoder-only or decode-only methods, it can be used for text generation tasks without using any task-specific techniques. |
| Approach: | They propose a sequence-to-sequence (seq2sequ) pre-training method PoDA which denoises autoencoders by denoising noise-corrupted text. |
| Outcome: | The proposed method improves model performance over strong baselines without using any task-specific techniques and significantly speed up convergence. |
Multi-Perspective Context Aggregation for Semi-supervised Cloze-style Reading Comprehension (C18-1)
Copied to clipboard
| Challenge: | Recent studies have shown that cloze-style reading comprehension is a popular task for measuring the progress of natural language understanding. |
| Approach: | They propose a multi-perspective framework which can be seen as joint training of heterogeneous experts and aggregate context information from different perspectives. |
| Outcome: | The proposed framework achieves new state-of-the-art over previous strong baselines on a recently released cloze-test dataset. |
T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step (2024.acl-long)
Copied to clipboard
Zehui Chen, Weihua Du, Wenwei Zhang, Kuikun Liu, Jiangning Liu, Miao Zheng, Jingming Zhuo, Songyang Zhang, Dahua Lin, Kai Chen, Feng Zhao
| Challenge: | Existing studies evaluate the tool utilization ability of large language models based on the final output or only consider the single-step tool calling. |
| Approach: | They propose a new approach to evaluate the tool utilization capability of large language models (LLMs) they decompose the tool usage into multiple sub-processes, including instruction following, planning, reasoning, retrieval, understanding, and review. |
| Outcome: | The proposed model exhibits consistency with the outcome-oriented evaluation and provides a more fine-grained analysis of the capabilities of LLMs. |