Papers by Luo Si
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation (2021.acl-long)
Copied to clipboard
Ruidan He, Linlin Liu, Hai Ye, Qingyu Tan, Bosheng Ding, Liying Cheng, Jiawei Low, Lidong Bing, Luo Si
| Challenge: | Existing studies have shown that adapter-based tuning is more parameter-efficient than fine-tuning. |
| Approach: | They propose to add adapter modules to a pretrained language model and update the parameters of adapter module when learning on a downstream task. |
| Outcome: | The proposed method outperforms fine-tuning on low-resource and cross-lingual tasks and settings. |
LLM-Rec: Personalized Recommendation via Prompting Large Language Models (2024.findings-naacl)
Copied to clipboard
Hanjia Lyu, Song Jiang, Hanqing Zeng, Yinglong Xia, Qifan Wang, Si Zhang, Ren Chen, Chris Leung, Jiajie Tang, Jiebo Luo
| Challenge: | Recent advances in large language models (LLMs) have showcased their remarkable ability to harness commonsense knowledge and reasoning. |
| Approach: | They propose a novel approach which incorporates four distinct prompting strategies of text enrichment for improving personalized text-based recommendations. |
| Outcome: | The proposed approach improves recommendation quality and even basic MLP models achieve comparable or even better results than complex content-based methods. |
A Unified Span-Based Approach for Opinion Mining with Syntactic Constituents (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for fine-grained opinion mining (OM) are based on span-based annotations, but they are not effective. |
| Approach: | They propose a unified span-based approach for the end-to-end OM setting using syntactic constituents and multi-task learning to integrate them into the proposed model. |
| Outcome: | The proposed approach achieves significant improvements over previous work on the MPQA 2.0 dataset and reduces the number of wrongly-predicted opinion expressions and roles. |
A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks (2026.acl-long)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent advances in large language models (LLMs) have leapt from static chatbots to versatile agents that tackle complex tasks such as science experiments. |
| Approach: | They propose a plan-and-execute framework and propose 'EAGLET' to enhance the executor agent's planning abilities without human effort. |
| Outcome: | The proposed method outperforms existing methods on three long-horizon tasks and reduces training costs by 8 compared to baselines. |
LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Prompting (2022.coling-1)
Copied to clipboard
Xiang Chen, Lei Li, Shumin Deng, Chuanqi Tan, Changliang Xu, Fei Huang, Luo Si, Huajun Chen, Ningyu Zhang
| Challenge: | Existing approaches for Named Entity Recognition (NER) use extensive labeled data for model training, which struggles in low-resource scenarios. |
| Approach: | They propose a lightweight tuning paradigm for low-resource NER via pluggable prompting . they construct a learnable verbalizer of entity categories without any label-specific classifiers . |
| Outcome: | The proposed model outperforms baselines and class transfer models in low-resource scenarios. |
Good Visual Guidance Make A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction (2022.findings-naacl)
Copied to clipboard
Xiang Chen, Ningyu Zhang, Lei Li, Yunzhi Yao, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen
| Challenge: | Existing approaches for named entity recognition and relation extraction suffer from error sensitivity when irrelevant object images are incorporated in texts. |
| Approach: | They propose a hierarchical visual prefix fusion NeTwork for visual-enhanced entity and relation extraction using pluggable visual prefixed visual features. |
| Outcome: | The proposed method achieves state-of-the-art on three benchmark datasets. |
FaithLens: Detecting and Explaining Faithfulness Hallucination (2026.findings-acl)
Copied to clipboard
Shuzheng Si, Qingyi Wang, Haozhe Zhao, Yuzhuo Bai, Guanqiao Chen, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent progress in large language models (LLMs) has revolutionized text generation. |
| Approach: | They propose a faithfulness hallucination detection model that can provide binary predictions and corresponding explanations to improve trustworthiness. |
| Outcome: | The proposed model outperforms advanced models on 12 diverse tasks. |
Detect Camouflaged Spam Content via StoneSkipping: Graph and Text Joint Embedding for Chinese Character Variation Representation (D19-1)
Copied to clipboard
| Challenge: | Currently, Chinese characters share glyph and phonetic variations to escape detection algorithms due to their complexity and complexity. |
| Approach: | They propose a Chinese variation-enhanced Graph Embedding algorithm that can learn Chinese character embeddings and latent variation families. |
| Outcome: | The proposed model outperforms state-of-the-art models on Chinese spam detection datasets and review datasets. |
De-Biased Court’s View Generation with Causality (2020.emnlp-main)
Copied to clipboard
Yiquan Wu, Kun Kuang, Yating Zhang, Xiaozhong Liu, Changlong Sun, Jun Xiao, Yueting Zhuang, Luo Si, Fei Wu
| Challenge: | Existing approaches to court’s view generation can be used to address this problem, but neglecting the confounding bias in data can limit the model performance and pollute learning outcomes. |
| Approach: | They propose a novel Attentional and Counterfactual based Natural Language Generation method consisting of an attentional encoder and a pair of innovative counterfactual decoders to generate judgment-discriminative court's views. |
| Outcome: | The proposed method is able to generate judgment-discriminative court's views (both supportive and non-supportive views) under both quantitative and qualitative evaluation metrics. |
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | a new text generation dataset is needed to controllable text summarization, but it lacks the domain knowledge. |
| Approach: | They propose to use existing text generation datasets to leverage input and control signals . they propose to annotate each meta-review sentence manually with a control signal . |
| Outcome: | The proposed method can be used to control the structure of a text generation dataset . it can be applied to a variety of tasks, including a task with a large number of meta-review sentences . |
Argument Pair Extraction via Attention-guided Multi-Layer Multi-Cross Encoding (2021.acl-long)
Copied to clipboard
| Challenge: | Argument pair extraction (APE) is a research task for extracting arguments from two passages and identifying potential argument pairs. |
| Approach: | They propose a novel attention-guided multi-layer multi-cross encoding scheme that processes two passages with two individual sequence encoders and updates their representations using each other’s attention. |
| Outcome: | The proposed model significantly improves the performance over several alternatives. |
Doc2Bot: Accessing Heterogeneous Documents via Conversational Bots (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Documents contain various structures that hinder the ability of machines to comprehend . user information needs are often underspecified, and the nature of heterogeneous documents poses challenges. |
| Approach: | They propose a dataset for building machines that help users seek information via conversations . their dataset contains over 100,000 turns based on Chinese documents from five domains . |
| Outcome: | The proposed tasks are challenging and worthy of further research. |
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing techniques for natural language understanding and generation use autoencoding and/or autoregressive objectives to train models. |
| Approach: | They propose a self-supervised pre-training scheme that pre-trains an autoencoding and autoregressive language model on a large unlabeled corpus for generating new text conditioned on context. |
| Outcome: | The proposed scheme achieves state-of-the-art results on a variety of language generation benchmarks covering generative question answering, abstractive summarization and conversational response generation. |
Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialogue State Tracking (2021.acl-short)
Copied to clipboard
| Challenge: | Existing dialog state tracking models neglect rich structural information in a dataset. |
| Approach: | They propose to use curriculum learning to leverage dialog state tracking data . they propose a model-agnostic framework that pre-trains a DST model with schema information . |
| Outcome: | The proposed framework improves performance over a transformer-based and RNN-based model on WOZ2.0 and MultiWOZ2.1. |
MulDA: A Multilingual Data Augmentation Framework for Low-Resource Cross-Lingual NER (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual NER are labeled sequence translation and instance-based transfer via machine translation (MT) Existing methods to cross NER include label projection and labeling, but they are expensive and time-consuming. |
| Approach: | They propose a simple but effective labeled sequence translation method to translate source-language training data to target languages and avoids word order change and entity span determination. |
| Outcome: | The proposed method avoids word order change and entity span determination and can be generalized with the language-specific features from the target-language synthetic data and the language independent features from multilingual synthetic data. |
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Zhitong Wang, Cheng Gao, Chaojun Xiao, Yufei Huang, Shuzheng Si, Kangyang Luo, Yuzhuo Bai, Wenhao Li, Tangjian Duan, Chuancheng Lv, Guoshan Lu, Gang Chen, Fanchao Qi, Maosong Sun
| Challenge: | Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence. |
| Approach: | They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary. |
| Outcome: | Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training. |
STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing (2022.findings-emnlp)
Copied to clipboard
Zefeng Cai, Xiangyu Li, Binyuan Hui, Min Yang, Bowen Li, Binhua Li, Zheng Cao, Weijie Li, Fei Huang, Luo Si, Yongbin Li
| Challenge: | Extensive experiments show that STAR outperforms previous pre-training methods and ranks first on the leaderboard . text-to-SQL parsing aims to translate natural language (NL) questions into executable SQL queries . |
| Approach: | They propose a SQL guided pre-training framework STAR for context-dependent text-to-SQL parsing . they propose two objectives that explore context-dependence of NL utterances and SQL queries . |
| Outcome: | The proposed framework outperforms existing methods on two downstream benchmarks and ranks first on the leaderboard. |
ConNER: Consistency Training for Cross-lingual Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing consistency training methods for named entity recognition (NER) are likely to violate the consistency hypothesis or focus on coarse-grain consistency. |
| Approach: | They propose a consistency training framework for cross-lingual named entity recognition that leverages unlabeled target-language data and dropout-based consistency training on labeled source-language datasets. |
| Outcome: | The proposed framework improves on translation-based consistency training on unlabeled target-language data and dropout-based consistent training on labeled source-language datasets. |
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to extract relation triplets require large datasets and a fixed set of relations. |
| Approach: | They propose to use a sentence-based task setting to generalize relation extraction methods to unseen relation sets. |
| Outcome: | The proposed method can extract multiple relation triplets in a sentence using language model prompts and structured text approaches. |
A Dataset for Hyper-Relational Extraction and a Cube-Filling Approach (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods do not consider qualifier attributes for each relation triplet, such as time, quantity or location. |
| Approach: | They propose a hyper-relational extraction task to extract more specific facts from text using qualifiers. |
| Outcome: | The proposed model outperforms baselines and reveal possible directions for future research. |
MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER (2022.acl-long)
Copied to clipboard
| Challenge: | Named entity recognition (NER) tasks have limited amount of labeled data . data augmentation methods suffer from token-label misalignment, which leads to unsatsifactory performance. |
| Approach: | They propose a data augmentation framework that explicitly injects NER labels into sentence context and generates high-quality augmented data with novel entities. |
| Outcome: | The proposed framework outperforms baseline methods on low-resource tasks. |
Unsupervised Domain Adaptation Method with Semantic-Structural Alignment for Dependency Parsing (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for dependency parsing are often of the pseudo-annotation type, but they fail to consider the change of model structure for domain adaptation. |
| Approach: | They propose a method that accomplishes unsupervised cross-domain dependency parsing without using labeled data. |
| Outcome: | The proposed method achieves consistent performance improvement on CODT1 and CTB9 domains. |
MEIC-DT: Memory-Efficient Incremental Clustering for Long-Text Coreference Resolution with Dual-Threshold Constraints (2026.findings-acl)
Copied to clipboard
Kangyang Luo, Shuzheng Si, Yuzhuo Bai, Cheng Gao, Zhitong Wang, Cheng Huang, Yingli Shen, Yufeng Han, Wenhao Li, Cunliang Kong, Maosong Sun
| Challenge: | Existing supervised neural methods are underexplored for coreference resolution, especially in incremental clustering. |
| Approach: | They propose a dual-threshold incremental clustering approach based on a lightweight Transformer. |
| Outcome: | Experiments on common benchmarks show that MEIC-DT achieves highly competitive coreference performance under stringent memory constraints. |
Review-based Question Generation with Adaptive Instance Transfer and Augmentation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to generate questions for verbose reviews are inefficient for potential consumers . lack of training data hinders efficient review digestion, authors say . |
| Approach: | They propose to generate questions that can be answered by corresponding review sentences . they propose an iterative learning framework with adaptive instance transfer and augmentation . |
| Outcome: | The proposed model can generate questions that can be answered by review sentences . it is easier to find critical review parts that are important for potential consumers . |
Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations (2023.acl-long)
Copied to clipboard
| Challenge: | Using hidden representations, pretrained language models are prone to overfitting due to the huge amount of parameters. |
| Approach: | They propose a method that inserts random autoencoders between hidden layers of a PLM to transform activations from the previous layers into multi-view compressed representations before feeding them into the upper layers. |
| Outcome: | The proposed method improves performance across sequence- and token-level lowresource tasks. |
Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to learn cross-lingual word embeddings are sense agnostic . a novel framework to align contextual embeddables at the sense level is proposed . |
| Approach: | They propose a framework to align contextual embeddings at the sense level by leveraging cross-lingual signal from bilingual dictionaries only. |
| Outcome: | The proposed framework improves word sense disambiguation tasks by leveraging bilingual dictionaries . compared with baseline results, the proposed models achieve 0.52%, 2.09% and 1.29% performance improvements . |
SUN: Exploring Intrinsic Uncertainties in Text-to-SQL Parsers (2022.coling-1)
Copied to clipboard
Bowen Qin, Lihan Wang, Binyuan Hui, Bowen Li, Xiangpeng Wei, Binhua Li, Fei Huang, Luo Si, Min Yang, Yongbin Li
| Challenge: | Existing methods that learn from multiple semantically-equivalent questions are limited to one-to-one mapping . |
| Approach: | They propose a constraint to explore the underlying complementary semantic information among multiple semantically-equivalent questions and learn robust feature representations with reduced spurious associations. |
| Outcome: | The proposed method outperforms strong competitors and achieves state-of-the-art results on five benchmark datasets. |
DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks (2020.emnlp-main)
Copied to clipboard
Bosheng Ding, Linlin Liu, Lidong Bing, Canasai Kruengkrai, Thien Hai Nguyen, Shafiq Joty, Luo Si, Chunyan Miao
| Challenge: | Data augmentation techniques are widely used to improve machine learning performance . however, due to the complexity of language, it is difficult to generalize such rules for languages. |
| Approach: | They propose a method to generate high quality synthetic data for low-resource tagging tasks . they use unlabeled data only and unlabelled data plus a knowledge base . |
| Outcome: | The proposed method outperforms baselines on NER, part of speech and target based sentiment analysis tasks. |
SentBS: Sentence-level Beam Search for Controllable Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Structure-controlled summarization is a useful and interesting research direction . current structure-controlling methods have limited effectiveness in enforcing the desired structure. |
| Approach: | They propose a sentence-level beam search generation method to select suitable sentences for subsequent generations. |
| Outcome: | The proposed method significantly reduces structural discrepancies by 68% on a structure-controlled dataset. |
Improve Neural Entity Recognition via Multi-Task Data Selection and Constrained Decoding (N18-2)
Copied to clipboard
| Challenge: | Entity recognition is a widely benchmarked task in natural language processing . a neural architecture called BiLSTM-CRF is used to model the language sequences . |
| Approach: | They propose a neural architecture called BiLSTM-CRF to model the language sequences. |
| Outcome: | The proposed system achieves state-of-the-art on English entity recognition task and also in other languages. |
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge-enhanced methods have trouble obtaining knowledge from different knowledge bases . a concept-centric model can be used to generate a contrastive explanation for QA tasks . |
| Approach: | They propose a Concept-centric Prompt-bAsed Contrastive Explanation Generation model which converts obtained symbolic knowledge into the contrastive explanation for better distinguishing the differences among given candidates. |
| Outcome: | The proposed model achieves new SOTA on CSQA, QASC, and OBQA. |
Uncover Sexual Harassment Patterns from Personal Stories by Joint Key Element Extraction and Categorization (D19-1)
Copied to clipboard
| Challenge: | Sexual harassment is a pervasive, worldwide problem with a long history . statistics show that girls and women are put at high risk of experiencing harassment. |
| Approach: | They manually annotated sexual harassment stories with labels in dimensions of location, time, and harassers’ characteristics and applied natural language processing techniques to extract key elements at the same time. |
| Outcome: | The proposed algorithms will help people who have been harassed, authorities, researchers and other related parties in various ways, such as automatically filling reports, and enabling faster action to be taken. |
A Unified Syntax-aware Framework for Semantic Role Labeling (D18-1)
Copied to clipboard
| Challenge: | Syntactic information has been paid a great attention over the role of enhancing SRL . but the gap between syntax-aware and syntax-gnostic SRL is smaller . a new framework proposes syntax-based SRL for a wide range of NLP tasks . |
| Approach: | They propose to extend existing models to investigate more effective ways of incorporating syntax into sequential neural networks. |
| Outcome: | The proposed framework outperforms existing models on CoNLL-2009 benchmarks in English and Chinese. |
IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks (2022.acl-long)
Copied to clipboard
| Challenge: | Argument mining (AM) is a computational process that is used to analyze information in a debating system. |
| Approach: | They propose to use a large dataset to automate the manual process of debating . they propose to integrate claim extraction, stance classification and evidence extraction tasks . |
| Outcome: | The proposed tasks can extract claims, stances, evidence and more from a large dataset . the proposed tasks are highly efficient and can be applied to argument mining tasks . |
GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completion (2025.findings-acl)
Copied to clipboard
Kangyang Luo, Yuzhuo Bai, Cheng Gao, Shuzheng Si, Zhu Liu, Yingli Shen, Zhitong Wang, Cunliang Kong, Wenhao Li, Yufei Huang, Ye Tian, Xuantang Xiong, Lei Han, Maosong Sun
| Challenge: | Existing knowledge graphs lack the ability to integrate structural information into LLMs and output predictions deterministically. |
| Approach: | They propose a method which encodes structural information of KGs and merges it with LLMs to enhance KGC performance. |
| Outcome: | The proposed method improves the performance of KG Completion datasets on KGs by integrating structural information with LLMs. |
Aspect Sentiment Classification with Document-level Sentiment Preference Modeling (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies consider Aspect Sentiment Classification (ASC) as an independent sentence-level classification problem aspect by aspect. |
| Approach: | They propose a Cooperative Graph Attention Networks approach for cooperatively learning aspect-related sentence representation. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods in document-level sentiment classification. |
DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings (2021.emnlp-main)
Copied to clipboard
| Challenge: | Conventional approaches to learning sentence embeddings from dialogues employ the siamese-network for this task, but such architecture yields a large gap between training and evaluating. |
| Approach: | They propose a dialogue-based contrastive learning approach to learn sentence embeddings from dialogues using a siamese-network. |
| Outcome: | The proposed model outperforms baseline methods on three multi-turn dialogue datasets in terms of MAP and Spearman’s correlation measures. |
ImCoref-CeS: An Improved Lightweight Pipeline for Coreference Resolution with LLM-based Checker-Splitter Refinement (2026.acl-long)
Copied to clipboard
Kangyang Luo, Yuzhuo Bai, Shuzheng Si, Cheng Gao, Zhitong Wang, Yingli Shen, Wenhao Li, Zhu Liu, Yufeng Han, Jiayi Wu, Cunliang Kong, Maosong Sun
| Challenge: | Existing supervised neural methods for coreference resolution are underexplored . current methods rely on small language models, but their potential is underexploited . |
| Approach: | They propose a framework that integrates an enhanced supervised model with LLM-based reasoning. |
| Outcome: | The proposed method surpasses existing state-of-the-art methods in coreference resolution. |
Multi-Turn Dialogue Generation in E-Commerce Platform with the Context of Historical Dialogue (2020.findings-emnlp)
Copied to clipboard
WeiSheng Zhang, Kaisong Song, Yangyang Kang, Zhongqing Wang, Changlong Sun, Xiaozhong Liu, Shoushan Li, Min Zhang, Luo Si
| Challenge: | Existing research on customer service dialogue generation generates generic responses from sellers . however, such cost prohibits small businesses, and multiturn dialogue generation is becoming more popular. |
| Approach: | They propose a novel and extensible dialogue generation method by leveraging sellers’ historical dialogue information to generate generic seller responses. |
| Outcome: | The proposed model can generate high-quality responses that cater to specific sellers’ characteristics and exhibit consistent superiority over baselines on a real-world multi-turn customer service dialogue dataset. |
One vs. Many QA Matching with both Word-level and Sentence-level Attention Network (C18-1)
Copied to clipboard
| Challenge: | Existing studies on question answer matching focus on formal text . however, there exists many scenarios where the QA text is informal . |
| Approach: | They propose a novel QA matching approach using informal text from a product review site. |
| Outcome: | The proposed approach improves word-level and sentence-level attentions for solving the noisy problem in the informal text. |
Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering (2025.acl-long)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Gang Chen, Cheng Gao, Yuzhuo Bai, Zhitong Wang, Kaikai An, Kangyang Luo, Chen Qian, Fanchao Qi, Baobao Chang, Maosong Sun
| Challenge: | Existing studies show that training LLMs on data containing unfamiliar knowledge during instruction tuning can encourage hallucinations. |
| Approach: | They propose a framework that measures how familiar the LLM is with instruction data and introduce an expert-aligned reward model to ensure the quality of selected samples. |
| Outcome: | The proposed framework reduces hallucinations while maintaining a competitive ability to follow instructions. |
Aspect Sentiment Classification Towards Question-Answering with Reinforced Bidirectional Attention Network (P19-1)
Copied to clipboard
| Challenge: | Existing studies on aspect sentiment classification focus on non-interactive reviews . a new task aims to predict sentiment polarities for specific aspects from interactive reviews based on annotated corpus . |
| Approach: | They propose a task to predict aspects from interactive QA style reviews using an annotated corpus. |
| Outcome: | The proposed approach is compared with state-of-the-art methods against a high-quality corpus of data. |
A Simple Concatenation can Effectively Improve Speech Translation (2023.acl-short)
Copied to clipboard
| Challenge: | Experimental results show that in our unified cross-modal ST model, models can effectively utilize the auxiliary information from speech and text. |
| Approach: | They propose a unified cross-modal ST method which concatenates speech and text as the input and builds a teacher that can utilize both cross-modities simultaneously. |
| Outcome: | The proposed method can effectively utilize the auxiliary information from speech and text, and achieve compelling results on MuST-C datasets. |
Supervised Treebank Conversion: Data and Approaches (P18-1)
Copied to clipboard
| Challenge: | Existing work on treebank conversion focuses on unsupervised treebanks . lack of manually labeled data means that sentences have two syntactic trees at the same time. |
| Approach: | They propose supervised treebank conversion using bi-tree aligned sentences . they propose two conversion approaches based on state-of-the-art deep biaffine parser . |
| Outcome: | The proposed method outperforms the state-of-the-art deep biaffine parser on the English WSJ dataset by 0.97 (93.76% -92.79%) |
Rumor Detection by Exploiting User Credibility Information, Attention and Multi-task Learning (P19-1)
Copied to clipboard
| Challenge: | Social media platforms do not always pose authentic information, and rumors spread fear or hate. |
| Approach: | They propose a new multi-task learning approach for rumor detection and stance classification tasks. |
| Outcome: | The proposed model outperforms the state-of-the-art rumor detection approaches on two datasets. |
Towards Generalizable and Robust Text-to-SQL Parsing (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-SQL parsers must be generalizable and robust against input perturbations. |
| Approach: | They propose a novel framework to learn text-to-SQL parsing in stages to improve parser's ability to acquire general SQL knowledge instead of capturing spurious patterns. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the Spider, SParC, and CoSQL datasets. |
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? (2022.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation models are often criticized for failures that happen without competency awareness. |
| Approach: | They propose a method that extends conventional NMT with a self-estimator to translate a source sentence and estimate its competency. |
| Outcome: | The proposed method performs on translation tasks intact and on quality estimation tasks better than existing methods. |
Sentiment Classification towards Question-Answering with Hierarchical Matching Network (D18-1)
Copied to clipboard
Chenlin Shen, Changlong Sun, Jingjing Wang, Yangyang Kang, Shoushan Li, Xiaozhong Liu, Luo Si, Min Zhang, Guodong Zhou
| Challenge: | Existing methods to classify QA text contain rich sentiment information. |
| Approach: | They propose a task/method to address QA sentiment analysis by annotating QA text pair with annotation guidelines. |
| Outcome: | The proposed method can learn the matching vectors of each Q-sentence, A-sentent unit. |
Estimating Soft Labels for Out-of-Domain Intent Detection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to detect out-of-dominance (OOD) intents are limited by the lack of OOD samples. |
| Approach: | They propose an adaptive soft pseudo labeling method that can estimate soft labels for pseudo OOD samples when training OOD detectors. |
| Outcome: | The proposed method outperforms competing methods on three benchmark datasets and consistently outperformed previous methods. |
SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for dialog understanding only consider self-augmented dialogs as positive samples and treat all other dialogs like negative ones. |
| Approach: | They propose a tree-structured pre-trained conversation model which learns dialog representations from limited labeled dialogs and large-scale unlabeled dialog corpora via semi-supervised contrastive pre-training. |
| Outcome: | The proposed model can achieve state-of-the-art results on the DialoGLUE benchmark. |
Rumor Detection on Social Media: Datasets, Methods and Opportunities (D19-50)
Copied to clipboard
| Challenge: | Social media platforms are used for information gathering, but they also lead to the spreading of rumors and fake news. |
| Approach: | This paper presents a comprehensive list of datasets used for rumor detection . it also reviews the important studies based on what types of information they exploit . |
| Outcome: | This paper presents an overview of the recent studies in the rumor detection field . it provides a comprehensive list of datasets used for rumour detection . |
Dependency Parsing via Sequence Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for dependency parsing are transition-based, graph-based and sequence-to-sequence method. |
| Approach: | They propose to achieve dependency parsing (DP) via Sequence Generation (SG) by utilizing only the pre-trained language model without any auxiliary structures. |
| Outcome: | The proposed method performs well on DP benchmarks including PTB, UD2.2, SDP15 and SemEval16. |
StructuralLM: Structural Pre-training for Form Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models focus on text-only representation, neglecting cell-level layout information. |
| Approach: | They propose a pre-training approach to leverage cell and layout information from scanned documents. |
| Outcome: | The proposed model achieves state-of-the-art in various downstream tasks . it uses 2Dposition embeddings to model word-level layout information . |
A Neural Multi-digraph Model for Chinese NER with Gazetteers (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to incorporating gazetteers into NER systems rely on manually defined selection strategies or handcrafted templates, which may not lead to optimal effectiveness. |
| Approach: | They propose to use graph neural networks to automatically learn how to incorporate multiple gazetteers into an NER system by capturing the information that the gazetteer offers. |
| Outcome: | The proposed model outperforms existing methods on Chinese NER datasets while incorporating rich gazetteer information while resolving ambiguities. |
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections (2022.emnlp-main)
Copied to clipboard
Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, He Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si
| Challenge: | Existing pre-trained vision-language models suffer from inefficiency and linguistic signal overwhelmed by long visual sequences in cross-modal alignment. |
| Approach: | They propose a vision-language foundation model with cross-modal skip-connections that can be pre-trained end-to-end on large-scale image-text pairs with both discriminative and generative objectives. |
| Outcome: | The proposed model achieves state-of-the-art results on a wide range of vision-language downstream tasks, including image captioning, image-text retrieval, visual grounding and visual question answering. |
GATEAU: Selecting Influential Samples for Long Context Alignment (2025.emnlp-main)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Gang Chen, Yunshui Li, Kangyang Luo, Chuancheng Lv, Kaikai An, Fanchao Qi, Baobao Chang, Maosong Sun
| Challenge: | Existing studies have attempted to scale up the available data volume by synthesizing long instruction-following samples, but a lack of a well-defined strategy for ensuring data quality may introduce low-quality samples and restrict the model’s performance. |
| Approach: | They propose a framework to identify influential samples enriched with long-range dependency relations that can be used to align large language models to handle instructions with extremely long contexts. |
| Outcome: | The proposed framework identifies samples with long-range dependency relations and shows that the model trained on these samples exhibits better instruction-following and long-context understanding capabilities. |
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)
Copied to clipboard
Ningyu Zhang, Mosha Chen, Zhen Bi, Xiaozhuan Liang, Lei Li, Xin Shang, Kangping Yin, Chuanqi Tan, Jian Xu, Fei Huang, Luo Si, Yuan Ni, Guotong Xie, Zhifang Sui, Baobao Chang, Hui Zong, Zheng Yuan, Linfeng Li, Jun Yan, Hongying Zan, Kunli Zhang, Buzhou Tang, Qingcai Chen
| Challenge: | a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages. |
| Approach: | They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models. |
| Outcome: | The proposed benchmarks show that the current models perform worse than the human ceiling. |
Human-Like Decision Making: Document-level Aspect Sentiment Classification via Hierarchical Reinforcement Learning (D19-1)
Copied to clipboard
Jingjing Wang, Changlong Sun, Shoushan Li, Jiancheng Wang, Luo Si, Min Zhang, Xiaozhong Liu, Guodong Zhou
| Challenge: | Recent neural networks have shown promising results on Document-level Aspect Sentiment Classification (DASC) however, these approaches often offer little transparency w.r.t. their inner working mechanisms and lack interpretability. |
| Approach: | They propose a Hierarchical Reinforcement Learning approach to DASC that incorporates clause selection and word selection strategies to tackle the data noise problem. |
| Outcome: | The proposed approach over the state-of-the-art approaches shows impressive performance over the current baselines. |
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for language model pretraining use limited knowledge graph data for knowledge-intensive tasks. |
| Approach: | They propose to make better use of multilingual annotations and language agnostic properties of KG triples for pretraining LMs. |
| Outcome: | The proposed models show significant performance improvements on a wide range of knowledge-intensive cross-lingual tasks. |
ENT-DESC: Entity Description Generation by Exploring Knowledge Graph (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for knowledge-to-text generation use RDF triples or key-value pairs to generate a natural language description. |
| Approach: | They propose a large-scale dataset to facilitate the study of KG-to-text . they propose MGCN model architecture that incorporates aggregation methods to extract the rich graph information. |
| Outcome: | The proposed model can represent the original graph information more comprehensively and integrates multiple aggregation methods to extract the rich graph information. |
APE: Argument Pair Extraction from Peer Review and Rebuttal via Multi-task Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | Argument mining is an important research field that attracts growing attention in recent years. |
| Approach: | They propose a new task to extract argument pairs from peer review and rebuttal . they use an open review platform to analyze the contents, structure and connections . |
| Outcome: | The proposed task is based on a dataset of 4,764 fully annotated review-rebuttal passage pairs . it is able to detect argumentative propositions and extract argument pairs from the corpus . |
VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work in multilingual pretraining relies on the shared vocabulary and bilingual contexts to encourage the correlation across languages. |
| Approach: | They propose to plug a cross-attention module into a Transformer encoder to explicitly build the interdependence between languages. |
| Outcome: | The proposed model outperforms existing models on XTREME and English-to-French translation datasets. |
GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systems (2022.acl-long)
Copied to clipboard
| Challenge: | Existing multilingual task-oriented dialogue datasets lack high-quality data curation due to the high expense and challenges of human annotation. |
| Approach: | They propose a method that generates a multilingual ToD dataset globalized from an English ToD data set for three unexplored use cases of multilingual toD systems. |
| Outcome: | The proposed method generates a large-scale multilingual ToD dataset globalized from an English ToD data set for three unexplored use cases of multilingual toD systems. |
Syntax-Enhanced Self-Attention-Based Semantic Role Labeling (D19-1)
Copied to clipboard
| Challenge: | Abstract: Syntax is the bridge to semantics, but recent studies have discussed the necessity of syntax in the context of SRL. |
| Approach: | They propose a syntax-enhanced self-attention model that incorporates syntactic knowledge into the SRL task effectively. |
| Outcome: | The proposed model achieves state-of-the-art for the Chinese SRL task on the CoNLL-2009 dataset. |
Semi-supervised Domain Adaptation for Dependency Parsing (P19-1)
Copied to clipboard
| Challenge: | Currently, most studies on cross-domain parsing focus on unsupervised domain adaptation . however, unsupervised approaches make limited progress due to the intrinsic difficulty of both domain adaptation and parse. |
| Approach: | They propose a semi-supervised domain adaptation problem for Chinese dependency parsing by using newly-annotated large-scale domain-aware datasets. |
| Outcome: | The proposed method is more effective than direct corpus concatenation and multi-task learning. |