Papers by Haisong Zhang
hyperdoc2vec: Distributed Representations of Hypertext Documents (P18-1)
Copied to clipboard
| Challenge: | Conventional text embedding methods suffer from information loss if directly adapted to hyper-documents. |
| Approach: | They propose an embedding approach for hyper-documents that incorporates four criteria to preserve necessary information for embeddable models. |
| Outcome: | The proposed model outperforms several existing models on two tasks in the academic domain. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
Semantic Role Labeling Guided Multi-turn Dialogue ReWriter (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing attentive models attend to all words without prior focus, which results in inaccurate concentration on some dispensable words. |
| Approach: | They propose to use semantic role labeling to provide additional guidance for multi-turn dialogue rewriting models. |
| Outcome: | The proposed model outperforms existing models on multi-turn dialogue rewriting tasks. |
Learning from Sibling Mentions with Scalable Graph Inference in Fine-Grained Entity Typing (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models struggle to handle hard mentions due to insufficient contexts, limiting their overall typing performance. |
| Approach: | They propose to exploit sibling mentions to enhance the mention representations by adding unseen test mentions as new nodes for inference. |
| Outcome: | The proposed model outperforms ten strong baseline models and outperformed strong baselines. |
Coupling Global and Local Context for Unsupervised Aspect Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing studies on aspect extraction focus on sequence tagging models trained on human-annotated data. |
| Approach: | They propose a novel neural model capable of coupling global and local representations to discover aspect words by combining global and locale contexts. |
| Outcome: | The proposed model outperforms state-of-the-art models on laptop and restaurant reviews on two benchmarks. |
Continuity of Topic, Interaction, and Query: Learning to Quote in Online Conversations (2020.emnlp-main)
Copied to clipboard
| Challenge: | Quotations are crucial for successful explanations and persuasions in interpersonal communications. |
| Approach: | They propose to use an encoder-decoder neural framework to continue the context with a quotation via language generation to capture latent topics, interactions with the dialogue history, and coherence to the existing contents. |
| Outcome: | The proposed model outperforms state-of-the-art models on two large-scale datasets in English and Chinese and shows that topic, interaction, and query consistency are helpful to learn how to quote in online conversations. |
Generating Classical Chinese Poems via Conditional Variational Autoencoder and Adversarial Training (D18-1)
Copied to clipboard
| Challenge: | Existing models for automatic poetry generation lack term novelty and thematic consistency. |
| Approach: | They propose a conditional variational autoencoder with adversarial training for classical Chinese poem generation. |
| Outcome: | The proposed model outperforms existing models on a large poetry corpus on 'classical Chinese' . it generates poems with novel terms and learns their thematic consistency with their titles. |
Directional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings (N18-2)
Copied to clipboard
| Challenge: | Existing word embedding models are limited by semantic resources, which are hard to obtain or annotate. |
| Approach: | They propose a directional skip-gram model that explicitly distinguishes between left and right contexts in word prediction. |
| Outcome: | The proposed model outperforms other models on different datasets in semantic and syntactic evaluations. |
Hypernymy Detection for Low-Resource Languages via Meta Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies focus on monolingual hypernymy detection on high-resource languages, but few investigate low-resourced scenarios. |
| Approach: | They propose to combine high-resource languages to solve low-resourced hypernymy detection problem . they extensively compare three joint training paradigms and propose meta learning . |
| Outcome: | The proposed method significantly improves performance of extremely low-resource languages by preventing over-fitting on small datasets. |
RFBFN: A Relation-First Blank Filling Network for Joint Relational Triple Extraction (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing methods for relational triple extraction ignore semantic information of relations or predict subjects and objects sequentially. |
| Approach: | They propose a relation-first blank filling network to capture semantic information of relations . they transform relations into relation templates with blanks which contain the fine-grained semantic representation of relations. |
| Outcome: | The proposed model outperforms current state-of-the-art methods on public benchmark datasets. |
Enhancing the Open-Domain Dialogue Evaluation in Latent Space (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to evaluate opendomain dialogues are limited due to the one-to-many nature of dialogues. |
| Approach: | They propose a self-supervised setting to obtain a smooth latent space that captures discourse-level context information and implicitly models more references in latent spaces. |
| Outcome: | The proposed method outperforms baseline methods on two real-world dialogue datasets. |
Rigid Formats Controlled Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural text generation is a challenging task that requires rigid formats to be controlled . a framework called SongNet is designed to tackle this problem . |
| Approach: | They propose a framework to tackle a task called rigid formats controlled text generation . they propose rhyming schemes and a transformer-based auto-regressive language model to improve the modeling performance . |
| Outcome: | The proposed framework improves the performance on format, rhyme, and sentence integrity. |
Domain-Adaptive Pretraining Methods for Dialogue Understanding (2021.acl-short)
Copied to clipboard
| Challenge: | Recent advances in pretraining methods have achieved promising results on NLP tasks . however, it is unclear which pretraining objective is the most effective for each downstream task . |
| Approach: | They evaluate the effectiveness of domain-adaptive pretraining objectives on downstream tasks . they use open-domain data to pretrain language models like BERT and SpanBERT . |
| Outcome: | The proposed model improves on two dialogue understanding tasks with domain-adaptive pretraining objectives. |
A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check (D18-1)
Copied to clipboard
| Challenge: | Chinese spelling check (CSC) is a challenging but meaningful task that serves as a preprocessing in many natural language processing(NLP) applications. |
| Approach: | They propose to construct Chinese spelling check corpus with automatically generated spelling errors, which are either visually or phonologically resembled characters, corresponding to OCR- and ASR-based methods. Experimental results demonstrate the effectiveness of the approach. |
| Outcome: | The proposed method is based on visual or phonologically similar spelling errors, and is validated with respect to three standard test sets. |
Fine-grained Entity Typing without Knowledge Base (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on fine-grained entity typing (FET) relies on knowledge bases as distant supervision, but lack of or incompleteness of KB can hinder training. |
| Approach: | They propose a two-step framework that trains FET models without accessing any knowledge base. |
| Outcome: | The proposed framework achieves competitive performance with respect to the models trained on the original KB-supervised datasets. |