Intra-Correlation Encoding for Chinese Sentence Intention Matching (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods to improve sentence intention matching for Chinese text are limited due to the particularity of the text. |
| Approach: | They propose a method that combines character-granularity and word-granulularity features to perform sentence intention matching. |
| Outcome: | The proposed method can capture sentence feature information from multiple perspectives and correlation information between different levels of sentences. |
Similar Papers
Enhancing Pre-trained Chinese Character Representation with Word-aligned Attention (2020.acl-main)
Copied to clipboard
| Challenge: | Pre-trained Chinese language models take character as the basic unit and learn representation according to character’s external contexts, ignoring the semantics expressed in the word, which is the smallest meaningful utterance in Chinese. |
| Approach: | They propose to pool character-level attention to the word level and propose to alleviate the potential issue of segmentation error propagation by multi-source information fusion. |
| Outcome: | The proposed approach improves on five Chinese NLP benchmark tasks against BERT, ERNIE and BERT-wwm. |
Multi-Granularity Fusion Text Semantic Matching Based on WoBERT (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text-matching methods struggle with semantic nuances in short texts . a novel approach to improve text semantic matching is being developed . |
| Approach: | They propose a multi-granularity fusion model that harnesses a pre-trained language model to capture text semantic nuances. |
| Outcome: | The proposed model improves on Chinese short text matching datasets compared to traditional methods . the proposed model captures individual text semantic nuances and improves accuracy . |
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing word alignment models capture few interactions between input sentence pairs, which severely degrades the word alignment quality. |
| Approach: | They propose to model deep interactions between input and target sentences using a two-stage training framework to train the model. |
| Outcome: | The proposed model achieves the state-of-the-art (SOTA) performance on four out of five language pairs. |
Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intents (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing text semantic matching models do not provide granularity for text comparison. |
| Approach: | They propose a simple yet effective training strategy for text semantic matching by disentangling keywords from intents. |
| Outcome: | The proposed approach achieves stable performance improvements against a wide range of models on three benchmarks. |
Neural Graph Matching Networks for Chinese Short Text Matching (2020.acl-main)
Copied to clipboard
| Challenge: | Chinese word segmentation can be erroneous, ambiguous or inconsistent, causing performance problems. |
| Approach: | They propose a sentence matching framework that uses paired word lattices as input instead of a character sequence. |
| Outcome: | The proposed framework outperforms the state-of-the-art short text matching models on two Chinese datasets. |
Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for learning semantic similarity between two English sentences have focused on one sub-task and therefore showed biased performance. |
| Approach: | They propose a method to learn semantic similarity between two English sentences using siamese networks. |
| Outcome: | The proposed method improves on both sub-tasks and predicts similarity scores in 14 languages. |
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models process text as a sequence of characters, ignoring more coarse granularity, e.g., words. |
| Approach: | They propose a new pre-training paradigm for Chinese that incorporates word representations along with characters and can model a sentence in a multi-granular manner. |
| Outcome: | The proposed model can bring an average increase of 1.5% under the 12-layer setting, which achieves new state-of-the-art among base-size models on the CLUE benchmarks. |
Document-Level Event Role Filler Extraction using Multi-Granularity Contextualized Encoding (2020.acl-main)
Copied to clipboard
| Challenge: | Document-level event extraction requires a view of a larger context to determine which spans of text correspond to event role fillers. |
| Approach: | They propose a multi-granularity reader to dynamically aggregate information captured by neural representations learned at different levels of granularities. |
| Outcome: | The proposed model performs substantially better than previous models on the MUC-4 event extraction dataset. |
Sentence Matching with Syntax- and Semantics-Aware BERT (2020.coling-main)
Copied to clipboard
| Challenge: | Sentence matching aims to determine the special relationship between two sentences. |
| Approach: | They propose to integrate syntactic and semantic information into BERT with sentence matching by using an implicit integration method that is less sensitive to the output structure information. |
| Outcome: | The proposed method achieves state-of-the-art or competitive performance on several sentence matching datasets. |
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models. |
| Approach: | They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key . |
| Outcome: | The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key . |