The BQ Corpus: A Large-scale Domain-specific Chinese Corpus For Sentence Semantic Equivalence Identification (D18-1)
Copied to clipboard
| Challenge: | Bank Question corpus is a corpus for sentence semantic equivalence identification (SSEI) because of rich expressions in natural languages, SSEI is really a challenging task. |
| Approach: | They propose to cluster 120,000 question pairs from 1-year online bank custom service logs into stacks by the Word Mover’s Distance (WMD) based Affinity Propagation algorithm to achieve questions with the same intent. |
| Outcome: | The proposed method achieves questions with the same intent by clustering deduplicated questions into stacks by the Word Mover’s Distance (WMD) based Affinity Propagation (AP) algorithm. |
Similar Papers
LCQMC:A Large-scale Chinese Question Matching Corpus (C18-1)
Copied to clipboard
| Challenge: | Existing methods for question answering system lack large-scale question matching corpora . lack of large-sized question matching results in problem solving . |
| Approach: | They propose a large-scale Chinese question matching corpus which is released to the public . they use a search engine to collect large-sized question pairs related to high-frequency words . |
| Outcome: | The proposed corpus is more general than paraphrase corpus as it focuses on intent matching rather than paraphrasing. |
Large-Scale QA-SRL Parsing (P18-1)
Copied to clipboard
| Challenge: | a crowd-sourced approach to learning semantic parsers to predict predicateargument structures is open to many researchers. |
| Approach: | They propose a large-scale corpus of Question-Answer driven Semantic Role Labeling annotations . they also propose QA-SRL Bank 2.0, a crowd-sourcing scheme that can be used to train high quality parsers . |
| Outcome: | The proposed QA-SRL parser can generate high-quality questions at low cost and is intuitive to non-experts. |
emrQA: A Large Corpus for Question Answering on Electronic Medical Records (D18-1)
Copied to clipboard
| Challenge: | Existing annotations for other NLP tasks are used to generate domain-specific large-scale question answering (QA) datasets. |
| Approach: | They propose to re-purpose existing annotations for other NLP tasks by generating a large-scale question answering corpus using 1 million questions-logical form and 400,000+ question-answer evidence pairs. |
| Outcome: | The proposed model can be trained to learn domain-specific large-scale question answering (QA) datasets. |
The ACQDIV Corpus Database and Aggregation Pipeline (2020.lrec-1)
Copied to clipboard
| Challenge: | ACQDIV corpus database and aggregation pipeline aims to identify universal cognitive processes that allow children to acquire any language. |
| Approach: | They present the ACQDIV corpus database and aggregation pipeline . the tool aims to identify universal cognitive processes that allow children to acquire any language . |
| Outcome: | The ACQDIV corpus database and aggregation pipeline is a tool developed by the European Research Council . the database represents 15 corpora from 14 typologically maximally diverse languages . |
CLGC: A Corpus for Chinese Literary Grace Evaluation (2022.lrec-1)
Copied to clipboard
| Challenge: | Literature grace is a key element of the style and quality of articles in China. |
| Approach: | They propose to annotate a Chinese literary grace corpus with 10,000 texts and 1.85 million tokens and build a literary grace evaluation task to assess the literary grace level. |
| Outcome: | The proposed model achieves 79.71% on the weighted average F1-score. |
Building Question-Answer Data Using Web Register Identification (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in web register (genre) identification have created a shortage of QA datasets for English and Finnish. |
| Approach: | They propose a machine learning-based method for extracting QA pairs from web-scale data using XLM-R and a multilingual CORE web register corpus . they then develop a NER-style token classifier to identify the QA text spans within these documents. |
| Outcome: | The proposed method is adaptable to any language given the availability of language models and extensive web data, but it is limited to English and Finnish. |
Long-Context Long-Form Question Answering for Legal Domain (2026.eacl-industry)
Copied to clipboard
| Challenge: | Legal documents have complex document layouts involving multiple nested sections and lengthy footnotes that make question answering challenging. |
| Approach: | They propose a question answering system that parses document layouts while isolating sections and footnotes and linking them appropriately. |
| Outcome: | The proposed system can parse complex document layouts while isolating sections and footnotes and linking them appropriately. |
A Methodology for Creating Question Answering Corpora Using Inverse Data Annotation (2020.acl-main)
Copied to clipboard
Jan Deriu, Katsiaryna Mlynchyk, Philippe Schläpfer, Alvaro Rodrigo, Dirk von Grünigen, Nicolas Kaiser, Kurt Stockinger, Eneko Agirre, Mark Cieliebak
| Challenge: | Existing methods to efficiently construct corpus for question answering over structured data are time-consuming and cost-intensive. |
| Approach: | They propose a method to efficiently construct a corpus for question answering over structured data. |
| Outcome: | The proposed method triples the annotation speed while maintaining complexity of queries. |
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark (2025.coling-main)
Copied to clipboard
Zhikun Xu, Yinghui Li, Ruixue Ding, Xinyu Wang, Boli Chen, Yong Jiang, Haitao Zheng, Wenlian Lu, Pengjun Xie, Fei Huang
| Challenge: | Recent work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer dynamic questions well. |
| Approach: | They propose a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest dynamic questions on the Chinese Internet. |
| Outcome: | The proposed benchmark will be one of the key data resources for improving LLMs’ Chinese question-answering ability in the future. |
AMR Beyond the Sentence: the Multi-sentence AMR corpus (C18-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is limited to capturing the semantics of individual sentences. |
| Approach: | They propose a corpus that annotates coreference and similar phenomena on top of existing AMRs. |
| Outcome: | The proposed corpus is compared with existing corpora on sentence-level semantics . it shows that it can be used for information extraction and question answering . |