BUSTER: a “BUSiness Transaction Entity Recognition” dataset (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Natural Language Processing has seen major breakthroughs in the last few years, but transferring these advances into industry applications can be difficult. |
| Approach: | They propose to use a BUSiness Transaction Entity Recognition dataset to support industry-oriented research by exploiting both general-purpose and domain-specific language models. |
| Outcome: | The proposed model is the best performing model and an additional silver corpus to BUSTER. |
Similar Papers
FiNER: Financial Numeric Entity Recognition for XBRL Tagging (2022.acl-long)
Copied to clipboard
Lefteris Loukas, Manos Fergadiotis, Ilias Chalkidis, Eirini Spyropoulou, Prodromos Malakasiotis, Ion Androutsopoulos, Georgios Paliouras
| Challenge: | Publicly traded companies are required to submit periodic reports with eXtensive Business Reporting Language (XBRL) word-level tags. |
| Approach: | They propose to use XBRL tagging as a new entity extraction task for the financial domain and release FiNER-139, a dataset of 1.1M sentences with gold X brl tags. |
| Outcome: | The proposed solution replaces numeric expressions with pseudo-tokens reflecting original token shapes and numeric magnitudes. |
FIRE: A Dataset for Financial Relation Extraction (2024.findings-naacl)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) and Relation Extraction (RE) datasets require extensive linguistic and domain knowledge, making dataset creation costly and labor-intensive. |
| Approach: | They introduce a sentence-level dataset of named entities and relations within the financial sector that encapsulates 13 named entity types along with 18 relation types. |
| Outcome: | The proposed dataset encapsulates 13 named entity types along with 18 relation types and was labeled by a single annotator to minimize labeling noise. |
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them . |
| Approach: | They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition . |
| Outcome: | The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs . |
A Named Entity Recognition Shootout for German (P18-2)
Copied to clipboard
| Challenge: | Named entity recognition and classification (NER) is a central component in many natural language processing pipelines. |
| Approach: | They propose to build a model for German named entity recognition that performs at the state of the art for both contemporary and historical texts. |
| Outcome: | The proposed model outperforms the CRF and BiLSTM on large and small datasets. |
CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Dataset (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models achieve F1-scores comparable to or exceed noise level in CoNLL-03 . current models have significant annotation errors, incompleteness, and inconsistencies in the data . |
| Approach: | They propose to add a layer of entity linking annotation to the CoNLL-03 corpus to correct 7.0% of all labels. |
| Outcome: | The proposed approach corrects 7.0% of all labels in the English CoNLL-03 dataset. |
FinEntity: Entity-level Sentiment Classification for Financial Texts (2023.emnlp-main)
Copied to clipboard
| Challenge: | FinEntity annotates financial entity spans and their sentiment (positive, neutral, and negative) in financial news. |
| Approach: | They introduce an entity-level sentiment classification dataset called FinEntity that annotates financial entity spans and their sentiment in financial news. |
| Outcome: | The proposed dataset annotates financial entity spans and their sentiment (positive, neutral, and negative) in financial news. |
Understanding Structured Financial Data with LLMs: A Case Study on Fraud Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are expensive to develop and maintain and require extensive feature engineering to perform. |
| Approach: | They propose a two-stage approach that serializes a compact subset of numeric/categorical attributes into natural language and performs retrieval-augmented in-context learning over label-aware, instance-level exemplars. |
| Outcome: | The proposed approach significantly improves F1/MCC over direct prompting and is competitive with strong tabular baselines in several settings. |
A French Corpus and Annotation Schema for Named Entity Recognition and Relation Extraction of Financial News (2020.lrec-1)
Copied to clipboard
| Challenge: | Strict regulatory regimes mandate financial institutions to rigorously monitor their customers' financial activities. |
| Approach: | They propose to use an ontology of compliance-related concepts and relationships along with a corpus annotated according to it to train and evaluate named entity recognition algorithms. |
| Outcome: | The proposed ontology allows for training and evaluating domain-specific named entity recognition and relation extraction algorithms. |
Rethinking Document-Level Relation Extraction: A Reality Check (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent efforts push up performance boundaries of document-level relation extraction (DocRE) but these efforts are not promising. |
| Approach: | They construct four types of entity mention attacks to examine model robustness . they also have a close check on model usability in a more realistic setting . |
| Outcome: | The proposed model is based on a strong or untenable assumption in common . the model is robust under four types of mention attacks and usable in a realistic setting . |
Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency (2024.lrec-main)
Copied to clipboard
Toyin D. Aguda, Suchetha Siddagangappa, Elena Kochkina, Simerjot Kaur, Dongsheng Wang, Charese Smiley
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general domain datasets, but their effectiveness on domain specific datasets remains under-explored. |
| Approach: | They compare the annotations produced by three LLMs against expert annotators and crowdworkers. |
| Outcome: | The proposed models outperform expert crowdworkers and crowd-sourced annotators on domain specific datasets. |