Papers by Amir Cohen
LM vs LM: Detecting Factual Errors via Cross Examination (2023.emnlp-main)
Copied to clipboard
| Challenge: | Modern language models (LMs) generate inconsistent, non-attributable or factually incorrect text, which hinders their usability. |
| Approach: | They propose a factuality evaluation framework for LMs that is based on cross-examination to detect inconsistencies between LM and examiner. |
| Outcome: | The proposed framework outperforms existing methods and baselines on factual claims on four benchmarks. |
McPhraSy: Multi-Context Phrase Similarity and Clustering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for estimating phrase similarity use the phrase context only during training, instead relying on the phrase itself. |
| Approach: | They propose a novel algorithm that leverages multiple contexts during inference to estimate the similarity of phrases based on multiple context. |
| Outcome: | The proposed method outperforms existing models on two phrase similarity datasets by 13.3% and a new task that relies on phrase similarities in the product reviews domain. |
HeQ: a Large and Diverse Hebrew Reading Comprehension Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current benchmarks for Hebrew Natural Language Processing (NLP) focus mainly on morpho-syntactic tasks, neglecting the semantic dimension of language understanding. |
| Approach: | They propose to use Hebrew machine reading comprehension (MRC) as extractive Question Answering to address this problem. |
| Outcome: | The proposed benchmark features 30,147 question-answer pairs derived from both Hebrew Wikipedia articles and Israeli tech news. |
Crawling The Internal Knowledge-Base of Language Models (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for representing factual knowledge in a language model are insufficient. |
| Approach: | They propose a procedure for “crawling” the internal knowledge-base of a language model by expanding a knowledge-graph around it. |
| Outcome: | The proposed method yields high precision graphs (82-92%) while emitting a reasonable number of facts per entity. |
SDR: Efficient Neural Re-ranking using Succinct Document Representation (2022.acl-long)
Copied to clipboard
| Challenge: | BERT based ranking models have been successful on various information retrieval tasks, but they are prone to storage and network fetching latency. |
| Approach: | They propose a late-interaction architecture that allows pre-computation of intermediate document representations, thus reducing latency. |
| Outcome: | The proposed model achieves 4x–11.6x higher compression rates on the MSMARCO passage re-reranking task compared to existing methods. |
NERetrieve: Dataset for Next Generation Named Entity Recognition and Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a widely adopted NLP task . authors present three variants of NER task, with dataset to support them . |
| Approach: | They propose three variants of the NER task, together with a dataset to support them . they propose a move towards more fine-grained entities and zero-shot recognition . |
| Outcome: | The proposed model matches or surpasses existing models in NER tasks . the proposed model is based on a large, silver-annotated corpus of 4 million paragraphs . |
Data-driven Coreference-based Ontology Building (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a new ontology is based on coreference resolution, but it is not comprehensive . a recent study found that ontologies categorize concepts into groups and arrange them in a hierarchy . |
| Approach: | They derive coreference chains from a corpus of 30 million biomedical abstracts and construct a graph based on the string phrases within these chains. |
| Outcome: | The proposed ontology overlaps significantly with human-authored ontologies. |
Automatic Rephrasing of Transcripts-based Action Items (2021.findings-acl)
Copied to clipboard
| Challenge: | a growing number of online meetings are transcribed using automated speech recognition systems. |
| Approach: | They propose to use annotated transcripts to generate a human-level rephrasing of an action item . they use supervised text generation techniques and pre-trained transformer models to train models . |
| Outcome: | The proposed model generates a human-level rephrasing of an action item in annotated meeting transcripts. |