Papers by Marina Danilevsky
Learning Explainable Linguistic Expressions with Neural Inductive Logic Programming for Sentence Classification (2020.emnlp-main)
Copied to clipboard
Prithviraj Sen, Marina Danilevsky, Yunyao Li, Siddhartha Brahma, Matthias Boehm, Laura Chiticariu, Rajasekar Krishnamurthy
| Challenge: | Existing approaches to explain models are difficult to interpret and have undesirable biases. |
| Approach: | They propose a neural network architecture for learning transparent sentences . they use linguistic expressions built on top of predicates extracted using shallow natural language understanding . |
| Outcome: | The proposed model outperforms statistical relational learning and other neuro-symbolic methods and performs better than black-box recurrent neural networks. |
Label Sleuth: From Unlabeled Text to a Classifier in a Few Hours (2022.emnlp-demos)
Copied to clipboard
Eyal Shnarch, Alon Halfon, Ariel Gera, Marina Danilevsky, Yannis Katsis, Leshem Choshen, Martin Santillan Cooper, Dina Epelboim, Zheng Zhang, Dakuo Wang
| Challenge: | Label Sleuth is an open source system for labeling and creating text classifiers which does not require coding skills nor machine learning knowledge. |
| Approach: | *Label Sleuth* is an open source system for labeling and creating text classifiers which does not require coding skills nor machine learning knowledge. |
| Outcome: | *Label Sleuth* is an open source system for labeling and creating text classifiers. |
Learning to Robustly Aggregate Labeling Functions for Semi-supervised Data Programming (2022.findings-acl)
Copied to clipboard
Ayush Maheshwari, Krishnateja Killamsetty, Ganesh Ramakrishnan, Rishabh Iyer, Marina Danilevsky, Lucian Popa
| Challenge: | supervised machine learning requires large amounts of labeled data to train models. |
| Approach: | They propose a framework to generate human-interpretable labeling functions . they propose to learn a model on the same labeled dataset and unlabeled data . |
| Outcome: | The proposed framework outperforms prior approaches on several text classification datasets. |
SystemT: Declarative Text Understanding for Enterprise (N18-3)
Copied to clipboard
| Challenge: | a growing number of enterprise applications are relying on text understanding systems to understand information in unstructured and semi-structured forms. |
| Approach: | They propose a declarative text understanding system that addresses these challenges . they summarize the impact of SystemT on business and education . |
| Outcome: | The system addresses the challenges of enterprise text understanding systems . it has been deployed in a wide range of enterprise applications . |
PriMeSRL-Eval: A Practical Quality Metric for Semantic Role Labeling Systems Evaluation (2023.findings-eacl)
Copied to clipboard
Ishan Jindal, Alexandre Rademaker, Khoi-Nguyen Tran, Huaiyu Zhu, Hiroshi Kanayama, Marina Danilevsky, Yunyao Li
| Challenge: | Existing evaluation scripts for semantic role labeling do not consider error propagation . existing evaluation script does not consider argument independent of predicate sense . |
| Approach: | They propose a more strict SRL evaluation metric PriMeSRL to address these issues . they propose to use a metric that measures the quality of the underlying SRL models . |
| Outcome: | The proposed metric reduces quality evaluation of all SoTA SRL models and penalizes failures. |
A Survey of the State of Explainable AI for Natural Language Processing (2020.aacl-main)
Copied to clipboard
| Challenge: | Recent years have seen significant advances in the quality of state-of-the-art models, but they have come at the expense of models becoming less interpretable. |
| Approach: | This survey examines the current state of Explainable AI within the domain of NLP . they detail the operations and explainability techniques currently available for generating explanations for NLP models . |
| Outcome: | This survey examines the state of explainable AI (XAI) within the domain of natural language processing . it focuses on the operations and explainability techniques currently available for NLP models . |
Development of an Enterprise-Grade Contract Understanding System (2021.naacl-industry)
Copied to clipboard
Arvind Agarwal, Laura Chiticariu, Poornima Chozhiyath Raman, Marina Danilevsky, Diman Ghazi, Ankush Gupta, Shanmukha Guttula, Yannis Katsis, Rajasekar Krishnamurthy, Yunyao Li, Shubham Mudgal, Vitobha Munigala, Nicholas Phan, Dhaval Sonawane, Sneha Srinivasan, Sudarshan R. Thitte, Mitesh Vasa, Ramiya Venkatachalam, Vinitha Yaski, Huaiyu Zhu
| Challenge: | Currently, legal contract review remains an expensive and arduous process. |
| Approach: | They describe a commercial system designed and deployed for contract understanding that enables legal professionals to review contracts. |
| Outcome: | The proposed system is used by a wide range of enterprise users and solves three major challenges. |
Active Learning for BERT: An Empirical Study (2020.emnlp-main)
Copied to clipboard
Liat Ein-Dor, Alon Halfon, Ariel Gera, Eyal Shnarch, Lena Dankin, Leshem Choshen, Marina Danilevsky, Ranit Aharonov, Yoav Katz, Noam Slonim
| Challenge: | Existing approaches to deal with data scarcity are active learning (AL) and pre-trained models are not being considered. |
| Approach: | They propose to use active learning techniques to cope with data scarcity in binary text classification scenarios where the annotation budget is very small and the data is often skewed. |
| Outcome: | The proposed methods improve BERT performance in binary text classification scenarios where the annotation budget is very small and the data is often skewed. |
MTRAG-UN: A Benchmark for Open Challenges in Multi-Turn RAG Conversations (2026.findings-acl)
Copied to clipboard
| Challenge: | Several benchmarks have been released to evaluate model performance on multi-turn retrieval augment generation tasks. |
| Approach: | They propose to benchmark 666 conversations with over 2,800 conversation turns across 6 domains and a corpora that focuses on unanswerable questions and later conversation turns. |
| Outcome: | The proposed benchmarks show that retrieval and generation models struggle on conversations with UNanswerable, UNderspecified, and NONstandalone questions and UNclear responses. |
Semi-Structured Object Sequence Encoders (2023.findings-emnlp)
Copied to clipboard
Rudra Murthy, Riyaz Bhat, Chulaka Gunasekara, Siva Patel, Hui Wan, Tejas Dhamecha, Danish Contractor, Marina Danilevsky
| Challenge: | Semi-structured object sequences are often represented as a sequence of key-value pairs over time . authors propose a two-part approach that takes each key independently and encodes a representation of its values over time. |
| Approach: | They propose a two-part approach that first considers each key independently and encodes a representation of its values over time. |
| Outcome: | The proposed approach outperforms existing methods on multiple prediction tasks using real-world data. |