Chop and Change: Anaphora Resolution in Instructional Cooking Videos (2022.findings-aacl)
Copied to clipboard
| Challenge: | temporally evolving entities present challenges for anaphora resolution tasks . recipes provide rich source for referring expressions of transformed entities . |
| Approach: | They propose to use annotations to annotate recipes for anaphora resolution task . they propose to employ temporal features to improve anamorphic resolution . |
| Outcome: | The proposed annotation scheme improves the performance of the anaphora resolution task. |
Similar Papers
MMAR: Multilingual and Multimodal Anaphora Resolution in Instructional Videos (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to multilingual anaphora resolution include images and video inputs. |
| Approach: | They propose to include multimodal information in the form of images in anaphora resolution tasks. |
| Outcome: | The proposed approach improves resolution by 10% for unseen languages. |
Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows (2022.coling-1)
Copied to clipboard
Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Yoshitaka Ushiku, Shinsuke Mori
| Challenge: | a new dataset enables us to learn a cooking action result for each object in a recipe text. |
| Approach: | They propose a multimodal dataset that enables us to learn a cooking action result for each object in a recipe text. |
| Outcome: | The proposed dataset reduces human annotation costs by allowing multimodal information retrieval. |
What does it take to bake a cake? The RecipeRef corpus and anaphora resolution in procedural text (2022.findings-acl)
Copied to clipboard
| Challenge: | Current research on anaphora resolution is mostly based on declarative text, such as chemical patents or instruction manuals. |
| Approach: | They propose a framework for anaphora annotation for the chemical domain for modeling anamorphic phenomena in recipes and chemical patents. |
| Outcome: | The proposed framework improves resolution of anaphora in recipes, suggesting transferability of general procedural knowledge. |
Universal Anaphora: The First Three Years (2024.lrec-main)
Copied to clipboard
Massimo Poesio, Maciej Ogrodniczuk, Vincent Ng, Sameer Pradhan, Juntao Yu, Nafise Sadat Moosavi, Silviu Paun, Amir Zeldes, Anna Nedoluzhko, Michal Novák, Martin Popel, Zdeněk Žabokrtský, Daniel Zeman
| Challenge: | Universal Anaphora initiative aims to push forward the state of the art in anaphora and anaphorism resolution by expanding the aspects of anaphonic interpretation which are or can be reliably annotated in an anagraphic corpora. |
| Approach: | They propose to develop a standard for anaphoric annotations and a method for evaluating models that can carry out this type of interpretation. |
| Outcome: | The Universal Anaphora initiative aims to push forward the state of the art in anaphora and anaphorism resolution by producing unified standards to annotate and encode annotations, delivering datasets encoded according to these standards, and developing methods for evaluating models that carry out this type of interpretation. |
English Recipe Flow Graph Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Annotated corpus of English cooking recipe procedures with domain-specific linguistic and semantic structure. |
| Approach: | They annotate a corpus of English cooking recipe procedures with domain-specific linguistic and semantic structure and then use a flow graph to represent the sequence of steps. |
| Outcome: | The proposed methods achieve 71.1 to 87.5 F1 in the cooking domain and a flow graph achieves similarity to those used in Japanese recipes. |
End-to-end Parsing of Procedural Text into Flow Graphs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing flow graph parsers lack sufficient annotated data to train them . a lack of annotation can cause costly training, and poor flow graph training results in a large improvement. |
| Approach: | They propose a multi-task framework that performs tagging and graph generation simultaneously . they take advantage of the abundance of unlabelled recipes and generate noisy silver annotations . |
| Outcome: | The proposed model can unify the input representation and use compact encoders, resulting in small models with significantly fewer parameters than existing models. |
Recipe Instruction Semantics Corpus (RISeC): Resolving Semantic Structure and Zero Anaphora in Recipes (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing approaches to understanding recipe instructions make assumptions that are domain specific. |
| Approach: | They propose a new dataset for information extraction on recipes . they avoid a priori pre-defining domain-specific predicates to recognize . instead, they focus on basic understanding of the expressed semantics . |
| Outcome: | The proposed dataset avoids a priori pre-defining domain-specific predicates to recognize . instead, it focuses on basic understanding of the expressed semantics rather than reducing them to a simplified state representation. |
NarrativeTime: Dense Temporal Annotation on a Timeline (2024.lrec-main)
Copied to clipboard
| Challenge: | e.g. TimeBank contains 1-5% of all possible tlinks, and this information is underspecified in the text. |
| Approach: | They propose a timeline-based framework that achieves full coverage of all possible TLINKs. |
| Outcome: | The proposed framework achieves full coverage of all possible TLINKs in a text. |
ReciFine: Finely Annotated Recipe Dataset for Controllable Recipe Generation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing resources, such as RecipeNLG, extract food items only from ingredient lists, overlooking entities expressed in instructions, such tools, chef actions, food and tool states, and durations. |
| Approach: | They extend RecipeNLG to extract 97 million entities from 2.2 million recipes. |
| Outcome: | The proposed model outperforms existing models trained on ingredient-list data on both automatic and human evaluations. |
Bridging Resolution: Making Sense of the State of the Art (2021.naacl-main)
Copied to clipboard
| Challenge: | bridging resolution is a task that involves identifying and resolving bridling/associative anaphors, which are anamorphic references to non-identical associated antecedents. |
| Approach: | They propose a hybrid rule-based and MTL approach that would enable a better understanding of their comparative strengths and weaknesses. |
| Outcome: | The proposed model would be able to better understand their strengths and weaknesses and perform a manual analysis of the errors made by the model. |