Papers by Todd Shore
Using Lexical Alignment and Referring Ability to Address Data Sparsity in Situated Dialog Reference Resolution (D18-1)
Copied to clipboard
| Challenge: | Existing work on exophoric reference resolution for situated dialogs is limited to a literary model . et al., 2010) showed that it is possible to improve dialogic reference resolving by incrementally adapting word semantic model parameters to idiosyncratic language use by dyad partners. |
| Approach: | They propose to use a logistic regression model to adapt a model to idiosyncratic language . they first train a log regression model and then use it to learn the general referring ability of each word . |
| Outcome: | The proposed methods improve dialogic reference resolution without annotation of referring expressions even with little background data. |
KTH Tangrams: A Dataset for Research on Alignment and Conceptual Pacts in Task-Oriented Dialogue (L18-1)
Copied to clipboard
| Challenge: | Existing studies on instructor-manipulator dialogue use disparate but similar datasets . a recent study examined the alignment of referring expressions (RL) in situated dialogue . |
| Approach: | They propose to use a corpus of referring expressions in a relatively free dialogue with physical features generated in simulated situations to study alignment in referring language. |
| Outcome: | The proposed datasets facilitate analysis of dialogic linguistic phenomena regarding alignment in the formation of referring expressions known as conceptual pacts. |
FARMI: A FrAmework for Recording Multi-Modal Interactions (L18-1)
Copied to clipboard
Patrik Jonell, Mattias Bystedt, Per Fallgren, Dimosthenis Kontogiorgos, José Lopes, Zofia Malisz, Samuel Mascarenhas, Catharine Oertel, Eran Raveh, Todd Shore
| Challenge: | a new framework for recording multi-modal data is needed to capture multi-party, richly recorded corpora and perform real-time processing of such data. |
| Approach: | They propose an open-source processing architecture for corpora and real-time processing . they deploy the architecture in a multi-party deception game with six humans and one robot . |
| Outcome: | The proposed architecture is agnostic to hardware and programming languages, although it's mostly written in Python. |