Applying Computational Models of Spatial Prepositions to Visually Situated Dialog
Open Access
- 1 June 2009
- journal article
- Published by MIT Press in Computational Linguistics
- Vol. 35 (2), 271-306
- https://doi.org/10.1162/coli.06-78-prep14
Abstract
This article describes the application of computational models of spatial prepositions to visually situated dialog systems. In these dialogs, spatial prepositions are important because people often use them to refer to entities in the visual context of a dialog. We first describe a generic architecture for a visually situated dialog system and highlight the interactions between the spatial cognition module, which provides the interface to the models of prepositional semantics, and the other components in the architecture. Following this, we present two new computational models of topological and projective spatial prepositions. The main novelty within these models is the fact that they account for the contextual effect which other distractor objects in a visual scene can have on the region described by a given preposition. We next present psycholinguistic tests evaluating our approach to distractor interference on prepositional semantics, and illustrate how these models are used for both interpretation and generation of prepositional expressions.Keywords
This publication has 15 references indexed in Scilit:
- Dynamically structuring, updating and interrelating representations of visual and linguistic discourse contextArtificial Intelligence, 2005
- Grounded Semantic Composition for Visual ScenesJournal of Artificial Intelligence Research, 2004
- The Spatial Semantic HierarchyArtificial Intelligence, 2000
- In and on: investigating the functional geometry of spatial prepositionsCognition, 1999
- The Influence of Reference Frame Selection on Spatial Template ConstructionJournal of Memory and Language, 1997
- Qualitative Spatial Representation and Reasoning with the Region Connection CalculusGeoInformatica, 1997
- Computational interpretations of the Gricean maxims in the generation of referring expressionsCognitive Science, 1995
- Spatial language and spatial representationCognition, 1995
- Spatial attention and the apprehension of spatial relations.Journal of Experimental Psychology: Human Perception and Performance, 1994
- Situations and prepositionsLinguistics and Philosophy, 1986