FROM IMAGE SEQUENCES TO NATURAL LANGUAGE: A First Step toward Automatic Perception and Description of Motions
- 1 January 1987
- journal article
- research article
- Published by Informa UK Limited in Applied Artificial Intelligence
- Vol. 1 (4), 287-305
- https://doi.org/10.1080/08839518708927976
Abstract
We present our work concerning the connection of a vision system to a natural language system. That is, automatic processing transforms the original sequence of TV images into natural language descriptions concerning moving objects. It is the first time that this transformation has been achieved entirely by computer. A vision system that has been developed in Karlsruhe is briefly introduced. By analyzing displacement vector fields, trajectories of object candidates are recognized. The natural language system CITYTOUR is presented. The verbalization of spatial relations between static and moving objects can be studied with this system. The present state of the connection is described, and the data resulting from the vision system are partially used and verbalized by CITYTOUR.Keywords
This publication has 5 references indexed in Scilit:
- Women, Fire, and Dangerous ThingsPublished by University of Chicago Press ,1987
- Detektion und Verfolgung Mehrerer Objekte in BilfolgenPublished by Springer Science and Business Media LLC ,1986
- Volumetric model and 3D trajectory of a moving car derived from monocular TV frame sequences of a street sceneComputer Graphics and Image Processing, 1982
- A framework for visual motion understandingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1980
- Language and PerceptionPublished by Harvard University Press ,1976