Ulster University Logo

Ulster Institutional Repository

Advances in Intelligent MultiMedia: MultiModal semantic representation

Biomedical Sciences Research Institute Computer Science Research Institute Environmental Sciences Research Institute Nanotechnology & Advanced Materials Research Institute

McKevitt, P (2005) Advances in Intelligent MultiMedia: MultiModal semantic representation. In: Proc. of the Pacific Rim International Conference on Computational Linguistics (PACLING-05), Meisei University (Hino Campus), Hino-shi, Tokyo, Japan. Meisei University (Hino Campus). 12 pp. [Conference contribution]

[img]
Preview
PDF - Accepted Version
538Kb

Abstract

Intelligent MultiMedia or MultiModal systems involve the computer processing, understanding and production of inputs and outputs from at least speech, text, and visual information in terms of semantic representations. One of the central questions for these systems is what form of semantic representation should be used. Here, we look at current trends in multimodal semantic representation which are mainly XML and frame- based, relate our experiences in the development of multimodal systems (CHAMELEON and CONFUCIUS) and conclude that producer/consumer, intention (speech acts), semantic-content, and timestamps are four important components of any multimodal semantic representation.

Item Type:Conference contribution (Keynote)
Faculties and Schools:Faculty of Arts
Faculty of Arts > School of Creative Arts and Technologies
Research Institutes and Groups:Computer Science Research Institute
ID Code:21388
Deposited By:Professor Paul McKevitt
Deposited On:10 May 2012 13:25
Last Modified:10 May 2012 13:25

Repository Staff Only: item control page