Ulster University Logo

Ulster Institutional Repository

SceneMaker: multimodal visualisation of natural language film scripts

Biomedical Sciences Research Institute Computer Science Research Institute Environmental Sciences Research Institute Nanotechnology & Advanced Materials Research Institute

Hanser, E, McKevitt, P, Lunney, TF, Condell, J and Ma, M (2010) SceneMaker: multimodal visualisation of natural language film scripts. In: Proc. of the 14th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES-10), Cardiff University, Cardiff, Wales. Springer-Verlag. Vol 6279 10 pp. [Conference contribution]

[img]
Preview
PDF - Accepted Version
1061Kb

URL: http://www.springerlink.com/content/d6w1n27161786kv4/

DOI: 10.1007/978-3-642-15384-6_46

Abstract

Producing plays, films or animations is a complex and expensive process involving various professionals and media. Our proposed software system, SceneMaker, aims to facilitate this creative process by automatically interpreting natural language film scripts and generating multimodal, animated scenes from them. During the generation of the story content, SceneMaker gives particular attention to emotional aspects and their reflection in fluency and manner of actions, body posture, facial expressions, speech, scene composition, timing, lighting, music and camera work. Related literature and software on Natural Language Processing, in particular textual affect sensing, affective embodied agents, visualisation of 3D scenes and digital cinematography are reviewed. In relation to other work, SceneMaker follows a genre-specific text-to-animation methodology which combines all relevant expressive modalities and is made accessible via web-based and mobile platforms. In conclusion, SceneMaker will enhance the communication of creative ideas providing quick pre-visualisations of scenes.

Item Type:Conference contribution (Paper)
Faculties and Schools:Faculty of Arts
Faculty of Computing & Engineering
Faculty of Arts > School of Creative Arts and Technologies
Faculty of Computing & Engineering > School of Computing and Intelligent Systems
Research Institutes and Groups:Computer Science Research Institute
Computer Science Research Institute > Intelligent Systems Research Centre
ID Code:21220
Deposited By:Professor Paul McKevitt
Deposited On:06 Mar 2012 10:47
Last Modified:06 Mar 2012 10:47

Repository Staff Only: item control page