Sonic Phonic - Towards a Generative Alphabet

Sonic Phonic - 迈向生成字母表

• 批准号: AH/E50258X/1
• 负责人: Mel Woods
• 金额: $ 1.77万
• 依托单位: University of Dundee
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2006
• 资助国家: 英国
• 起止时间: 2006 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=AH%2FE50258X%2F1
• 关键词: Sonic; Phonic; Towards; Generative; Alphabet

The concept of an association between sound and image can be traced back to Greek philosophers Pythagoras and Aristotle who speculated on the correlation between musical scale and the rainbow spectrum. From traditional art studio practise (drawing, painting, montage) to the beginnings of media art, the concept of image, sound and text relationships have been explored by artists and writers. Periods of technological change such as advances in audio-visual media technology at the turn of the 19th Centuryand digital revolution of the 21st Century have influenced advances in concepts such as in avant-garde film and music in the 1920's, video art and new music in the 1960's and currently digital media art, digital narrative, artificial intelligence and computational processing. The rapid development and spread of new technologies has effected change in many spheres of human experience, computers have created and are transforming culture, motivating simultaneous widespread innovation in artistic and scientific research. The convergence of interactive technologies and digital environment has created expanded capacities and possibilities for the presentation of language, text and sound media. It has enabled a new relationship between the viewer and the interface, between the senses and the different modes of visual, aural and tactile perception. Recent research by Neuroscientist Antonio Damasio concerning the brain's preconscious engagement with images and perceptual cognition in relation to meaning has informed developments in the area of the perception of image, text and sound, which has the potential to lead towards a shift in our perceptual environment and possibility our cognitive evolution.This research arises from converging interests in my practice as an artist relating to artworks exploring concepts of language, communication and visual perception and issues relating to the juxtaposition of media such as photography, digital imaging, printmaking and video in installation and multimedia design. Currently I have a particular interest in evolutionary computational processes that allow juxtaposition and layering of such concepts and objects within a system. It is these computationally blended conceptual and visual spaces that has influenced the concept of a cross fertilization of alphabetic media and the possibility of emergent audio/visual ideas for new constructs in the alphabet. The research questions have arisen through personal experience of children's' engagement with correlations made between images and reality, symbols and sound. The Alphabet, with its historical association with pictograms and ideograms and subsequent evolution to the indexing of letter symbol (Grapheme)-phonic sound (Phoneme) relationships, provides a context for digital and interactive media to re-frame the symbol-sound relationship by expanding the possibilities for the synesthetic juxtaposition of image, sound and text as well as moving image, animation and drawing.Aims and ObjectivesThe aim of the research is the creation of an interactive alphabetic prototype to consider the development and emergent characteristics and properties of digital (image, sound and text) relationships, using the architecture of a generative database at the heart of the installation.The objective of the interactive alphabet prototype is to facilitate, through the installation of the prototype artwork, the interaction of invited participants with the evolving generative alphabetic space and gather data from these experimental interactions to evaluate the behaviours of participant and database.Potential Applications and BenefitsThe Research will contribute to existing knowledge ofConcepts in image, text and sound correlationThe potential for technological change to influence the cognition and communication of cultureExplorations of the alphabet by artists and writersArtworks using new interactive interfaces, databases and computational processing.Benefits might include an intermedia approach to constructs of digital alphabets where future potential for image sound and text as a generative system may lead to new meaning and relationships in alphabets and narrative.Practical applications for long-term research include online adaptive human-machine alphabetic databases for digital writing and narrative, education, language applications, entertainment, and contributions to the development of understanding in e-learning environments. With that potential, it is likely that future research will develop the prototype for online publication where adaptations may include the ability for uploading of new content including imagery, video, sound and text based media. New constructs could be developed through an online evolving collaborative alphabet or alternatively creation of individual bespoke alphabets/language for a range of applications such as for dysphasic stroke patients, where there is potential for research to examine the use of personal imagery, sounds and artefacts in conjunction with the database to trigger the re-learning of language. Through my background research process I have had discussions with psychologists who are interested in developing the potential of sonic phonic for this purpose. Other possibilities for further research lie in the relevance of kinesthetic haptic interface to the development of the generative database and digital content.

声音和图像之间关联的概念可以追溯到希腊哲学家毕达哥拉斯和亚里士多德，他们推测了音乐规模与彩虹谱之间的相关性。从传统的艺术工作室实践（绘画，绘画，蒙太奇）到媒体艺术的开端，艺术家和作家已经探索了形象，声音和文字关系的概念。技术变革的时期，例如在19世纪初期和21世纪的数字革命之交的音频视频媒体技术的进步时影响了概念的进步，例如1920年代前卫电影和音乐，视频艺术和新音乐， 1960年代且目前数字媒体艺术，数字叙事，人工智能和计算处理。新技术的快速发展和传播已经影响了许多人类经验领域的变化，计算机已经创造并正在改变文化，并激发了艺术和科学研究的同时广泛创新。交互式技术和数字环境的融合创造了扩大的能力和语言，文本和声音媒体的可能性。它已经使观众与界面，感官与视觉，听觉和触觉感知的不同模式之间建立了新的关系。神经科学家安东尼奥·达马西奥（Antonio Damasio）的最新研究涉及大脑对图像和感知认知与意义有关的意识的互动，这在图像，文本和声音的感知方面有知情的发展，这有可能导致我们的感知环境和我们的感知环境以及转变我们的认知进化的可能性。这项研究是由我作为艺术家的实践融合的兴趣引起的多媒体设计。目前，我对进化计算过程特别感兴趣，这些计算过程允许系统中的此类概念和对象并置和分层。正是这些计算融合的概念和视觉空间影响了字母介质的交叉施肥的概念，以及在字母内对新结构的新兴音频/视觉思想的可能性。研究问题是通过个人经历与图像与现实，符号和声音之间建立的相关性的个人经验而产生的。该字母与象形图和意识形态图的历史关联以及随后的转化为字母符号（grupheme） - phonic声音（音素）关系的索引，为数字和交互式媒体提供了一个上下文，以通过扩展来重新构架符号 - 符号。图像，声音和文本的综合置并置的可能性以及运动图像，动画和绘画的可能性。 ，声音和文本）关系，使用安装核心的生成数据库的体系结构。交互式字母原型的目的是通过安装原型艺术品的安装来促进受邀参与者与不断发展的生成字母的相互作用空间并从这些实验互动中收集数据以评估参与者和数据库的行为。潜力应用和受益研究将有助于图像，文本和声音相关的现有知识，从而影响技术变革的潜力，以影响Alphabet文化的认知和交流由艺术家和作品进行了使用新的交互式接口，数据库和计算处理的作品。Beenfits可能包括一种中间媒体方法，用于数字字母的构造，其中图像声音和文本作为生成系统的未来潜力可能会导致新的含义，并在字母和叙事中带来新的含义和关系。长期研究的应用包括在线自适应人机字母数据库，用于数字写作和叙事，教育，语言应用，娱乐以及对电子学习环境中理解发展的贡献。有了这一潜力，未来的研究可能会开发用于在线出版物的原型，在线适应可能包括上传新内容的能力，包括图像，视频，声音和基于文本的媒体。可以通过在线不断发展的协作字母或为一系列应用程序（例如不适性中风患者）创建单个定制字母/语言的新结构，或者有可能研究使用个人图像，声音和人工企业的使用潜力与数据库的结合以触发语言重新学习。通过我的背景研究过程，我与有兴趣为此目的发展Sonic Phonic潜力的心理学家进行了讨论。进一步研究的其他可能性在于动力学触觉界面与生成数据库和数字内容的开发的相关性。