Study on Controlling Emotion of a Multimedia Viewer Based on Interactive Evolutionary Computation and Physiological Analysis

基于交互式进化计算和生理分析的多媒体观看者情绪控制研究

基本信息

批准号：
17300073
负责人：
TAKAGI Hideyuki
金额：
$ 10.32万
依托单位：
Kyushu University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2005
资助国家：
日本
起止时间：
2005 至 2007
项目状态：
已结题

项目摘要

We conducted this research with three steps in 2005-2007 fiscal years.In the first step, “extracting possible movie features that may influence physiological responses, “we firstly cut 60 scenes of 20 seconds from several varieties of movies and extracted 78 physical movie features. Secondly, we constructed a 2-D psychological space, called an emotional space, consisting of(tension-relax)axis and(refreshing-gloomy)axis, and narrowed 30 from 78 possible movie features not using a physiological experiment but a psychological one.In the second step, “extracting relationship between movie features and physiological responses, “we firstly made abstract experimental movie scenes with 20 different variables of one feature that shown the highest correlation among 30 features. Since movie context, i.e. story, deeply influences to human emotion, we made the abstract movie scenes to avoid its effect. Secondly, we measured physiological data by displaying the abstract movies. Measured data are EEG at two side points and two back side, ECG, sweating rate, blood pressure level, and finger pulse volume. However, the difference of measured data among subjects was bigger than the difference of values of physical movie features, we have not found out the significant relationship between the movie features and physiological responses yet.In the third step," establishing driving emotion using extended interactive evolutionary computation(IEC),"we aimed to establish a technique to optimize movie features to drive a movie viewer's physiological condition to a given target condition. Since we have not found out the movie features that surely drive human physiology in the second step, we focused on improving IEC technique. What we did was combining IEC with evolutionary multi-objective optimization, introducing Particle Swarm Optimization instead of evolutionary computation, introducing IEC user's evaluation model, and others.

我们在2005-2007财年分三步进行了这项研究。第一步，“提取可能影响生理反应的电影特征”，我们首先从多种电影中剪辑出60个20秒的场景，提取了78个物理电影特征。其次，我们构建了一个二维心理空间，称为情感空间，由（紧张-放松）轴和（清爽-忧郁）轴组成，并从78种可能的范围中缩小了30种电影特征不是使用生理实验，而是心理实验。在第二步“提取电影特征与生理反应之间的关系”中，我们首先制作了抽象的实验电影场景，其中一个特征的 20 个不同变量显示出 30 个特征中相关性最高的特征由于电影的背景，即故事，对人的情感影响很大，我们制作了抽象的电影场景来避免其影响。其次，我们通过显示抽象电影来测量生理数据，测量的数据是两个侧面的脑电图和两个背面的心电图。 ,出汗然而，受试者之间测量数据的差异大于身体电影特征值的差异，我们尚未发现电影特征与生理反应之间的显着关系。在第三步“使用扩展交互式进化计算（IEC）建立驱动情感”中，我们的目标是建立一种优化电影特征的技术，以将电影观众的生理状况驱动到给定的目标条件。在第二步中，肯定会推动人类生理学的电影特征，我们重点关注我们所做的就是将IEC进化与多目标优化相结合，引入粒子群优化代替进化计算，引入IEC用户评估模型等。