Creation and Evaluation of Novel Media Experiences

新颖媒体体验的创造和评估

• 批准号: RGPIN-2015-04971
• 负责人: Fels, Sidney
• 金额: $ 3.64万
• 依托单位: University of British Columbia
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=650582
• 关键词: Creation; Evaluation; Novel; Media; Experiences

This proposal has two threads investigating novel means of leveraging human perceptive and cognitive abilities to create and evaluate next generation media experiences. Two media experiences will be investigated: a novel 3D display and interactive video in an educational context. ***For the first thread, I plan to advance the state of the art of 3D perspective-corrected spherical (3DPS) displays. Touch and gesture input, high-resolution, and multi-person functionality will be added to a spherical, 3D display targeting two aspects of behaviour in 3D: interaction and collaboration. Having high-resolution using multiple projectors with low-latency feedback and fast refresh rate, enables the sensation of an object being physically in the sphere. With this phenomenon, along with gesture and touch interaction on and around the spherical display, the potential for high-fidelity, collaborative 3D interaction can be explored. Leveraging off existing work on interaction with volumetric, cylindrical and cubic displays, new interaction semantics for pointing, selecting, translating, rotating, and sculpting content will be explored. As the display supports multiplexed video, novel co-located and remote collaborative, 3D interaction semantics will be created and evaluated.****The second thread advances the state of interactive video (IV) authoring, navigation and sharing in educational environments. The main insight pursued matches interface design for spatio-temporal video content with peoples' cognitive and affective mechanisms, as and applies it to educational video contexts. Current video players target mostly linear viewing of relatively long video content leading to poor mechanisms for organizing partially viewed video or salient content. However, with online video content becoming ubiquitous and shorter, consumption has become more non-linear and the amount of video viewing has increased by at least an order of magnitude. Finding particular videos, or salient content within videos are significant challenges, especially as existing mechanisms tend to be geared towards semantic memory rather than episodic. Furthermore, user generated content suffers from a model that separates authoring from viewing and sharing, impeding video content creation by non-experts, such as educators and learners. Exploring additional mechanisms, such as affective, temporal and spatial cueing will address this challenge. **

该提案有两个线程，调查了利用人类敏锐和认知能力来创建和评估下一代媒体体验的新颖手段。将研究两种媒体体验：在教育背景下的一个新颖的3D展示和互动视频。 ***对于第一个线程，我计划推进3D透视校正的球形（3DPS）显示的艺术状态。触摸和手势输入，高分辨率和多人功能将添加到针对3D行为的两个方面的球形3D显示中：相互作用和协作。使用具有低延迟反馈和快速刷新速率的多个投影仪具有高分辨率的高分辨率，可以使物体在球体中物理上具有感觉。有了这种现象，可以探讨球形显示和周围周围的手势和触摸相互作用，因此可以探索高保真性的潜力，可以探索协作3D相互作用。将探索与体积，圆柱和立方显示的相互作用的现有工作，将探索用于指向，选择，翻译，旋转和雕刻内容的新互动语义。当显示器支持多路复用视频时，将创建和评估3D交互语义的新型共同和远程协作。主要的见解追求与人民的认知和情感机制的时空视频内容的界面设计，并将其应用于教育视频环境。当前的视频播放器主要针对相对较长的视频内容的线性观看，导致组织部分观看的视频或显着内容的机制差。但是，随着在线视频内容变得无处不在且较短，消费变得更加非线性，视频观看量至少增加了数量级。在视频中查找特定的视频或显着内容是重大挑战，尤其是因为现有机制倾向于使用语义记忆而不是情节性。 此外，用户生成的内容遭受了一个模型，该模型将创作与观看和共享，妨碍非专家（例如教育者和学习者）的视频内容创建。探索其他机制，例如情感，时间和空间提示将解决这一挑战。 **