Mobile Mid-Air Interactive Systems and Design Workflows for Creative 3D Shape Modeling

用于创意 3D 形状建模的移动空中交互系统和设计工作流程

• 批准号: 1538868
• 负责人: Karthik Ramani
• 金额: $ 20万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2017-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1538868&HistoricalAwards=false
• 关键词: Mobile; Mid; Air; Interactive; Systems

Currently 3D modeling tools for product design and manufacturing are the purview of trained engineers and professional artists. Everyone has ideas but only a select few can bring them to reality. Although touch enabled devices such as tablets and smartphones are ubiquitous, the direct manipulation of content is inherently two-dimensional, and the plethora of tools commonly used today grew out of design metaphors based on windows, icons, menus, and pointers. They require extensive training, and inhibit the user's ability to create, manipulate, and modify virtual shapes in a straightforward manner. Research on mid-air interactions has shown that our bodies and their perceptually guided motions through the world do much of the work required to achieve our creative goals. This perceptual process, if carefully integrated into 3D modeling, can be instrumental in eliminating the barrier-to-entry for common users motivated to externalize their creative ideas. This work aims at harnessing the potential of mobile interactions in mid-air to cater to the creative processes involved in design. In doing so, it takes an important step towards the computer-as-a-partner paradigm that transfers our cognition to the virtual environment through hand-held mobile devices.The integration of a variety of sensors into smartphones provides new affordances for designing interactive processes towards creative on-the-fly shape modeling processes. However, existing research on mobile interactions has focused on 3D object manipulation, virtual scene navigation, and scientific visualization. The work will develop a framework for direct 3D shape conceptualization using mobile interactions. To do so, this work will leverage the unique advantage of using smartphones as an extension to our mind and body, to spatially create 2D and 3D sketches, and create, manipulate and modify virtual 3D objects. The ensuing simplicity of spatial interactions for easy, direct shape-modeling operations will transform our bodily motions and rotations of the phone and contextual sketches on the devices to desired configurations and geometries. By combining multi-touch interactions and device sensors, the work aims to leverage embodied cognition towards spatial interaction and develop new metaphors for spatial control, and develop processes for shape modeling to explore a new design space of intuitive interactions. This will be achieved by developing process flows for constrained and free-form 3D shapes, spatial configuration of 3D objects, and creative 3D compositions with shapes. These development cycles will be driven by rigorous user evaluations and iterations to derive the guidelines for design process flow and user experiences.

目前，用于产品设计和制造的 3D 建模工具属于经过培训的工程师和专业艺术家的权限。每个人都有想法，但只有少数人能够将其变为现实。尽管平板电脑和智能手机等支持触摸的设备无处不在，但内容的直接操作本质上是二维的，并且当今常用的大量工具都源于基于窗口、图标、菜单和指针的设计隐喻。它们需要大量的培训，并且限制了用户以简单的方式创建、操作和修改虚拟形状的能力。对空中互动的研究表明，我们的身体及其在世界各地的感知引导运动完成了实现我们的创造性目标所需的大部分工作。如果将这种感知过程仔细地集成到 3D 建模中，则可以有助于消除那些有动力将其创意想法具体化的普通用户的进入障碍。 这项工作旨在利用空中移动交互的潜力来满足设计中涉及的创意过程。这样做，向计算机作为合作伙伴范式迈出了重要一步，通过手持移动设备将我们的认知转移到虚拟环境中。将各种传感器集成到智能手机中为设计交互流程提供了新的可供性走向创造性的动态形状建模过程。然而，现有的移动交互研究主要集中在 3D 对象操作、虚拟场景导航和科学可视化上。这项工作将开发一个使用移动交互进行直接 3D 形状概念化的框架。为此，这项工作将利用智能手机作为我们思想和身体的延伸的独特优势，在空间上创建 2D 和 3D 草图，并创建、操作和修改虚拟 3D 对象。随之而来的空间交互的简单性，可实现简单、直接的形状建模操作，将把我们的身体运动和手机旋转以及设备上的上下文草图转变为所需的配置和几何形状。通过结合多点触控交互和设备传感器，该工作旨在利用具身认知进行空间交互，开发空间控制的新隐喻，并开发形状建模流程，以探索直观交互的新设计空间。这将通过开发受约束和自由形式的 3D 形状、3D 对象的空间配置以及形状的创意 3D 合成的流程来实现。这些开发周期将由严格的用户评估和迭代驱动，以获得设计流程和用户体验的指南。

项目成果

RealFusion: An Interactive Workflow for Repurposing Real-World Objects towards Early-stage Creative Ideation

• DOI: 10.20380/gi2016.11
• 发表时间: 2016-06
• 作者: Cecil Piya;Vinayak Vinayak-Vinayak;Yunbo Zhang;K. Ramani

MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane

MobiSweep：使用智能手机作为手持参考平面探索空间设计理念

• DOI: 10.1145/2839462.2839490
• 发表时间: 2016
• 期刊: and Embodied Interaction
• 作者: Vinayak, Devarajan Ramanujan

Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World

• DOI: 10.1145/3024969.3024995
• 发表时间: 2017-01-01
• 期刊: PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON TANGIBLE, EMBEDDED, AND EMBODIED INTERACTION (TEI'17)
• 作者: Huo, Ke;Vinayak;Ramani, Karthik
• 通讯作者: Ramani, Karthik