Mobile Mid-Air Interactive Systems and Design Workflows for Creative 3D Shape Modeling

用于创意 3D 形状建模的移动空中交互系统和设计工作流程

• 批准号: 1538868
• 负责人: Karthik Ramani
• 金额: $ 20万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2017-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1538868&HistoricalAwards=false
• 关键词: Mobile; Mid; Air; Interactive; Systems

Currently 3D modeling tools for product design and manufacturing are the purview of trained engineers and professional artists. Everyone has ideas but only a select few can bring them to reality. Although touch enabled devices such as tablets and smartphones are ubiquitous, the direct manipulation of content is inherently two-dimensional, and the plethora of tools commonly used today grew out of design metaphors based on windows, icons, menus, and pointers. They require extensive training, and inhibit the user's ability to create, manipulate, and modify virtual shapes in a straightforward manner. Research on mid-air interactions has shown that our bodies and their perceptually guided motions through the world do much of the work required to achieve our creative goals. This perceptual process, if carefully integrated into 3D modeling, can be instrumental in eliminating the barrier-to-entry for common users motivated to externalize their creative ideas. This work aims at harnessing the potential of mobile interactions in mid-air to cater to the creative processes involved in design. In doing so, it takes an important step towards the computer-as-a-partner paradigm that transfers our cognition to the virtual environment through hand-held mobile devices.The integration of a variety of sensors into smartphones provides new affordances for designing interactive processes towards creative on-the-fly shape modeling processes. However, existing research on mobile interactions has focused on 3D object manipulation, virtual scene navigation, and scientific visualization. The work will develop a framework for direct 3D shape conceptualization using mobile interactions. To do so, this work will leverage the unique advantage of using smartphones as an extension to our mind and body, to spatially create 2D and 3D sketches, and create, manipulate and modify virtual 3D objects. The ensuing simplicity of spatial interactions for easy, direct shape-modeling operations will transform our bodily motions and rotations of the phone and contextual sketches on the devices to desired configurations and geometries. By combining multi-touch interactions and device sensors, the work aims to leverage embodied cognition towards spatial interaction and develop new metaphors for spatial control, and develop processes for shape modeling to explore a new design space of intuitive interactions. This will be achieved by developing process flows for constrained and free-form 3D shapes, spatial configuration of 3D objects, and creative 3D compositions with shapes. These development cycles will be driven by rigorous user evaluations and iterations to derive the guidelines for design process flow and user experiences.

目前，用于产品设计和制造的3D建模工具是训练有素的工程师和专业艺术家的权限。每个人都有想法，但是只有少数人可以将它们带入现实。尽管启用触摸的设备（例如平板电脑和智能手机）无处不在，但直接操纵内容是固有的二维设备，而当今常用的大量工具是根据基于窗户，图标，菜单和指针的设计隐喻而增长的。他们需要广泛的培训，并抑制用户以直接方式创建，操纵和修改虚拟形状的能力。关于中间互动的研究表明，我们的身体及其在世界范围内的感知指导动作做出了实现我们创造性目标所需的许多工作。如果仔细地集成到3D建模中，这种感知过程可能会为消除进入其创意外部想法的普通用户的障碍。 这项工作旨在利用在空中中间的移动互动的潜力，以迎合设计所涉及的创作过程。这样一来，它迈出了重要的一步，它通过手持移动设备将认知转移到虚拟环境的计算机范式上。将各种传感器集成到智能手机中，为设计互动过程提供了新的负担，以设计互动流程，以朝着创造性的形状建模过程中进行创造性。但是，现有关于移动互动的研究集中在3D对象操纵，虚拟场景导航和科学可视化上。这项工作将开发一个使用移动交互的直接3D形状概念化的框架。为此，这项工作将利用使用智能手机作为我们思维和身体扩展的独特优势，在空间上创建2D和3D草图，并创建，操纵和修改虚拟3D对象。随之而来的空间互动的简单性，用于简单，直接的形状模型操作将改变我们的身体运动和手机的旋转，以及设备上的上下文草图，以使其成为所需的配置和几何形状。通过结合多点触摸交互和设备传感器，该作品旨在利用具体的认知来实现空间互动，并为空间控制开发新的隐喻，并开发用于形状建模的过程，以探索直观相互作用的新设计空间。这将通过为约束和自由形式的3D形状，3D对象的空间配置以及具有形状的创意3D组成来开发过程流来实现。这些开发周期将由严格的用户评估和迭代来驱动，以得出设计过程流和用户体验的准则。

项目成果

RealFusion: An Interactive Workflow for Repurposing Real-World Objects towards Early-stage Creative Ideation

• DOI: 10.20380/gi2016.11
• 发表时间: 2016-06
• 作者: Cecil Piya;Vinayak Vinayak-Vinayak;Yunbo Zhang;K. Ramani

MobiSweep: Exploring Spatial Design Ideation Using a Smartphone as a Hand-held Reference Plane

MobiSweep：使用智能手机作为手持参考平面探索空间设计理念

• DOI: 10.1145/2839462.2839490
• 发表时间: 2016
• 期刊: and Embodied Interaction
• 作者: Vinayak, Devarajan Ramanujan

Window-Shaping: 3D Design Ideation by Creating on, Borrowing from, and Looking at the Physical World

• DOI: 10.1145/3024969.3024995
• 发表时间: 2017-01-01
• 期刊: PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON TANGIBLE, EMBEDDED, AND EMBODIED INTERACTION (TEI'17)
• 作者: Huo, Ke;Vinayak;Ramani, Karthik
• 通讯作者: Ramani, Karthik