CHS: Medium: Collaborative Research: Sculpting Visualizations: Toward a Practice and Theory of 3D Scientific Visualizations Using Physical Objects and Augmented Reality

CHS：媒介：协作研究：雕刻可视化：利用物理对象和增强现实实现 3D 科学可视化的实践和理论

基本信息

批准号：
1704604
负责人：
Daniel Keefe
金额：
$ 67.5万
依托单位：
University of Minnesota-Twin Cities
依托单位国家：
美国
项目类别：
Continuing Grant
财政年份：
2017
资助国家：
美国
起止时间：
2017-09-01 至 2022-08-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1704604&HistoricalAwards=false
关键词：
CHS Medium Collaborative Research Sculpting

项目摘要

Advances in 3D printing, augmented reality (AR), and virtual reality (VR), are creating new possibilities for computing tools that integrate with our physical environment and take advantage of our physical abilities. This proposal will study how these technologies can support 3D data visualization, an increasingly important and common scientific activity. The team, which includes computer scientists, artists, neuroscientists, geologists, and oceanologists, will first use 3D printing to develop physical representations of 3D data ("physical data forms") that match the needs of specific analysis domains and tasks, and through this develop principles for doing 3D design for visualizations in general. They will then design hybrid spaces that use AR visual representations along with physical data forms, looking at ways to leverage the strengths of each and developing ways to interact with the data through both the virtual and physical forms. Finally, they will create tools that leverage these design principles and interaction techniques to allow scientists to create new physical data forms and hybrid visualizations to address outstanding data analysis challenges in brain imaging, geology, and, ultimately, many scientific fields. The work will support interdisciplinary courses at the intersection of art, science, computing, and data visualization at the PIs' institutions; students will also be trained in research methods and work with the research team to develop public science museum exhibits that raise awareness of both the technology and the science involved. To leverage the possibilities of rapid, creative, artistic iteration and exploration of physical form, the team will develop interfaces and algorithms for capturing and extracting properties of physical forms, along with tools for exploring mappings between these properties and 3D data, a design theory and taxonomy, and a catalog for using physical inputs in visualization processes. These physical elements will be augmented with colocated digital head-tracked stereoscopic displays that directly incorporate the printed objects into the AR experience, along with touch-based interaction techniques such as touch-sensitive input surfaces or the direct inclusion of physical widgets in the printed objects. These visualizations will be evaluated through user studies based on existing methodologies for comparing 3D vector field visualization methods. The team will then develop exploratory visualization tools, using streamlined versions of the catalog and visualizations developed earlier to help manage the complexity of creating new visualizations while teaching visual design processes to scientists through the use of the tools, recasting the scientific task of data exploration as a creative process of visualization design to support learning, engagement, and effective analysis. These tools will be iteratively developed by teams of art and computer science students in conjunction with domain scientists and used to facilitate data exploration and discovery, as well as to bring science more directly into the public sphere through interactive experiences, such as at science museums.

3D 打印、增强现实 (AR) 和虚拟现实 (VR) 的进步正在为与我们的物理环境集成并利用我们的身体能力的计算工具创造新的可能性。该提案将研究这些技术如何支持 3D 数据可视化，这是一项日益重要和常见的科学活动。该团队包括计算机科学家、艺术家、神经科学家、地质学家和海洋学家，他们将首先使用 3D 打印来开发符合特定分析领域和任务需求的 3D 数据的物理表示（“物理数据形式”），并通过此技术制定一般可视化 3D 设计的原则。然后，他们将设计使用 AR 视觉表示和物理数据形式的混合空间，寻找利用各自优势的方法，并开发通过虚拟和物理形式与数据交互的方法。最后，他们将创建利用这些设计原则和交互技术的工具，使科学家能够创建新的物理数据形式和混合可视化，以解决脑成像、地质学以及最终许多科学领域中突出的数据分析挑战。这项工作将支持 PI 机构的艺术、科学、计算和数据可视化交叉领域的跨学科课程；学生还将接受研究方法方面的培训，并与研究团队合作开发公共科学博物馆展品，以提高人们对所涉及技术和科学的认识。为了利用快速、创造性、艺术性迭代和物理形式探索的可能性，该团队将开发用于捕获和提取物理形式属性的接口和算法，以及用于探索这些属性和 3D 数据之间映射的工具、设计理论和分类法，以及在可视化过程中使用物理输入的目录。这些物理元素将通过并置的数字头部跟踪立体显示器进行增强，这些显示器直接将打印对象融入到 AR 体验中，以及基于触摸的交互技术，例如触摸感应输入表面或直接将物理小部件包含在打印对象中。这些可视化将通过基于现有方法的用户研究来评估，以比较 3D 矢量场可视化方法。然后，该团队将开发探索性可视化工具，使用先前开发的目录和可视化的简化版本来帮助管理创建新可视化的复杂性，同时通过使用这些工具向科学家教授可视化设计过程，将数据探索的科学任务重新定义为支持学习、参与和有效分析的可视化设计的创造性过程。这些工具将由艺术和计算机科学专业的学生团队与领域科学家一起迭代开发，用于促进数据探索和发现，并通过互动体验（例如在科学博物馆）将科学更直接地带入公共领域。

项目成果

期刊论文数量（10）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

AFFECTIVE PALETTES FOR SCIENTIFIC VISUALIZATION: GROUNDING ENVIRONMENTAL DATA IN THE NATURAL WORLD

科学可视化的情感调色板：将环境数据扎根于自然世界

DOI：
10.1109/visap52981.2021.00009
发表时间：
2021-10
期刊：
2021 IEEE Vis
影响因子：
0
作者：
Samsel, Francesca: Zeller;Abram, Greg;Keefe, Daniel
通讯作者：
Keefe, Daniel

Multi-Touch Querying on Data Physicalizations in Immersive AR

沉浸式 AR 中数据物理化的多点触控查询

DOI：
10.1145/3488542
发表时间：
2021-11-03
期刊：
Proceedings of the ACM on Human-Computer Interaction
影响因子：
0
作者：
Bridger Herman;Maxwell Omdal;Stephanie Zeller;Clara A. Richter;F. Samsel;G. Abram;Daniel F. Keefe
通讯作者：
Daniel F. Keefe

Printmaking, Puzzles, and Studio Closets: Using Artistic Metaphors to Reimagine the User Interface for Designing Immersive Visualizations

版画、拼图和工作室壁橱：使用艺术隐喻重新构想用于设计沉浸式可视化的用户界面

DOI：
10.1109/visap51628.2020.00009
发表时间：
2020-10-01
期刊：
2020 IEEE VIS Arts Program (VISAP)
影响因子：
0
作者：
Bridger Herman;F. Samsel;Annie Bares;Seth Johnson;G. Abram;Daniel F. Keefe
通讯作者：
Daniel F. Keefe

The State of the Art of Spatial Interfaces for 3D Visualization

3D 可视化空间接口的最新技术

DOI：
10.1111/cgf.14189
发表时间：
2021-01-06
期刊：
Computer Graphics Forum
影响因子：
2.5
作者：
Lonni Besançon;A. Ynnerman;Daniel F. Keefe;Lingyun Yu;Tobias Isenberg
通讯作者：
Tobias Isenberg

Antarctic Water Masses and Ice Shelves: Visualizing the Physics

南极水团和冰架：物理可视化

DOI：
10.1109/mcg.2020.3044228
发表时间：
2021-01
期刊：
IEEE Computer Graphics and Applications
影响因子：
1.8
作者：
Abram, Greg;Samsel, Francesca;Petersen, Mark R.;Asay;Comeau, Darin;Price, Stephen F.;Potel, Mike
通讯作者：
Potel, Mike