EAGER: Minimal 3D Modeling Methodology

EAGER：最小 3D 建模方法

基本信息

批准号：
2032770
负责人：
Daniel Aliaga
金额：
$ 6.5万
依托单位：
Purdue University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2020
资助国家：
美国
起止时间：
2020-07-01 至 2022-06-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2032770&HistoricalAwards=false
关键词：
EAGER Minimal 3D Modeling Methodology

项目摘要

Modeling and design are core components of computer graphics and computer vision research and applications. Traditional modeling consists of having the designer provide either a detailed (digital) specification of the desired virtual object or sufficient photographs of a physical object to enable a multi-view stereo reconstruction, although modern GUI-based tools can help reduce to a certain extent the number of photographs required. Digital sketching tools provide an alternative mechanism for modeling objects, but even though some of these try to assist the user by completing partial sketches a notable effort is still required to achieve detailed results. This project will explore a modeling methodology that addresses the following question: What is the least we can design and still obtain a sufficiently expressive system? At one extreme digital modeling tools support high expressivity but require high design effort, while at the other extreme providing a fixed set of model templates incurs very low design effort but results in low model expressivity as well. Some recent efforts, such as the PI's sketch-to-procedural-modeling work, fall somewhere in the middle. The goal of the current research is to determine the point of optimum balance between design and expressivity, that is just enough design effort to produce a sufficiently expressive model. The focus of this multi-disciplinary work will be on computational archaeology, an interesting application where only fragmented information is available, hence success of the approach in this domain will imply broad generalizability of project outcomes to other areas as well.It has been established in the literature that only a fraction of what we perceive suffices for a person to create a mental 3D representation of an object. With this observation in mind, the project will build upon and extend the PI's existing photograph-to-3D modeling tool by adding new minimalist machine learning underpinnings applied to urban and archaeological modeling and design, to build software that requests just enough input from the user and is able to produce 3D models of sufficient completeness for the intended goal. Various ways of degrading the input detail and analyzing how the model output is affected will be explored to identify the most promising for retention and improvement of robustness. About a terabyte of imagery and point cloud data from two archaeological sites of ancient settlements on the islands of Dana and Bogsak along the southern coast of Turkey will serve as a testbed. These islands have structures built using material from local stone quarries and are a main type of urban landscape to survive from antiquity but are difficult to study due to size, complexity, terrain, and incompleteness. Nonetheless, aerial drone-based imagery and LIDAR are possible. The research will investigate how much must be specified during design to differentiate among the possible forms and their parameters to express a desired output.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

建模和设计是计算机图形和计算机视觉研究和应用程序的核心组成部分。传统的建模包括让设计师提供所需虚拟对象的详细（数字）规范，或者是物理对象的足够照片以实现多视图立体声重建，尽管现代GUI的工具可以在一定程度上减少所需的照片数量。数字素描工具提供了建模对象的替代机制，但是即使其中一些试图通过完成部分草图来帮助用户，仍然需要明显的努力来获得详细的结果。该项目将探讨一种解决以下问题的建模方法：我们至少可以设计并仍然获得足够表达的系统？在一个极端的数字建模工具上，工具支持高表现力，但需要高度的设计工作，而在另一个极端则提供了固定的模型模板的设计工作非常低，但也导致模型表达较低。最近的一些努力，例如PI的素描到杂质的模型工作，落在中间的某个地方。当前研究的目的是确定设计和表现力之间的最佳平衡点，这是足够的设计工作来产生足够表达的模型。这项多学科工作的重点将放在计算考古学上，这是一个有趣的应用程序，在该应用程序中，只有零散的信息可用，因此该方法在该领域的成功将意味着项目成果对其他领域的广泛概括性也是如此。它在文献中已经建立了我们只有我们对一个人创建精神3D代表的人的足够的一小部分。考虑到这一观察，该项目将通过添加适用于城市和考古建模和设计的新的简约机器学习的基础来建立并扩展PI现有的照片对3D建模工具，以构建用户的要求足够的软件，并能够为预期的预期范围提供足够的完整范围。将探索各种降解输入细节并分析如何影响模型输出的方式，以确定保留和改善鲁棒性的最有希望的。关于来自Dana和Bogsak岛上的古代定居点的两个考古遗址的图像和点云数据的Terabyte将用作测试床。这些岛屿具有使用当地石材采石场的材料建造的结构，是一种主要的城市景观类型，可以从上古生存，但由于大小，复杂性，地形和不完整而难以研究。尽管如此，基于空中无人机的图像和激光雷达还是可能的。该研究将调查在设计过程中必须指定多少规定，以区分可能的形式及其参数，以表达所需的输出。该奖项反映了NSF的法定任务，并且使用基金会的知识分子优点和更广泛的影响审查标准，被认为值得通过评估来获得支持。