3D object manipulation

3D 对象操作

• 批准号: 484408-2015
• 负责人: Li, ZeNian
• 金额: $ 1.82万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=584295
• 关键词: 3D; object; manipulation

LNG Productions, Inc. is interested in developing a method to identify objects within a 2D space (i.e., photographs, images) and to have the ability to manipulate them in a 3D realm. Manipulation will include moving the object around within the image, editing the object's physical characteristics and changing/swapping out the object for another. The challenge is that current photo editing software restricts the control of objects in a photograph to the 2D image plane. We are looking to create a solution that enables users to perform the full range of 3D manipulations, including scaling, rotation, and translation to an object in a photograph. Additionally, we are trying to develop a platform whereby users can interact and immerse themselves in a 3D architectural environment from a first person perspective. The users would have the ability to manipulate various materials, including but not limited to furniture, appliances, flooring, fixtures, etc. The software would be easily accessible via mobile/tablet devices (app) and over the Internet. The proposed project will involve three research topics: (i) Object detection and extraction aided by user interactions; (ii) 3D object manipulation; and (iii) Inpainting - to fill the holes left behind by moved objects. All three topics are active and important computer vision and computer graphics research problems. If the proposed research is successful, LNG Productions, Inc. will be one of the first companies to combine object recognition in a photo and manipulation of 3D assets that a user can select from to modify their captured spaces. Any Canadian manufacturer of raw materials, furniture, appliances, etc. could benefit from having their products digitally reproduced in 3D. An e-commerce platform or a platform for informational purposes could be developed so users could directly purchase or find out more information about the manufacturers' products.

LNG Productions, Inc. 有兴趣开发一种识别 2D 空间内物体的方法（即 照片、图像）并能够在 3D 领域中操纵它们。操纵将包括 在图像内移动对象、编辑对象的物理特征并更改/交换 为另一个对象取出对象。挑战在于当前的照片编辑软件限制了对对象的控制 二维图像平面上的照片。我们正在寻求创建一个解决方案，使用户能够执行完整的操作 一系列 3D 操作，包括缩放、旋转和平移到照片中的对象。 此外，我们正在尝试开发一个平台，让用户可以互动并沉浸在 3D 世界中 第一人称视角的建筑环境。用户将有能力操纵 各种材料，包括但不限于家具、电器、地板、固定装置等。该软件将 可通过移动/平板设备（应用程序）和互联网轻松访问。 拟议的项目将涉及三个研究主题：（i）用户辅助的对象检测和提取 互动； (ii) 3D 对象操纵； (iii) 修复 - 填补移动物体留下的孔洞。 这三个主题都是活跃且重要的计算机视觉和计算机图形学研究问题。 如果拟议的研究成功，LNG Productions, Inc.将成为首批合并的公司之一 照片中的对象识别以及 3D 资产的操作，用户可以从中选择以修改其捕获的内容 空间。任何加拿大原材料、家具、电器等制造商都可以从拥有 他们的产品以 3D 方式进行数字复制。电子商务平台或信息平台 可以开发以便用户可以直接购买或找到有关制造商的更多信息 产品。