Integrating Conversational AI and Augmented Reality with BIM for faster and collaborative on-site Construction Assemblage (Conversational-BIM)

将对话式 AI 和增强现实与 BIM 相集成，以实现更快、协作的现场施工装配（对话式 BIM）

基本信息

批准号：
EP/S031480/1
负责人：
Lukumon Oyedele
金额：
$ 155.39万
依托单位：
University of the West of England
依托单位国家：
英国
项目类别：
Research Grant
财政年份：
2019
资助国家：
英国
起止时间：
2019 至无数据
项目状态：
已结题

来源：
https://gtr.ukri.org/projects?ref=EP%2FS031480%2F1
关键词：
Integrating Conversational AI Augmented Reality

项目摘要

The traditional approach to construction is notorious for poor productivity and inadequate contribution to economic development (ONS, 2017). With the aim of boosting productivity, the construction sector must transform its methods of construction and adopt effective digital technologies (TIP, 2017). The adoption of BIM has transformed the way buildings are designed and enhanced the implementation of building manufacturing technologies such as Design for Manufacturing and Assembly (DFMA). However, the adoption of BIM by onsite frontline workers for assembly of manufactured building components is non-existent. This results in loss of the productivity gain from using BIM for design and manufacturing phases of the process (BCI, 2016). Onsite frontline workers spend more time interfacing with BIM tools than they spend on completing the actual assembly tasks. Current BIM interfaces are not practicable for onsite operations because they are too slow, hazardous and distracting for onsite frontline workers (Construction News, 2017). On this basis, the research will introduce advanced Natural Language Processing (NLP) and Conversational Artificial-Intelligence for enabling onsite frontline workers to verbally communicate with BIM systems. Assembly operations are complex and are often complicated by the uniqueness of each project, the inconsistency of assembly methods, and the diversity and alterations of project team. During onsite assembly operations, onsite frontline workers are required to quickly understand the procedure of installing building components to minimise assembly errors and reduce the overall project duration. The time spent by frontline workers can be reduced by 50% with the introduction of hands-free assembly support BIM system that utilises verbal communication. In addition to boosting productivity, it will further enhance error-free assembly operation through step-by-by assembly guide for pre-manufactured/pre-assembled building components.The development of technologies to aid easy adoption of BIM for onsite assembly has great potential to revolutionise the current approach to construction. However, apart from the slow pace and hazardous nature of current BIM interfaces, other limitations include visual obstruction, distraction and the associated health and safety challenge for frontline workers. This project aims to utilise Augmented Reality (AR) for providing visual support to access BIM systems and installation guides without obstructing or distracting the view of onsite workers. This will provide accurate and just-in-time information for online frontline workers to gradually follow the installation guide of manufactured building components. For example, an onsite assembly worker can merely ask, "hey Conversational-BIM, guide me through toilet installation" and the system will facilitate the assembly procedures through AR-assisted verbal instructions, the AR device will overlay the exact illustration of the assembly steps on the actual components onsite. It is important to note that onsite coordination between resources is vital for boosting productivity and guaranteeing faster and safer assembly (ICE, 2018). This project will therefore exploit advanced AI, computer visions, and AR technologies to develop an end-to-end BIM solution to support onsite assembly operations. In addition to boosting the productivity of frontline assembly workers, this project seeks to eliminate the tedious process of coordinating onsite activities which often involve multiple workers and machinery. Accordingly, the AR-assisted Conversational-BIM system will ensure a coordinated approach for remote experts to guide frontline workers and monitor project progress and productivity.

传统的建设方法臭名昭著，因为生产力差和对经济发展的贡献不足（ONS，2017年）。为了提高生产率，建筑部门必须改变其建设方法并采用有效的数字技术（Tip，2017）。 BIM的采用改变了建筑物的设计方式，并增强了建筑制造技术的实施，例如制造和组装设计（DFMA）。但是，不存在现场前线工人的BIM来组装制造的建筑组件。这会导致生产率损失，从而将BIM用于该过程的设计和制造阶段（BCI，2016年）。现场前线工人花费的时间更多的时间与BIM工具相比，他们花在完成实际的组装任务上。目前的BIM界面对于现场操作而言是不可行的，因为它们太慢，有害和分散了现场前线工人的注意力（Construction News，2017年）。在此基础上，该研究将引入先进的自然语言处理（NLP）和对话人工智能，以使现场前线工人能够与BIM系统进行口头交流。组装操作很复杂，每个项目的唯一性，组装方法的不一致以及项目团队的多样性和变化通常会变得复杂。在现场组装操作中，需要现场前线工人快速了解安装建筑组件以最大程度地减少组件错误并减少整个项目持续时间的过程。通过引入使用语言交流的免费组装支持BIM系统，一线工人花费的时间可以减少50％。除了提高生产率外，它还将通过预先制造/预组装建筑组件的逐步组装指南进一步增强无错误的组装操作。技术的开发以帮助轻松采用BIM进行OnSite组装，具有巨大的潜力，可以彻底改变当前的建筑方法。但是，除了当前BIM界面的缓慢和危险性质外，其他局限性还包括视觉阻塞，分心以及前线工人相关的健康和安全挑战。该项目旨在利用增强现实（AR）提供视觉支持，以访问BIM系统和安装指南，而不会阻碍或分散现场工人的视野。这将为在线前线工人提供准确且恰当的信息，以逐步遵循制造建筑组件的安装指南。例如，现场装配工人只能问：“嘿，对话式，指导我穿过厕所安装”，系统将通过AR辅助口头说明来促进装配程序，AR设备将覆盖实际组件上实际组件上的组装步骤的确切说明。重要的是要注意，资源之间的现场协调对于提高生产率和确保更快，更安全的组装至关重要（ICE，2018年）。因此，该项目将利用先进的AI，计算机视觉和AR技术来开发端到端BIM解决方案，以支持现场装配操作。除了提高前线组装工人的生产率外，该项目还旨在消除协调现场活动的繁琐过程，这些过程通常涉及多个工人和机械。因此，AR辅助对话BIM系统将确保远程专家指导前线工人并监视项目进度和生产力的协调方法。