Application of Vision-Based Artificial Intelligence in Creating a Contactless Interaction with Immersive Environments

Document Type

Conference Proceeding

Publication Title

Computing in Civil Engineering 2021 - Selected Papers from the ASCE International Conference on Computing in Civil Engineering 2021

Publication Date

1-1-2021

Abstract

Virtual reality (VR) is one of the building information modeling (BIM) use cases that can benefit a project from the early stages of design to the construction and operation phases. VR enables designers, contractors, and owners to experience interacting with a facility before it is constructed. Currently, interaction with VR environments takes place through controllers. The equipment helps users to navigate virtual facilities and interact with the surrounding objects. Although controllers address the need for creating an interactive virtual environment, they make the experience less realistic, since real-life interactions take place through body movements, not by/through pressing buttons. This paper reports a project in which vision-based artificial intelligence (AI) technology is used to create a contactless connection between users and virtual environments. In this project, a series of body movements and gestures are mapped to the input commands of a BIM-based VR software. The paper overviews the state of the art in remote human-computer interaction (HCI) technologies and discusses both the potential and challenges of applying HCI technologies to immersive VR environments. It then introduces the architecture of the developed, contactless virtual environment and reports a case study of using this technology in an immersive setting.

First Page

1351

Last Page

1358

DOI

10.1061/9780784483893.165

ISBN

9780784483893

Link to Full Text

Share

 
COinS