Dataset Information

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System.

ABSTRACT: Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge to provide references without relying on restrictive static empty surfaces of the same object or nearby objects for projection. Towards this end, we propose a novel approach that contextualizes projected references in real-time and on demand, onto and through the surface across a wireless network. To demonstrate the effectiveness of the approach, we apply the method to the safe inspection of printed circuit board assembly (PCBA) wirelessly networked to a remote automatic optical inspection (AOI) system. A defect detected and localized by the AOI system is wirelessly remitted to the proposed remote inspection system for prompt guidance to the inspector by augmenting a rectangular bracket and a reference image. The rectangular bracket transmitted through the switchable glass aids defect localization over the PCBA, whereas the image is projected over the opaque cells of the switchable glass to provide reference to a user. The developed system is evaluated in a user study for its robustness, precision and performance. Results indicate that the resulting contextualization from variability in occlusion levels not only positively affect inspection performance but also supersedes the state of the art in user preference. Furthermore, it supports a variety of complex visualization needs including varied sizes, contrast, online or offline tracking, with a simple robust integration requiring no additional calibration for registration.

SUBMITTER: Runji JM

PROVIDER: S-EPMC7435772 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System.

Runji Joel Murithi JM Lin Chyi-Yeu CY

Sensors (Basel, Switzerland) 20200731 15

Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge ...[more]

PMID: 32752016

Similar Datasets

Project description:While emerging technology for self-driving automation in vehicles progresses rapidly, the transition to an era of roads full of fully connected and automated vehicles (CAVs) may take longer than expected. Until then, it is inevitable that CAVs should coexist and interact with drivers of non-autonomous vehicles (NAVs) in urban roads. During this period of transition, it is critical to provide road safety with the mixed vehicular traffic and uncertainty caused by human drivers. To investigate the issues caused by the coexistence and interaction with humans, we propose to build a component-based and interactive intelligent transportation cyber-physical systems (ITCPS) framework. Our design of the interactive ITCPS framework aims to provide a standardized structure for users by defining core components. The framework is specified by behavior models and interfaces for the desired ITCPS components and is implemented as a form of human and hardware-in-the-loop system. We developed an intersection crossing assistance service and an automatic emergency braking service as an example of practical applications using the framework. To evaluate the framework, we tested its performance to show how effectively it operates while supporting real-time processing. The results indicate that it satisfies the timing requirements of vehicle-to-vehicle (V2V) communication and the limited processing time required for performing the functions of behavior models, even though the traffic volume reaches the road capacity. A case study using statistical analysis is conducted to assess the practical value of the developed experimental environment. The results of the case study validate the reliability among the specified variables for the experiments involving human drivers. It has shown that V2V communication support has positive effects on road safety, including intersection safety, braking events, and perception-reaction time (PRT) of the drivers. Furthermore, V2V communication support and PRT are identified as the important indicators affecting road safety at an un-signalized intersection. The proposed interactive framework is expected to contribute in constructing a comprehensive environment for the urban ITCPS and providing experimental support for the analysis of human behavior in the coexistence environment.

Dataset Information

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System.

Publications

Switchable Glass Enabled Contextualization for a Cyber-Physical Safe and Interactive Spatial Augmented Reality PCBA Manufacturing Inspection System.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets