Dataset Information

Method for user interface of large displays using arm pointing and finger counting gesture recognition.

ABSTRACT: Although many three-dimensional pointing gesture recognition methods have been proposed, the problem of self-occlusion has not been considered. Furthermore, because almost all pointing gesture recognition methods use a wide-angle camera, additional sensors or cameras are required to concurrently perform finger gesture recognition. In this paper, we propose a method for performing both pointing gesture and finger gesture recognition for large display environments, using a single Kinect device and a skeleton tracking model. By considering self-occlusion, a compensation technique can be performed on the user's detected shoulder position when a hand occludes the shoulder. In addition, we propose a technique to facilitate finger counting gesture recognition, based on the depth image of the hand position. In this technique, the depth image is extracted from the end of the pointing vector. By using exception handling for self-occlusions, experimental results indicate that the pointing accuracy of a specific reference position was significantly improved. The average root mean square error was approximately 13 pixels for a 1920 × 1080 pixels screen resolution. Moreover, the finger counting gesture recognition accuracy was 98.3%.

SUBMITTER: Kim H

PROVIDER: S-EPMC4165742 | biostudies-other | 2014

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:IntroductionA commercially available EMG Pattern Recognition (EMG-PR) control system was adapted to interface with the multi-degree of freedom (DOF) DEKA Arm.PurposeTo describe users' experience of controlling the DEKA Arm using EMG-PR.MethodsSample: Twelve persons with upper limb amputation participated, 10 with transradial (TR), 2 with transhumeral (TH) level amputation. Ten were male, and 11 were users of a prosthesis at baselines. Design: This was a two-part study consisting of in-laboratory prosthetic training (Part A) and up to 12 weeks of home use of the prosthesis (Part B). Data collection: Qualitative data were collected through open-ended survey questions and semi-structured interviews. Data Analysis: The study used a qualitative case series design with a constant comparative approach to identify common categories of experience. Coding categories were iteratively refined until saturation of categories was achieved. The data were organized in a primary category, major categories of experience, factors impacting experience, and broader contextual factors.ResultsUsers had mixed perspectives on the desirability of the EMG-PR control system in combination with the DEKA Arm. Major aspects of user experience related to the system complexity, process of calibrating, and functional benefits. Factors influencing user experience included training and acclimation, fatigue, prosthesis design, technical issues and control changes. Broader contextual factors, both personal and environmental, also impacted users' experience.Discussion/conclusionThis study provided an in-depth description of user experience operating the DEKA Arm using EMG-PR control. The majority of participants expressed a preference for the controls of their personal prosthesis and controls rather than the iteration of EMG-PR controlled DEKA Arm used in this study. Most were positive about the future potential of EMG-PR as a control method. An understanding of patient experience will assist clinicians and patients choosing prosthetic options.

Dataset Information

Method for user interface of large displays using arm pointing and finger counting gesture recognition.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets