Dataset Information

Taking a call is facilitated by the multisensory processing of smartphone vibrations, sounds, and flashes.

ABSTRACT: Many electronic devices that we use in our daily lives provide inputs that need to be processed and integrated by our senses. For instance, ringing, vibrating, and flashing indicate incoming calls and messages in smartphones. Whether the presentation of multiple smartphone stimuli simultaneously provides an advantage over the processing of the same stimuli presented in isolation has not yet been investigated. In this behavioral study we examined multisensory processing between visual (V), tactile (T), and auditory (A) stimuli produced by a smartphone. Unisensory V, T, and A stimuli as well as VA, AT, VT, and trisensory VAT stimuli were presented in random order. Participants responded to any stimulus appearance by touching the smartphone screen using the stimulated hand (Experiment 1), or the non-stimulated hand (Experiment 2). We examined violations of the race model to test whether shorter response times to multisensory stimuli exceed probability summations of unisensory stimuli. Significant violations of the race model, indicative of multisensory processing, were found for VA stimuli in both experiments and for VT stimuli in Experiment 1. Across participants, the strength of this effect was not associated with prior learning experience and daily use of smartphones. This indicates that this integration effect, similar to what has been previously reported for the integration of semantically meaningless stimuli, could involve bottom-up driven multisensory processes. Our study demonstrates for the first time that multisensory processing of smartphone stimuli facilitates taking a call. Thus, research on multisensory integration should be taken into consideration when designing electronic devices such as smartphones.

SUBMITTER: Pomper U

PROVIDER: S-EPMC4130528 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Taking a call is facilitated by the multisensory processing of smartphone vibrations, sounds, and flashes.

Pomper Ulrich U Brincker Jana J Harwood James J Prikhodko Ivan I Senkowski Daniel D

PloS one 20140812 8

Many electronic devices that we use in our daily lives provide inputs that need to be processed and integrated by our senses. For instance, ringing, vibrating, and flashing indicate incoming calls and messages in smartphones. Whether the presentation of multiple smartphone stimuli simultaneously provides an advantage over the processing of the same stimuli presented in isolation has not yet been investigated. In this behavioral study we examined multisensory processing between visual (V), tactil ...[more]

PMID: 25116195

Similar Datasets

Project description:The precordial mechanical vibrations generated by cardiac contractions have a rich frequency spectrum. While the lowest frequencies can be palpated, the higher infrasonic frequencies are usually captured by the seismocardiogram (SCG) signal and the audible ones correspond to heart sounds. Forcecardiography (FCG) is a non-invasive technique that measures these vibrations via force sensing resistors (FSR). This study presents a new piezoelectric sensor able to record all heart vibrations simultaneously, as well as a respiration signal. The new sensor was compared to the FSR-based one to assess its suitability for FCG. An electrocardiogram (ECG) lead and a signal from an electro-resistive respiration band (ERB) were synchronously acquired as references on six healthy volunteers (4 males, 2 females) at rest. The raw signals from the piezoelectric and the FSR-based sensors turned out to be very similar. The raw signals were divided into four components: Forcerespirogram (FRG), Low-Frequency FCG (LF-FCG), High-Frequency FCG (HF-FCG) and heart sounds (HS-FCG). A beat-by-beat comparison of FCG and ECG signals was carried out by means of regression, correlation and Bland-Altman analyses, and similarly for respiration signals (FRG and ERB). The results showed that the infrasonic FCG components are strongly related to the cardiac cycle (R 2 > 0.999, null bias and Limits of Agreement (LoA) of ± 4.9 ms for HF-FCG; R 2 > 0.99, null bias and LoA of ± 26.9 ms for LF-FCG) and the FRG inter-breath intervals are consistent with ERB ones (R 2 > 0.99, non-significant bias and LoA of ± 0.46 s). Furthermore, the piezoelectric sensor was tested against an accelerometer and an electronic stethoscope: synchronous acquisitions were performed to quantify the similarity between the signals. ECG-triggered ensemble averages (synchronized with R-peaks) of HF-FCG and SCG showed a correlation greater than 0.81, while those of HS-FCG and PCG scored a correlation greater than 0.85. The piezoelectric sensor demonstrated superior performances as compared to the FSR, providing more accurate, beat-by-beat measurements. This is the first time that a single piezoelectric sensor demonstrated the ability to simultaneously capture respiration, heart sounds, an SCG-like signal (i.e., HF-FCG) and the LF-FCG signal, which may provide information on ventricular emptying and filling events. According to these preliminary results the novel piezoelectric FCG sensor stands as a promising device for accurate, unobtrusive, long-term monitoring of cardiorespiratory functions and paves the way for a wide range of potential applications, both in the research and clinical fields. However, these results should be confirmed by further analyses on a larger cohort of subjects, possibly including also pathological patients.

Project description:ImportanceBreathing sounds during sleep are an important characteristic feature of obstructive sleep apnea (OSA) and have been regarded as a potential biomarker. Breathing sounds during sleep can be easily recorded using a microphone, which is found in most smartphone devices. Therefore, it may be easy to implement an evaluation tool for prescreening purposes.ObjectiveTo evaluate OSA prediction models using smartphone-recorded sounds and identify optimal settings with regard to noise processing and sound feature selection.Design, setting, and participantsA cross-sectional study was performed among patients who visited the sleep center of Seoul National University Bundang Hospital for snoring or sleep apnea from August 2015 to August 2019. Audio recordings during sleep were performed using a smartphone during routine, full-night, in-laboratory polysomnography. Using a random forest algorithm, binary classifications were separately conducted for 3 different threshold criteria according to an apnea hypopnea index (AHI) threshold of 5, 15, or 30 events/h. Four regression models were created according to noise reduction and feature selection from the input sound to predict actual AHI: (1) noise reduction without feature selection, (2) noise reduction with feature selection, (3) neither noise reduction nor feature selection, and (4) feature selection without noise reduction. Clinical and polysomnographic parameters that may have been associated with errors were assessed. Data were analyzed from September 2019 to September 2020.Main outcomes and measuresAccuracy of OSA prediction models.ResultsA total of 423 patients (mean [SD] age, 48.1 [12.8] years; 356 [84.1%] male) were analyzed. Data were split into training (n = 256 [60.5%]) and test data sets (n = 167 [39.5%]). Accuracies were 88.2%, 82.3%, and 81.7%, and the areas under curve were 0.90, 0.89, and 0.90 for an AHI threshold of 5, 15, and 30 events/h, respectively. In the regression analysis, using recorded sounds that had not been denoised and had only selected attributes resulted in the highest correlation coefficient (r = 0.78; 95% CI, 0.69-0.88). The AHI (β = 0.33; 95% CI, 0.24-0.42) and sleep efficiency (β = -0.20; 95% CI, -0.35 to -0.05) were found to be associated with estimation error.Conclusions and relevanceIn this cross-sectional study, recorded sleep breathing sounds using a smartphone were used to create reasonably accurate OSA prediction models. Future research should focus on real-life recordings using various smartphone devices.

Project description:BackgroundLateralized processing of speech is a well studied phenomenon in humans. Both anatomical and neurophysiological studies support the view that nonhuman primates and other animal species also reveal hemispheric differences in areas involved in sound processing. In recent years, an increasing number of studies on a range of taxa have employed an orienting paradigm to investigate lateralized acoustic processing. In this paradigm, sounds are played directly from behind and the direction of turn is recorded. This assay rests on the assumption that a hemispheric asymmetry in processing is coupled to an orienting bias towards the contralateral side. To examine this largely untested assumption, speech stimuli as well as artificial sounds were presented to 224 right-handed human subjects shopping in supermarkets in Germany and in the UK. To verify the lateralized processing of the speech stimuli, we additionally assessed the brain activation in response to presentation of the different stimuli using functional magnetic resonance imaging (fMRI).ResultsIn the naturalistic behavioural experiments, there was no difference in orienting behaviour in relation to the stimulus material (speech, artificial sounds). Contrary to our predictions, subjects revealed a significant left bias, irrespective of the sound category. This left bias was slightly but not significantly stronger in German subjects. The fMRI experiments confirmed that the speech stimuli evoked a significant left lateralized activation in BA44 compared to the artificial sounds.ConclusionThese findings suggest that in adult humans, orienting biases are not necessarily coupled with lateralized processing of acoustic stimuli. Our results -- as well as the inconsistent orienting biases found in different animal species -- suggest that the orienting assay should be used with caution. Apparently, attention biases, experience, and experimental conditions may all affect head turning responses. Because of the complexity of the interaction of factors, the use of the orienting assay to determine lateralized processing of sound stimuli is discouraged.

Dataset Information

Taking a call is facilitated by the multisensory processing of smartphone vibrations, sounds, and flashes.

Publications

Taking a call is facilitated by the multisensory processing of smartphone vibrations, sounds, and flashes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets