Validity, Reliability, and Usability of a Smartphone App to Measure Bicycling Location
Ontology highlight
ABSTRACT:
SUBMITTER: Porter A
PROVIDER: S-EPMC9903956 | biostudies-literature | 2022 Jan
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundThere is strong evidence suggesting that higher levels of cardiorespiratory fitness (CRF) are associated with a healthier metabolic profile, and that CRF can serve as a powerful predictor of morbidity and mortality. In this context, a smartphone app based on the 2-km walk test (UKK test) would provide the possibility to assess CRF remotely in individuals geographically distributed around a country or continent, and even between continents, with minimal equipment and low costs.ObjectiveThe overall aim of this study was to evaluate the validity and reliability of 2kmFIT-App developed for Android and iOS mobile operating systems to estimate maximum oxygen consumption (VO2max) as an indicator of CRF. The specific aims of the study were to determine the validity of 2kmFIT-App to track distance and calculate heart rate (HR).MethodsTwenty participants were included for field-testing validation and reliability analysis. The participants completed the UKK test twice using 2kmFIT-App. Distance and HR were measured with the app as well as with accurate methods, and VO2max was estimated using the UKK test equation.ResultsThe validity results showed the following mean differences (app minus criterion): distance (-70.40, SD 51.47 meters), time (-0.59, SD 0.45 minutes), HR (-16.75, SD 9.96 beats/minute), and VO2max (3.59, SD 2.01 ml/kg/min). There was moderate validity found for HR (intraclass correlation coefficient [ICC] 0.731, 95% CI -0.211 to 0.942) and good validity found for VO2max (ICC 0.878, 95% CI -0.125 to 0.972). The reliability results showed the following mean differences (retest minus test): app distance (25.99, SD 43.21 meters), app time (-0.15, SD 0.94 seconds), pace (-0.18, SD 0.33 min/km), app HR (-4.5, 13.44 beats/minute), and app VO2max (0.92, SD 3.04 ml/kg/min). There was good reliability for app HR (ICC 0.897, 95% CI 0.742-0.959) and excellent validity for app VO2max (ICC 0.932, 95% CI 0.830-0.973). All of these findings were observed when using the app with an Android operating system, whereas validity was poor when the app was used with iOS.ConclusionsThis study shows that 2kmFIT-App is a new, scientifically valid and reliable tool able to objectively and remotely estimate CRF, HR, and distance with an Android but not iOS mobile operating system. However, certain limitations such as the time required by 2kmFIT-App to calculate HR or the temperature environment should be considered when using the app.
| S-EPMC7822719 | biostudies-literature
Project description:Clinically valid and reliable simulated inspiratory sounds were required for the development and evaluation of a new therapeutic respiratory exergame application (i.e., QUT Inspire). This smartphone application virtualises incentive spirometry, a longstanding respiratory therapy technique. Inspiratory flows were simulated using a 3 litre calibration syringe and validated using clinical reference devices. Syringe flow nozzles of decreasing diameter were applied to model the influence of mouth shape on audible sound levels generated. A library of calibrated audio inspiratory sounds was created to determine the reliability and range of inspiratory sound detection at increasing distances separating the sound source and smartphones running the app. Simulated inspiratory sounds were reliably detected by the new application at higher air inflows (high, medium), using smaller mouth diameters (<25 mm) and where smartphones were held proximal (≤5 cm) to the mouth (or at distances up to 50 cm for higher airflows). Performance was comparable for popular smartphone types and using different phone orientations (i.e., held horizontally, at 45° or 90°). These observations inform future application refinements, including prompts to reduce mouth diameter, increase inspiratory flow and maintain proximity to the phone to optimise sound detection. This library of calibrated inspiratory sounds offers reproducible non-human reference data suitable for development, evaluation and regression testing of a therapeutic respiratory exergame application for smartphones.
| S-EPMC8513019 | biostudies-literature
Project description:Measuring joint range of motion is an important skill for many allied health professionals. While the Universal Goniometer is the most commonly utilised clinical tool for measuring joint range of motion, the evolution of smartphone technology and applications (apps) provides the clinician with more measurement options. However, the reliability and validity of these smartphones and apps is still somewhat uncertain. The aim of this study was to systematically review the literature regarding the intra- and inter-rater reliability and validity of smartphones and apps to measure joint range of motion. Eligible studies were published in English peer-reviewed journals with full text available, involving the assessment of reliability and/or validity of a non-videographic smartphone app to measure joint range of motion in participants >18 years old. An electronic search using PubMed, Medline via Ovid, EMBASE, CINAHL, and SPORTSDiscus was performed. The risk of bias was assessed using a standardised appraisal tool. Twenty-three of the eligible 25 studies exceeded the minimum 60% score to be classified as a low risk of bias, although 3 of the 13 criteria were not achieved in >50% of the studies. Most of the studies demonstrated adequate intra-rater or inter-rater reliability and/or validity for >50% of the range of motion tests across all joints assessed. However, this level of evidence appeared weaker for absolute (e.g. mean difference ± limit of agreement, minimal detectable change) than relative (e.g. intraclass correlation, correlation) measures; and for spinal rotation than spinal extension, flexion and lateral flexion. Our results provide clinicians with sufficient evidence to support the use of smartphones and apps in place of goniometers to measure joint motion. Future research should address some methodological limitations of the literature, especially including the inclusion of absolute and not just relative reliability and validity statistics.
| S-EPMC6505893 | biostudies-literature
Project description:BackgroundRepeated applications of short-term dietary assessment instruments are recommended for estimating usual dietary intake. For this purpose, NutriDiary, a smartphone app for collecting weighed dietary records (WDRs) in the German population, was developed.ObjectiveWe aim to describe NutriDiary and evaluate its usability and acceptability.MethodsNutriDiary was developed as a WDR, allowing users to enter food items via text search, barcode scanning, or free text entry. The sample for the evaluation study included 74 participants (n=51, 69% female, aged 18-64 years), including 27 (37.5%) experts and 47 (63.5%) laypersons (including n=22, 30%, nutrition students). Participants completed a 1-day WDR and entered a predefined sample meal (n=17 foods) the following day by using NutriDiary. An evaluation questionnaire was answered from which the system usability scale (SUS) score (0-100) was calculated. A backward selection procedure (PROC REG in SAS; SAS Institute) was used to identify potential predictors for the SUS score (age, sex, status [expert or laypersons], and operating system [iOS or Android]).ResultsThe median SUS score of 75 (IQR 63-88) indicated good usability. Age was the only characteristic identified as a potential predictor for a lower SUS score (P<.001). The median completion time for an individual WDR was 35 (IQR 19-52) minutes. Older participants took longer to enter the data than younger ones (18-30 y: median 1.5, IQR 1.1-2.0 min/item vs 45-64 y: median 1.8, IQR 1.3-2.3 min/item). Most participants expressed a preference for NutriDiary over the traditional paper-based method.ConclusionsGood usability and acceptability make NutriDiary promising for use in epidemiological studies.
| S-EPMC11833184 | biostudies-literature
Project description:BACKGROUND:Each year, millions of older adults fall, with more than 1 out of 4 older people experiencing a fall annually, thereby causing a major social and economic impact. Falling once doubles one’s chances of falling again, making fall prediction an important aspect of preventative strategies. In this study, 22 older adults aged between 65 and 85 years were trained in the use of a smartphone-based fall prediction system. The system is designed to continuously assess fall risk by measuring various gait and balance parameters using a smart insole and smartphone, and is also designed to detect falls. The use case of the fall prediction system in question required the users to interact with the smartphone via an app for device syncing, data uploads, and checking system status. OBJECTIVE:The objective of this study was to observe the effect that basic smartphone training could have on the user experience of a group that is not technically proficient with smartphones when using a new connected health system. It was expected that even short rudimentary training could have a large effect on user experience and therefore increase the chances of the group accepting the new technology. METHODS:All participants received training on how to use the system smartphone app; half of the participants (training group) also received extra training on how to use basic functions of the smartphone, such as making calls and sending text messages, whereas the other half did not receive this extra training (no extra training group). Comparison of training group and no extra training group was carried out using metrics such as satisfaction rating, time taken to complete tasks, cues required to complete tasks, and errors made during tasks. RESULTS:The training group fared better in the first 3 days of using the system. There were significant recorded differences in number of cues required and errors committed between the two groups. By the fourth and fifth day of use, both groups were performing at the same level when using the system. CONCLUSIONS:Supplementary basic smartphone training may be critical in trials where a smartphone app–based system for health intervention purposes is being introduced to a population that is not proficient with technology. This training could prevent early technology rejection and increase the engagement of older participants and their overall user experience with the system.
| S-EPMC5945986 | biostudies-literature
Project description:BACKGROUND:Smartphone apps for heart rate variability (HRV) measurement have been extensively developed in the last decade. However, ultra-short-term HRV recordings taken by wearable devices have not been examined. OBJECTIVE:The aims of this study were the following: (1) to compare the validity and reliability of ultra-short-term and short-term HRV time-domain and frequency-domain variables in a novel smartphone app, Pulse Express Pro (PEP), and (2) to determine the agreement of HRV assessments between an electrocardiogram (ECG) and PEP. METHODS:In total, 60 healthy adults were recruited to participate in this study (mean age 22.3 years [SD 3.0 years], mean height 168.4 cm [SD 8.0 cm], mean body weight 64.2 kg [SD 11.5 kg]). A 5-minute resting HRV measurement was recorded via ECG and PEP in a sitting position. Standard deviation of normal R-R interval (SDNN), root mean square of successive R-R interval (RMSSD), proportion of NN50 divided by the total number of RR intervals (pNN50), normalized very-low-frequency power (nVLF), normalized low-frequency power (nLF), and normalized high-frequency power (nHF) were analyzed within 9 time segments of HRV recordings: 0-1 minute, 1-2 minutes, 2-3 minutes, 3-4 minutes, 4-5 minutes, 0-2 minutes, 0-3 minutes, 0-4 minutes, and 0-5 minutes (standard). Standardized differences (ES), intraclass correlation coefficients (ICC), and the Spearman product-moment correlation were used to compare the validity and reliability of each time segment to the standard measurement (0-5 minutes). Limits of agreement were assessed by using Bland-Altman plot analysis. RESULTS:Compared to standard measures in both ECG and PEP, pNN50, SDNN, and RMSSD variables showed trivial ES (<0.2) and very large to nearly perfect ICC and Spearman correlation coefficient values in all time segments (>0.8). The nVLF, nLF, and nHF demonstrated a variation of ES (from trivial to small effects, 0.01-0.40), ICC (from moderate to nearly perfect, 0.39-0.96), and Spearman correlation coefficient values (from moderate to nearly perfect, 0.40-0.96). Furthermore, the Bland-Altman plots showed relatively narrow values of mean difference between the ECG and PEP after consecutive 1-minute recordings for SDNN, RMSSD, and pNN50. Acceptable limits of agreement were found after consecutive 3-minute recordings for nLF and nHF. CONCLUSIONS:Using the PEP app to facilitate a 1-minute ultra-short-term recording is suggested for time-domain HRV indices (SDNN, RMSSD, and pNN50) to interpret autonomic functions during stabilization. When using frequency-domain HRV indices (nLF and nHF) via the PEP app, a recording of at least 3 minutes is needed for accurate measurement.
| S-EPMC7428904 | biostudies-literature
Project description:The aim of this study was to investigate the reliability and validity of an affordable wireless force sensor in measuring mean and peak forces during resistance training.A Suiff Pro wireless force sensor (Suiff, Spain) and a MuscleLab force platform (Ergotest, Norway) were used concurrently to assess tensile load and the ground reaction force resulting from an upright row exercise. Thirteen participants (28.2 ± 5.7 years, 76.2 ± 9.6 kg, 178.2 ± 9.2 cm) performed the exercise under three velocity conditions and isometrically. Each condition involved three sets of exercise. Mean (Fmean) and peak (Fpeak) force values from both sensors were collected and compared.Suiff Pro exhibited excellent reliability for Fmean and Fpeak (ICCs = 0.99). When compared to the criterion measures, Suiff Pro showed trivial standardized bias for Fmean (Mean = 0.00 [CI 95% = 0.00 to 0.01]) and Fpeak (-0.02 [-0.04 to 0.00]). The standardized typical error was also trivial for Fmean (0.03 [0.02 to 0.03]) and Fpeak (0.07 [0.05 to 0.09]). Correlations with the MuscleLab force platform were nearly perfect: Fmean (0.97 [0.94 to 0.98]; p<0.001); Fpeak (0.96 [0.92 to 0.97]; p<0.001).The findings demonstrate that the Suiff Pro sensor is reliable and valid device for measuring force during isometric and dynamic resistance training exercises. Therefore, practitioners can confidently use this device to monitor kinematic variables of resistance training exercises and to obtain real-time augmented feedback during a training session.
| S-EPMC10956869 | biostudies-literature
Project description:BackgroundComplicated grief, which is often under-recognized and under-treated, can lead to substantial impairment in functioning. The Brief Grief Questionnaire (BGQ) is a 5-item self-report or interview instrument for screening complicated grief. Although investigations with help-seeking samples suggest that the BGQ is valid and reliable, it has not been validated in a broader population.Methodology/principal findingsA questionnaire was mailed to a randomly selected sample (n = 5000) residing in one of 4 areas of Japan. The BCQ was examined for responders who were bereaved more than 6 months and less than 10 years (n = 915). Non-specific psychological distress was assessed with the K6 screening scale. Multiple group confirmatory factor analysis supported a uni-dimensional factor structure and the invariance of parameters across gender and age. Cronbach's alpha was sufficiently high (alpha = .75) to confirm internal consistency. Average Variance Extracted (0.39) was higher than the shared covariance (0.14) between BGQ and K6, suggesting discriminant validity.ConclusionsThe results of this study support the reliability and validity of the BGQ in the Japanese population. Future studies should examine predictive validity by using structured interviews or more detailed scales for complicated grief.
| S-EPMC3279351 | biostudies-literature
Project description:ImportanceFrontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD.ObjectiveTo evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations.Design, setting, and participantsIn this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)-based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes.ExposureParticipants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests.Main outcomes and measuresInternal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy.ResultsIn the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity (r range, 0.38-0.59), criterion-standard neuropsychological tests (r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) (z of comparison, -2.49 [95% CI, -0.19 to -0.02]; P = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32).Conclusions and relevanceThe findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.
| S-EPMC10985553 | biostudies-literature
Project description:BACKGROUND:In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. OBJECTIVE:The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. METHODS:The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. RESULTS:All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. CONCLUSIONS:The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.
| S-EPMC6789421 | biostudies-literature