Dataset Information

Reliability and validity of daily self-monitoring by smartphone application for health-related quality-of-life, antiretroviral adherence, substance use, and sexual behaviors among people living with HIV.

ABSTRACT: This paper examines inter-method reliability and validity of daily self-reports by smartphone application compared to 14-day recall web-surveys repeated over 6 weeks with people living with HIV (PLH). A participatory sensing framework guided participant-centered design prioritizing external validity of methods for potential applications in both research and self-management interventions. Inter-method reliability correlations were consistent with prior research for physical and mental health quality-of-life (r = 0.26-0.61), antiretroviral adherence (r = 0.70-0.73), and substance use (r = 0.65-0.92) but not for detailed sexual encounter surveys (r = 0.15-0.61). Concordant and discordant pairwise comparisons show potential trends in reporting biases, for example, lower recall reports of unprotected sex or alcohol use, and rounding up errors for frequent events. Event-based reporting likely compensated for modest response rates to daily time-based prompts, particularly for sexual and drug use behaviors that may not occur daily. Recommendations are discussed for future continuous assessment designs and analyses.

SUBMITTER: Swendeman D

PROVIDER: S-EPMC4344409 | biostudies-literature | 2015 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of daily self-monitoring by smartphone application for health-related quality-of-life, antiretroviral adherence, substance use, and sexual behaviors among people living with HIV.

Swendeman Dallas D Comulada W Scott WS Ramanathan Nithya N Lazar Maya M Estrin Deborah D

AIDS and behavior 20150201 2

This paper examines inter-method reliability and validity of daily self-reports by smartphone application compared to 14-day recall web-surveys repeated over 6 weeks with people living with HIV (PLH). A participatory sensing framework guided participant-centered design prioritizing external validity of methods for potential applications in both research and self-management interventions. Inter-method reliability correlations were consistent with prior research for physical and mental health qual ...[more]

PMID: 25331266

Similar Datasets

Project description:ImportanceFrontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD.ObjectiveTo evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations.Design, setting, and participantsIn this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)-based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes.ExposureParticipants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests.Main outcomes and measuresInternal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy.ResultsIn the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity (r range, 0.38-0.59), criterion-standard neuropsychological tests (r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) (z of comparison, -2.49 [95% CI, -0.19 to -0.02]; P = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32).Conclusions and relevanceThe findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.

Project description:BackgroundPrevious questionnaires targeting older adults' sedentary time have underestimated total sedentary time, possibly by not including all relevant specific sedentary behaviors. The current study aimed to investigate the criterion validity and test-retest reliability of a new questionnaire assessing a comprehensive set of sedentary behaviors. Additionally, we examined whether the criterion validity of the questionnaire differed according to age, gender and educational level.MethodsA sample of home-dwelling Belgian older adults (>64 years, n?=?508) completed a newly-developed questionnaire assessing twelve specific sedentary behaviors and wore an accelerometer for seven consecutive days as criterion measure. A subsample (n?=?28) completed the questionnaire a second time to examine test-retest reliability. Data collection occurred between September 2010 and October 2012.ResultsCorrelational analyses examining self-reported total sitting time and accelerometer-derived sedentary time yielded a Spearman's ? of 0.30. Using the Bland-Altman regression procedure, self-reported total sitting time underestimated accelerometer-derived sedentary time by -82 minutes/day for a participant with an average level of sedentary time (539 minutes/day). Corresponding 95% limits of agreement were wide (-364, 200 minutes/day). Better, but still not ideal, validity findings were observed in the younger, male and tertiary-educated subgroups. Acceptable test-retest reliability (ICC?>?0.70) was found for total sitting time, TV viewing, computer use, and driving a car.ConclusionValidity for older adults' self-reported total sitting time against accelerometer-derived sedentary time was not strong, but comparable to previous studies. However, underestimation of total sedentary time was lower compared to previous studies, possibly explained by the inclusion of additional specific sedentary behaviors. Further research is needed to develop self-report tools and objective criterion measures that accurately measure engagement in (specific) sedentary behavior(s) among different subgroups of the older population.

Project description:BackgroundThere is strong evidence suggesting that higher levels of cardiorespiratory fitness (CRF) are associated with a healthier metabolic profile, and that CRF can serve as a powerful predictor of morbidity and mortality. In this context, a smartphone app based on the 2-km walk test (UKK test) would provide the possibility to assess CRF remotely in individuals geographically distributed around a country or continent, and even between continents, with minimal equipment and low costs.ObjectiveThe overall aim of this study was to evaluate the validity and reliability of 2kmFIT-App developed for Android and iOS mobile operating systems to estimate maximum oxygen consumption (VO2max) as an indicator of CRF. The specific aims of the study were to determine the validity of 2kmFIT-App to track distance and calculate heart rate (HR).MethodsTwenty participants were included for field-testing validation and reliability analysis. The participants completed the UKK test twice using 2kmFIT-App. Distance and HR were measured with the app as well as with accurate methods, and VO2max was estimated using the UKK test equation.ResultsThe validity results showed the following mean differences (app minus criterion): distance (-70.40, SD 51.47 meters), time (-0.59, SD 0.45 minutes), HR (-16.75, SD 9.96 beats/minute), and VO2max (3.59, SD 2.01 ml/kg/min). There was moderate validity found for HR (intraclass correlation coefficient [ICC] 0.731, 95% CI -0.211 to 0.942) and good validity found for VO2max (ICC 0.878, 95% CI -0.125 to 0.972). The reliability results showed the following mean differences (retest minus test): app distance (25.99, SD 43.21 meters), app time (-0.15, SD 0.94 seconds), pace (-0.18, SD 0.33 min/km), app HR (-4.5, 13.44 beats/minute), and app VO2max (0.92, SD 3.04 ml/kg/min). There was good reliability for app HR (ICC 0.897, 95% CI 0.742-0.959) and excellent validity for app VO2max (ICC 0.932, 95% CI 0.830-0.973). All of these findings were observed when using the app with an Android operating system, whereas validity was poor when the app was used with iOS.ConclusionsThis study shows that 2kmFIT-App is a new, scientifically valid and reliable tool able to objectively and remotely estimate CRF, HR, and distance with an Android but not iOS mobile operating system. However, certain limitations such as the time required by 2kmFIT-App to calculate HR or the temperature environment should be considered when using the app.

Dataset Information

Reliability and validity of daily self-monitoring by smartphone application for health-related quality-of-life, antiretroviral adherence, substance use, and sexual behaviors among people living with HIV.

Publications

Reliability and validity of daily self-monitoring by smartphone application for health-related quality-of-life, antiretroviral adherence, substance use, and sexual behaviors among people living with HIV.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets