Dataset Information

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

ABSTRACT: BACKGROUND:Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are of sufficient content quality. OBJECTIVE:The goal of this study was to develop and test an instrument, which was designed to score the content quality of exercise program apps with respect to the exercise guidelines set forth by the American College of Sports Medicine (ACSM). METHODS:We conducted two focus groups (N=14) to elicit input for developing a preliminary 27-item scoring instruments based on the ACSM exercise prescription guidelines. Three reviewers who were no sports medicine experts independently scored 28 exercise program apps using the instrument. Inter- and intra-rater reliability was assessed among the 3 reviewers. An expert reviewer, a Fellow of the ACSM, also scored the 28 apps to create criterion scores. Criterion validity was assessed by comparing nonexpert reviewers' scores to the criterion scores. RESULTS:Overall, inter- and intra-rater reliability was high with most coefficients being greater than .7. Inter-rater reliability coefficients ranged from .59 to .99, and intra-rater reliability coefficients ranged from .47 to 1.00. All reliability coefficients were statistically significant. Criterion validity was found to be excellent, with the weighted kappa statistics ranging from .67 to .99, indicating a substantial agreement between the scores of expert and nonexpert reviewers. Finally, all apps scored poorly against the ACSM exercise prescription guidelines. None of the apps received a score greater than 35, out of a possible maximal score of 70. CONCLUSIONS:We have developed and presented valid and reliable scoring instruments for exercise program apps. Our instrument may be useful for consumers and health care providers who are looking for apps that provide safe, progressive general exercise programs for health and fitness.

SUBMITTER: Guo Y

PROVIDER: S-EPMC5360889 | biostudies-literature | 2017 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

Guo Yi Y Bian Jiang J Leavitt Trevor T Vincent Heather K HK Vincent Heather K HK Vander Zalm Lindsey L Teurlings Tyler L TL Smith Megan D MD Modave François F

Journal of medical Internet research 20170307 3

<h4>Background</h4>Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are ...[more]

PMID: 28270378

Similar Datasets

Project description:BACKGROUND: Low physical activity level is a significant contributor to chronic disease, weight dysregulation, and mortality. Nearly 70% of the American population is overweight, and 35% is obese. Obesity costs an estimated US$ 147 billion annually in health care, and as many as 95 million years of life. Although poor nutritional habits remain the major culprit, lack of physical activity significantly contributes to the obesity epidemic and related lifestyle diseases. OBJECTIVE: Over the past 10 years, mobile devices have become ubiquitous, and there is an ever-increasing number of mobile apps that are being developed to facilitate physical activity, particularly for active people. However, no systematic assessment has been performed about their quality with respect to following the parameters of sound fitness principles and scientific evidence, or suitability for a variety of fitness levels. The aim of this paper is to fill this gap and assess the quality of mobile coaching apps on iOS mobile devices. METHODS: A set of 30 popular mobile apps pertaining to physical activity programming was identified and reviewed on an iPhone device. These apps met the inclusion criteria and provided specific prescriptive fitness and exercise programming content. The content of these apps was compared against the current guidelines and fitness principles established by the American College of Sports Medicine (ACSM). A weighted scoring method based on the recommendations of the ACSM was developed to generate subscores for quality of programming content for aerobic (0-6 scale), resistance (0-6 scale), and flexibility (0-2 scale) components using the frequency, intensity, time, and type (FITT) principle. An overall score (0-14 scale) was generated from the subscores to represent the overall quality of a fitness coaching app. RESULTS: Only 3 apps scored above 50% on the aerobic component (mean 0.7514, SD 1.2150, maximum 4.1636), 4 scored above 50% on the resistance/strength component (mean 1.4525, SD 1.2101, maximum 4.1094), and no app scored above 50% on the flexibility component (mean 0.1118, SD 0.2679, maximum 0.9816). Finally, only 1 app had an overall score (64.3%) above 50% (mean 2.3158, SD 1.911, maximum 9.0072). CONCLUSIONS: There are over 100,000 health-related apps. When looking at popular free apps related to physical activity, we observe that very few of them are evidence based, and respect the guidelines for aerobic activity, strength/resistance training, and flexibility, set forth by the ACSM. Users should exercise caution when adopting a new app for physical activity purposes. This study also clearly identifies a gap in evidence-based apps that can be used safely and effectively to start a physical routine program, develop fitness, and lose weight. App developers have an exciting opportunity to improve mobile coaching app quality by addressing these gaps.

Project description:ContextThe Landing Error Scoring System (LESS) is a clinical tool often used in research and practice to identify athletes presenting high injury-risk biomechanical patterns during a jump-landing task.ObjectiveTo systematically review the literature addressing the psychometric properties of the LESS.Data sourcesThree electronic databases (PubMed, Web of Science, and Scopus) were searched on March 28, 2018, using the term "Landing Error Scoring System."Study selectionAll studies using the LESS as main outcome measure and addressing its reliability, validity against motion capture system, and predictive validity were included. Original English-language studies published in peer-reviewed journals were reviewed. Studies using modified versions of the LESS were excluded.Study designSystematic literature review.Level of evidenceLevel 4.Data extractionStudy design, population, LESS testing procedures, LESS scores, statistical analysis, and main results were extracted from studies using a standardized template.ResultsTen studies met inclusion criteria and were appraised using Newcastle-Ottawa Quality Assessment Scale adapted for cross-sectional studies. The overall LESS score demonstrated good-to-excellent intrarater (intraclass correlation coefficient [ICC], 0.82-0.99), interrater (ICC, 0.83-0.92), and intersession reliability (ICC, 0.81). The validity of the overall LESS score against 3-dimensional jump-landing biomechanics was good when individuals were divided into 4 quartiles based on LESS scores. The validity of individual LESS items versus 3-dimensional motion capture data was moderate-to-excellent for most of the items addressing key risk factors for anterior cruciate ligament (ACL) injury. The predictive value of the LESS for ACL and other noncontact lower-extremity injuries remains uncertain based on the current scientific evidence.ConclusionThe LESS is a reliable screening tool. However, further work is needed to improve the LESS validity against motion capture system and confirm its predictive validity for ACL and other noncontact lower-extremity injuries.

Project description:BackgroundPeople's sexual experiences have a strong association with contraceptive satisfaction and continuation, but no measures exist to specifically assess contraceptive-related sexual acceptability.AimThis study developed and examined the psychometric properties of reliability, separation, and item fit of a new Contraceptive Sexual Acceptability (CSA) instrument.MethodsEnrolled participants initiating a new contraceptive method from the HER Salt Lake longitudinal cohort study contributed baseline survey responses for scale development. The study included the Female Sexual Function Index, the New Sexual Satisfaction Scale, measures of physical and mood-related side effects, and self-reported perceptions of contraception's sexual impacts. Items from these measures' served as the basis for analyses. We analyzed responses using descriptive techniques and modeled using exploratory factor (EFA) and bifactor analyses (BFA). The Masters' Partial Credit Rasch method modeled reliability, separation, and item fit statistics. Here we evaluate (i) the reproducibility of relative measure location on the modeled linear latent variable, (ii) the number of statistically unique performance levels that can be distinguished by the measure, and (iii) the discrepancy between item responses and expectations of the model. Psychometric findings and theoretical models informed item reduction and final scale development.OutcomesWe developed a 10-item Contraceptive Sexual Acceptability scale that exceeded the thresholds and sufficiently covered domains for use in contraceptive research and clinical settings.ResultsStarting with data on 39-items from 4,387 individuals, we identified 10-items that best measured the CSA latent construct. The Rasch model included a total of 5 calibrations. We reduced items based on bifactor analysis and surpassed unidimensionality thresholds (OH = 0.84, ECV = 0.74) set a priori. The final items included questions with scaled responses about pleasure and orgasm (orgasm quality, orgasm frequency, giving partner pleasure), physical (arousal and function) and psychological (emotional connection, surrender) components, general questions of satisfaction and frequency, and a measure of perceived impact of contraception on sexual experiences in the previous 4 weeks.Clinical implicationsThe 10-item CSA instrument covers physical and psychological aspects of contraceptive sexual acceptability and can be used in clinical settings.Strengths & limitationsThe unidimensional CSA instrument offers a brief, yet comprehensive assessment of sexual acceptability. Given the limited diversity of the sample, implementation of this scale in contraceptive research and clinical interactions should be evaluated and validated in more diverse settings.ConclusionAttuning to sexual acceptability could ultimately help contraceptive clients find methods that better meet their needs and preferences. Sanders JN, Kean J, Zhang C, et al. Measuring the Sexual Acceptability of Contraception: Psychometric Examination and Development of a Valid and Reliable Prospective Instrument. J Sex Med 2022;19:507-520.

Project description:BackgroundMobile apps are fundamental tools in today's society for practical and social endeavors. However, these technologies are often not usable for older users. Given the increased use of mobile apps by this group of users and the impact that certain services may have on their quality of life, such as mobile health, personal finance, or online administrative procedures, a clear set of guidelines for mobile app designers is needed. Existing recommendations for older adults focus on investigations with certain groups of older adults or have not been extracted from experimental results.ObjectiveIn this research work, we systematically reviewed the scientific literature that provided recommendations for the design of mobile apps based on usability testing with older adults and organized such recommendations into a meaningful set of design guidelines.MethodsWe conducted a systematic literature review of journal and conference articles from 2010 to 2021. We included articles that carried out usability tests with populations aged >60 years and presented transferable guidelines on mobile software design, resulting in a final set of 40 articles. We then carried out a thematic analysis with 3 rounds of analysis to provide meaning to an otherwise diverse set of recommendations. At this stage, we discarded recommendations that were made by just 1 article, were based on a specific mobile app and were therefore nontransferrable, were based on other authors' literature (as opposed to recommendations based on the results of usability tests), or were not sufficiently argued. With the remaining recommendations, we identified commonalities, wrote a faithful statement for each guideline, used a common language for the entire set, and organized the guidelines into categories, thereby giving shape to an otherwise diverse set of recommendations.ResultsAmong the 27 resulting guidelines, the rules Simplify and Increase the size and distance between interactive controls were transversal and of the greatest significance. The rest of the guidelines were divided into 5 categories (Help & Training, Navigation, Visual Design, Cognitive Load, and Interaction) and consequent subcategories in Visual Design (Layout, Icons, and Appearance) and Interaction (Input and Output). The recommendations were structured, explained in detail, and illustrated with applied examples extracted from the selected studies, where appropriate. We discussed the design implications of applying these guidelines, contextualized with relevant studies. We also discussed the limitations of the approach followed, stressing the need for further experimentation to gain a better understanding of how older adults use mobile apps and how to better design such apps with these users in mind.ConclusionsThe compiled guidelines support the design of mobile apps that cater to the needs of older adults because they are based on the results of actual usability tests with users aged >60 years.

Dataset Information

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

Publications

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets