Dataset Information

Evaluation of HIV/AIDS-related mobile health applications content using an evidence-based content rating tool.

ABSTRACT:

Background

Despite the increasing number of mobile health applications, the validity of their content is understudied. The objective of this study was to rate the content of HIV/AIDS-related mobile applications and to determine the extent to which evidence-based medicine is being incorporated into their content using a new tool called the Evidence-based content rating tool of mobile health applications (EBCRT-mHealth).

Methods

All available HIV/AIDS-related applications in Iran from Cafe Bazaar and Google Play Store were evaluated. This study was first conducted in 2018, then after almost two years in 2021 was done again. In this study, researchers developed the EBCRT-mHealth tool to rate the content of applications based on the evidence-based medicine pyramid. Its reliability was calculated (α = 0.78), and five specialists confirmed its validity. Two reviewers independently reviewed all HIV/AIDS applications directly downloaded and installed from the Google Play Store and Cafe Bazaar.

Results

Out of 980 retrieved applications, in 2018, 85, and in 2021, 78 applications were included in the study. Only in 17 (28%) out of the 60 in 2018, and 25 (51%) in 2021 Google Play store applications the source of content information was mentioned. All Cafe Bazaar mobile applications mentioned the source of information. The mean rating of all application content in 2018 was 2.38 (SD = 0.74), and in 2021 was 2.90 (SD = 1.35) out of 5. The mean rating of the content of Cafe Bazaar applications in 2018 was 2.10 (SD = 0.49), and in 2021 was 1.94 (SD = 0.29). The mean content rating of Google Play store applications in 2018 was 2.50 (SD = 0.80) and in 2021 was 3.86 (SD = 1.18).

Conclusion

After two years, the rating of the content of HIV/AIDS-related applications available in Iran that existed in Cafe Bazaar decreased from "poor" to "inappropriate". Also, the content score of the Google Play Store applications increased from "poor" to "good". It is critical to ensure the credibility of the sources used in developing their content and removing applications with inappropriate and unreliable content from the App Stores. Also, mobile health application developers should use the highest quality information in their applications.

SUBMITTER: Raeesi A

PROVIDER: S-EPMC8067376 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundOver 11 million care partners in the United States who provide care to people living with Alzheimer disease and related dementias (ADRD) cite persistent and pervasive unmet needs related to their caregiving role. The proliferation of mobile apps for care partners has the potential to meet care partners' needs, but the quality of apps is unknown.ObjectiveThis study aims to evaluate the quality of publicly available apps for care partners of people living with ADRD and identify design features of low- and high-quality apps to guide future research and user-centered app development.MethodsWe searched the US Apple App and Google Play stores with the criteria that included apps needed to be available in the US Google Play or Apple App stores, accessible to users out of the box, and primarily intended for use by an informal (family or friend) care partner of a person living with ADRD. We classified and tabulated app functionalities. The included apps were then evaluated using the Mobile App Rating Scale (MARS) using 23 items across 5 dimensions: engagement, functionality, aesthetics, information, and subjective quality. We computed descriptive statistics for each rating. To identify recommendations for future research and app development, we categorized rater comments on score-driving factors for each MARS rating item and what the app could have done to improve the item score.ResultsWe evaluated 17 apps. We found that, on average, apps are of minimally acceptable quality. Functionalities supported by apps included education (12/17, 71%), interactive training (3/17, 18%), documentation (3/17, 18%), tracking symptoms (2/17, 12%), care partner community (3/17, 18%), interaction with clinical experts (1/17, 6%), care coordination (2/17, 12%), and activities for the person living with ADRD (2/17, 12%). Of the 17 apps, 8 (47%) had only 1 feature, 6 (35%) had 2 features, and 3 (18%) had 3 features. The MARS quality mean score across apps was 3.08 (SD 0.83) on the 5-point rating scale (1=inadequate to 5=excellent), with apps scoring highest on average on functionality (mean 3.37, SD 0.99) and aesthetics (mean 3.24, SD 0.92) and lowest on average on information (mean 2.95, SD 0.95) and engagement (mean 2.76, SD 0.89). The MARS subjective quality mean score across apps was 2.26 (SD 1.02).ConclusionsWe identified apps whose mean scores were more than 1 point below minimally acceptable quality, whereas some were more than 1 point above. Many apps had broken features and were rated as below acceptable for engagement and information. Minimally acceptable quality is likely to be insufficient to meet care partner needs. Future research should establish minimum quality standards across dimensions for care partner mobile apps. Design features of high-quality apps identified in this study can provide the foundation for benchmarking these standards.

Project description:BACKGROUND:The spread of technology and dissemination of knowledge across the World Wide Web has prompted the development of apps for American Sign Language (ASL) translation, interpretation, and syntax recognition. There is limited literature regarding the quality, effectiveness, and appropriateness of mobile health (mHealth) apps for the deaf and hard-of-hearing (DHOH) that pose to aid the DHOH in their everyday communication and activities. Other than the star-rating system with minimal comments regarding quality, the evaluation metrics used to rate mobile apps are commonly subjective. OBJECTIVE:This study aimed to evaluate the quality and effectiveness of DHOH apps using a standardized scale. In addition, it also aimed to identify content-specific criteria to improve the evaluation process by using a content expert, and to use the content expert to more accurately evaluate apps and features supporting the DHOH. METHODS:A list of potential apps for evaluation was generated after a preliminary screening for apps related to the DHOH. Inclusion and exclusion criteria were developed to refine the master list of apps. The study modified a standardized rating scale with additional content-specific criteria applicable to the DHOH population for app evaluation. This was accomplished by including a DHOH content expert in the design of content-specific criteria. RESULTS:The results indicate a clear distinction in Mobile App Rating Scale (MARS) scores among apps within the study's three app categories: ASL translators (highest score=3.72), speech-to-text (highest score=3.6), and hard-of-hearing assistants (highest score=3.90). Of the 217 apps obtained from the search criteria, 21 apps met the inclusion and exclusion criteria. Furthermore, the limited consideration for measures specific to the target population along with a high app turnover rate suggests opportunities for improved app effectiveness and evaluation. CONCLUSIONS:As more mHealth apps enter the market for the DHOH population, more criteria-based evaluation is needed to ensure the safety and appropriateness of the apps for the intended users. Evaluation of population-specific mHealth apps can benefit from content-specific measurement criteria developed by a content expert in the field.

Project description:Mobile health technologies (mHealth) are efficacious along the continuum of HIV/AIDS-from prevention of HIV transmission to those at the highest risk of acquiring infection, to adherence to HIV medical care, for those living with the disease-decreasing the public health burden of the disease. HIV/AIDS is a complex condition, as certain population subgroups are disproportionately affected. Furthermore, barriers experienced at the individual level (e.g., HIV stigma) and at the systems level (i.e., access to care) contribute to these disparities. Low cost, high penetration rates and ease of use mean mHealth SMS/texting solutions hold the biggest promise for curbing the global HIV/AIDS epidemic; yet these technologies have their own challenges. Our primary objective was to assess interventions that promote adherence, which are delivered via SMS/texting, and important design and ethical considerations of these technologies. Specifically, we evaluated the underlying frameworks underpinning intervention design, strategies to safeguard privacy and confidentiality, and measures taken to ensure equity and equitable access across different subgroups of persons living with HIV (PLWH). We also synthesized study outcomes, barriers/facilitators to adherence, and barriers/facilitators of technology to support HIV adherence. A scoping review methodology was utilized, searching the Medline database for recently published articles (January 2017 to June 2019). Two reviewers independently screened titles and abstracts for relevancy using the following eligibility criteria: (a) original research or protocol; (b) inclusion of persons living with HIV; (c) intervention delivery via SMS/text messaging; and, (d) intervention included HIV care adherence. Seven (7) of the 134 articles met full criteria. The great majority (n = 6) did not report whether the interventions were developed under established behavioral change models or frameworks. Strategies to address privacy, confidentiality and equity/equitable access were taken in four (n = 4) studies. Our mixed methods review determined that privacy and confidentiality remain a concern for PLWH. Provisions to accommodate literacy, infrastructure, technology and other challenges (e.g., access to smartphones and Wifi) are important ethical considerations that guarantee equity and equitable access. Further investigation will determine the contexts within which theoretical models and frameworks remain relevant in the rapidly evolving field of digitized interventions that support adherence.