Dataset Information

Chinese Version of the Mobile Health App Usability Questionnaire: Translation, Adaptation, and Validation Study.

ABSTRACT:

Background

The usability of mobile health (mHealth) apps needs to be effectively evaluated before they are officially approved to be used to deliver health interventions. To this end, the mHealth App Usability Questionnaire (MAUQ) has been designed and proved valid and reliable in assessing the usability of mHealth apps. However, this English questionnaire needs to be translated into other languages, adapted, and validated before being utilized to evaluate the usability of mHealth apps.

Objective

This study aims to improve, further adapt, and validate the Chinese version of the MAUQ (C-MAUQ; interactive for patients) on Left-handed Doctor, one of the most popular "reaching out to patients" interactive mHealth apps with chatbot function in China, to test the reliability and cross-cultural adaptability of the questionnaire.

Methods

The MAUQ (interactive for patients) has been translated into Chinese and validated for its reliability on Good Doctor, one of the most influential "reaching out to patients" mHealth apps without chatbot function in China. After asking for the researchers' approval to use this Chinese version, we adjusted and further adapted the C-MAUQ by checking it against the original English version and improving its comprehensibility, readability, idiomaticity, and cross-cultural adaptability. Following a trial survey completed by 50 respondents on wenjuanxing, the most popular online questionnaire platform in China, the improved version of the C-MAUQ (I-C-MAUQ) was finally used to evaluate the usability of Left-handed Doctor through an online questionnaire survey (answered by 322 participants) on wenjuanxing, to test its internal consistency, reliability, and validity.

Results

The I-C-MAUQ still retained the 21 items and 3 dimensions of the original MAUQ: 8 items for usability and satisfaction, 6 items for system information arrangement, and 7 items for efficiency. The translation problems in the C-MAUQ, including (1) redundancy, (2) incompleteness, (3) misuse of parts of speech, (4) choice of inappropriate words, (5) incomprehensibility, and (6) cultural difference-induced improper translation, were improved. As shown in the analysis of data obtained through the online survey, the I-C-MAUQ had a better internal consistency (ie, the correlation coefficient between the score of each item and the total score of the questionnaire determined within the range of 0.861-0.938; P<.01), reliability (Cronbach α=.988), and validity (Kaiser-Meyer-Olkin=0.973), compared with the C-MAUQ. It was effectively used to test the usability of Left-handed Doctor, eliciting over 80% of informants' positive attitudes toward this mHealth app.

Conclusions

The I-C-MAUQ is highly reliable and valid for Left-handed Doctor, and suitable for testing the usability of interactive mHealth apps used by patients in China. This finding further confirms the cross-cultural validity, reliability, and adaptability of the MAUQ. We identified certain factors influencing the perceived usability of mHealth apps, including users' age, gender, education, profession, and possibly previous experience with mHealth apps and the chatbot function of such apps. Most notably, we found a wider acceptance of this new technology among young Chinese female college students who were more engaged in the interaction with health care chatbots. The age-, gender-, and profession-induced preference for new digital health interventions in China aligns with the findings in other similar studies in America and Malaysia. This preference identifies areas for further research on the social, cultural, and gender adaptation of health technologies.

SUBMITTER: Shan Y

PROVIDER: S-EPMC9301561 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients' health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness.ObjectiveThis study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia.MethodsForward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app.ResultsThe content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app.ConclusionsThe M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

Project description:BACKGROUND:A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. OBJECTIVE:The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. METHODS:Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. RESULTS:The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. CONCLUSIONS:The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia.

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BackgroundIn the recent decades, the number of apps promoting health behaviors and health-related strategies and interventions has increased alongside the number of smartphone users. Nevertheless, the validity process for measuring and reporting app quality remains unsatisfactory for health professionals and end users and represents a public health concern. The Mobile Application Rating Scale (MARS) is a tool validated and widely used in the scientific literature to evaluate and compare mHealth app functionalities. However, MARS is not adapted to the French culture nor to the language.ObjectiveThis study aims to translate, adapt, and validate the equivalent French version of MARS (ie, MARS-F).MethodsThe original MARS was first translated to French by two independent bilingual scientists, and their common version was blind back-translated twice by two native English speakers, culminating in a final well-established MARS-F. Its comprehensibility was then evaluated by 6 individuals (3 researchers and 3 nonacademics), and the final MARS-F version was created. Two bilingual raters independently completed the evaluation of 63 apps using MARS and MARS-F. Interrater reliability was assessed using intraclass correlation coefficients. In addition, internal consistency and validity of both scales were assessed. Mokken scale analysis was used to investigate the scalability of both MARS and MARS-F.ResultsMARS-F had a good alignment with the original MARS, with properties comparable between the two scales. The correlation coefficients (r) between the corresponding dimensions of MARS and MARS-F ranged from 0.97 to 0.99. The internal consistencies of the MARS-F dimensions engagement (ω=0.79), functionality (ω=0.79), esthetics (ω=0.78), and information quality (ω=0.61) were acceptable and that for the overall MARS score (ω=0.86) was good. Mokken scale analysis revealed a strong scalability for MARS (Loevinger H=0.37) and a good scalability for MARS-F (H=0.35).ConclusionsMARS-F is a valid tool, and it would serve as a crucial aid for researchers, health care professionals, public health authorities, and interested third parties, to assess the quality of mHealth apps in French-speaking countries.

Project description:Objective:To translate the Mindfulness in Parenting Questionnaire (MIPQ) into Standard Mandarin and then explore the reliability and validity of this newly translated measure in a large sample of Chinese middle school parents. Methods:We translated the MIPQ using the forward-backward method and pilot tested it on a sample of parents of adolescents (aged 12-16 years) in China. Following minor modifications, 1057 Chinese parents (Mothers or Fathers) in two middle schools (one in the North and one in the South of China) completed the translated Chinese Mindfulness in Parenting Questionnaire (C-MIPQ). To determine test-retest reliability 121 participants completed the C-MIPQ again 2 weeks later. In order to test convergent validity, 395 participants completed the Mindful Attention and Awareness Scale (MAAS), Parenting Styles and Dimensions Questionnaire-Short Version (PSDQ-short) and the Interpersonal Mindfulness in Parenting Scale (IM-P). The Chinese Perceived Stress Scale (CPSS), Beck Depression Scale (BDI-13), and socioeconomic status (SES) were completed in order to test discriminant validity. Results:Confirmatory factor analysis showed that the two-factor model indicated in the original study was a good fit. The total score of the scale and the scores of the two dimensions ('Mindful discipline' and 'Being in the moment with the child') were significantly positively correlated with the total score of the MAAS, IM-P and the authoritative parenting style in the PSDQ-short, demonstrating convergent validity. Discriminant validity was established as there was no difference in C-MIPQ sub-scale scores across any of the SES variables except for levels of education (parents with higher education had higher scores on the 'being in the moment with the child' subscale). In addition, the C-MIPQ was negatively related to stress and depression. Cronbach's alpha of the total scale was 0.93 (and 0.88, 0.89 for the two dimensions of the C-MIPQ) indicating excellent internal consistency. Test-retest reliability was good (intra-class correlation of 0.83). Conclusion:This study is the first step toward establishing the psychometric properties of the C-MIPQ for measuring mindful parenting in parents of adolescents aged 12-16 years; additional studies will be needed in order to test this further.

Project description:BackgroundThe Anterior Cruciate Ligament-Quality of Life (ACL-QOL) questionnaire is a patient-reported outcome measure used to assess the effect of an anterior cruciate ligament (ACL) injury on the lives of patients. It was originally written in English, which may affect its use when completed by nonnative English speakers.PurposeTo translate and adapt the ACL-QOL to Spanish and provide evidence of its psychometric properties.Study designCohort study (diagnosis); Level of evidence, 2.MethodsA total of 183 patients with an ACL injury from 4 Catalan hospitals were included: 99 patients who had undergone ACL reconstruction (ACLR) completed the Spanish version of the ACL-QOL (ACL-QOL-Sp) twice (mean interval, 15.2 days) in 2 weeks for test-retest reliability, and 84 patients completed the ACL-QOL-Sp, the Lysholm knee scoring scale, the Knee injury and Osteoarthritis Outcome Score (KOOS), Tegner Activity Scale, and the 12-item Short Form Health Survey (SF-12) before and at 4 and 9 months after ACLR to assess responsiveness. The association between the ACL-QOL-Sp and the other outcome measures was evaluated with the Spearman correlation coefficient.ResultsThe ACL-QOL-Sp showed good internal consistency (Cronbach alpha = 0.96) and test-retest reliability (intraclass correlation coefficient = 0.97). The standard error of measurement was 3.6, also suggesting the precision of measurements. The smallest detectable change was 9.98 in 94% of patients. No association was found between the ACL-QOL-Sp score and the Tegner score or SF-12 mental component summary score; however, a moderate correlation was found with the overall KOOS score (r = -0.545), Lysholm score (r = 0.509), and SF-12 physical component summary score (r = 0.607). The correlation ranged from weak for the KOOS-Symptoms subscore (r = -0.290) to moderate for the KOOS-Quality of Life subscore (r = -0.698). No ceiling or floor effects were observed. The ACL-QOL-Sp showed a moderate effect size (0.73) at 4 months but a large effect size (1.70) at 9 months.ConclusionThe ACL-QOL-Sp showed adequate internal consistency, test-retest reliability, and responsiveness in evaluating quality of life after ACLR in Spanish-speaking patients.

Project description:BackgroundThe number of patients with chronic illness is increasing worldwide. These patients usually receive care from a primary care facility. The Patient Assessment of Chronic Illness Care (PACIC) is a tool that is increasingly used in several countries to measure how the patients perceive the care they receive. The goal of this validation study is to provide and validate an extended version of the tool, the PACIC+ questionnaire, in Thailand.MethodsIn this observational validation study, patients with type 2 diabetes from the outpatient clinic at a university hospital in Thailand completed the PACIC+ at the clinic. For follow-up, they received the questionnaire per mail after four weeks. The Thai PACIC+ comprises 26 items, which map onto 5 subscales and a summary score related to the Chronic Care Model (CCM) and 5 subscales and a summary score related to the 5A model, a counseling model for behavioral changes. Data-analysis focused on the use of most extreme answering categories (> 15%), internal consistency (Cronbach's alpha), and test-retest reliability. An exploratory factor analysis (EFA) was performed for the CCM and the 5A model separately to examine the factor structure.ResultsA total of 151 patients participated. The average age of the sample was 63 ± 9 years (range 29-86 years). Fifty-three percent of the respondents were female. In the Delivery System subscale, 20% of patients reported the highest possible value; in all other subscales, relative frequencies of the most extreme categories did not exceed 15%. Cronbach's alpha per subscale varied from 0.58 to 0.81, while that of the summary scores were 0.89 and 0.91. The mean difference from the test-retest varied from - 0.06 to 0.17 across subscales. The Kaiser-Meyer-Olkin criterion for sampling adequacy (KMO) was good for both models as well as the Bartlett's test for sphericity p. While the factor loadings in rotated factor solution showed good concordance with the CCM, concordance was not as good for the 5A model, especially for the subscales "Assess" and "Advice".ConclusionA validated Thai version of the PACIC+ is now available to measure how the patients perceive the care they receive.