Dataset Information

Measuring Mental Effort for Creating Mobile Data Collection Applications.

ABSTRACT: To deal with drawbacks of paper-based data collection procedures, the QuestionSys approach empowers researchers with none or little programming knowledge to flexibly configure mobile data collection applications on demand. The mobile application approach of QuestionSys mainly pursues the goal to mitigate existing drawbacks of paper-based collection procedures in mHealth scenarios. Importantly, researchers shall be enabled to gather data in an efficient way. To evaluate the applicability of QuestionSys, several studies have been carried out to measure the efforts when using the framework in practice. In this work, the results of a study that investigated psychological insights on the required mental effort to configure the mobile applications are presented. Specifically, the mental effort for creating data collection instruments is validated in a study with N = 80 participants across two sessions. Thereby, participants were categorized into novices and experts based on prior knowledge on process modeling, which is a fundamental pillar of the developed approach. Each participant modeled 10 instruments during the course of the study, while concurrently several performance measures are assessed (e.g., time needed or errors). The results of these measures are then compared to the self-reported mental effort with respect to the tasks that had to be modeled. On one hand, the obtained results reveal a strong correlation between mental effort and performance measures. On the other, the self-reported mental effort decreased significantly over the course of the study, and therefore had a positive impact on measured performance metrics. Altogether, this study indicates that novices with no prior knowledge gain enough experience over the short amount of time to successfully model data collection instruments on their own. Therefore, QuestionSys is a helpful instrument to properly deal with large-scale data collection scenarios like clinical trials.

SUBMITTER: Schobel J

PROVIDER: S-EPMC7084515 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring Mental Effort for Creating Mobile Data Collection Applications.

Schobel Johannes J Probst Thomas T Reichert Manfred M Schlee Winfried W Schickler Marc M Kestler Hans A HA Pryss Rüdiger R

International journal of environmental research and public health 20200303 5

To deal with drawbacks of paper-based data collection procedures, the QuestionSys approach empowers researchers with none or little programming knowledge to flexibly configure mobile data collection applications on demand. The mobile application approach of QuestionSys mainly pursues the goal to mitigate existing drawbacks of paper-based collection procedures in mHealth scenarios. Importantly, researchers shall be enabled to gather data in an efficient way. To evaluate the applicability of Quest ...[more]

PMID: 32138381

Similar Datasets

Project description:ImportanceChild-directed mobile applications (apps) have been found to collect digital identifiers and transmit them to third-party companies, a potential violation of federal privacy rules. This study seeks to examine the differences in app data collection and sharing practices by evaluating the sociodemographic characteristics of the children who play them.ObjectiveTo examine data collection and sharing practices of 451 apps played by young children and to test associations with child sociodemographic characteristics.Design, setting, and participantsThis study used data from the baseline phase of the Preschooler Tablet Study, a prospective cohort study conducted from August 2018 to January 2020. This study used a population-based sample. A convenience sample of the parents of preschool-aged children was recruited from pediatric offices, childcare centers, social media posts, and an online participant registry. Eligibility criteria included (1) parent or guardian of a child aged 3 to 5 years, (2) parent or guardian who lived with the child at least 5 days per week, (3) participants who spoke English, and (4) a child who used an Android (Google LLC) device. All interactions with participants were through email, online surveys, and mobile device sampling.ExposuresSociodemographic characteristics were assessed by parental report.Main outcomes and measuresThis study tested the hypothesis that data transmissions to third-party domains are more common in apps played by children from low-socioeconomic-status homes. Child app usage was assessed via a mobile sampling app for an average of 9 days. Persistent identifier data transmissions to third-party domains were quantified for each app using an instrumented Android environment with monitoring of network traffic; for each child, the counts of total data transmissions were calculated, and the total third-party domains were detected for the apps they played.ResultsOur sample comprised 124 children who used Android devices (35 tablets, 89 smartphones; 65 girls [52%]; mean [SD] age, 3.85 [0.57] years; 87 non-Hispanic White [71%]). One hundred twenty of participating parents (97%) were women. Of 451 apps tested, 303 (67%) transmitted persistent identifiers to 1 to 33 third-party domains. Child data transmission counts ranged from 0 to 614 (median [interquartile range], 5.0 [1-17.5]) and third-party domain counts from 0 to 399 (4.0 [1-12.5]). In multivariable negative binomial regression models, higher transmission and third-party domain rates per app were positively associated with older age (rate ratio, 1.67 [95% CI, 1.20-2.33]; P = .002 and 1.69 [95% CI, 1.26-2.27]; P < .001, respectively) and lower parent educational attainment (eg, high school or General Educational Development or less rate ratio, 2.29 [95% CI, 1.20-4.39]; P = .003 and 2.05 [95% CI, 1.13-3.70]; P < .02, respectively), but not with household income.Conclusions and relevanceThis study found that apps used by young children had a high frequency of persistent identifier transmissions to third-party companies, suggesting that federal privacy rules are not being enforced. Older children, those with their own devices, or those from lower-education households may be at higher risk of potential privacy violations.

Project description:mHealth researchers can now collect a wealth of data using “life tracking apps” (LTAs), which are smartphone applications that use mobile sensing to capture and summarise a multitude of data channels (e.g., location, movement, keyword use, sleep, exercise, and so on). The combined wealth of information can create digital signatures of individuals, which hold immense promise for mental health research and interventions by allowing new insights into moment-to-moment changes in behaviour and mental states. However, little is known about what a common research demographic (university students) thinks about these apps and what might factor into their decisions to participate in research using a LTA. This qualitative study ran five focus group sessions (21 students in total) to explore students’ experiences, beliefs, and opinions about LTAs to generate insights into what would make them more or less likely to participate in research involving LTAs. Transcripts were coded and examined for categories using qualitative content analysis. Important categories that emerged were privacy (although this varied based on the individual and data being collected), data security, inconvenience, intrusiveness, financial compensation, and the perceived nature of the research team responsible. On the basis of these categories, we derived seven key insights to increase student participation in research using LTAs: strengthen and communicate privacy and data security, design the app to be as convenient as possible to users, maximise passive data collection, think cautiously before tracking data perceived as “creepy” such as messages, offer suitable financial compensation, be transparent about goals and justification for data being collection to build trust, and attract participants by highlighting how the app can help them achieve their goals. With these insights, mHealth researchers can maximise their participant pool and improve this nascent and promising field.

Project description:BackgroundThere is a need for valid approaches to measure sexual interactions to assess the impact of behavioural interventions and to predict the impact of behaviour changes. Different methods of asking about sexual behaviour often yield conflicting answers and men often report higher levels of heterosexual activity than women. To better understand self-reported sexual behaviour data and how best to collect it, we analyzed data collected as part of a larger project (ST IMPACTS) on the social and behavioural impact of introducing community-level HIV self-testing (HIVST) with counseling (semi-supervised with pre- and generic post-test counseling provided on delivery or collection of test kits) in an urban Malawian setting.MethodsInformation on sexual behaviour was collected from HIV self-testers over a three-month period. Three different methods were used: retrospective face-to-face interviews (FTFI); audio computer assisted self-interviews (ACASI) and a prospective coital diary. Both retrospective instruments were used before and after the three-month study period. Frequency and cross-tabulation, as well as scatterplots, were used for exploratory analyses. Chi-square tests were used to test for differences in proportions. Spearman's correlation coefficient was used to explore associations between both continuous and ordinal variables and Wilcoxon's paired sample and Mann-Whitney test was used to test for differences in such variables or between variables.ResultsThere was reasonable agreement between the two retrospective methods although both yielded inconsistent answers e.g. with lower reported numbers of life-time sexual partners at the end than at the beginning of the study period. The diary method elicited higher reported levels of sex with multiple partners than both retrospective instruments which may be due to inadequate recall. Over the study period 37.4% of men and 19.7% of women reported multiple sexual partners using the diary. There was no clear relationship between reported sexual behaviour and HIV status (prevalence 9.6%).ConclusionsDiaries may therefore have higher validity for sensitive behaviour reporting and thus be the preferred method in similar African contexts in measuring sexual behaviours.

Project description:BACKGROUND:Mobile data collection systems are often difficult to use for nontechnical or novice users. This can be attributed to the fact that developers of such tools do not adequately involve end users in the design and development of product features and functions, which often creates interaction challenges. OBJECTIVE:The main objective of this study was to assess the guidelines for form design using high-fidelity prototypes developed based on end-user preferences. We also sought to investigate the association between the results from the System Usability Scale (SUS) and those from the Study Tailored Evaluation Questionnaire (STEQ) after the evaluation. In addition, we sought to recommend some practical guidelines for the implementation of the group testing approach particularly in low-resource settings during mobile form design. METHODS:We developed a Web-based high-fidelity prototype using Axure RP 8. A total of 30 research assistants (RAs) evaluated this prototype in March 2018 by completing the given tasks during 1 common session. An STEQ comprising 13 affirmative statements and the commonly used and validated SUS were administered to evaluate the usability and user experience after interaction with the prototype. The STEQ evaluation was summarized using frequencies in an Excel sheet while the SUS scores were calculated based on whether the statement was positive (user selection minus 1) or negative (5 minus user selection). These were summed up and the score contributions multiplied by 2.5 to give the overall form usability from each participant. RESULTS:Of the RAs, 80% (24/30) appreciated the form progress indication, found the form navigation easy, and were satisfied with the error messages. The results gave a SUS average score of 70.4 (SD 11.7), which is above the recommended average SUS score of 68, meaning that the usability of the prototype was above average. The scores from the STEQ, on the other hand, indicated a 70% (21/30) level of agreement with the affirmative evaluation statements. The results from the 2 instruments indicated a fair level of user satisfaction and a strong positive association as shown by the Pearson correlation value of .623 (P<.01). CONCLUSIONS:A high-fidelity prototype was used to give the users experience with a product they would likely use in their work. Group testing was done because of scarcity of resources such as costs and time involved especially in low-income countries. If embraced, this approach could help assess user needs of the diverse user groups. With proper preparation and the right infrastructure at an affordable cost, usability testing could lead to the development of highly usable forms. The study thus makes recommendations on the practical guidelines for the implementation of the group testing approach particularly in low-resource settings during mobile form design.

Dataset Information

Measuring Mental Effort for Creating Mobile Data Collection Applications.

Publications

Measuring Mental Effort for Creating Mobile Data Collection Applications.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets