Running online experiments using web-conferencing software
Ontology highlight
ABSTRACT: Supplementary Information
The online version contains supplementary material available at 10.1007/s40881-021-00112-w.
SUBMITTER: Li J
PROVIDER: S-EPMC8649685 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Background Online focus groups have been increasing in use over the last 2 decades, including in biomedical and health-related research. However, most of this research has made use of text-based services such as email, discussion boards, and chat rooms, which do not replicate the experience of face-to-face focus groups. Web conferencing services have the potential to more closely match the face-to-face focus group experience, including important visual and aural cues. This paper provides critical reflections on using a web conferencing service to conduct online focus groups. Methods As part of a broader study, we conducted both online and face-to-face focus groups with participants. The online groups were conducted in real-time using the web conferencing service, Blackboard Collaborate TM. We used reflective practice to assess how the conduct and content of the groups were similar and how they differed across the two platforms. Results We found that further research using such services is warranted, particularly when working with hard-to-reach or geographically dispersed populations. The level of discussion and the quality of the data obtained was similar to that found in face-to-face groups. However, some issues remain, particularly in relation to managing technical issues experienced by participants and ensuring adequate recording quality to facilitate transcription and analysis. Conclusions Our experience with using web conferencing for online focus groups suggests that they have the potential to offer a realistic and comparable alternative to face-to-face focus groups, especially for geographically dispersed populations such as rural and remote health practitioners. Further testing of these services is warranted but researchers should carefully consider the service they use to minimise the impact of technical difficulties.
| S-EPMC5527981 | biostudies-literature
Project description:Performing online behavioral research is gaining increased popularity among researchers in psychological and cognitive science. However, the currently available methods for conducting online reaction time experiments are often complicated and typically require advanced technical skills. In this article, we introduce the Qualtrics Reaction Time Engine (QRTEngine), an open-source JavaScript engine that can be embedded in the online survey development environment Qualtrics. The QRTEngine can be used to easily develop browser-based online reaction time experiments with accurate timing within current browser capabilities, and it requires only minimal programming skills. After introducing the QRTEngine, we briefly discuss how to create and distribute a Stroop task. Next, we describe a study in which we investigated the timing accuracy of the engine under different processor loads using external chronometry. Finally, we show that the QRTEngine can be used to reproduce classic behavioral effects in three reaction time paradigms: a Stroop task, an attentional blink task, and a masked-priming task. These findings demonstrate that QRTEngine can be used as a tool for conducting online behavioral research even when this requires accurate stimulus presentation times.
| S-EPMC4636512 | biostudies-literature
Project description:Business researchers use experimental methods extensively due to their high internal validity. However, controlled laboratory and crowdsourcing settings often introduce issues of artificiality, data contamination, and low managerial relevance of the dependent variables. Field experiments can overcome these issues but are traditionally time- and resource-consuming. This primer presents an alternative experimental setting to conduct online field experiments in a time- and cost-effective way. It does so by introducing the Facebook A/B split test functionality, which allows for random assignment of manipulated variables embedded in ecologically-valid stimuli. We compare and contrast this method against laboratory settings and Amazon Mechanical Turk in terms of design flexibility, managerial relevance, data quality control, and sample representativeness. We then provide an empirical demonstration of how to set up, pre-test, run, and analyze FBST experiments.
| S-EPMC7331542 | biostudies-literature
Project description:BackgroundVISPR is an interactive visualization and analysis framework for CRISPR screening experiments. However, it only supports the output of MAGeCK, and requires installation and manual configuration. Furthermore, VISPR is designed to run on a single computer, and data sharing between collaborators is challenging.ResultsTo make the tool easily accessible to the community, we present VISPR-online, a web-based general application allowing users to visualize, explore, and share CRISPR screening data online with a few simple steps. VISPR-online provides an exploration of screening results and visualization of read count changes. Apart from MAGeCK, VISPR-online supports two more popular CRISPR screening analysis tools: BAGEL and JACKS. It provides an interactive environment for exploring gene essentiality, viewing guide RNA (gRNA) locations, and allowing users to resume and share screening results.ConclusionsVISPR-online allows users to visualize, explore and share CRISPR screening data online. It is freely available at http://vispr-online.weililab.org , while the source code is available at https://github.com/lemoncyb/VISPR-online .
| S-EPMC8223366 | biostudies-literature
Project description:Problem-based learning (PBL) has been effectively used within BME education, though there are several challenges in its implementation within courses with larger enrollments. Furthermore, the sudden transition to online learning from the COVID-19 pandemic introduced additional challenges in creating a similar PBL experience in an online environment. Online constrained PBL was implemented through asynchronous modules and synchronous web conferencing with rotating facilitators. Overall, facilitators perceived web conferencing facilitation to be similar to in-person, but noted that students were more easily “hidden” or distracted. Students did not comment on web conferencing facilitation specifically, but indicated the transition to online PBL was smooth. Course instructors identified that a fully synchronous delivery as well as modifications of Group Meeting Minutes assignments as potential modifications for future offerings. Future work will aim to address the perceptions and effectiveness of web conferencing facilitation for PBL courses within an undergraduate BME curriculum, as web conferencing could prove to be another significant breakthrough in addressing challenges of problem-based learning courses.
| S-EPMC7466918 | biostudies-literature
Project description:BackgroundWhile web conferencing technologies are being widely used in communication and collaboration, their uptake in conducting research field work has been relatively slow. The benefits that these technologies offer researchers for engaging with hard-to-reach populations are beginning to be recognised, however, the acceptability and feasibility of using web conferencing technology to engage Aboriginal and Torres Strait Islander young people in research is unknown.ObjectiveThis study aims to evaluate whether the use of web conferencing to engage Aboriginal and Torres Strait Islander young people in research is an acceptable and feasible alternative to conventional face-to-face methods.MethodsAboriginal and Torres Strait Islander young people aged between 18 and 24 years were recruited via emails, flyers and snowballing to participate in an Online Yarning Circle (OYC) about wellbeing conducted via web conferencing. Five young Aboriginal and Torres Strait Islander Australians were trained as peer facilitators and each conducted one or more OYCs with support from an experienced Aboriginal and Torres Strait Islander researcher. The OYCs were recorded and the researchers conducted post-OYC interviews with the facilitators. OYC recordings, facilitator interviews and researchers' reflections about the method were analysed to assess acceptability and feasibility for use with this population.Results11 OYCs were conducted with 21 participants. The evaluation focused on (a) acceptability of the method for participants and facilitators and (b) feasibility of data collection method and procedures for use in research. Our evaluation revealed good acceptability and feasibility of the method, with only minor challenges experienced, which were predominantly logistical in nature and related to scheduling, obtaining documentation of consent, and technical issues. These challenges were offset by the greater control over the level of engagement that was comfortable for individual participants and the greater ease with which they felt they could withdraw from participating. This shift in the traditional researcher-participant power dynamic was recognised by both participants and peer facilitators and was regarded as a support for Aboriginal and Torres Strait Islander young people's participation in research.ConclusionsThe use of web conferencing to engage Aboriginal and Torres Strait Islander young people in research offers an acceptable and feasible alternative to face-to-face research methods. The benefits conferred by these technologies associated with yielding greater control and power to the research participant has broad relevance to research with marginalised populations.
| S-EPMC8369329 | biostudies-literature
Project description:Selecting the appropriate Woven EndoBridge (WEB) device sizing for the treatment of wide-neck bifurcation aneurysms (WNBAs) remains challenging. The aim of this study was to evaluate different volumetric-based imaging methodologies to predict an accurate WEB device size selection to result in a successful implantation. All consecutive patients treated with WEB devices for intracranial aneurysms from January 2019 to June 2020 were included. Aneurysm dimensions to calculate aneurysm volumes were measured using three different modalities: automated three-dimensional (3D) digital subtraction angiography (DSA), manual 3D DSA, and two-dimensional (2D) DSA. The device-aneurysm volume (DAV) ratio was defined as device volume divided by the aneurysm volume. WEB volumes and the DAV ratios were used for assessing the device implantation success and follow-up angiographic outcomes at six months. Pearson correlation, Wilcoxon Rank Sum test, and density approximations were used for estimating the WEB volumes and the imaging modality volumes for successful implantation. A total of 41 patients with 43 aneurysms were included in the study. WEB device and aneurysm volume correlation coefficient was highest for 3D automatic (r = 0.943), followed by 3D manual (r = 0.919), and 2D DSA (r = 0.882) measurements. Measured median volumes were significantly different for 3D automatic and 2D DSA (p = 0.017). The highest rate of successful implantation (87.5%) was between 0.6 and 0.8 DAV ratio. Pre-procedural assessment of DAV ratios may increase WEB device implantation success. Our results suggest that volumetric measurements, especially using automated 3D volumes of the aneurysms, can assist in accurate WEB device size selection.
| S-EPMC8307121 | biostudies-literature
Project description:Online labor markets provide new opportunities for behavioral research, but conducting economic experiments online raises important methodological challenges. This particularly holds for interactive designs. In this paper, we provide a methodological discussion of the similarities and differences between interactive experiments conducted in the laboratory and online. To this end, we conduct a repeated public goods experiment with and without punishment using samples from the laboratory and the online platform Amazon Mechanical Turk. We chose to replicate this experiment because it is long and logistically complex. It therefore provides a good case study for discussing the methodological and practical challenges of online interactive experimentation. We find that basic behavioral patterns of cooperation and punishment in the laboratory are replicable online. The most important challenge of online interactive experiments is participant dropout. We discuss measures for reducing dropout and show that, for our case study, dropouts are exogenous to the experiment. We conclude that data quality for interactive experiments via the Internet is adequate and reliable, making online interactive experimentation a potentially valuable complement to laboratory studies.
| S-EPMC5807491 | biostudies-literature
Project description:Gross domestic product (GDP) and derived metrics such as productivity have been central to our understanding of economic progress and well-being. In principle, changes in consumer surplus provide a superior, and more direct, measure of changes in well-being, especially for digital goods. In practice, these alternatives have been difficult to quantify. We explore the potential of massive online choice experiments to measure consumer surplus. We illustrate this technique via several empirical examples which quantify the valuations of popular digital goods and categories. Our examples include incentive-compatible discrete-choice experiments where online and laboratory participants receive monetary compensation if and only if they forgo goods for predefined periods. For example, the median user needed a compensation of about $48 to forgo Facebook for 1 mo. Our overall analyses reveal that digital goods have created large gains in well-being that are not reflected in conventional measures of GDP and productivity. By periodically querying a large, representative sample of goods and services, including those which are not priced in existing markets, changes in consumer surplus and other new measures of well-being derived from these online choice experiments have the potential for providing cost-effective supplements to the existing national income and product accounts.
| S-EPMC6462102 | biostudies-literature
Project description:This work presents sPyNNaker 4.0.0, the latest version of the software package for simulating PyNN-defined spiking neural networks (SNNs) on the SpiNNaker neuromorphic platform. Operations underpinning realtime SNN execution are presented, including an event-based operating system facilitating efficient time-driven neuron state updates and pipelined event-driven spike processing. Preprocessing, realtime execution, and neuron/synapse model implementations are discussed, all in the context of a simple example SNN. Simulation results are demonstrated, together with performance profiling providing insights into how software interacts with the underlying hardware to achieve realtime execution. System performance is shown to be within a factor of 2 of the original design target of 10,000 synaptic events per millisecond, however SNN topology is shown to influence performance considerably. A cost model is therefore developed characterizing the effect of network connectivity and SNN partitioning. This model enables users to estimate SNN simulation performance, allows the SpiNNaker team to make predictions on the impact of performance improvements, and helps demonstrate the continued potential of the SpiNNaker neuromorphic hardware.
| S-EPMC6257411 | biostudies-literature