A User-centred Analysis of Explanations for a Multi-component Semantic Parser
Ontology highlight
ABSTRACT:
SUBMITTER: Metais E
PROVIDER: S-EPMC7298187 | biostudies-literature | 2020 May
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundSemantically-enriched browsing has enhanced the browsing experience by providing contextualized dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure.MethodsThis paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system.ResultsIt was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers.ConclusionConfirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.
| S-EPMC2755822 | biostudies-literature
Project description:BackgroundMobile health (mHealth) has the potential to improve access to healthcare, especially in developing countries. The proliferation of mHealth has not been accompanied by a corresponding growth in design guidelines for mHealth applications. This paper proposes a framework for mHealth application design that combines the Information Systems Research (ISR) framework and design thinking. We demonstrate a use case for the proposed framework in the form of an app to read the result of the tuberculin skin test (TST), which is used to screen for latent tuberculosis infection. The framework was used in the re-design of the TST reading app but could also be used in earlier stages of mHealth app design.MethodsThe ISR framework and design thinking were merged based on how the modes of design thinking integrate with the cycles of the ISR framework. Using the combined framework, we re-designed an mHealth app for TST reading, intended to be used primarily in a developing context by healthcare workers. Using the proposed framework, the app was iterated upon and developed with the aid of personas, observations, prototyping and questionnaires.ResultThe combined framework was applied through engagement with end-users, namely ten healthcare workers and ten graduate students. Through review of the literature and iterations of the app prototype, we identified various usability requirements and limitations. These included challenges related to image capture and a misunderstanding of instructions. These insights influenced the development and improvement of the app.ConclusionThe combined framework allowed for engagement with end-users and for low-cost, rapid development of the app while addressing contextual challenges and needs. The integration of design thinking modes with the ISR cycles was effective in achieving the objectives of each approach. The combined framework acknowledges the importance of engaging users when implementing mHealth technologies, especially in developing and under-resourced contexts. Findings from this study support the use of this framework as a guide in the design of user-centred mHealth interventions.
| S-EPMC7444488 | biostudies-literature
Project description:The purpose of this study was to explore a range of perspectives on how academic research and clinical assessment of upper-limb prosthetics could happen in environments outside of laboratories and clinics, such as within peoples' homes. Two co-creation workshops were held, which included people who use upper limb prosthetic devices (hereafter called users), clinicians, academics, a policy stakeholder, and a representative from the upper-limb prosthetics industry (hereafter called professionals). The discussions during the workshops indicate that research and clinical assessment conducted remotely from a laboratory or clinic could inform future solutions that address user needs. Users were open to the idea of sharing sensor and contextual data from within their homes to external laboratories during research studies. However, this was dependent upon several considerations, such as choice and control over data collection. Regarding clinical assessment, users had reservations of how data may be used to inform future prosthetic prescriptions whilst, clinicians were concerned with resource implications and capacity to process user data. The paper presents findings of the discussions shared by participants during both workshops. The paper concludes with a conjecture that collecting sensor and contextual data from users within their home environment will contribute towards literature within the field, and potentially inform future care policies for upper limb prosthetics. The involvement of users during such studies will be critical and can be enabled via a co-creation approach. In the short term, this may be achieved through academic research studies, which may in the long term inform a framework for clinical in-home trials and clinical remote assessment.
| S-EPMC9048479 | biostudies-literature
Project description:Using low-cost portable air quality (AQ) monitoring devices is a growing trend in personal exposure studies, enabling a higher spatio-temporal resolution and identifying acute exposure to high concentrations. Comprehension of the results by participants is not guaranteed in exposure studies. However, information on personal exposure is multiplex, which calls for participant involvement in information design to maximise communication output and comprehension. This study describes and proposes a model of a user-centred design (UCD) approach for preparing a final report for participants involved in a multi-sensor personal exposure monitoring study performed in seven cities within the EU Horizon 2020 ICARUS project. Using a combination of human-centred design (HCD), human-information interaction (HII) and design thinking approaches, we iteratively included participants in the framing and design of the final report. User needs were mapped using a survey (n = 82), and feedback on the draft report was obtained from a focus group (n = 5). User requirements were assessed and validated using a post-campaign survey (n = 31). The UCD research was conducted amongst participants in Ljubljana, Slovenia, and the results report was distributed among the participating cities across Europe. The feedback made it clear that the final report was well-received and helped participants better understand the influence of individual behaviours on personal exposure to air pollution.
| S-EPMC8656880 | biostudies-literature
Project description:Background:Isolation precautions are intended to prevent transmission of infectious agents, yet healthcare provider (HCP) adherence remains suboptimal. This may be due to ambiguity regarding the required precautions or to cognitive overload of HCPs. In response to the challenge of changing HCP behaviour, increasing attention should be paid to the role of engineering controls and facility design that incorporate human factors elements. In the current study, we aimed to develop an isolation precaution signage system that provides visual cues, serves as a cognitive aid at the point of care, and removes ambiguity regarding which precautions are necessary (e.g. masks, gowns, gloves, single rooms) when caring for isolated patients. Methods:We employed a user-centred, participatory design approach in which HCPs were actively involved in generating an isolation precaution signage system based on human factors design principles. HCPs were purposefully sampled for each design phase to include a representative sample of potential system users. We conducted front-end analysis through interviews and observations to identify challenges related to the existing signage and to establish design requirements for new signage. This was followed by the creation of user personas, design thinking workshops, and prototyping, which then underwent iterative cycles of evaluation. Graphical symbols were developed and tested for comprehensibility. Results:Front-end analysis revealed several barriers to use of the current signage system such as unclear target audience, low signal-to-noise ratio, and ambiguity regarding the applicable precautions. A comprehensive list of design requirements was generated. The project ultimately resulted in a collection of validated, comprehensible symbols and signs for contact, droplet, and airborne isolation, as well as the identification of several systems-level solutions for work re-organisation to improve compliance with isolation precautions. Conclusions:The introduction of visual cues in the form of signage offers a promising opportunity to make guidelines available directly at the frontline. Anecdotal evidence based on observations and interviews with HCP have shown that the current solution is superior to previous isolation signage. User-centred participatory design was a useful approach that holds potential for further improving design in healthcare settings.
| S-EPMC6862753 | biostudies-literature
Project description:BackgroundAs the demand for nursing home (NH) services increases, older adults and their families expect exceptional services. Neighbourhood Team Development (NTD) is a multi-component intervention designed to train team members (staff) in the implementation of resident-centered care in NH settings. A neighbourhood is a 32-resident home area within a NH. This paper presents the protocol used to implement and evaluate NTD. The evaluation aimed to 1) examine fidelity with which the NTD was implemented across NHs; 2) explore contextual factors associated with implementation and outcomes of the NTD; and 3) examine effects of NTD on residents, team members, family, and organizational outcomes, and the association between level of implementation fidelity and outcomes.MethodsThe study employed a repeated measure, mixed method design. NTD consisted of a 30-month standardised training and implementation plan to modify the physical environment, organize delivery and services and align staff members to promote inter-professional team collaboration and enhanced resident centeredness. Training was centred in each 32-resident neighbourhood or home area. Quantitative and qualitative data were collected with reliable and valid measures over the course of 3 years from residents (clinical outcomes, quality of life, satisfaction with care, perception of person centeredness, opportunities for social engagement), families (satisfaction with care for relative, person centeredness, relationship opportunities), team members (satisfaction with job, ability to provide person centered care, team relationships) and organizations (retention, turnover, staffing, events) in 6 NHs. Mixed models were used for the analysis.DiscussionThe advantages and limitations of the NTD intervention are described. The challenges in implementing and evaluating this multi-component intervention are discussed as related to the complexity of the NH environment.Trial registrationClinicalTrials.gov ID: NCT03415217 (January 30, 2018 - Retrospectively registered).
| S-EPMC6889341 | biostudies-literature
Project description:Persona development techniques are a well-established method to create relatable descriptions of representatives of target users of digital systems. In the field of education, research on learner characteristics has yielded comprehensive results that can help advance educational approaches. Nonetheless, these results often remain abstract and distant for researchers and practitioners. Personas offer a bridge to make this knowledge more accessible and to facilitate user-centred design processes. This study focuses on creating personas of mathematics school students to ease such accessibility. These personas are constructed based on an understanding of learners' goals, needs, challenges and problems, joys, fears, feelings and emotions, and strategies. Data collection was conducted through a multifaceted approach, encompassing qualitative and quantitative data from web surveys, think-aloud protocols, and interviews. The target demographic comprised upper secondary school mathematics students in Austria. We found five distinct patterns of characteristics prevalent in this target group. The patterns of characteristics reflected by the personas complement the scientific body of knowledge obtained from traditional approaches investigating characteristics and needs of learners. In practical terms, these personas empower the development of user-centred digital systems, learning materials, and lessons, thus fostering an enriched educational experience for mathematics students.
| S-EPMC10827463 | biostudies-literature
Project description:MotivationRecent advances in computational methods have facilitated large-scale sampling of protein structures, leading to breakthroughs in protein structural prediction and enabling de novo protein design. Establishing methods to identify candidate structures that can lead to native folds or designable structures remains a challenge, since few existing metrics capture high-level structural features such as architectures, folds and conformity to conserved structural motifs. Convolutional Neural Networks (CNNs) have been successfully used in semantic segmentation-a subfield of image classification in which a class label is predicted for every pixel. Here, we apply semantic segmentation to protein structures as a novel strategy for fold identification and structure quality assessment.ResultsWe train a CNN that assigns each residue in a multi-domain protein to one of 38 architecture classes designated by the CATH database. Our model achieves a high per-residue accuracy of 90.8% on the test set (95.0% average per-class accuracy; 87.8% average per-structure accuracy). We demonstrate that individual class probabilities can be used as a metric that indicates the degree to which a randomly generated structure assumes a specific fold, as well as a metric that highlights non-conformative regions of a protein belonging to a known class. These capabilities yield a powerful tool for guiding structural sampling for both structural prediction and design.Availability and implementationThe trained classifier network, parser network, and entropy calculation scripts are available for download at https://git.io/fp6bd, with detailed usage instructions provided at the download page. A step-by-step tutorial for setup is provided at https://goo.gl/e8GB2S. All Rosetta commands, RosettaRemodel blueprints, and predictions for all datasets used in the study are available in the Supplementary Information.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC7075530 | biostudies-literature
Project description:BackgroundTheoretically semantic processing can be separated into early automatic semantic activation and late contextualization. Semantic processing deficits have been suggested in patients with schizophrenia, however it is not clear which stage of semantic processing is impaired. We attempted to clarify this issue by conducting a meta-analysis of the N400 component.MethodsTwenty-one studies met the inclusion criteria for the meta-analysis procedure. The Comprehensive Meta-Analysis software package was used to compute pooled effect sizes and homogeneity.ResultsStudies favoring early automatic activation produced a significant effect size of -0.41 for the N400 effect. Studies favoring late contextualization generated a significant effect size of -0.36 for the N400 effect, a significant effect size of -0.52 for N400 for congruent/related target words, and a significant effect size of 0.82 for the N400 peak latency.ConclusionThese findings suggest the automatic spreading activation process in patients with schizophrenia is very similar for closely related concepts and weakly or remotely related concepts, while late contextualization may be associated with impairments in processing semantically congruent context accompanied by slow processing speed.
| S-EPMC3192062 | biostudies-literature
Project description:A set of cortical and sub-cortical brain structures has been linked with sentence-level semantic processes. However, it remains unclear how these brain regions are organized to support the semantic integration of a word into sentential context. To look into this issue, we conducted a functional magnetic resonance imaging (fMRI) study that required participants to silently read sentences with semantically congruent or incongruent endings and analyzed the network properties of the brain with two approaches, independent component analysis (ICA) and graph theoretical analysis (GTA). The GTA suggested that the whole-brain network is topologically stable across conditions. The ICA revealed a network comprising the supplementary motor area (SMA), left inferior frontal gyrus, left middle temporal gyrus, left caudate nucleus, and left angular gyrus, which was modulated by the incongruity of sentence ending. Furthermore, the GTA specified that the connections between the left SMA and left caudate nucleus as well as that between the left caudate nucleus and right thalamus were stronger in response to incongruent vs. congruent endings.
| S-EPMC6869055 | biostudies-literature