Dataset Information

A user-centred evaluation framework for the Sealife semantic web browsers.

ABSTRACT:

Background

Semantically-enriched browsing has enhanced the browsing experience by providing contextualized dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure.

Methods

This paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system.

Results

It was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers.

Conclusion

Confirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.

SUBMITTER: Oliver H

PROVIDER: S-EPMC2755822 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMobile health (mHealth) has the potential to improve access to healthcare, especially in developing countries. The proliferation of mHealth has not been accompanied by a corresponding growth in design guidelines for mHealth applications. This paper proposes a framework for mHealth application design that combines the Information Systems Research (ISR) framework and design thinking. We demonstrate a use case for the proposed framework in the form of an app to read the result of the tuberculin skin test (TST), which is used to screen for latent tuberculosis infection. The framework was used in the re-design of the TST reading app but could also be used in earlier stages of mHealth app design.MethodsThe ISR framework and design thinking were merged based on how the modes of design thinking integrate with the cycles of the ISR framework. Using the combined framework, we re-designed an mHealth app for TST reading, intended to be used primarily in a developing context by healthcare workers. Using the proposed framework, the app was iterated upon and developed with the aid of personas, observations, prototyping and questionnaires.ResultThe combined framework was applied through engagement with end-users, namely ten healthcare workers and ten graduate students. Through review of the literature and iterations of the app prototype, we identified various usability requirements and limitations. These included challenges related to image capture and a misunderstanding of instructions. These insights influenced the development and improvement of the app.ConclusionThe combined framework allowed for engagement with end-users and for low-cost, rapid development of the app while addressing contextual challenges and needs. The integration of design thinking modes with the ISR cycles was effective in achieving the objectives of each approach. The combined framework acknowledges the importance of engaging users when implementing mHealth technologies, especially in developing and under-resourced contexts. Findings from this study support the use of this framework as a guide in the design of user-centred mHealth interventions.

Project description:BackgroundA main element of patient-centred care, Patient Decision Aids (PtDAs) facilitate shared decision-making (SDM). A recent update of the International Patient Decision Aids Standards (IPDAS) emphasised patient involvement during PtDA development, but omitted a methodology for doing so. This article reports on the value of user-centred design (UCD) methods for the development of a PtDA that aims to support inflammatory arthritis patients in their choice between disease modifying anti-rheumatic drugs (DMARDs).MethodsThe IPDAS development process model in combination with UCD methods were applied. The process was overseen by an eight-member multidisciplinary steering group. Patients and health professionals were iteratively consulted. Qualitative in-depth interviews combined with rapid prototyping were conducted with patients to assess their needs for specific functionality, content and design of the PtDA. Group meetings with health professionals were organized to assess patients' needs and to determine how the PtDA should be integrated into patient pathways. The current literature was reviewed to determine the clinical evidence to include in the PtDA. To evaluate usability among patients, they were observed using the PtDA while thinking aloud and then interviewed.ResultsThe combination of patient interviews with rapid prototyping revealed that patients wanted to compare multiple DMARDs both for their clinical aspects and implications for daily life. Health professionals mainly wanted to refer patients to a reliable, easily adjustable source of information about DMARDs. A web-based PtDA was constructed consisting of four parts: 1) general information about SDM, inflammatory arthritis and DMARDs; 2) an application to compare particular DMARDs; 3) value clarification exercises; and 4) a printed summary of patients' notes, preferences, worries and questions that they could bring to discuss with their rheumatologist.ConclusionsThe study demonstrated that UCD methods can be of great value for the development of PtDAs. The early, iterative involvement of patients and health professionals was helpful in developing a novel user-friendly PtDA that allowed patients to choose between DMARDs. The PtDA fits the values of all stakeholders and easily integrates with the patient pathway and daily workflow of health professionals. This collaborative designed PtDA may improve SDM and patient participation in arthritis care.