Dataset Information

Development of the AGREE II, part 1: performance, usefulness and areas for improvement.

ABSTRACT:

Background

We undertook research to improve the AGREE instrument, a tool used to evaluate guidelines. We tested a new seven-point scale, evaluated the usefulness of the original items in the instrument, investigated evidence to support shorter, tailored versions of the tool, and identified areas for improvement.

Method

We report on one component of a larger study that used a mixed design with four factors (user type, clinical topic, guideline and condition). For the analysis reported in this article, we asked participants to read a guideline and use the AGREE items to evaluate it based on a seven-point scale, to complete three outcome measures related to adoption of the guideline, and to provide feedback on the instrument's usefulness and how to improve it.

Results

Guideline developers gave lower-quality ratings than did clinicians or policy-makers. Five of six domains were significant predictors of participants' outcome measures (p < 0.05). All domains and items were rated as useful by stakeholders (mean scores > 4.0) with no significant differences by user type (p > 0.05). Internal consistency ranged between 0.64 and 0.89. Inter-rater reliability was satisfactory. We received feedback on how to improve the instrument.

Interpretation

Quality ratings of the AGREE domains were significant predictors of outcome measures associated with guideline adoption: guideline endorsements, overall intentions to use guidelines, and overall quality of guidelines. All AGREE items were assessed as useful in determining whether a participant would use a guideline. No clusters of items were found more useful by some users than others. The measurement properties of the seven-point scale were promising. These data contributed to the refinements and release of the AGREE II.

SUBMITTER: Brouwers MC

PROVIDER: S-EPMC2900328 | biostudies-literature | 2010 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of the AGREE II, part 1: performance, usefulness and areas for improvement.

Brouwers Melissa C MC Kho Michelle E ME Browman George P GP Burgers Jako S JS Cluzeau Francoise F Feder Gene G Fervers Béatrice B Graham Ian D ID Hanna Steven E SE Makarski Julie J

CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne 20100531 10

<h4>Background</h4>We undertook research to improve the AGREE instrument, a tool used to evaluate guidelines. We tested a new seven-point scale, evaluated the usefulness of the original items in the instrument, investigated evidence to support shorter, tailored versions of the tool, and identified areas for improvement.<h4>Method</h4>We report on one component of a larger study that used a mixed design with four factors (user type, clinical topic, guideline and condition). For the analysis repor ...[more]

PMID: 20513780

Similar Datasets

Project description:When musicians improvise freely together-not following any sort of script, predetermined harmonic structure, or "referent"-to what extent do they understand what they are doing in the same way as each other? And to what extent is their understanding privileged relative to outside listeners with similar levels of performing experience in free improvisation? In this exploratory case study, a saxophonist and a pianist of international renown who knew each other's work but who had never performed together before were recorded while improvising freely for 40 min. Immediately afterwards the performers were interviewed separately about the just-completed improvisation, first from memory and then while listening to two 5 min excerpts of the recording in order to prompt specific and detailed commentary. Two commenting listeners from the same performance community (a saxophonist and drummer) listened to, and were interviewed about, these excerpts. Some months later, all four participants rated the extent to which they endorsed 302 statements that had been extracted from the four interviews and anonymized. The findings demonstrate that these free jazz improvisers characterized the improvisation quite differently, selecting different moments to comment about and with little overlap in the content of their characterizations. The performers were not more likely to endorse statements by their performing partner than by a commenting listener from the same performance community, and their patterns of agreement with each other (endorsing or dissenting with statements) across multiple ratings-their interrater reliability as measured with Cohen's kappa-was only moderate, and not consistently higher than their agreement with the commenting listeners. These performers were more likely to endorse statements about performers' thoughts and actions than statements about the music itself, and more likely to endorse evaluatively positive than negative statements. But these kinds of statements were polarizing; the performers were more likely to agree with each other in their ratings of statements about the music itself and negative statements. As in Schober and Spiro (2014), the evidence supports a view that fully shared understanding is not needed for joint improvisation by professional musicians in this genre and that performing partners can agree with an outside listener more than with each other.

Dataset Information

Development of the AGREE II, part 1: performance, usefulness and areas for improvement.

Background

Method

Results

Interpretation

Publications

Development of the AGREE II, part 1: performance, usefulness and areas for improvement.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets