Dataset Information

The International Guideline Evaluation Screening Tool (IGEST): development and validation.

ABSTRACT:

Background

Guideline adaptation provides an important alternative to de novo guideline development by making the process more efficient and reducing unnecessary duplication. The quality evaluation of international guidelines is an essential part of the adaptation process. The study aims at describing the development and validation of a new tool to screen trustworthy Clinical Practice Guidelines (CPGs) for their adoption/adaption: the International Guideline Evaluation Screening Tool (IGEST).

Methods

The process of developing the IGEST involved two main phases: 1) tool development and 2) content validation. The tool development phase comprised three stages, where the scope of the IGEST was defined and the item pool was generated and refined. The content validation was performed through the computation of a content validity index (CVI) based on the opinions of an expert panel.

Results

All the items obtained a CVI >0.78, which resulted in the validation of the instrument. The final instrument comprised four preliminary conditions and 12 criteria organised into three dimensions: (i) the management of conflict of interest; (ii) the quality of evidence and the coherence between evidence and recommendations; and (iii) the panel composition.

Conclusion

The IGEST showed good content validity for assessing the quality of international guidelines. Using the new tool to select trustworthy guidelines might increase the likelihood that international clinical practice guidelines will be adopted/adapted to the local context by allowing a quick screening of existing guidelines trustworthiness and providing an acceptability threshold that supports the decision-making process.

SUBMITTER: D'angelo D

PROVIDER: S-EPMC9088113 | biostudies-literature | 2022 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The International Guideline Evaluation Screening Tool (IGEST): development and validation.

D'angelo Daniela D Coclite Daniela D Napoletano Antonello A Gianola Silvia S Castellini Greta G Latina Roberto R Iacorossi Laura L Fauci Alice Josephine AJ Iannone Primiano P

BMC medical research methodology 20220510 1

<h4>Background</h4>Guideline adaptation provides an important alternative to de novo guideline development by making the process more efficient and reducing unnecessary duplication. The quality evaluation of international guidelines is an essential part of the adaptation process. The study aims at describing the development and validation of a new tool to screen trustworthy Clinical Practice Guidelines (CPGs) for their adoption/adaption: the International Guideline Evaluation Screening Tool (IGE ...[more]

PMID: 35538433

Similar Datasets

Project description:BackgroundClinical and laboratory parameters can aid in the early identification of neonates at risk for bacteremia before clinical deterioration occurs. However, current prediction models have poor diagnostic capabilities. The objective of this study was to develop, evaluate and validate a screening tool for late onset (> 72 h post admission) neonatal bacteremia using common laboratory and clinical parameters; and determine its predictive value in the identification of bacteremia.MethodsA retrospective chart review of neonates admitted to a neonatal intensive care unit (NICU) between March 1, 2012 and January 14, 2015 and a prospective evaluation of all neonates admitted between January 15, 2015 and March 30, 2015 were completed. Neonates with late-onset bacteremia (> 72 h after NICU admission) were eligible for inclusion in the bacteremic cohort. Bacteremic patients were matched to non-infected controls on several demographic parameters. A Pearson's Correlation matrix was completed to identify independent variables significantly associated with infection (p < 0.05, univariate analysis). Significant parameters were analyzed using iterative binary logistic regression to identify the simplest significant model (p < 0.05). The predictive value of the model was assessed and the optimal probability cut-off for bacteremia was determined using a Receiver Operating Characteristic curve.ResultsMaximum blood glucose, heart rate, neutrophils and bands were identified as the best predictors of bacteremia in a significant binary logistic regression model. The model's sensitivity, specificity and accuracy were 90, 80 and 85%, respectively, with a false positive rate of 20% and a false negative rate of 9.7%. At the study bacteremia prevalence rate of 51%, the positive predictive value, negative predictive value and negative post-test probability were 82, 89 and 11%, respectively.ConclusionThe model developed in the current study is superior to currently published neonatal bacteremia screening tools. Validation of the tool in a historic data set of neonates from our institution will be completed.

Project description:BackgroundEvaluating the methodological quality of clinical practice guidelines is essential before deciding which ones which could best inform policy or practice. One current method of evaluating clinical guideline quality is the research-focused AGREE II instrument. This uses 23 questions scored 1-7, arranged in six domains, which requires at least two independent testers, and uses a formulaic weighted domain scoring system. Following feedback from time-poor clinicians, policy-makers and managers that this instrument did not suit clinical need, we developed and tested a simpler, shorter, binary scored instrument (the iCAHE Guideline Quality Checklist) designed for single users.MethodsContent and construct validity, inter-tester reliability and clinical utility were tested by comparing the new iCAHE Guideline Quality Checklist with the AGREE II instrument. Firstly the questions and domains in both instruments were compared. Six randomly-selected guidelines on a similar theme were then assessed by three independent testers with different experience in guideline quality assessment, using both instruments. Per guideline, weighted domain and total AGREE II scores were calculated, using the scoring rubric for three testers. Total iCAHE scores were calculated per guideline, per tester. The linear relationship between iCAHE and AGREE II scores was assessed using Pearson r correlation coefficients. Score differences between testers were assessed for the iCAHE Guideline Quality Checklist.ResultsThere were congruent questions in each instrument in four domains (Scope & Purpose, Stakeholder involvement, Underlying evidence/Rigour, Clarity). The iCAHE and AGREE II scores were moderate to strongly correlated for the six guidelines. There was generally good agreement between testers for iCAHE scores, irrespective of their experience. The iCAHE instrument was preferred by all testers, and took significantly less time to administer than the AGREE II instrument. However, the use of only three testers and six guidelines compromised study power, rendering this research as pilot investigations of the psychometric properties of the iCAHE instrument.ConclusionThe iCAHE Guideline Quality Checklist has promising psychometric properties and clinical utility.

Project description:Importance:Clinical practice guidelines (CPGs) may lack rigor and suitability to the setting in which they are to be applied. Methods to yield clinical practice guideline recommendations that are credible and implementable remain to be determined. Objective:To describe the development of AGREE-REX (Appraisal of Guidelines Research and Evaluation-Recommendations Excellence), a tool designed to evaluate the quality of clinical practice guideline recommendations. Design, Setting, and Participants:A cross-sectional study of 322 international stakeholders representing CPG developers, users, and researchers was conducted between December 2015 and March 2019. Advertisements to participate were distributed through professional organizations as well as through the AGREE Enterprise social media accounts and their registered users. Exposures:Between 2015 and 2017, participants appraised 1 of 161 CPGs using the Draft AGREE-REX tool and completed the AGREE-REX Usability Survey. Main Outcomes and Measures:Usability and measurement properties of the tool were assessed with 7-point scales (1 indicating strong disagreement and 7 indicating strong agreement). Internal consistency of items was assessed with the Cronbach α, and the Spearman-Brown reliability adjustment was used to calculate reliability for 2 to 5 raters. Results:A total of 322 participants (202 female participants [62.7%]; 83 aged 40-49 years [25.8%]) rated the survey items (on a 7-point scale). All 11 items were rated as easy to understand (with a mean [SD] ranging from 5.2 [1.38] for the alignment of values item to 6.3 [0.87] for the evidence item) and easy to apply (with a mean [SD] ranging from 4.8 [1.49] for the alignment of values item to 6.1 [1.07] for the evidence item). Participants provided favorable feedback on the tool's instructions, which were considered clear (mean [SD], 5.8 [1.06]), helpful (mean [SD], 5.9 [1.00]), and complete (mean [SD], 5.8 [1.11]). Participants considered the tool easy to use (mean [SD], 5.4 [1.32]) and thought that it added value to the guideline enterprise (mean [SD], 5.9 [1.13]). Internal consistency of the items was high (Cronbach α = 0.94). Positive correlations were found between the overall AGREE-REX score and the implementability score (r = 0.81) and the clinical credibility score (r = 0.76). Conclusions and Relevance:This cross-sectional study found that the AGREE-REX tool can be useful in evaluating CPG recommendations, differentiating among them, and identifying those that are clinically credible and implementable for practicing health professionals and decision makers who use recommendations to inform clinical policy.

Project description:ObjectiveTo develop and validate a screening tool to identify patients with a high likelihood for Spondyloarthritis (SpA) in the Democratic Republic of the Congo (DR Congo).MethodsThe development of the SpA Screening questionnaire in Sub Saharian Africa (SpASSS) questionnaire followed 3 steps: The item generation was carried out by a systematic literature review according to the PRISMA guidelines on the clinical manifestations of SpA, interviewing clinical experts and the classification criteria for Spondyloarthritis. The candidate questions were tested in a population of 50 consecutive patients with confirmed diagnosis of spondyloarthritis, in a control population of rheumatic disease excluding SpA and in a group of 200 non-rheumatic participants, randomly chosen in the general population for question reduction and validation. Descriptive statistical analyses were performed to assess socio-demographic characteristics and response distribution for each item. Their diagnostic performance was investigated using ROC curves. For validation, principal component analysis was performed using factor analysis. Referral strategy score for SpA was determined by adjusted Cronbach's alpha coefficient.ResultsMean ± SD age of SpA cases was 41.8 ± 14.4 years, 56% were men compared to diseased controls 60.0 ± 12.5 years, 28.7% men (p < 0.001). 14/20 items showed a statistically significant difference (p < 0.05) between SpA cases and control groups. All items were factorable and 6 components were identified. Only the two first components (C1 with 8 items, C2 with 3 items) showed a significant threshold for reliability in detection of suspected SpA with a Cronbach's alpha of 0.830 and 0.708. All validated items of these two components showed the global reliability threshold with α-adjusted Cronbach calculated at 66.9%. The performance for correctly screening SpA was demonstrated with an area under the curve of 0.938 (0.884-0.991) and 0.794 (0.728-0.861) for C1 and C2 respectively.ConclusionsThis validation and item reduction of the SpASSS questionnaire for SpA might identify patients to refer for case ascertainment and will help conducting future epidemiological and clinical studies in the DR Congo.Strengths and limitations of this study• To the best of our knowledge, this is the first study in Sub-Saharan Africa based on local data to develop a screening tool for SpA in the population for epidemiological and clinical use. • Referral strategies based on context-specific data are necessary to provide accurate case definition and epidemiological data, thus reducing methodological bias. • In the SpA group, no discrimination was made regarding SpA subtypes, disease duration, activity and severity.

Project description:BackgroundThe aim of the study was to develop quality indicators that can be used for quality assessment of registries of occupational diseases in relation to preventive policy on a national level. The research questions were: 1. Which indicators determine the quality of national registries of occupational diseases with respect to their ability to provide appropriate information for preventive policy? 2. What are the criteria that can distinguish low quality from high quality?MethodsFirst, we performed a literature search to assess which output of registries can be considered appropriate for preventive policy and to develop a set of preliminary indicators and criteria. Second, final indicators and criteria were assessed and their content validity was tested in a Delphi study, for which experts from the 25 EU Member States were invited.ResultsThe literature search revealed two different types of information output to be appropriate for preventive policy: monitor and alert information. For the evaluation of the quality of the monitor and alert function we developed ten indicators and criteria. Sixteen of the twenty-five experts responded in the first round of the Delphi study, and eleven in the second round. Based on their comments, we assessed the final nine indicators: the completeness of the notification form, coverage of registration, guidelines or criteria for notification, education and training of reporting physicians, completeness of registration, statistical methods used, investigation of special cases, presentation of monitor information, and presentation of alert information. Except for the indicator "coverage of registration" for the alert function, all the indicators met the preset requirements of content validity.ConclusionWe have developed quality indicators and criteria to evaluate registries for occupational diseases on the ability to provide appropriate information for preventive policy on a national level. Together, these indicators form a tool which can be used for quality improvement of registries of occupational diseases.

Dataset Information

The International Guideline Evaluation Screening Tool (IGEST): development and validation.

Background

Methods

Results

Conclusion

Publications

The International Guideline Evaluation Screening Tool (IGEST): development and validation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets