Dataset Information

Lack of grading agreement among international hemostasis external quality assessment programs.

ABSTRACT: : Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance.

SUBMITTER: Olson JD

PROVIDER: S-EPMC5794233 | biostudies-literature | 2018 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Lack of grading agreement among international hemostasis external quality assessment programs.

Olson John D JD Jennings Ian I Meijer Piet P Bon Chantal C Bonar Roslyn R Favaloro Emmanuel J EJ Higgins Russell A RA Keeney Michael M Mammen Joy J Marlar Richard A RA Meley Roland R Nair Sukesh C SC Nichols William L WL Raby Anne A Reverter Joan C JC Srivastava Alok A Walker Isobel I

Blood coagulation & fibrinolysis : an international journal in haemostasis and thrombosis 20180101 1

: Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and he ...[more]

PMID: 29232255

Similar Datasets

Project description:Currently dengue viruses (DENV) pose an increasing threat to over 2.5 billion people in over 100 tropical and sub-tropical countries worldwide. International air travel is facilitating rapid global movement of DENV, increasing the risk of severe dengue epidemics by introducing different serotypes. Accurate diagnosis is critical for early initiation of preventive measures. Different reverse transcriptase PCR (RT-PCR) methods are available, which should be evaluated and standardized. Epidemiological and laboratory-based surveillance is required to monitor and guide dengue prevention and control programmes, i.e., by mosquito control or possible vaccination (as soon as an effective and safe vaccine becomes available). The purpose of the external quality assurance (EQA) study described is to assess the efficiency and accuracy of dengue molecular diagnosis methods applied by expert laboratories. A panel of 12 human plasma samples was distributed and tested for DENV-specific RNA. The panel comprised 9 samples spiked with different DENV serotypes (DENV-1 to DENV-4), including 10-fold dilution series of DENV-1 and DENV-3. Two specificity controls consisted of a sample with a pool of 4 other flaviviruses and a sample with chikungunya virus. A negative control sample was also included. Thirty-seven laboratories (from Europe, Middle East Asia, Asia, the Americas/Caribbean, and Africa) participated in this EQA study, and reports including 46 sets of results were returned. Performance among laboratories varied according to methodologies used. Only 5 (10.9%) data sets met all criteria with optimal performance, and 4 (8.7%) with acceptable performance, while 37 (80.4%) reported results showed the need for improvement regarding accomplishment of dengue molecular diagnosis. Failures were mainly due to lack of sensitivity and the presence of false positives. The EQA provides information on each laboratory's efficacy of RT-PCR techniques for dengue diagnosis and indicates for most laboratories an urgent need to improve sensitivity and specificity.

Project description:Crimean-Congo hemorrhagic fever (CCHF) is a zoonosis caused by a Nairovirus of the family Bunyaviridae. Infection is transmitted to humans mostly by Hyalomma ticks and also by direct contact with the blood or tissues of infected humans or viremic livestock. Clinical features usually include a rapid progression characterized by hemorrhage, myalgia and fever, with a lethality rate up to 30%. CCHF is one of the most widely distributed viral hemorrhagic fevers and has been reported in Africa, the Middle East and Asia, as well as parts of Europe. There is no approved vaccine or specific treatment against CCHF virus (CCHFV) infections. In this context, an accurate diagnosis as well as a reliable surveillance of CCHFV infections is essential. Diagnostic techniques include virus culture, serology and molecular methods, which are now increasingly used. The European Network for the Diagnostics of "Imported" Viral Diseases organized the first international external quality assessment of CCHVF molecular diagnostics in 2011 to assess the efficiency and accurateness of CCHFV molecular methods applied by expert laboratories. A proficiency test panel of 15 samples was distributed to the participants including 10 different CCHFV preparations generated from infected cell cultures, a preparation of plasmid cloned with the nucleoprotein of CCHFV, two CCHFV RNA preparations and two negative controls. Forty-four laboratories worldwide participated in the EQA study and 53 data sets were received. Twenty data sets (38%) met all criteria with optimal performance, 10 (19%) with acceptable performance, while 23 (43%) reported results showing a need for improvement. Differences in performance depended on the method used, the type of strain tested, the concentration of the sample tested and the laboratory performing the test. These results indicate that there is still a need for improving testing conditions and standardizing protocols for the molecular detection of Crimean-Congo hemorrhagic fever virus.

Project description:BackgroundParticipation in quality controls, also called external quality assessment (EQA) schemes, is required for the ISO15189 accreditation of the Medical Centers of Human Genetics. However, directives on the minimal frequency of participation in genetic quality control schemes are lacking or too heterogeneous, with a possible impact on health care quality.ObjectiveThe aim of this project is to develop Belgian guidelines on the frequency of participation in quality controls for genetic testing in the context of rare diseases.MethodsA group of experts analyzed 90 EQA schemes offered by accredited providers and focused on analyses used for the diagnosis of rare diseases. On that basis, the experts developed practical recommendations about the minimal frequencies of participation of the Medical Centers of Human Genetics in quality controls and how to deal with poor performances and change management. These guidelines were submitted to the Belgian Accreditation Body and then reviewed and approved by the Belgian College of Human Genetics and Rare Diseases and by the National Institute for Health and Disability Insurance.ResultsThe guidelines offer a decisional algorithm for the minimal frequency of participation in human genetics EQA schemes. This algorithm has been developed taking into account the scopes of the EQA schemes, the levels of experience, and the annual volumes of the Centers of Human Genetics in the performance of the tests considered. They include three key principles: (1) the recommended annual assessment of all genetic techniques and technological platforms, if possible through EQAs covering the technique, genotyping, and clinical interpretation; (2) the triennial assessment of the genotyping and interpretation of specific germline mutations and pharmacogenomics analyses; and (3) the documentation of actions undertaken in the case of poor performances and the participation to quality control the following year. The use of a Bayesian statistical model has been proposed to help the Centers of Human Genetics to determine the theoretical number of tests that should be annually performed to achieve a certain threshold of performance (eg, a maximal error rate of 1%). Besides, the guidelines insist on the role and responsibility of the national public health authorities in the follow-up of the quality of analyses performed by the Medical Centers of Human Genetics and in demonstrating the cost-effectiveness and rationalization of participation frequency in these quality controls.ConclusionsThese guidelines have been developed based on the analysis of a large panel of EQA schemes and data collected from the Belgian Medical Centers of Human Genetics. They are applicable to other countries and will facilitate and improve the quality management and financing systems of the Medical Centers of Human Genetics.

Dataset Information

Lack of grading agreement among international hemostasis external quality assessment programs.

Publications

Lack of grading agreement among international hemostasis external quality assessment programs.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets