Dataset Information

Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting.

ABSTRACT:

Purpose

Indirect immunofluorescence (IIF) on the human epithelial cell-line HEp-2 (or derivatives) serves as the gold standard in antinuclear antibody (ANA) screening. IIF, and its evaluation, is a labor-intensive method, making ANA testing a major challenge for present clinical laboratories. Nowadays, several automated ANA pattern recognition systems are on the market. In the current study, the EUROPattern Suite is evaluated for its use in daily practice in a routine setting.

Methods

A total of 1033 consecutive routine samples was used to screen for ANA. Results (positive/negative ANA screening, pattern identification and titer) were compared between software-generated results (EUROPattern) and visual interpretation (observer) of automatically acquired digital images.

Results

Considering the visual interpretation as reference, a relative sensitivity of 99.3% and a relative specificity of 88.9% were obtained for negative and positive discrimination by the software (EPa). A good agreement between visual and software-based interpretation was observed with respect to pattern recognition (mean kappa: for 7 patterns: 0.7). Interestingly, EPa software distinguished more patterns per positive sample than the observer (on average 1.5 and 1.2, respectively). Finally, a concordance of 99.3% was observed within the range of 1 titer step difference between EPa and observer.

Conclusions

The ANA IIF results reported by the EPa software are in very good agreement with the results reported by the observer with respect to being negative/positive, pattern recognition and titer, making automated ANA IIF evaluation an objective and time-efficient tool for routine testing.

SUBMITTER: van Beers JJBC

PROVIDER: S-EPMC6147779 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting.

van Beers Joyce J B C JJBC Hahn Melanie M Fraune Johanna J Mallet Kathleen K Krause Christopher C Hormann Wymke W Fechner Kai K Damoiseaux Jan G M C JGMC

Auto- immunity highlights 20180921 1

<h4>Purpose</h4>Indirect immunofluorescence (IIF) on the human epithelial cell-line HEp-2 (or derivatives) serves as the gold standard in antinuclear antibody (ANA) screening. IIF, and its evaluation, is a labor-intensive method, making ANA testing a major challenge for present clinical laboratories. Nowadays, several automated ANA pattern recognition systems are on the market. In the current study, the EUROPattern Suite is evaluated for its use in daily practice in a routine setting.<h4>Methods ...[more]

PMID: 30238164

Similar Datasets

Project description:Indirect immunofluorescence assay (IFA) using HEp-2 cells as a substrate is the gold standard for detecting antinuclear antibodies (ANA) in patient serum. However, the ANA IFA has labor-intensive nature of the procedure and lacks adequate standardization. To overcome these drawbacks, the automation has been developed and implemented to the clinical laboratory. The purposes of this study were to evaluate the analytical performance of a fully automated Helios ANA IFA analyzer in a real-life laboratory setting, and to compare the time and the cost of ANA IFA testing before and after adopting the Helios system. A total of 3,276 consecutive serum samples were analyzed for ANA using the Helios system from May to August 2019. The positive/negative results, staining patterns, and endpoint titers were compared between Helios and visual readings. Furthermore, the turnaround time and the number of wells used were compared before and after the introduction of Helios system. Of the 3,276 samples tested, 748 were positive and 2,528 were negative based on visual readings. Using visual reading as the reference standard, the overall relative sensitivity, relative specificity, and concordance of Helios reading were 73.3, 99.4, and 93.4% (κ = 0.80), respectively. For pattern recognition, the overall agreement was 70.1% (298/425) for single patterns, and 72.4% (89/123) for mixed patterns. For titration, there was an agreement of 75.9% (211/278) between automated and classical endpoint titers by regarding within ± one titer difference as acceptable. Helios significantly shortened the median turnaround time from 100.6 to 55.7 h (P < 0.0001). Furthermore, routine use of the system reduced the average number of wells used per test from 4 to 1.5. Helios shows good agreement in distinguishing between positive and negative results. However, it still has limitations in positive/negative discrimination, pattern recognition, and endpoint titer prediction, requiring additional validation of results by human observers. Helios provides significant advantages in routine laboratory ANA IFA work in terms of labor, time, and cost savings. We hope that upgrading and developing softwares with more reliable capabilities will allow automated ANA IFA analyzers to be fully integrated into the routine operations of the clinical laboratory.

Project description:BackgroundTo evaluate the interpretation and reporting of antinuclear antibodies (ANA) by indirect immunofluorescence assay (IFA) using HEp-2 substrates based on common practice and guidance by the International Consensus on ANA patterns (ICAP).MethodParticipants included two groups [16 clinical laboratories (CL) and 8 in vitro diagnostic manufacturers (IVD)] recruited via an email sent to the Association of Medical Laboratory Immunologists (AMLI) membership. Twelve (n = 12) pre-qualified specimens were distributed to participants for testing, interpretation and reporting HEp-2 IFA. Results obtained were analyzed for accuracy with the intended and consensus response for three main categorical patterns (nuclear, cytoplasmic and mitotic), common patterns and ICAP report nomenclatures. The distributions of antibody titers of specimens were also compared.ResultsLaboratories differed in the categorical patterns reported; 8 reporting all patterns, 3 reporting only nuclear patterns and 5 reporting nuclear patterns with various combinations of other patterns. For all participants, accuracy with the intended response for the categorical nuclear pattern was excellent at 99% [95% confidence interval (CI): 97-100%] compared to 78% [95% CI 67-88%] for the cytoplasmic, and 93% [95% CI 86%-100%] for mitotic patterns. The accuracy was 13% greater for the common nomenclature [87%, 95% CI 82-90%] compared to the ICAP nomenclature [74%, 95% CI 68-79%] for all participants. Participants reporting all three main categories demonstrated better performances compared to those reporting 2 or less categorical patterns. The average accuracies varied between participant groups, however, with the lowest and most variable performances for cytoplasmic pattern specimens. The reported titers for all specimens varied, with the least variability for nuclear patterns and most titer variability associated with cytoplasmic patterns.ConclusionsOur study demonstrated significant accuracy for all participants in identifying the categorical nuclear staining as well as traditional pattern assignments for nuclear patterns. However, there was less consistency in reporting cytoplasmic and mitotic patterns, with implications for assigning competencies and training for clinical laboratory personnel.

Project description:BackgroundParasitological confirmation of malaria is now recommended in all febrile patients by the World Health Organization (WHO) to reduce inappropriate use of anti-malarial drugs. Widespread implementation of rapid diagnostic tests (RDTs) is regarded as an effective strategy to achieve this goal. However, the quality of diagnosis provided by RDTs in remote rural dispensaries and health centres is not ideal. Feasible RDT quality control programmes in these settings are challenging. Collection of information regarding diagnostic events is also very deficient in low-resource countries.MethodsA prospective cohort of consecutive patients aged more than one year from both genders, seeking routine care for febrile episodes at dispensaries located in the Bagamoyo district of Tanzania, were enrolled into the study after signing an informed consent form. Blood samples were taken for thick blood smear (TBS) microscopic examination and malaria RDT (SD Bioline Malaria Antigen Pf/Pan™ (SD RDT)). RDT results were interpreted by both visual interpretation and Deki Reader™ device. Results of visual interpretation were used for case management purposes. Microscopy was considered the "gold standard test" to assess the sensitivity and specificity of the Deki Reader interpretation and to compare it to visual interpretation.ResultsIn total, 1,346 febrile subjects were included in the final analysis. The SD RDT, when used in conjunction with the Deki Reader and upon visual interpretation, had sensitivities of 95.3% (95% CI, 90.6-97.7) and 94.7% (95% CI, 89.8-97.3) respectively, and specificities of 94.6% (95% CI, 93.5-96.1) and 95.6% (95% CI, 94.2-96.6), respectively to gold standard. There was a high percentage of overall agreement between the two methods of interpretation.ConclusionThe sensitivity and specificity of the Deki Reader in interpretation of SD RDTs were comparable to previous reports and showed high agreement to visual interpretation (>98%). The results of the study reflect the situation in real practice and show good performance characteristics of Deki Reader on interpreting malaria RDTs in the hands of local laboratory technicians. They also suggest that a system like this could provide great benefits to the health care system. Further studies to look at ease of use by community health workers, and cost benefit of the system are warranted.

Dataset Information

Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting.

Purpose

Methods

Results

Conclusions

Publications

Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure