Dataset Information

RSNA and BSTI grading systems of COVID-19 pneumonia: comparison of the diagnostic performance and interobserver agreement.

ABSTRACT:

Background

This study aimed to compare the performance and interobservers agreement of cases with findings on chest CT based on the British Society of Thoracic Imaging (BSTI) guideline statement of COVID-19 and the Radiological Society of North America (RSNA) expert consensus statement.

Methods

In this study, 903 patients who had admitted to the emergency department with a pre-diagnosis of COVID-19 between 1 and 18 July 2020 and had chest CT. Two radiologists classified the chest CT findings according to the RSNA and BSTI consensus statements. The performance, sensitivity and specificity values of the two classification systems were calculated and the agreement between the observers was compared by using kappa analysis.

Results

Considering RT-PCR test result as a gold standard, the sensitivity, specificity and positive predictive values were significantly higher for the two observers according to the BSTI guidance statement and the RSNA expert consensus statement (83.3%, 89.7%, 89.0%; % 81.2,% 89.7,% 88.7, respectively). There was a good agreement in the PCR positive group (κ: 0.707; p < 0.001 for BSTI and κ: 0.716; p < 0.001 for RSNA), a good agreement in the PCR negative group (κ: 0.645; p < 0.001 for BSTI and κ: 0.743; p < 0.001 for RSNA) according to the BSTI and RSNA classification between the two radiologists.

Conclusion

As a result, RSNA and BSTI statement provided reasonable performance and interobservers agreement in reporting CT findings of COVID-19. However, the number of patients defined as false negative and indeterminate in both classification systems is at a level that cannot be neglected.

SUBMITTER: Kavak S

PROVIDER: S-EPMC8487757 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:A common problem in the assessment of Ki67 proliferative index in well-differentiated gastrointestinal neuroendocrine tumors is distinguishing tumor from non-tumor. This is because background stromal lymphocytes, entrapped non-neoplastic glands, and the delicate vascular network characteristic of neuroendocrine tumors frequently contain a subset of proliferating cells. Furthermore, in small biopsies, crush and cautery artifact can alter the morphologic appearance of tumor cells, making the Ki67 proliferative index more difficult to assess. To address these issues, we developed a synaptophysin-Ki67 double stain using a commercially available immunohistochemistry kit, allowing simultaneous visualization of tumor and proliferating nuclei. To test this method, three gastrointestinal pathologists individually graded 50 gastrointestinal neuroendocrine tumors first using synaptophysin-Ki67 double-stained slides and then, after a washout period, using Ki67-only stained slides (along with routine hematoxylin- and eosin-stained slides). Interobserver agreement on Ki67 proliferative index was moderate using the Ki67-only stained slides (intraclass correlation 0.51, 95% confidence interval: 0.35-0.66) and improved using the synaptophysin-Ki67 double stain (intraclass correlation 0.79, 95% confidence interval: 0.69-0.86). Similarly, interobserver agreement on tumor grade was fair with Ki67-only stained slides (κ=0.39, P<0.001) and improved with the double stain (κ=0.58, P<0.001). Analysis of individual pathologists' scores revealed that fewer total number of tumor cells counted correlated with higher grade designation and appeared to contribute to grade discordance. In tumors cited as particularly challenging to assess by the pathologists, three of four tumors were grade discordant with the Ki67-only stain, whereas all four tumors were grade concordant with the synaptophysin-Ki67 stain. The synaptophysin-Ki67 double stain is the first technique to address specifically the histomorphologic challenges of evaluating Ki67 proliferative index in well-differentiated gastrointestinal neuroendocrine tumors. Although further validation is needed, this study provides evidence that the synaptophysin-Ki67 double stain can improve interobserver agreement.