Dataset Information

Convolutional neural network for classification of two-dimensional array images generated from clinical information may support diagnosis of rheumatoid arthritis.

ABSTRACT: This research aimed to study the application of deep learning to the diagnosis of rheumatoid arthritis (RA). Definite criteria or direct markers for diagnosing RA are lacking. Rheumatologists diagnose RA according to an integrated assessment based on scientific evidence and clinical experience. Our novel idea was to convert various clinical information from patients into simple two-dimensional images and then use them to fine-tune a convolutional neural network (CNN) to classify RA or nonRA. We semi-quantitatively converted each type of clinical information to four coloured square images and arranged them as one image for each patient. One rheumatologist modified each patient's clinical information to increase learning data. In total, 1037 images (252 RA, 785 nonRA) were used to fine-tune a pretrained CNN with transfer learning. For clinical data (10 RA, 40 nonRA), which were independent of the learning data and were used as testing data, we compared the classification ability of the fine-tuned CNN with that of three expert rheumatologists. Our simple system could potentially support RA diagnosis and therefore might be useful for screening RA in both specialised hospitals and general clinics. This study paves the way to enabling deep learning in the diagnosis of RA.

SUBMITTER: Fukae J

PROVIDER: S-EPMC7101306 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Convolutional neural network for classification of two-dimensional array images generated from clinical information may support diagnosis of rheumatoid arthritis.

Fukae Jun J Isobe Masato M Hattori Toshiyuki T Fujieda Yuichiro Y Kono Michihiro M Abe Nobuya N Kitano Akemi A Narita Akihiro A Henmi Mihoko M Sakamoto Fumihiko F Aoki Yuko Y Ito Takeya T Mitsuzaki Akio A Matsuhashi Megumi M Shimizu Masato M Tanimura Kazuhide K Sutherland Kenneth K Kamishima Tamotsu T Atsumi Tatsuya T Koike Takao T

Scientific reports 20200327 1

This research aimed to study the application of deep learning to the diagnosis of rheumatoid arthritis (RA). Definite criteria or direct markers for diagnosing RA are lacking. Rheumatologists diagnose RA according to an integrated assessment based on scientific evidence and clinical experience. Our novel idea was to convert various clinical information from patients into simple two-dimensional images and then use them to fine-tune a convolutional neural network (CNN) to classify RA or nonRA. We ...[more]

PMID: 32221385

Similar Datasets

Project description:PURPOSE:Convolutional neural networks have become rapidly popular for image recognition and image analysis because of its powerful potential. In this paper, we developed a method for classifying subtypes of lung adenocarcinoma from pathological images using neural network whose that can evaluate phenotypic features from wider area to consider cellular distributions. METHODS:In order to recognize the types of tumors, we need not only to detail features of cells, but also to incorporate statistical distribution of the different types of cells. Variants of autoencoders as building blocks of pre-trained convolutional layers of neural networks are implemented. A sparse deep autoencoder which minimizes local information entropy on the encoding layer is then proposed and applied to images of size [Formula: see text]. We applied this model for feature extraction from pathological images of lung adenocarcinoma, which is comprised of three transcriptome subtypes previously defined by the Cancer Genome Atlas network. Since the tumor tissue is composed of heterogeneous cell populations, recognition of tumor transcriptome subtypes requires more information than local pattern of cells. The parameters extracted using this approach will then be used in multiple reduction stages to perform classification on larger images. RESULTS:We were able to demonstrate that these networks successfully recognize morphological features of lung adenocarcinoma. We also performed classification and reconstruction experiments to compare the outputs of the variants. The results showed that the larger input image that covers a certain area of the tissue is required to recognize transcriptome subtypes. The sparse autoencoder network with [Formula: see text] input provides a 98.9% classification accuracy. CONCLUSION:This study shows the potential of autoencoders as a feature extraction paradigm and paves the way for a whole slide image analysis tool to predict molecular subtypes of tumors from pathological features.

Project description:Rheumatoid arthritis (RA) is a chronic autoimmune, inflammatory disease, characterized by synovitis in small- and medium-sized joints and, if not treated early and efficiently, joint damage, and destruction. RA is a heterogeneous disease with a plethora of treatment options. The pro-inflammatory cytokine tumor necrosis factor (TNF) plays a central role in the pathogenesis of RA, and TNF inhibitors effectively repress inflammatory activity in RA. Currently, treatment decisions are primarily based on empirics and economic considerations. However, the considerable interpatient variability in response to treatment is a challenge. Markers for a more exact patient classification and stratification are lacking. The objective of this study was to identify markers in immune cell populations that distinguish RA patients from healthy donors with an emphasis on TNF signaling. We employed mass cytometry (CyTOF) with a panel of 13 phenotyping and 10 functional markers to explore signaling in unstimulated and TNF-stimulated peripheral blood mononuclear cells from 20 newly diagnosed, untreated RA patients and 20 healthy donors. The resulting high-dimensional data were analyzed in three independent analysis pipelines, characterized by differences in both data clean-up, identification of cell subsets/clustering and statistical approaches. All three analysis pipelines identified p-p38, IkBa, p-cJun, p-NFkB, and CD86 in cells of both the innate arm (myeloid dendritic cells and classical monocytes) and the adaptive arm (memory CD4+ T cells) of the immune system as markers for differentiation between RA patients and healthy donors. Inclusion of the markers p-Akt and CD120b resulted in the correct classification of 18 of 20 RA patients and 17 of 20 healthy donors in regression modeling based on a combined model of basal and TNF-induced signal. Expression patterns in a set of functional markers and specific immune cell subsets were distinct in RA patients compared to healthy individuals. These signatures may support studies of disease pathogenesis, provide candidate markers for response, and non-response to TNF inhibitor treatment, and aid the identification of future therapeutic targets.

Dataset Information

Convolutional neural network for classification of two-dimensional array images generated from clinical information may support diagnosis of rheumatoid arthritis.

Publications

Convolutional neural network for classification of two-dimensional array images generated from clinical information may support diagnosis of rheumatoid arthritis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets