Open Access
Subscription Access
Open Access
Subscription Access
Automated Severity Scoring of Covid-19 CT Sequences Using Space-Time Transformers
Subscribe/Renew Journal
Automatic diagnosis of Covid-19 lung complications from Computerized Tomography (CT) scans is an increasingly important research topic. In this rapidly developing area of Covid detection from medical image sequences, it is noted that most prior literature has focused on binary classification to detect diseased versus healthy cases from single X-ray or CT image. In this paper, we advance a step further by presenting a comprehensive framework for automated classification of the severity of lung infection (mild, moderate and severe) from CT sequences of confirmed Covid cases. We consider the sequence information for automation because in practice, the medical experts look at the CT sequence to score the severity of infection. We have collected a new lung CT sequence dataset at various stages of Covid infection from Indian patients. This dataset has been scored in terms of the severity of each lung lobe by experts in the field. We present a novel application of space-time transformers for CT sequences and achieve 93.3% accuracy for sequence level and 99% accuracy for patient-level, for multi- class classification of severity classes.
Keywords
Artificial Intelligence, Computerized Tomography, Covid-19, Deep Learning, Image Classification, Vision Transformer.
Subscription
Login to verify subscription
User
Font Size
Information
- Di Dong, Zhenchao Tang, Shuo Wang, Hui Hui, Lixin Gong, Yao Lu and Zhong Xue, “The Role of Imaging in the Detection and Management of COVID-19: A Review”, IEEE Reviews in Biomedical Engineering, Vol. 14, pp. 16-29, 2020.
- Deng Ping Fan, Tao Zhou, Ge-Peng Ji, Yi Zhou, Geng Chen, Huazhu Fu, Jianbing Shen and Ling Shao, “Inf-Net: Automatic Covid-19 Lung Infection Segmentation from CT Images”, IEEE Transactions on Medical Imaging, Vol. 39, No. 8, pp. 2626-2637, 2020.
- T.C. Kwee and R.M. Kwee, “Chest CT in COVID-19: What the Radiologist Needs to Know”, Radiographics, Vol. 40, No. 7, pp. 1848-1865, 2020.
- A. Dosovitskiy, “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale”, Proceedings of International Conference on Learning Representations, pp. 1-21, 2021.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser and I. Polosukhin, “Attention is all you Need”, Advances in Neural Information Processing Systems, Vol. 30, pp. 5998-6008, 2017.
- G. Girdhar, H. Wang and L. Torresani, “Is Space-Time Attention all you need for Video Understanding?”, Proceedings of International Conference on Machine Learning, pp. 1007-1017, 2021.
- M. Frid-Adar, R. Amer, O. Gozes, J. Nassar and H. Greenspan, “COVID-19 in CXR: From Detection and Severity Scoring to Patient Disease Monitoring,” IEEE Journal of Biomedical and Health Informatics, Vol. 25, No. 6, pp. 1892-1903, 2021.
- S. Hu, W. Menpes-Smith and H. Ye, “Weakly Supervised Deep Learning for Covid-19 Infection Detection and Classification from CT Images”, IEEE Access, Vol. 8, pp. 118869-118883, 2020.
- H. Alshazly, C. Linse, E. Barth and T. Marinetz, “Explainable Covid-19 Detection using Chest CT Scans and Deep Learning”, Sensors, Vol. 21, No. 2, pp. 455-464, 2021.
- L. Meng, Y. Zha and J. Tian, “A Deep Learning Prognosis Model Help Alert for COVID-19 Patients at High-Risk of Death: A Multi-Center Study”, IEEE Journal of Biomedical and Health Informatics, Vol. 24, No. 12, pp. 3576-3584, 2020.
- M. Jamshidi, “Artificial Intelligence and COVID-19: Deep Learning Approaches for Diagnosis and Treatment”, IEEE Access, Vol. 8, pp. 109581-109595, 2020
- O. Gozes, M. Frid-Adar, N. Sagie, H. Zhang, W. Ji and H. Greenspan, “Coronavirus Detection and Analysis on Chest CT with Deep Learning”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2020.
- M.N. Islam, T.T. Inan, S. Rafi, S.S. Akter, I.H. Sarker and A.N. Islam, “A Systematic Review on the Use of AI and ML for Fighting the COVID-19 Pandemic,” IEEE Transactions on Artificial Intelligence, Vol. 2, No. 2, pp. 139-156, 2021.
- T. Mahmud and S.Y. Kung, “Cov-SegNet: A Multi Encoder-Decoder Architecture for Improved Lesion Segmentation of COVID-19 Chest CT Scans”, IEEE Transactions on Artificial Intelligence, Vol. 2, No. 3, pp. 283-297, 2021.
- S. Latif, A. Razi, A. Weller and J. Crowcroft, “Leveraging Data Science to Combat Covid-19: A Comprehensive Review”, IEEE Transactions on Artificial Intelligence, Vol. 2, No. 2, pp. 139-156, 2021.
- G. Kim, “Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformer”, Proceedings of International Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2021.
- Y.D. Zhang, “A Five-Layer Deep Convolutional Neural Network with Stochastic Pooling for Chest CT based Covid-19 Diagnosis”, Machine Vision and Applications, Vol. 32, No. 1, pp. 1-13, 2021.
- M. Sokolova and G. Lapalme, “A Systematic Analysis of Performance Measures for Classification Tasks”, Information Processing and Management, Vol. 45, No. 4, pp. 427-437, 2009.
- A. Kumar, “COVID19 Severity Scoring from CT: Primer for Radiologists”, Available at https://medium.com/predible/covid19-severity-scoring-from-ct-primer-for-radiologists-930536dfade5, Accessed at 2023.
- A. Kapishnikov and M. Terry, “XRAI: Better Attributions Through Regions”, Proceedings of International Conference on Computer Vision, pp. 4942-4951, 2019.
Abstract Views: 143
PDF Views: 0