We are concerned with the challenge of coronavirus disease (COVID-19) detection in chest<br>X-ray and Computed Tomography (CT) scans, and the classification and segmentation of related<br>infection manifestations. Even though it is arguably not an established diagnostic tool, using machine<br>learning-based analysis of COVID-19 medical scans has shown the potential to provide a preliminary<br>digital second opinion. This can help in managing the current pandemic, and thus has been attracting<br>significant research attention. In this research, we propose a multi-task pipeline that takes advantage<br>of the growing advances in deep neural network models. In the first stage, we fine-tuned an<br>Inception-v3 deep model for COVID-19 recognition using multi-modal learning, i.e., using X-ray and<br>CT scans. In addition to outperforming other deep models on the same task in the recent literature,<br>with an attained accuracy of 99.4%, we also present comparative analysis for multi-modal learning<br>against learning from X-ray scans alone. The second and the third stages of the proposed pipeline<br>complement one another in dealing with different types of infection manifestations. The former<br>features a convolutional neural network architecture for recognizing three types of manifestations,<br>while the latter transfers learning from another knowledge domain, namely, pulmonary nodule<br>segmentation in CT scans, to produce binary masks for segmenting the regions corresponding to<br>these manifestations. Our proposed pipeline also features specialized streams in which multiple deep<br>models are trained separately to segment specific types of infection manifestations, and we show the<br>significant impact that this framework has on various performance metrics. We evaluate the<br>proposed models on widely adopted datasets, and we demonstrate an increase of approximately 4%<br>and 7% for dice coefficient and mean intersection-over-union (mIoU), respectively, while achieving<br>60% reduction in computational time, compared to the recent literature.<br>
<br>