Computer Vision in Medical Imaging (CVMI) Research - Jio Institute
Computer Vision in Medical Imaging (CVMI)

Current areas of research  

1. Thoracic disease detection from a Chest X-ray image

The main purpose of this work is detecting thoracic disease from a Chest X-ray image and multiple disease from one image, if present. We are currently working on visualizing the anomaly in parallel to disease detection which can further help the radiologist to better analyze and make concluding remarks.

2. Missed or delayed fracture detection from X-rays

We are currently working on the missed or delayed fracture detection to draw the attention of doctors to the affected area using deep learning. Also, we are working on the localization of the fracture to pinpoint the exact location of the fracture which can help the radiologist in accurate detection.

3. Automatic segmentation and annotation of medical images

Automatic segmentation and annotation of medical image plays a critical role. Automatic segmentation and annotation not only increase the efficiency of clinical workflow, but also prevent overburdening of radiologists. The objective of this work is to improve the accuracy and give probabilistic map for annotation.


4. Early Sepsis prediction from ICU Patient’s data

The main purpose of the project is to predict sepsis 6 hours earlier from patient’s physiological data. After getting the cleaned data we are using ML method to see their performance, but the accuracy is affected by class imbalance problem on which we are currently working.

5. Fine-grained visual classification

Fine-grained visual classification (FGVC) is challenging but more critical than traditional classification tasks. It requires distinguishing different subcategories with the inherently subtle intra-class object variations. Previous works focus on enhancing the feature representation ability using multiple granularities and discriminative regions based on the attention strategy or bounding boxes. However, these methods highly rely on deep neural networks which lack interpretability. Our target is to implement on medical images using some attention guided framework which can guide the network to extract discriminative regions in an interpretable way, a progressive training mechanism as the complexity of the problem, and transfer learning based on pretrained model on medical images.

6. Multimodality Breast Cancer Detection Using Artificial Intelligence

Many imaging modalities such as ultrasound, (X-ray) mammography, breast MRI are frequently used to examine the Breast Cancer severity. All imaging modalities have their pros and cons depending upon cost, image resolution, radiation uses etc. Further, early detection and disease severity prediction is a major challenge in medical practices. Previous methods use machine learning based methods for classification of breast cancer into corresponding BI-RADS (Breast Imaging Reporting and Database system) scores. In the proposed work we intend to use deep learning-based methods for completely automated solution of breast cancer detection and disease severity classification. Further, based on the BI-RADS guidelines we suggest the patient for a biopsy of the diseased area. Once the biopsy images of the same patient are available, we’ll find the correlation between the histopathological images and corresponding radiological images. Finally, we’ll validate our system using some performance analysis and statistical tools.


Research Publications related to CVMI Lab 

  1. Debojyoti Pal, Pailla Balakrishna Reddy, and Sudipta Roy. "Attention UW-Net: A fully connected model for automatic segmentation and annotation of chest X-ray." Computers in Biology and Medicine, ELSEVIER, Vol 150 (2022): 106083.
  2. Anwesh Kabiraj, Tanushree Meena, Pailla Balakrishna Reddy, and Sudipta Roy. "Detection and Classification of Lung Disease Using Deep Learning Architecture from X-ray Images." In Proceedings (Springer LNCS) of the 17th International Symposium on Visual Computing, San Diego, CA, USA, pp. 3-5. 2022. 
  3. Tanushree Meena, and Sudipta Roy. "Bone Fracture Detection Using Deep Supervised Learning from Radiological Images: A Paradigm Shift." Diagnostics 12, no. 10 (2022): 2420.
  4. Sudipta Roy, Tanushree Meena, and Se-Jung Lim. "Demystifying Supervised Learning in Healthcare 4.0: A New Reality of Transforming Diagnostic Medicine." Diagnostics 12, no. 10 (2022): 2549.
  5. Anwesh Kabiraj, Debojyoti Pal, Debayan Ganguly, Kingshuk Chatterjee, and Sudipta Roy. "Number plate recognition from enhanced super-resolution using generative adversarial network." Multimedia Tools and Applications (2022): 1-17.

Research Faculty


Team Associates


News & Stories