Hyperspectral Imaging (HSI)

Hyperspectral imaging (HSI) also called imaging spectrometer is an emerging imaging modality for medical applications. HSI has been explored for various remote sensing applications by NASA. With the advantages of acquiring two dimensional images across a wide range of electromagnetic spectrum, HSI has been applied to archaeology and art conservation, vegetation and water resource control, food quality and safety control, forensic medicine, crime scene detection, and biomedical areas, etc.

HSI offers great potential for non-invasive disease diagnosis and surgical guidance. Light delivered to the biological tissue undergoes multiple scattering from inhomogeneity of biological structures and absorption primarily in hemoglobin, melanin and water as it propagates through tissue. It is assumed that the absorption, fluorescence and scattering characteristics of tissue change during the progression of disease, therefore the reflected, fluorescent and transmitted light from tissue captured by HSI carries quantitative diagnostic information about tissue pathology. In recent years, the advancements of hyperspectral cameras, image analysis methods and computational power make it possible for many exciting applications in the medical field.

Schematic diagram of a pushbroom hyperspectral imaging system

Comparison between hypercube and RGB image. Hypercube is three dimensional dataset a 2D image on each wavelength. The lower left is the reflectance curve (spectral signature) of a pixel in the image. RGB color image only has three image bands on red, green and blue wavelength respectively. The lower right is the intensity curve of a pixel in the RGB image.

Selected Publications

  1. Ma L, Rathgeb A, Mubarak H, Tran M, Fei B. Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging. Journal of biomedical optics. 2022 May 1;27(5):056502-.

    Ma_2022_JBO_SuperRes_Reconstruction_WSI [PubMed] [PDF]

  2. Tran MH, Ma L, Litter JV, Chen AY, Fei B. Thyroid carcinoma detection on whole histologic slides using hyperspectral imaging and deep learning. In Medical Imaging 2022: Digital and Computational Pathology 2022 Apr 4 (Vol. 12039, pp. 101-111). SPIE.

    Fei_2022_SPIE_Minh_HSI_Histology [PubMed] [PDF]

  3. Ma L, Rathgeb A, Tran M, Fei B. Unsupervised super resolution network for hyperspectral histologic imaging. In Medical Imaging 2022: Digital and Computational Pathology 2022 Apr 4 (Vol. 12039, pp. 149-159). SPIE.

    Fei_2022_SPIE_Ling_HSI_Super_Resolution [PubMed] [PDF]

  4. Leitch K, Halicek M, Shahedi M, Little JV, Chen AY, Fei B. Detecting aggressive papillary thyroid carcinoma using hyperspectral imaging and radiomic features. In Medical Imaging 2022: Computer-Aided Diagnosis 2022 Apr 4 (Vol. 12033, pp. 537-544). SPIE.

    Fei_2022_SPIE_KaToria_HSI_Thyroid_Radiomics [PubMed] [PDF]

  5. Modir N, Shahedi M, Dormer J, Ma L, Ghaderi M, Sirsi S, Cheng YS, Fei B. LED-based hyperspectral endoscopic imaging. In Optical Biopsy XX: Toward Real-Time Spectroscopic Imaging and Diagnosis 2022 Mar 2 (Vol. 11954, pp. 47-58). SPIE.

    Fei_2022_Photoncis_Naeeme_LED_Endoscope [PubMed] [PDF]

  6. Ayala L, Isensee F, Wirkert SJ, Vemuri AS, Maier-Hein KH, Fei B, Maier-Hein L. Band selection for oxygenation estimation with multispectral/hyperspectral imaging. Biomedical Optics Express. 2022 Mar 1;13(3):1224-42.

    Fei_2022_BOE_Band_Selection [PubMed] [PDF]

  7. Zhou X, Ma L, Brown W, Little JV, Chen AY, Myers LL, Sumer BD, Fei B. Automatic detection of head and neck squamous cell carcinoma on pathologic slides using polarized hyperspectral imaging and machine learning. In Medical Imaging 2021: Digital Pathology 2021 Feb 15 (Vol. 11603, p. 116030Q). International Society for Optics and Photonics.

    Fei_2021_Zhou_HSI_HNC [PDF]

  8. Ma L, Shahedi M, Shi T, Halicek M, Little JV, Chen AY, Myers LL, Sumer BD, Fei B. Pixel-level tumor margin assessment of surgical specimen in hyperspectral imaging and deep learning classification. In Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling 2021 Feb 15 (Vol. 11598, p. 1159811). International Society for Optics and Photonics.

    Fei_2021_Ma_Margin_HSI_Deep_Learning [PubMed] [PDF]

  9. Ma L, Zhou X, Little JV, Chen AY, Myers LL, Sumer BD, Fei B. Hyperspectral microscopic imaging for the detection of head and neck squamous cell carcinoma on histologic slides. In Medical Imaging 2021: Digital Pathology 2021 Feb 15 (Vol. 11603, p. 116030P). International Society for Optics and Photonics.

    Fei_2021_Ma_HSI_Histology_HNC [PubMed] [PDF]

  10. Edwards K, Halicek M, Little JV, Chen AY, Fei B. Multiparametric radiomics for predicting the aggressiveness of papillary thyroid carcinoma using hyperspectral images. In Medical Imaging 2021: Computer-Aided Diagnosis 2021 Feb 15 (Vol. 11597, p. 1159728). International Society for Optics and Photonics.

    Fei_2021_Edwards_Radiomics_HSI [PubMed] [PDF]

  11. Ortega S, Halicek M, Fabelo H, Quevedo E, Fei B, Callico GM. Information Extraction Techniques in Hyperspectral Imaging Biomedical Applications. InMultimedia Information Retrieval 2020 Oct 10. IntechOpen.

    Fei_2020_HSI_Book_Chapter [PDF]
  12. Ortega S, Halicek M, Fabelo H, Camacho R, Plaza MD, Godtliebsen F, M Callicó G, Fei BW (Corresponding author). Hyperspectral imaging for the detection of glioblastoma tumor cells in H&E slides using convolutional neural networks. Sensors; 20(7):1911.
    Ortega_2020_Sensors [PubMed] [PDF]
  13. Zhou X, Ma L, Halicek M, Dormer J, Fei BW (Corresponding author). Development of a new polarized hyperspectral imaging microscope. Imaging, Therapeutics, and Advanced Technology in Head and Neck Surgery and Otolaryngology 2020; 11213(1121308). International Society for Optics and Photonics,
    Zhou_2020_Otolaryngology [PubMed] [PDF]
  14. Ma L, Halicek M, Fei BW. In vivo cancer detection in animal model using hyperspectral image classification with wavelet feature extraction. Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging; 11317(113171C). International Society for Optics and Photonics,
    Ma_2020_SPIE_2 [PubMed] [PDF]
  15. Halicek M, Dormer JD, Little JV, Chen AY, Fei BW (Corresponding author). Tumor detection of the thyroid and salivary glands using hyperspectral imaging and deep learning. Biomedical Optics Express; 11(3):1383-400.
    Halicek_2020_BOE_2 [PubMed] [PDF]

  16. Ortega S, Halicek M, Fabelo H, Guerra R, Lopez C, Lejeune M, Godtliebsen F, Callico GM, Fei BW (Corresponding author). Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images. Medical Imaging 2020: Digital Pathology; 11320(113200V). International Society for Optics and Photonics,

    Ortega_2020_SPIE [PubMed] [PDF]

  17. Halicek M, Ortega S, Fabelo H, Lopez C, Lejeune M, Callico GM, Fei BW (Corresponding author). Conditional generative adversarial network for synthesizing hyperspectral images of breast cancer cells from digitized histology. Medical Imaging 2020: Digital Pathology; 11320(113200U). International Society for Optics and Photonics,

    Halicek_2020_SPIE [PubMed] [PDF]

  18. Ma L, Halicek M, Zhou X, Dormer J, Fei BW (Corresponding author). Hyperspectral microscopic imaging for automatic detection of head and neck squamous cell carcinoma using histologic image and machine learning. Medical Imaging 2020: Digital Pathology; 11320(113200W). International Society for Optics and Photonics,

    Ma_2020_SPIE [PubMed] [PDF]

  19. Huang J, Halicek M, Shahedi M, Fei BW (Corresponding author). Augmented reality visualization of hyperspectral imaging classifications for image-guided brain tumor resection. Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling; 11315(113150U). International Society for Optics and Photonics,

    Huang_2020_SPIE [PubMed] [PDF]

  20. Ortega S, Halicek M, Fabelo H, Callico GM, Fei BW (Corresponding author). Hyperspectral and multispectral imaging in digital and computational pathology: a systematic review. Biomedical Optics Express; 11(6): 3195-3233.

    [PubMed] [PDF]

  21. Fei BW. Hyperspectral imaging in medical applications. Data Handling in Science and Technology; 32: 523-565. Elsevier,

    Fei_2020_DHST

  22. Halicek M, Himar F, Ortega S, Little JV, Wang X, Chen AY, Callicó GM, Myers LL, Sumer BD, Fei BW (Corresponding author). Cancer detection using hyperspectral imaging and evaluation of the superficial tumor margin variance with depth. Proceedings of SPIE Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling.

    Halicek_2019_SPIE_1 [PubMed] [PDF]

  23. Fabelo H, Halicek M, Ortega S, Shahedi M, Szolna A, Pineiro JF, Sosa C, O’Shanahan AJ, Bisshopp S, Espino C, Marquez M, Hernandez M, Carrera D, Morera J, Callicó GM, Sarmiento R, Fei BW (Corresponding author). Deep learning-based framework for in-vivo identification of glioblastoma tumor using hyperspectral images of human brain. Sensors;19(4).

    Fabelo_2019_Sensors [PubMed] [PDF]

  24. Halicek M, Little JV, Wang X, Chen AY, Fei BW (Corresponding author). Optical biopsy of head and neck cancer using hyperspectral imaging and convolution neural networks. Journal of Biomedical Optics;24(3):1-9.

    Halicek_2019_JBO [PubMed] [PDF]

  25. Halicek M, Little JV, Wang X, Chen ZG, Patel M, Griffith CC, El-Diery MW, Sava NF, Chen AY, Fei BW (Corresponding author). Deformable registration of histological cancer margins to gross hyperspectral images using demons. Proceedings of SPIE: The International Society for Optical Engineering;10581.

    Halicek_2018_MedImaging_1 [PubMed] [PDF]

  26. Halicek M, Little JV, Wang X, Patel M, Griffith CC, El-Diery MW, Chen AY, Fei BW (Corresponding author). Optical biopsy of head and neck cancer using hyperspectral imaging and convolution neural networks. Proceedings of SPIE: The Internation Society for Optical Engineering;10469.

    Halicek_2018_SPIE [PubMed] [PDF]

  27. Halicek M, Little JV, Wang X, Patel M, Griffith CC, Chen AY, Fei BW (Corresponding author). Tumor margin classification of head and neck cancer using hyperspectral imaging and convolutional neural networks. Proceedings of SPIE: The International Society for Optical Engineering;10576.

    Halicek_2018_MedImaging [PubMed] [PDF]

  28. Halicek, M., Lu, GL., Little, JV., Wang, X., Patel, M., Griffith, CC., El-Deiry, MW., Chen, A., Fei, BW.(2017). “Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging.”Journal of Biomedical Optics 22(6): 4.

    Halicek_2017_JBO [PubMed] [PDF]

  29. Ma L, Lu G, Wang D, Wang X, Chen ZG, Fei BW. Deep learning-based classification for head and neck cancer detection with hyperspectral imaging in an animal model, Proc. SPIE 10137, Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging, 101372G, March 13, 2017, Orlando, FL.

    Ma_2017_MedImaging [PubMed] [PDF]

  30. Lu G, Zhang H, Wang X, Little J, Magliocca K, Chen A, Fei BW (Corresponding author).“Detection of head and neck cancer in surgical specimens using quantitative hyperspectral imaging,” Clinical Cancer Research. 2017 Jun 13. pii: clincanres.0906.2017. doi: 10.1158/1078-0432.CCR-17-0906. [Epub ahead of print] PubMed PMID:28611203.

    Lu_2017_CCR [PubMed] [PDF] [DOI]

  31. Fei BW, Lu G, Wang X, Zhang H, Little JV, Magliocca KR, Chen AY, Tumor margin assessment of surgical tissue specimen of cancer patients using label-free hyperspectral imaging, Proc. SPIE 10054, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XV, 100540E, February 14, 2017, San Francisco, CA.

    Fei_2017_SPIE [PubMed] [PDF]

  32. Lu G, Wang D, Qin X, Halig L, Muller S, Zhang H, Chen A, Pogue BW, Chen ZG, Fei BW (Corresponding author). Framework for hyperspectral image processing and quantification for cancer detection during animal tumor surgery. Journal of Biomedical Optics 2015; 20:126012.

    Lu_2015_JBO [PubMed] [PDF]

  33. Lu G, Qin X, Wang D, Chen ZG, Fei BW (Corresponding author). Quantitative wavelength analysis and image classification for intraoperative cancer diagnosis with hyperspectral imaging. Proceedings of SPIE – The International Society for Optical Engineering 2015; 9415: 94151B. PubMed PMID:26523083.

    Lu_2015_MedImaging [PubMed] [PDF]

  34. Pike R, Patton SK, Lu G, Halig LV, Wang D, Chen ZG, Fei BW (Corresponding author). A minimum spanning forest based hyperspectral image classification method for cancerous tissue detection. Proceedings of SPIE – The International Society for Optical Engineering 2014; 9034:90341W. PubMed PMID:25426272.

    Pike_2014_MedImaging [PubMed] [PDF]