TY - GEN
T1 - Automated Identification of Cardiomyocyte Nuclei in H&E-stained Heart Tissue with CycleGAN
AU - Udin, Michael H.
AU - Doyle, Scott T.
AU - Ionita, Ciprian N.
AU - Sharma, Umesh C.
AU - Pokharel, Saraswati
N1 - Publisher Copyright:
© 2023 SPIE.
PY - 2023
Y1 - 2023
N2 - Purpose: Identification of cardiomyocyte nuclei is of great importance when assessing heart tissue for cardiovascular disease. However, manual identification of cardiomyocyte nuclei in hematoxylin & eosin (H&E)-stained heart tissue is particularly complex due to extensive heterogeneity in morphology. While expensive and time-consuming staining processes can be utilized to identify cardiomyocyte nuclei, this study proposes to test the feasibility of using a cycle-consistent generative adversarial network (CycleGAN) to automate the identification of cardiomyocyte nuclei in H&E-stained heart tissue without the need for additional staining. Materials and Methods: 100 H&E-stained heart tissue sample regions from cancer patients were manually labeled with the input from an expert pathologist. Sample regions were processed into 3,584 labeled tiles and 3,584 tiles without labels, and then sorted, augmented, and run through a CycleGAN to facilitate the identification of cardiomyocyte nuclei. Performance was assessed with Fréchet Inception Distance (FID), Fréchet ResNet-50 Distance (FRD), sensitivity, specificity, and accuracy. Results: Sensitivity and specificity were 61.6% sensitivity, 96.3% specificity with an accuracy of 85.0% for 30 randomly selected samples. FID and FRD reached as low as 64.8 and 2.46, respectively, with downward trend for FID and high volatility with a slight downward trend for FRD. Notably, the best results were achieved when FRD was at its lowest value. Conclusion: The results suggest cardiomyocyte nuclei can be identified by a CycleGAN. However, targeted improvements are necessary to ensure accurate identification. An enhanced version of this approach may facilitate the automation of identifying cardiomyocyte nuclei in H&E-stained heart tissue, facilitating cardiovascular research.
AB - Purpose: Identification of cardiomyocyte nuclei is of great importance when assessing heart tissue for cardiovascular disease. However, manual identification of cardiomyocyte nuclei in hematoxylin & eosin (H&E)-stained heart tissue is particularly complex due to extensive heterogeneity in morphology. While expensive and time-consuming staining processes can be utilized to identify cardiomyocyte nuclei, this study proposes to test the feasibility of using a cycle-consistent generative adversarial network (CycleGAN) to automate the identification of cardiomyocyte nuclei in H&E-stained heart tissue without the need for additional staining. Materials and Methods: 100 H&E-stained heart tissue sample regions from cancer patients were manually labeled with the input from an expert pathologist. Sample regions were processed into 3,584 labeled tiles and 3,584 tiles without labels, and then sorted, augmented, and run through a CycleGAN to facilitate the identification of cardiomyocyte nuclei. Performance was assessed with Fréchet Inception Distance (FID), Fréchet ResNet-50 Distance (FRD), sensitivity, specificity, and accuracy. Results: Sensitivity and specificity were 61.6% sensitivity, 96.3% specificity with an accuracy of 85.0% for 30 randomly selected samples. FID and FRD reached as low as 64.8 and 2.46, respectively, with downward trend for FID and high volatility with a slight downward trend for FRD. Notably, the best results were achieved when FRD was at its lowest value. Conclusion: The results suggest cardiomyocyte nuclei can be identified by a CycleGAN. However, targeted improvements are necessary to ensure accurate identification. An enhanced version of this approach may facilitate the automation of identifying cardiomyocyte nuclei in H&E-stained heart tissue, facilitating cardiovascular research.
KW - cardiomyocyte nuclei detection
KW - Cardiovascular disease
KW - CycleGAN
KW - H&E staining
UR - https://www.scopus.com/pages/publications/85160530674
U2 - 10.1117/12.2653958
DO - 10.1117/12.2653958
M3 - Conference contribution
AN - SCOPUS:85160530674
T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE
BT - Medical Imaging 2023
A2 - Tomaszewski, John E.
A2 - Ward, Aaron D.
PB - SPIE
T2 - Medical Imaging 2023: Digital and Computational Pathology
Y2 - 19 February 2023 through 23 February 2023
ER -