Deep learning for cardiac image segmentation: A review

0
Structured data

A study conducted in the UK from 2009 to 2010 by leading scientists explored neonatal resuscitation practices in various neonatal units, aiming to assess adherence to international guidelines and identify differences between tertiary and non-tertiary care providers...

Read on arXivCardiologyLorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.

One Sentence Abstract

"This paper reviews over 100 deep learning-based cardiac image segmentation studies across MRI, CT, and US modalities, discusses challenges and limitations, and proposes future research directions to improve interpretability, model generalizability, and address scarcity of labels."

Simplified Abstract

In this study, researchers explored how a popular tool, called deep learning, is used to help identify the heart's different parts in images like MRI scans, CT scans, and ultrasound. They looked at over 100 research papers using this technique and found that it's quite common and useful. They also listed some resources where others can access the images and tools needed to replicate their work.

Deep learning has some challenges, however. Sometimes, there aren't enough examples to learn from, the models don't work well in different situations, and it's hard to understand how the models arrive at their answers. The researchers suggest some ideas for future research to fix these issues.

In simple terms, this study is about using a specific technology to help identify different parts of the heart in images. The researchers analyzed many studies using this technology, listed helpful resources for others to follow suit, and identified some challenges with this technique. They also suggest ways to improve the technology in future studies.

Study Fields

Main fields:

  • Cardiac image segmentation
  • Deep learning
  • Neural networks
  • Artificial intelligence

Subfields:

  • Magnetic resonance imaging (MRI)
  • Computed tomography (CT)
  • Ultrasound (US)
  • Ventricles
  • Atria
  • Vessels

Study Objectives

  1. Review over 100 cardiac image segmentation papers using deep learning.
  2. Cover common imaging modalities including MRI, CT, and US.
  3. Address major anatomical structures of interest (ventricles, atria, and vessels).
  4. Summarize publicly available cardiac image datasets and code repositories.
  5. Discuss challenges and limitations of current deep learning-based approaches.
  6. Suggest potential directions for future research.

Conclusions

  • The paper provides a review of over 100 cardiac image segmentation papers using deep learning, covering common imaging modalities such as MRI, CT, and US, as well as major anatomical structures of interest (ventricles, atria, and vessels).
  • A summary of publicly available cardiac image datasets and code repositories is included to promote reproducible research.
  • The paper discusses challenges and limitations of current deep learning-based approaches, such as scarcity of labels, model generalizability across different domains, and interpretability.
  • Potential directions for future research are suggested, including improving data quality, addressing model interpretability, and exploring hybrid approaches combining deep learning with other techniques.

References

C. Petitjean, M.A. Zuluaga, W. Bai, J.-N. Dacher, D. Grosgeorge, J. CaudronMedical image analysis
Petitjean, C., Zuluaga, M. A., Bai, W., Dacher, J.-N., Grosgeorge, D., Caudron, J., et al. (2015). Right ventricle segmentation from cardiac MRI: a collation study. Medical image analysis 19, 187–202. 10.1016/j.media.2014.10.004
P. Peng, K. Lekadir, A. Gooya, L. Shao, S.E. Petersen, A.F. FrangiMagnetic Resonance Materials in Physics, Biology and Medicine
Peng, P., Lekadir, K., Gooya, A., Shao, L., Petersen, S. E., and Frangi, A. F. (2016). A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging. Magnetic Resonance Materials in Physics, Biology and Medicine 29, 155—195. 10.1007/s10334-015-0521-4
V. Tavakoli, A.A. AminiComputer Vision and Image Understanding
Tavakoli, V. and Amini, A. A. (2013). A survey of shaped-based registration and segmentation techniques for cardiac images. Computer Vision and Image Understanding 117, 966–989. 10.1016/j.cviu.2012.11.017
D. Lesage, E.D. Angelini, I. Bloch, G. Funka-LeaMedical Image Analysis
Lesage, D., Angelini, E. D., Bloch, I., and Funka-Lea, G. (2009). A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes. Medical Image Analysis 13, 819–845
H. Greenspan, B. Van Ginneken, R.M. SummersIEEE Transactions on Medical Imaging
Greenspan, H., Van Ginneken, B., and Summers, R. M. (2016). Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique. IEEE Transactions on Medical Imaging 35, 1153–1159
D. Shen, G. Wu, H.-I. SukAnnual review of biomedical engineering
Shen, D., Wu, G., and Suk, H.-I. (2017). Deep learning in medical image analysis. Annual review of biomedical engineering 19, 221–248
G. Litjens, T. Kooi, B.E. Bejnordi, A.A A. Setio, F. Ciompi, M. GhafoorianMedical Image Analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., et al. (2017). A survey on deep learning in medical image analysis. Medical Image Analysis 42, 60 – 88
S. Gandhi, W. Mosleh, J. Shen, C.-M. ChowEchocardiography
Gandhi, S., Mosleh, W., Shen, J., and Chow, C.-M. (2018). Automation, machine learning, and artificial intelligence in echocardiography: A brave new world. Echocardiography 35, 1402–1418. 10.1111/echo.14086
M.A. Mazurowski, M. Buda, A. Saha, M.R. BashirJournal of magnetic resonance imaging
Mazurowski, M. A., Buda, M., Saha, A., and Bashir, M. R. (2019). Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI. Journal of magnetic resonance imaging 49, 939–954. 10.1002/jmri.26534
I. Goodfellow
Goodfellow, I. (2016). Deep learning. Adaptive computation and machine learning (Cambridge, Massachusetts ; London, England: The MIT Press)
S. Ioffe, C. Szegedy
Ioffe, S. and Szegedy, C. (2015). Batch normalization: accelerating deep network training by reducing internal covariate shift. In ICML (JMLR.org), 448–456
K. Simonyan, A. Zisserman
Simonyan, K. and Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition. In International Conference on Learning Representations. 14. 10.1016/j.infsof.2008.09.005
D.C. Ciresan, A. Giusti
Ciresan, D. C. and Giusti, A. (2012). Deep neural networks segment neuronal membranes in electron microscopy images. In Conference on Neural Information Processing Systems. 2852–2860
M.R. Avendi, A. Kheradvar, H. JafarkhaniMedical Image Analysis
Avendi, M. R., Kheradvar, A., and Jafarkhani, H. (2016). A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac mri. Medical Image Analysis 30, 108–119
P.V. Tran
Tran, P. V. (2016). A fully convolutional neural network for cardiac segmentation in Short-Axis MRI. Arxiv Preprint abs/1604.00494. Available at http://arxiv.org/abs/1604.00494CardiologyLorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. (Accessed September 1, 2019)
F.P. Ronneberger, None. Olaf, T. BroxMedical Image Computing and Computer Assisted Intervention
Ronneberger, F. P., Olaf and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer Assisted Intervention (Springer), 234–241
J. Long, E. Shelhamer, T. Darrell
Long, J., Shelhamer, E., and Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Conference on Computer Vision and Pattern Recognition. 3431–3440
E. Shelhamer, J. Long, T. DarrellIEEE transactions on pattern analysis and machine intelligence
Shelhamer, E., Long, J., and Darrell, T. (2017). Fully convolutional networks for semantic segmentation. IEEE transactions on pattern analysis and machine intelligence 39, 640–651. 10.1109/TPAMI.2016.2572683
Ö. Çiçek, A. Abdulkadir, S.S. Lienkamp, T. Brox, O. RonnebergerMedical Image Computing and Computer Assisted Intervention
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., and Ronneberger, O. (2016). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. In Medical Image Computing and Computer Assisted Intervention. 424–432. 10.1007/978-3-319-46723-8_49
F. Milletari, N. Navab, S. Ahmadi
Milletari, F., Navab, N., and Ahmadi, S. (2016). V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 Fourth International Conference on 3D Vision (3DV). 565–571. 10.1109/3DV.2016.79
Q. Tao, W. Yan, Y. Wang, E.H M. Paiman, D.P. Shamonin, P. GargRadiology
Tao, Q., Yan, W., Wang, Y., Paiman, E. H. M., Shamonin, D. P., Garg, P., et al. (2019). Deep learning–based method for fully automatic quantification of left ventricle...

References

Unlock full article access by joining Solve