Skip to main navigation Skip to search Skip to main content

UMedNeRF: Uncertainty-Aware Single View Volumetric Rendering For Medical Neural Radiance Fields

  • Jing Hu
  • , Qinrui Fan
  • , Shu Hu
  • , Siwei Lyu
  • , Xi Wu
  • , Xin Wang
  • Chengdu University of Information Technology
  • Purdue University
  • SUNY Albany

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

16 Scopus citations

Abstract

In the field of clinical medicine, computed tomography (CT) is an effective medical imaging modality for the diagnosis of various pathologies. Compared with X-ray images, CT images can provide more information, including multi-planar slices and three-dimensional structures for clinical diagnosis. However, CT imaging requires patients to be exposed to large doses of ionizing radiation for a long time, which may cause irreversible physical harm. In this paper, we propose an Uncertainty-aware MedNeRF (UMedNeRF) network based on generated radiation fields. This network can learn a continuous representation of CT projections from 2D X-ray images by obtaining the internal structure and depth information and using multi-task adaptive loss weights to ensure the quality of the generated images. Our model is trained on publicly available knee and chest datasets, and we show the results of CT projection rendering with a single X-ray and compare our method with other methods based on generated radiation fields.

Original languageEnglish
Title of host publicationIEEE International Symposium on Biomedical Imaging, ISBI 2024 - Conference Proceedings
PublisherIEEE Computer Society
ISBN (Electronic)9798350313338
DOIs
StatePublished - 2024
Event21st IEEE International Symposium on Biomedical Imaging, ISBI 2024 - Athens, Greece
Duration: May 27 2024May 30 2024

Publication series

NameProceedings - International Symposium on Biomedical Imaging
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference21st IEEE International Symposium on Biomedical Imaging, ISBI 2024
Country/TerritoryGreece
CityAthens
Period05/27/2405/30/24

Keywords

  • CT Reconstruction
  • Deep Learning
  • GAN
  • Medical Imaging
  • NeRF
  • Uncertainty
  • X-ray

Fingerprint

Dive into the research topics of 'UMedNeRF: Uncertainty-Aware Single View Volumetric Rendering For Medical Neural Radiance Fields'. Together they form a unique fingerprint.

Cite this