NeRF for 3D Reconstruction from X-ray Angiography: Possibilities and Limitations

Simple item page
dc.contributor.authorMaas, Kirsten W. H.en_US
dc.contributor.authorPezzotti, Nicolaen_US
dc.contributor.authorVermeer, Amy J. E.en_US
dc.contributor.authorRuijters, Dannyen_US
dc.contributor.authorVilanova, Annaen_US
dc.contributor.editorHansen, Christianen_US
dc.contributor.editorProcter, Jamesen_US
dc.contributor.editorRenata G. Raidouen_US
dc.contributor.editorJönsson, Danielen_US
dc.contributor.editorHöllt, Thomasen_US
dc.date.accessioned2023-09-19T11:31:47Z
dc.date.available2023-09-19T11:31:47Z
dc.date.issued2023
dc.description.abstractNeural Radiance Field (NeRF) is a promising deep learning technique based on neural rendering for three-dimensional (3D) reconstruction. This technique has overcome several limitations of 3D reconstruction techniques, such as removing the need for 3D ground truth or two-dimensional (2D) segmentations. In the medical context, the 3D reconstruction of vessels from 2D X-ray angiography is a relevant problem. For example, the treatment of coronary arteries could still benefit from 3D reconstruction solutions, as common solutions do not suffice. Challenging areas in the 3D reconstruction from X-ray angiography are the vessel morphology characteristics, such as sparsity, overlap, and the distinction between foreground and background. Moreover, sparse view and limited angle X-ray projections restrict the information available for the 3D reconstructions. Many traditional and machine learning methods have been proposed, but they rely on demanding user interactions or require large amounts of training data. NeRF could solve these limitations, given that promising results have been shown for medical (X-ray) applications. However, to the best of our knowledge, no results have been shown with X-ray angiography projections or consider the vessel morphology characteristics. This paper explores the possibilities and limitations of using NeRF for 3D reconstruction from X-ray angiography. An extensive experimental analysis is conducted to quantitatively and qualitatively evaluate the effects of the X-ray angiographic challenges on the reconstruction quality. We demonstrate that NeRF has the potential for 3D Xray angiography reconstruction (e.g., reconstruction with sparse and limited angle X-ray projections) but also identify explicit limitations (e.g., the overlap of background structures) that must be addressed in future works.en_US
dc.description.sectionheadersRadiology and Histopathology
dc.description.seriesinformationEurographics Workshop on Visual Computing for Biology and Medicine
dc.identifier.doi10.2312/vcbm.20231210
dc.identifier.isbn978-3-03868-216-5
dc.identifier.issn2070-5786
dc.identifier.pages29-40
dc.identifier.pages12 pages
dc.identifier.urihttps://doi.org/10.2312/vcbm.20231210
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/vcbm20231210
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies -> Reconstruction; Applied computing -> Life and medical sciences
dc.subjectComputing methodologies
dc.subjectReconstruction
dc.subjectApplied computing
dc.subjectLife and medical sciences
dc.titleNeRF for 3D Reconstruction from X-ray Angiography: Possibilities and Limitationsen_US
Files
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
029-040.pdf
Size:
6.95 MB
Format:
Adobe Portable Document Format
Download
No Thumbnail Available
Name:
paper1000_mm.pdf
Size:
7.56 MB
Format:
Adobe Portable Document Format
Download
Collections
VCBM 2023: Eurographics Workshop on Visual Computing for Biology and Medicine