Foveated Real-Time Ray Tracing for Head-Mounted Displays

dc.contributor.authorWeier, Martinen_US
dc.contributor.authorRoth, Thorstenen_US
dc.contributor.authorKruijff, Ernsten_US
dc.contributor.authorHinkenjann, Andréen_US
dc.contributor.authorPérard-Gayot, Arsèneen_US
dc.contributor.authorSlusallek, Philippen_US
dc.contributor.authorLi, Yongminen_US
dc.contributor.editorEitan Grinspun and Bernd Bickel and Yoshinori Dobashien_US
dc.date.accessioned2016-10-11T05:20:08Z
dc.date.available2016-10-11T05:20:08Z
dc.date.issued2016
dc.description.abstractHead-mounted displays with dense pixel arrays used for virtual reality applications require high frame rates and low latency rendering. This forms a challenging use case for any rendering approach. In addition to its ability of generating realistic images, ray tracing offers a number of distinct advantages, but has been held back mainly by its performance. In this paper, we present an approach that significantly improves image generation performance of ray tracing. This is done by combining foveated rendering based on eye tracking with reprojection rendering using previous frames in order to drastically reduce the number of new image samples per frame. To reproject samples a coarse geometry is reconstructed from a G-Buffer. Possible errors introduced by this reprojection as well as parts that are critical to the perception are scheduled for resampling. Additionally, a coarse color buffer is used to provide an initial image, refined smoothly by more samples were needed. Evaluations and user tests show that our method achieves real-time frame rates, while visual differences compared to fully rendered images are hardly perceivable. As a result, we can ray trace non-trivial static scenes for the Oculus DK2 HMD at 1182x1464 per eye within the the VSync limits without perceived visual differences.en_US
dc.description.number7
dc.description.sectionheadersRay Tracing/Appearance Capture
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume35
dc.identifier.doi10.1111/cgf.13026
dc.identifier.issn1467-8659
dc.identifier.pages289-298
dc.identifier.urihttps://doi.org/10.1111/cgf.13026
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13026
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectI.3.7 [Computer Graphics]
dc.subjectThree Dimensional Graphics and Realism
dc.subjectRay Tracing
dc.subjectVirtual Reality
dc.titleFoveated Real-Time Ray Tracing for Head-Mounted Displaysen_US
Files
Collections