Evaluating AI-based static stereoscopic rendering of indoor panoramic scenes
Loading...
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Panoramic imaging has recently become an extensively used technology for the representation and exploration of indoor environments. Panoramic cameras generate omnidirectional images that provide a comprehensive 360-degree view, making them a valuable tool for applications such as virtual tours in real estate, architecture, and cultural heritage. However, constructing truly immersive experiences from panoramic images presents challenges, particularly in generating panoramic stereo pairs that offer consistent depth cues and visual comfort across all viewing directions. Traditional stereo-imaging techniques do not directly apply to spherical panoramic images, requiring complex processing to avoid artifacts that can disrupt immersion. To address these challenges, various imaging and processing technologies have been developed, including multi-camera systems and computational methods that generate stereo images from a single panoramic input. Although effective, these solutions often involve complicated hardware and processing pipelines. Recently, deep learning approaches have emerged, enabling novel view generation from single panoramic images. While these methods show promise, they have not yet been thoroughly evaluated in practical scenarios. This paper presents a series of evaluation experiments aimed at assessing different technologies for creating static stereoscopic environments from omnidirectional imagery, with a focus on 3DOF immersive exploration. A user study was conducted using a WebXR prototype and a Meta Quest 3 headset to quantitatively and qualitatively compare traditional image composition techniques with AI-based methods. Our results indicate that while traditional methods provide a satisfactory level of immersion, AI-based generation is nearing a quality level suitable for deployment in web-based environments.
Description
CCS Concepts: Computing methodologies → Computer vision; Virtual reality; Neural networks
@inproceedings{10.2312:stag.20241333,
booktitle = {Smart Tools and Applications in Graphics - Eurographics Italian Chapter Conference},
editor = {Caputo, Ariel and Garro, Valeria and Giachetti, Andrea and Castellani, Umberto and Dulecha, Tinsae Gebrechristos},
title = {{Evaluating AI-based static stereoscopic rendering of indoor panoramic scenes}},
author = {Jashari, Sara and Tukur, Muhammad and Boraey, Yehia and Alzubaidi, Mahmood and Pintore, Giovanni and Gobbetti, Enrico and Villanueva, Alberto Jaspe and Schneider, Jens and Fetais, Noora and Agus, Marco},
year = {2024},
publisher = {The Eurographics Association},
ISSN = {2617-4855},
ISBN = {978-3-03868-265-3},
DOI = {10.2312/stag.20241333}
}