Quad‐fisheye Image Stitching for Monoscopic Panorama Reconstruction

Simple item page
dc.contributor.authorCheng, Haojieen_US
dc.contributor.authorXu, Chunxiaoen_US
dc.contributor.authorWang, Jiajunen_US
dc.contributor.authorZhao, Lingxiaoen_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2022-10-11T05:24:55Z
dc.date.available2022-10-11T05:24:55Z
dc.date.issued2022
dc.description.abstractMonoscopic panorama provides the display of omnidirectional contents surrounding the viewer. An increasingly popular way to reconstruct a panorama is to stitch a collection of fisheye images. However, such non‐planar views may result in problems such as distortions and boundary irregularities. In most cases, the computational expense for stitching non‐planar images is also too high to satisfy real‐time applications. In this paper, a novel monoscopic panorama reconstruction pipeline that produces better quad‐fisheye image stitching results for omnidirectional environment viewing is proposed. The main idea is to apply mesh deformation for image alignment. To optimize inter‐lens parallaxes, unwarped images are firstly cropped and reshuffled to facilitate the circular environment scene composition by the seamless ring‐connection of the panorama borders. Several mesh constraints are then adopted to ensure a high alignment accuracy. After alignment, the boundary of the result is rectified to be rectangular to prevent gapping artefacts. We further extend our approach to video stitching. The temporal smoothness model is added to prevent unexpected artefacts in the panoramic videos. To support interactive applications, our stitching algorithm is programmed using CUDA. The camera motion and average gradient per video frame are further calculated to accelerate for synchronous real‐life panoramic scene reconstruction and visualization. Experimental results demonstrate that our method has advantages in respects of alignment accuracy, adaptability and image quality of the stitching result.en_US
dc.description.number6
dc.description.sectionheadersArticles
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14512
dc.identifier.issn1467-8659
dc.identifier.pages94-109
dc.identifier.urihttps://doi.org/10.1111/cgf.14512
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14512
dc.publisher© 2022 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.subjectmonoscopic panorama
dc.subjectpanorama reconstruction
dc.subjectimage stitching
dc.subjectmesh deformation
dc.subjectGPU acceleration
dc.titleQuad‐fisheye Image Stitching for Monoscopic Panorama Reconstructionen_US
Files
Collections
41-Issue 6