VISPI: Virtual Staging Pipeline for Single Indoor Panoramic Images

Simple item page
dc.contributor.authorShah, Uzairen_US
dc.contributor.authorJashari, Saraen_US
dc.contributor.authorTukur, Muhammaden_US
dc.contributor.authorPintore, Giovannien_US
dc.contributor.authorGobbetti, Enricoen_US
dc.contributor.authorSchneider, Jensen_US
dc.contributor.authorAgus, Marcoen_US
dc.contributor.editorCaputo, Arielen_US
dc.contributor.editorGarro, Valeriaen_US
dc.contributor.editorGiachetti, Andreaen_US
dc.contributor.editorCastellani, Umbertoen_US
dc.contributor.editorDulecha, Tinsae Gebrechristosen_US
dc.date.accessioned2024-11-11T12:48:01Z
dc.date.available2024-11-11T12:48:01Z
dc.date.issued2024
dc.description.abstractTaking a 360◦ image is the quickest and most cost-effective way to capture the entire environment around the viewer in a form that can be directly exploited for creating immersive content [PBAG23]. In this work, we introduce novel solutions for the virtual staging of indoor environments, supporting automatic emptying, object insertion, and relighting. Our solution, dubbed VISPI (Virtual Staging Pipeline for Single Indoor Panoramic Images), integrates data-driven processing components, that take advantage of the analysis of knowledge learned from massive data collections, within a real-time rendering and editing system, allowing for interactive restaging of indoor scenes. Key components of VISPI include: i) a holistic architecture based on a multi-task vision transformer for extracting geometry, semantic, and material information from a single panoramic image, ii) a lighting model based on spherical Gaussians, iii) a method for lighting estimation from the geometric, semantic, and material signals, and iv) a real-time editing and rendering component. The proposed framework provides an interactive and user-friendly solution for creating immersive visualizations of indoor spaces. We present a preliminary assessment of VISPI using a synthetic dataset - Structured3D - and demonstrate its application in creating restaged indoor scenes.en_US
dc.description.sectionheadersComputer Vision
dc.description.seriesinformationSmart Tools and Applications in Graphics - Eurographics Italian Chapter Conference
dc.identifier.doi10.2312/stag.20241334
dc.identifier.isbn978-3-03868-265-3
dc.identifier.issn2617-4855
dc.identifier.pages11 pages
dc.identifier.urihttps://doi.org/10.2312/stag.20241334
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/stag20241334
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Computer graphics; Computer vision; Shape inference; Neural networks
dc.subjectComputing methodologies → Computer graphics
dc.subjectComputer vision
dc.subjectShape inference
dc.subjectNeural networks
dc.titleVISPI: Virtual Staging Pipeline for Single Indoor Panoramic Imagesen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
stag20241334.pdf
Size:
5.61 MB
Format:
Adobe Portable Document Format
Download
Collections
Italian Chapter Conference 2024 - Smart Tools and Apps in Graphics