Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth
| dc.contributor.author | Zhang, Xindan | en_US |
| dc.contributor.author | Li, Ying | en_US |
| dc.contributor.author | Sheng, Huankun | en_US |
| dc.contributor.author | Zhang, Xinnian | en_US |
| dc.contributor.editor | Chen, Renjie | en_US |
| dc.contributor.editor | Ritschel, Tobias | en_US |
| dc.contributor.editor | Whiting, Emily | en_US |
| dc.date.accessioned | 2024-10-13T18:09:30Z | |
| dc.date.available | 2024-10-13T18:09:30Z | |
| dc.date.issued | 2024 | |
| dc.description.abstract | Unsupervised domain adaptation (UDA) is increasingly used for 3D point cloud semantic segmentation tasks due to its ability to address the issue of missing labels for new domains. However, most existing unsupervised domain adaptation methods focus only on uni-modal data and are rarely applied to multi-modal data. Therefore, we propose a cross-modal UDA on multimodal datasets that contain 3D point clouds and 2D images for 3D Semantic Segmentation. Specifically, we first propose a Dual discriminator-based Domain Adaptation (Dd-bDA) module to enhance the adaptability of different domains. Second, given that the robustness of depth information to domain shifts can provide more details for semantic segmentation, we further employ a Dense depth Feature Fusion (DdFF) module to extract image features with rich depth cues. We evaluate our model in four unsupervised domain adaptation scenarios, i.e., dataset-to-dataset (A2D2→SemanticKITTI), Day-to-Night, country-tocountry (USA→Singapore), and synthetic-to-real (VirtualKITTI→SemanticKITTI). In all settings, the experimental results achieve significant improvements and surpass state-of-the-art models. | en_US |
| dc.description.number | 7 | |
| dc.description.sectionheaders | Image Processing and Filtering II | |
| dc.description.seriesinformation | Computer Graphics Forum | |
| dc.description.volume | 43 | |
| dc.identifier.doi | 10.1111/cgf.15250 | |
| dc.identifier.issn | 1467-8659 | |
| dc.identifier.pages | 11 pages | |
| dc.identifier.uri | https://doi.org/10.1111/cgf.15250 | |
| dc.identifier.uri | https://diglib.eg.org/handle/10.1111/cgf15250 | |
| dc.publisher | The Eurographics Association and John Wiley & Sons Ltd. | en_US |
| dc.subject | CCS Concepts: Computing methodologies → Point-based models | |
| dc.subject | Computing methodologies → Point | |
| dc.subject | based models | |
| dc.title | Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth | en_US |