Towards Multimodal Exploratory Data Analysis: SoniScope as a Prototypical Implementation

Thumbnail Image
Files
067-071.pdf (1.28 MB)
1036-file1.m4v (59.04 MB)
soniscope_prototype.zip (1.98 MB)
Date
2022
Authors
Enge, Kajetan
Rind, Alexander
Iber, Michael
Höldrich, Robert
Aigner, Wolfgang
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
The metaphor of auscultating with a stethoscope can be an inspiration to combine visualization and sonification for exploratory data analysis. This paper presents SoniScope, a multimodal approach and its prototypical implementation based on this metaphor. It combines a scatterplot with an interactive parameter mapping sonification, thereby conveying additional information about items that were selected with a visual lens. SoniScope explores several design options for the shape of its lens and the sorting of the selected items for subsequent sonification. Furthermore, the open-source prototype serves as a blueprint framework for how to combine D3.js visualization and SuperCollider sonification in the Jupyter notebook environment.
Description

CCS Concepts: Human-centered computing --> Visualization systems and tools; Auditory feedback; Sound-based input / output

        
@inproceedings{
10.2312:evs.20221095
,
booktitle = {
EuroVis 2022 - Short Papers
},
editor = {
Agus, Marco
 and 
Aigner, Wolfgang
 and 
Hoellt, Thomas
},
title = {{
Towards Multimodal Exploratory Data Analysis: SoniScope as a Prototypical Implementation
}},
author = {
Enge, Kajetan
 and 
Rind, Alexander
 and 
Iber, Michael
 and 
Höldrich, Robert
 and 
Aigner, Wolfgang
},
year = {
2022
},
publisher = {
The Eurographics Association
},
ISBN = {
978-3-03868-184-7
},
DOI = {
10.2312/evs.20221095
}
}
Citation
URI
https://doi.org/10.2312/evs.20221095
 https://diglib.eg.org:443/handle/10.2312/evs20221095
Collections
EuroVisShort2022