41-Issue 3
Permanent URI for this collection
Browse
Browsing 41-Issue 3 by Issue Date
Now showing 1 - 20 of 45
Results Per Page
Sort Options
Item Exploring Multivariate Event Sequences with an Interactive Similarity Builder(The Eurographics Association and John Wiley & Sons Ltd., 2022) Xu, Shaobin; Sun, Minghui; Zhang, Zhengtai; Xue, Hao; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasSimilarity-based exploration is an effective method in knowledge discovery. Faced with multivariate event sequence data (MVES), developing a satisfactory similarity measurement for a specific question is challenging because of the heterogeneity introduced by numerous attributes with different data formats, coupled with their associations. Additionally, the absence of effective validation feedback makes judging the goodness of a measurement scheme a time-consuming and error-prone procedure. To free analysts from tedious programming to concentrate on the exploration of MVES data, this paper introduces an interactive similarity builder, where analysts can use visual building blocks for assembling similarity measurements in a drag-and-drop and incremental fashion. Based on the builder, we further propose a visual analytics framework that provides multi-granularity visual validations for measurement schemes and supports a recursive workflow for refining the focus set. We illustrate the power of our prototype through a case study and a user study with real-world datasets. Results suggest that the system improves the efficiency of developing similarity measurements and the usefulness of exploring MVES data.Item Reusing Interactive Analysis Workflows(The Eurographics Association and John Wiley & Sons Ltd., 2022) Gadhave, Kiran; Cutler, Zach; Lex, Alexander; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasInteractive visual analysis has many advantages, but an important disadvantage is that analysis processes and workflows cannot be easily stored and reused. This is in contrast to code-based analysis workflows, which can simply be run on updated datasets, and adapted when necessary. In this paper, we introduce methods to capture workflows in interactive visualization systems for different interactions such as selections, filters, categorizing/grouping, labeling, and aggregation. These workflows can then be applied to updated datasets, making interactive visualization sessions reusable. We demonstrate this specification using an interactive visualization system that tracks interaction provenance, and allows generating workflows from the recorded actions. The system can then be used to compare different versions of datasets and apply workflows to them. Finally, we introduce a Python library that can load workflows and apply it to updated datasets directly in a computational notebook, providing a seamless bridge between computational workflows and interactive visualization tools.Item LineageD: An Interactive Visual System for Plant Cell Lineage Assignments based on Correctable Machine Learning(The Eurographics Association and John Wiley & Sons Ltd., 2022) Hong, Jiayi; Trubuil, Alain; Isenberg, Tobias; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasWe describe LineageD-a hybrid web-based system to predict, visualize, and interactively adjust plant embryo cell lineages. Currently, plant biologists explore the development of an embryo and its hierarchical cell lineage manually, based on a 3D dataset that represents the embryo status at one point in time. This human decision-making process, however, is time-consuming, tedious, and error-prone due to the lack of integrated graphical support for specifying the cell lineage. To fill this gap, we developed a new system to support the biologists in their tasks using an interactive combination of 3D visualization, abstract data visualization, and correctable machine learning to modify the proposed cell lineage. We use existing manually established cell lineages to obtain a neural network model. We then allow biologists to use this model to repeatedly predict assignments of a single cell division stage. After each hierarchy level prediction, we allow them to interactively adjust the machine learning based assignment, which we then integrate into the pool of verified assignments for further predictions. In addition to building the hierarchy this way in a bottom-up fashion, we also offer users to divide the whole embryo and create the hierarchy tree in a top-down fashion for a few steps, improving the ML-based assignments by reducing the potential for wrong predictions. We visualize the continuously updated embryo and its hierarchical development using both 3D spatial and abstract tree representations, together with information about the model's confidence and spatial properties. We conducted case study validations with five expert biologists to explore the utility of our approach and to assess the potential for LineageD to be used in their daily workflow. We found that the visualizations of both 3D representations and abstract representations help with decision making and the hierarchy tree top-down building approach can reduce assignments errors in real practice.Item Visual Analytics of Contact Tracing Policy Simulations During an Emergency Response(The Eurographics Association and John Wiley & Sons Ltd., 2022) Sondag, Max; Turkay, Cagatay; Xu, Kai; Matthews, Louise; Mohr, Sibylle; Archambault, Daniel; ; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasEpidemiologists use individual-based models to (a) simulate disease spread over dynamic contact networks and (b) to investigate strategies to control the outbreak. These model simulations generate complex 'infection maps' of time-varying transmission trees and patterns of spread. Conventional statistical analysis of outputs offers only limited interpretation. This paper presents a novel visual analytics approach for the inspection of infection maps along with their associated metadata, developed collaboratively over 16 months in an evolving emergency response situation. We introduce the concept of representative trees that summarize the many components of a time-varying infection map while preserving the epidemiological characteristics of each individual transmission tree. We also present interactive visualization techniques for the quick assessment of different control policies. Through a series of case studies and a qualitative evaluation by epidemiologists, we demonstrate how our visualizations can help improve the development of epidemiological models and help interpret complex transmission patterns.Item SimilarityNet: A Deep Neural Network for Similarity Analysis Within Spatio-temporal Ensembles(The Eurographics Association and John Wiley & Sons Ltd., 2022) Huesmann, Karim; Linsen, Lars; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasLatent feature spaces of deep neural networks are frequently used to effectively capture semantic characteristics of a given dataset. In the context of spatio-temporal ensemble data, the latent space represents a similarity space without the need of an explicit definition of a field similarity measure. Commonly, these networks are trained for specific data within a targeted application. We instead propose a general training strategy in conjunction with a deep neural network architecture, which is readily applicable to any spatio-temporal ensemble data without re-training. The latent-space visualization allows for a comprehensive visual analysis of patterns and temporal evolution within the ensemble. With the use of SimilarityNet, we are able to perform similarity analyses on large-scale spatio-temporal ensembles in less than a second on commodity consumer hardware. We qualitatively compare our results to visualizations with established field similarity measures to document the interpretability of our latent space visualizations and show that they are feasible for an in-depth basic understanding of the underlying temporal evolution of a given ensemble.Item Hybrid Touch/Tangible Spatial Selection in Augmented Reality(The Eurographics Association and John Wiley & Sons Ltd., 2022) Sereno, Mickael; Gosset, Stéphane; Besançon, Lonni; Isenberg, Tobias; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasWe study tangible touch tablets combined with Augmented Reality Head-Mounted Displays (AR-HMDs) to perform spatial 3D selections. We are primarily interested in the exploration of 3D unstructured datasets such as cloud points or volumetric datasets. AR-HMDs immerse users by showing datasets stereoscopically, and tablets provide a set of 2D exploration tools. Because AR-HMDs merge the visualization, interaction, and the users' physical spaces, users can also use the tablets as tangible objects in their 3D space. Nonetheless, the tablets' touch displays provide their own visualization and interaction spaces, separated from those of the AR-HMD. This raises several research questions compared to traditional setups. In this paper, we theorize, discuss, and study different available mappings for manual spatial selections using a tangible tablet within an AR-HMD space. We then study the use of this tablet within a 3D AR environment, compared to its use with a 2D external screen.Item Leveraging Analysis History for Improved In Situ Visualization Recommendation(The Eurographics Association and John Wiley & Sons Ltd., 2022) Epperson, Will; Lee, Doris Jung-Lin; Wang, Leijie; Agarwal, Kunal; Parameswaran, Aditya G.; Moritz, Dominik; Perer, Adam; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasExisting visualization recommendation systems commonly rely on a single snapshot of a dataset to suggest visualizations to users. However, exploratory data analysis involves a series of related interactions with a dataset over time rather than one-off analytical steps. We present Solas, a tool that tracks the history of a user's data analysis, models their interest in each column, and uses this information to provide visualization recommendations, all within the user's native analytical environment. Recommending with analysis history improves visualizations in three primary ways: task-specific visualizations use the provenance of data to provide sensible encodings for common analysis functions, aggregated history is used to rank visualizations by our model of a user's interest in each column, and column data types are inferred based on applied operations. We present a usage scenario and a user evaluation demonstrating how leveraging analysis history improves in situ visualization recommendations on real-world analysis tasks.Item AirLens: Multi-Level Visual Exploration of Air Quality Evolution in Urban Agglomerations(The Eurographics Association and John Wiley & Sons Ltd., 2022) Qu, Dezhan; Lv, Cheng; Lin, Yiming; Zhang, Huijie; Wang, Rong; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasThe precise prevention and control of air pollution is a great challenge faced by environmental experts in recent years. Understanding the air quality evolution in the urban agglomeration is important for coordinated control of air pollution. However, the complex pollutant interactions between different cities lead to the collaborative evolution of air quality. The existing statistical and machine learning methods cannot well support the comprehensive analysis of the dynamic air quality evolution. In this study, we propose AirLens, an interactive visual analytics system that can help domain experts explore and understand the air quality evolution in the urban agglomeration from multiple levels and multiple aspects. To facilitate the cognition of the complex multivariate spatiotemporal data, we first propose a multi-run clustering strategy with a novel glyph design for summarizing and understanding the typical pollutant patterns effectively. On this basis, the system supports the multi-level exploration of air quality evolution, namely, the overall level, stage level and detail level. Frequent pattern mining, city community extraction and useful filters are integrated into the system for discovering significant information comprehensively. The case study and positive feedback from domain experts demonstrate the effectiveness and usability of AirLens.Item Misinformed by Visualization: What Do We Learn From Misinformative Visualizations?(The Eurographics Association and John Wiley & Sons Ltd., 2022) Lo, Leo Yu-Ho; Gupta, Ayush; Shigyo, Kento; Wu, Aoyu; Bertini, Enrico; Qu, Huamin; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasData visualization is powerful in persuading an audience. However, when it is done poorly or maliciously, a visualization may become misleading or even deceiving. Visualizations give further strength to the dissemination of misinformation on the Internet. The visualization research community has long been aware of visualizations that misinform the audience, mostly associated with the terms ''lie'' and ''deceptive.'' Still, these discussions have focused only on a handful of cases. To better understand the landscape of misleading visualizations, we open-coded over one thousand real-world visualizations that have been reported as misleading. From these examples, we discovered 74 types of issues and formed a taxonomy of misleading elements in visualizations. We found four directions that the research community can follow to widen the discussion on misleading visualizations: (1) informal fallacies in visualizations, (2) exploiting conventions and data literacy, (3) deceptive tricks in uncommon charts, and (4) understanding the designers' dilemma. This work lays the groundwork for these research directions, especially in understanding, detecting, and preventing them.Item Urban Rhapsody: Large-scale Exploration of Urban Soundscapes(The Eurographics Association and John Wiley & Sons Ltd., 2022) Rulff, João; Miranda, Fabio; Hosseini, Maryam; Lage, Marcos; Cartwright, Mark; Dove, Graham; Bello, Juan; Silva, Claudio T.; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasNoise is one of the primary quality-of-life issues in urban environments. In addition to annoyance, noise negatively impacts public health and educational performance. While low-cost sensors can be deployed to monitor ambient noise levels at high temporal resolutions, the amount of data they produce and the complexity of these data pose significant analytical challenges. One way to address these challenges is through machine listening techniques, which are used to extract features in attempts to classify the source of noise and understand temporal patterns of a city's noise situation. However, the overwhelming number of noise sources in the urban environment and the scarcity of labeled data makes it nearly impossible to create classification models with large enough vocabularies that capture the true dynamism of urban soundscapes. In this paper, we first identify a set of requirements in the yet unexplored domain of urban soundscape exploration. To satisfy the requirements and tackle the identified challenges, we propose Urban Rhapsody, a framework that combines state-of-the-art audio representation, machine learning and visual analytics to allow users to interactively create classification models, understand noise patterns of a city, and quickly retrieve and label audio excerpts in order to create a large high-precision annotated database of urban sound recordings. We demonstrate the tool's utility through case studies performed by domain experts using data generated over the five-year deployment of a one-of-a-kind sensor network in New York City.Item Level of Detail Exploration of Electronic Transition Ensembles using Hierarchical Clustering(The Eurographics Association and John Wiley & Sons Ltd., 2022) Sidwall Thygesen, Signe; Masood, Talha Bin; Linares, Mathieu; Natarajan, Vijay; Hotz, Ingrid; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasWe present a pipeline for the interactive visual analysis and exploration of molecular electronic transition ensembles. Each ensemble member is specified by a molecular configuration, the charge transfer between two molecular states, and a set of physical properties. The pipeline is targeted towards theoretical chemists, supporting them in comparing and characterizing electronic transitions by combining automatic and interactive visual analysis. A quantitative feature vector characterizing the electron charge transfer serves as the basis for hierarchical clustering as well as for the visual representations. The interface for the visual exploration consists of four components. A dendrogram provides an overview of the ensemble. It is augmented with a level of detail glyph for each cluster. A scatterplot using dimensionality reduction provides a second visualization, highlighting ensemble outliers. Parallel coordinates show the correlation with physical parameters. A spatial representation of selected ensemble members supports an in-depth inspection of transitions in a form that is familiar to chemists. All views are linked and can be used to filter and select ensemble members. The usefulness of the pipeline is shown in three different case studies.Item ModelWise: Interactive Model Comparison for Model Diagnosis, Improvement and Selection(The Eurographics Association and John Wiley & Sons Ltd., 2022) Meng, Linhao; Elzen, Stef van den; Vilanova, Anna; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasModel comparison is an important process to facilitate model diagnosis, improvement, and selection when multiple models are developed for a classification task. It involves careful comparison concerning model performance and interpretation. Current visual analytics solutions often ignore the feature selection process. They either do not support detailed analysis of multiple multi-class classifiers or rely on feature analysis alone to interpret model results. Understanding how different models make classification decisions, especially classification disagreements of the same instances, requires a deeper model understanding. We present ModelWise, a visual analytics method to compare multiple multi-class classifiers in terms of model performance, feature space, and model explanation. ModelWise adapts visualizations with rich interactions to support multiple workflows to achieve model diagnosis, improvement, and selection. It considers feature subspaces generated for use in different models and improves model understanding by model explanation. We demonstrate the usability of ModelWise with two case studies, one with a small exemplar dataset and another developed with a machine learning expert with real-world perioperative data.Item Of Course it's Political! A Critical Inquiry into Underemphasized Dimensions in Civic Text Visualization(The Eurographics Association and John Wiley & Sons Ltd., 2022) Baumer, Eric P. S.; Jasim, Mahmood; Sarvghad, Ali; Mahyar, Narges; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasRecent developments in critical information visualization have brought the field's attention to political, feminist, ethical, and rhetorical aspects of data visualization. However, less work has explored the interplay between design decisions and political ramifications-structures of authority, means of representation, etc. In this paper, we build upon these critical perspectives and highlight the political aspect of civic text visualization especially in the context of democratic decision-making. Based on a critical analysis of survey papers about text visualization in general, followed by a review on the status quo of text visualization in civics, we argue that civic text visualization inherits an exclusively analytic framing. This framing leads to a series of issues and challenges in the fundamentally political context of civics, such as misinterpretation of data, missing minority voices, and excluding the public from decision making processes. To span this gap between political context and analytic framing, we provide a series of two-pole conceptual dimensions, such as from singular user to multiple relationships, and from complexity to inclusivity of visualization design. For each dimension, we discuss how the tensions between these poles can help surface the political ramifications of design decisions in civic text visualization. These dimensions can thus help visualization researchers, designers, and practitioners attend more intentionally to these political aspects and inspire their design choices. We conclude by suggesting that these dimensions may be useful for visualization design across a variety of application domains, beyond civic text visualization.Item Rich Screen Reader Experiences for Accessible Data Visualization(The Eurographics Association and John Wiley & Sons Ltd., 2022) Zong, Jonathan; Lee, Crystal; Lundgard, Alan; Jang, JiWoong; Hajas, Daniel; Satyanarayan, Arvind; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasCurrent web accessibility guidelines ask visualization designers to support screen readers via basic non-visual alternatives like textual descriptions and access to raw data tables. But charts do more than summarize data or reproduce tables; they afford interactive data exploration at varying levels of granularity-from fine-grained datum-by-datum reading to skimming and surfacing high-level trends. In response to the lack of comparable non-visual affordances, we present a set of rich screen reader experiences for accessible data visualization and exploration. Through an iterative co-design process, we identify three key design dimensions for expressive screen reader accessibility: structure, or how chart entities should be organized for a screen reader to traverse; navigation, or the structural, spatial, and targeted operations a user might perform to step through the structure; and, description, or the semantic content, composition, and verbosity of the screen reader's narration. We operationalize these dimensions to prototype screen-reader-accessible visualizations that cover a diverse range of chart types and combinations of our design dimensions. We evaluate a subset of these prototypes in a mixed-methods study with 13 blind and visually impaired readers. Our findings demonstrate that these designs help users conceptualize data spatially, selectively attend to data of interest at different levels of granularity, and experience control and agency over their data analysis process.Item A Typology of Guidance Tasks in Mixed-Initiative Visual Analytics Environments(The Eurographics Association and John Wiley & Sons Ltd., 2022) Pérez-Messina, Ignacio; Ceneda, Davide; El-Assady, Mennatallah; Miksch, Silvia; Sperrle, Fabian; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasGuidance has been proposed as a conceptual framework to understand how mixed-initiative visual analytics approaches can actively support users as they solve analytical tasks. While user tasks received a fair share of attention, it is still not completely clear how they could be supported with guidance and how such support could influence the progress of the task itself. Our observation is that there is a research gap in understanding the effect of guidance on the analytical discourse, in particular, for the knowledge generation in mixed-initiative approaches. As a consequence, guidance in a visual analytics environment is usually indistinguishable from common visualization features, making user responses challenging to predict and measure. To address these issues, we take a system perspective to propose the notion of guidance tasks and we present it as a typology closely aligned to established user task typologies. We derived the proposed typology directly from a model of guidance in the knowledge generation process and illustrate its implications for guidance design. By discussing three case studies, we show how our typology can be applied to analyze existing guidance systems. We argue that without a clear consideration of the system perspective, the analysis of tasks in mixed-initiative approaches is incomplete. Finally, by analyzing matchings of user and guidance tasks, we describe how guidance tasks could either help the user conclude the analysis or change its course.Item DanmuVis: Visualizing Danmu Content Dynamics and Associated Viewer Behaviors in Online Videos(The Eurographics Association and John Wiley & Sons Ltd., 2022) Chen, Shuai; Li, Sihang; Li, Yanda; Zhu, Junlin; Long, Juanjuan; Chen, Siming; Zhang, Jiawan; Yuan, Xiaoru; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasDanmu (Danmaku) is a unique social media service in online videos, especially popular in Japan and China, for viewers to write comments while watching videos. The danmu comments are overlaid on the video screen and synchronized to the associated video time, indicating viewers' thoughts of the video clip. This paper introduces an interactive visualization system to analyze danmu comments and associated viewer behaviors in a collection of videos and enable detailed exploration of one video on demand. The watching behaviors of viewers are identified by comparing video time and post time of viewers' danmu. The system supports analyzing danmu content and viewers' behaviors against both video time and post time to gain insights into viewers' online participation and perceived experience. Our evaluations, including usage scenarios and user interviews, demonstrate the effectiveness and usability of our system.Item CorpusVis: Visual Analysis of Digital Sheet Music Collections(The Eurographics Association and John Wiley & Sons Ltd., 2022) Miller, Matthias; Rauscher, Julius; Keim, Daniel A.; El-Assady, Mennatallah; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasManually investigating sheet music collections is challenging for music analysts due to the magnitude and complexity of underlying features, structures, and contextual information. However, applying sophisticated algorithmic methods would require advanced technical expertise that analysts do not necessarily have. Bridging this gap, we contribute CorpusVis, an interactive visual workspace, enabling scalable and multi-faceted analysis. Our proposed visual analytics dashboard provides access to computational methods, generating varying perspectives on the same data. The proposed application uses metadata including composers, type, epoch, and low-level features, such as pitch, melody, and rhythm. To evaluate our approach, we conducted a pair-analytics study with nine participants. The qualitative results show that CorpusVis supports users in performing exploratory and confirmatory analysis, leading them to new insights and findings. In addition, based on three exemplary workflows, we demonstrate how to apply our approach to different tasks, such as exploring musical features or comparing composers.Item Interactively Assessing Disentanglement in GANs(The Eurographics Association and John Wiley & Sons Ltd., 2022) Jeong, Sangwon; Liu, Shusen; Berger, Matthew; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasGenerative adversarial networks (GAN) have witnessed tremendous growth in recent years, demonstrating wide applicability in many domains. However, GANs remain notoriously difficult for people to interpret, particularly for modern GANs capable of generating photo-realistic imagery. In this work we contribute a visual analytics approach for GAN interpretability, where we focus on the analysis and visualization of GAN disentanglement. Disentanglement is concerned with the ability to control content produced by a GAN along a small number of distinct, yet semantic, factors of variation. The goal of our approach is to shed insight on GAN disentanglement, above and beyond coarse summaries, instead permitting a deeper analysis of the data distribution modeled by a GAN. Our visualization allows one to assess a single factor of variation in terms of groupings and trends in the data distribution, where our analysis seeks to relate the learned representation space of GANs with attribute-based semantic scoring of images produced by GANs. Through use-cases, we show that our visualization is effective in assessing disentanglement, allowing one to quickly recognize a factor of variation and its overall quality. In addition, we show how our approach can highlight potential dataset biases learned by GANs.Item Seeing Through Sounds: Mapping Auditory Dimensions to Data and Charts for People with Visual Impairments(The Eurographics Association and John Wiley & Sons Ltd., 2022) Wang, Ruobin; Jung, Crescentia; Kim, Yea-Seul; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasSonification can be an effective medium for people with visual impairments to understand data in visualizations. However, there are no universal design principles that apply to various charts that encode different data types. Towards generalizable principles, we conducted an exploratory experiment to assess how different auditory channels (e.g., pitch, volume) impact the data and visualization perception among people with visual impairments. In our experiment, participants evaluated the intuitiveness and accuracy of the mapping of auditory channels on different data and chart types. We found that participants rated pitch to be the most intuitive, while the number of tappings and the length of sounds yielded the most accurate perception in decoding data. We study how audio channels can intuitively represent different charts and demonstrate that data-level perception might not directly transfer to chart-level perception as participants reflect on visual aspects of the charts while listening to audio. We conclude by how future experiments can be designed to establish a robust ranking for creating audio charts.Item A Grammar-Based Approach for Applying Visualization Taxonomies to Interaction Logs(The Eurographics Association and John Wiley & Sons Ltd., 2022) Gathani, Sneha; Monadjemi, Shayan; Ottley, Alvitta; Battle, Leilani; Borgo, Rita; Marai, G. Elisabeta; Schreck, TobiasResearchers collect large amounts of user interaction data with the goal of mapping user's workflows and behaviors to their high-level motivations, intuitions, and goals. Although the visual analytics community has proposed numerous taxonomies to facilitate this mapping process, no formal methods exist for systematically applying these existing theories to user interaction logs. This paper seeks to bridge the gap between visualization task taxonomies and interaction log data by making the taxonomies more actionable for interaction log analysis. To achieve this, we leverage structural parallels between how people express themselves through interactions and language by reformulating existing theories as regular grammars.We represent interactions as terminals within a regular grammar, similar to the role of individual words in a language, and patterns of interactions or non-terminals as regular expressions over these terminals to capture common language patterns. To demonstrate our approach, we generate regular grammars for seven existing visualization taxonomies and develop code to apply them to three public interaction log datasets. In analyzing these regular grammars, we find that the taxonomies at the low-level (i.e., terminals) show mixed results in expressing multiple interaction log datasets, and taxonomies at the high-level (i.e., regular expressions) have limited expressiveness, due to primarily two challenges: inconsistencies in interaction log dataset granularity and structure, and under-expressiveness of certain terminals. Based on our findings, we suggest new research directions for the visualization community to augment existing taxonomies, develop new ones, and build better interaction log recording processes to facilitate the data-driven development of user behavior taxonomies.