Learning from the Best - Visual Analysis of a Quasi-Optimal Data Labeling Strategy
| dc.contributor.author | Bernard, Jürgen | en_US |
| dc.contributor.author | Hutter, Marco | en_US |
| dc.contributor.author | Lehmann, Markus | en_US |
| dc.contributor.author | Müller, Martin | en_US |
| dc.contributor.author | Zeppelzauer, Matthias | en_US |
| dc.contributor.author | Sedlmair, Michael | en_US |
| dc.contributor.editor | Jimmy Johansson and Filip Sadlo and Tobias Schreck | en_US |
| dc.date.accessioned | 2018-06-02T17:54:33Z | |
| dc.date.available | 2018-06-02T17:54:33Z | |
| dc.date.issued | 2018 | |
| dc.description.abstract | An overarching goal of active learning strategies is to reduce the human effort when labeling datasets and training machine learning methods. In this work, we focus on the analysis of a (theoretical) quasi-optimal, ground-truth-based strategy for labeling instances, which we refer to as the upper limit of performance (ULoP). Our long-term goal is to improve existing active learning strategies and to narrow the gap between current strategies and the outstanding performance of ULoP. In an observational study conducted on five datasets, we leverage visualization methods to better understand how and why ULoP selects instances. Results show that the strategy of ULoP is not constant (as in most state-of-the-art active learning strategies) but changes within the labeling process. We identify three phases that are common to most observed labeling processes, partitioning the labeling process into (1) a Discovery Phase, (2) a Consolidation Phase, and (3) a Fine Tuning Phase. | en_US |
| dc.description.sectionheaders | Information Visualization and Visual Analytics | |
| dc.description.seriesinformation | EuroVis 2018 - Short Papers | |
| dc.identifier.doi | 10.2312/eurovisshort.20181085 | |
| dc.identifier.isbn | 978-3-03868-060-4 | |
| dc.identifier.pages | 95-99 | |
| dc.identifier.uri | https://diglib.eg.org:443/handle/10.2312/eurovisshort20181085 | |
| dc.identifier.uri | https://doi.org/10.2312/eurovisshort.20181085 | |
| dc.publisher | The Eurographics Association | en_US |
| dc.subject | Human | |
| dc.subject | centered computing | |
| dc.subject | Information visualization | |
| dc.subject | Theory of computation | |
| dc.subject | Active learning | |
| dc.title | Learning from the Best - Visual Analysis of a Quasi-Optimal Data Labeling Strategy | en_US |