NPAR2017

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/2631863

Expressive 2017

Joint Symposium of
Computational Aesthetics (CAe)
Non-Photorealistic Animation and Rendering (NPAR)
Sketch-Based Interfaces and Modeling (SBIM)

Los Angeles, California | June 29 – 30, 2017

Front-and Backmatter
Sketching
SmartSketcher: Sketch-based Image Retrieval with Dynamic Semantic Reranking
[full paper Image] [meta data Image]
Tiziano Portenier, Qiyang Hu, Paolo Favaro, and Matthias Zwicker
Conquering the Cube: Learning to Sketch Primitives in Perspective with an Intelligent Tutoring System
[full paper Image] [meta data Image]
Swarna Keshavabhotla, Blake Williford, Shalini Kumar, Ethan Hilton, Paul Taele, Wayne Li, Julie Linsey, and Tracy Hammond
Flow2Code: From Hand-drawn Flowcharts to Code Execution
[full paper Image] [meta data Image]
Jorge-Ivan Herrera-Camara and Tracy Hammond
3D (The Third Dimension)
Interactive swept surface modeling in virtual reality with motion-tracked controllers
[full paper Image] [meta data Image]
Tim McGraw, Esteban Garcia, and Drew Sumner
General Submissions (Abstracts)
A taxonomy of motion applications in data visualization
[full paper Image] [meta data Image]
Irene de la Torre - Arenas and Pedro Cruz
Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations
[full paper Image] [meta data Image]
Saif Castaneda and Ergun Akleman
Modeling Go: A mobile sketch-based modeling system for extracting objects
[full paper Image] [meta data Image]
Chun-An Lai and Pei-Ying Chiang
Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces
[full paper Image] [meta data Image]
Ozan Can Altıok and Tev k Metin Sezgin
Sketch and Shade : An interactive assistant for sketching and shading
[full paper Image] [meta data Image]
Amal Dev Parakkat, Sarang Anil Joshi, Uday Bondi Pundarikaksha, and Ramanathan Muthuganapathy

BibTeX (NPAR2017)
@inproceedings{
not assigned,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Front- and Backmatter: NPAR 2017}},

author = {
Holger Winnemoeller
 and 
Lyn Bartram
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
not assigned}

}
@inproceedings{
10.1145:3092919.3092926,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Pigment-Based Recoloring of Watercolor Paintings}},

author = {
Aharoni-Mack, Elad
 and 
Shambik, Yakov
 and 
Lischinski, Dani
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092926}

}
@inproceedings{
10.1145:3092919.3092928,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Edge- and substrate-based effects for watercolor stylization}},

author = {
Montesdeoca, Santiago E.
 and 
Seah, Hock Soon
 and 
Bénard, Pierre
 and 
Vergne, Romain
 and 
Thollot, Joëlle
 and 
Rall, Hans-Martin
 and 
Benvenuti, Davide
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092928}

}
@inproceedings{
10.1145:3092919.3092929,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Example-Based Brushes for Coherent Stylized Renderings}},

author = {
Zheng, Ming
 and 
Milliez, Antoine
 and 
Gross, Markus
 and 
Sumner, Robert W.
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092929}

}
@inproceedings{
10.1145:3092919.3092924,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Depth-aware Neural Style Transfer}},

author = {
Liu, Xiao-Chang
 and 
Cheng, Ming-Ming
 and 
Lai, Yu-Kun
 and 
Rosin, Paul L.
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092924}

}
@inproceedings{
10.1145:3092919.3092920,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?}},

author = {
Semmo, Amir
 and 
Isenberg, Tobias
 and 
Döllner, Jürgen
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092920}

}
@inproceedings{
10.1145:3092919.3092922,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Real-Time Panorama Maps}},

author = {
Brown, S. Alex
 and 
Samavati, Faramarz
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092922}

}
@inproceedings{
10.1145:3092919.3092925,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Whole-Cloth Quilting Patterns from Photographs}},

author = {
Liu, Chenxi
 and 
Hodgins, Jessica
 and 
McCann, James
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092925}

}
@inproceedings{
10.1145:3092919.3092923,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Quantifying Visual Abstraction  ality for Stipple Drawings}},

author = {
Spicker, Marc
 and 
Hahn, Franz
 and 
Lindemeier, Thomas
 and 
Saupe, Dietmar
 and 
Deussen, Oliver
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092923}

}
@inproceedings{
10.1145:3092919.3092930,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
A generic framework for the structured abstraction of images}},

author = {
Faraj, Noura
 and 
Xia,  Gui-Song
 and 
Delon,  Julie
 and 
Gousseau, Yann
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092930}

}
@inproceedings{
10.1145:3092919.3092927,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Mixed Illumination Analysis in Single Image for Interactive Color Grading}},

author = {
Duchêne, Sylvain
 and 
Aliaga, Carlos
 and 
Pouli, Tania
 and 
Pérez, Patrick
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092927}

}
@inproceedings{
10.1145:3092919.3092921,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Benchmarking Non-Photorealistic Rendering of Portraits}},

author = {
Rosin, Paul L.
 and 
Mould, David
 and 
Winnem, Holger
 and 
Berger, Itamar
 and 
Collomosse, John
 and 
Lai, Yu-Kun
 and 
Li, Chuan
 and 
Li, Hua
 and 
Shamir, Ariel
 and 
Wand, Michael
 and 
Wang, Tinghuai
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3092919.3092921}

}
@inproceedings{
10.1145:3122791.3122798,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
A taxonomy of motion applications in data visualization}},

author = {
Arenas, Irene de la Torre -
 and 
Cruz, Pedro
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3122791.3122798}

}
@inproceedings{
10.1145:3122791.3122800,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations}},

author = {
Castaneda, Saif
 and 
Akleman, Ergun
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3122791.3122800}

}
@inproceedings{
10.1145:3122791.3122797,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Modeling Go: A mobile sketch-based modeling system for extracting objects}},

author = {
Lai, Chun-An
 and 
Chiang, Pei-Ying
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3122791.3122797}

}
@inproceedings{
10.1145:3122791.3122801,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces}},

author = {
Altıok, Ozan Can
 and 
Sezgin, Tev k Metin
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3122791.3122801}

}
@inproceedings{
10.1145:3122791.3122799,

booktitle = {
Non-Photorealistic Animation and Rendering},

editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Sketch and Shade : An interactive assistant for sketching and shading}},

author = {
Parakkat, Amal Dev
 and 
Joshi, Sarang Anil
 and 
Pundarikaksha, Uday Bondi
 and 
Muthuganapathy, Ramanathan
},
year = {
2017},

publisher = {
Association for Computing Machinery, Inc (ACM)},


ISSN = {-},
ISBN = {978-1-4503-5081-5},

DOI = {
10.1145/3122791.3122799}

}

Browse

Recent Submissions

Now showing 1 - 17 of 17
  • Thumbnail Image
    Item
    Front- and Backmatter: NPAR 2017
    (Association for Computing Machinery, Inc (ACM), 2017) Holger Winnemoeller; Lyn Bartram; Holger Winnemoeller and Lyn Bartram
  • Thumbnail Image
    Item
    Pigment-Based Recoloring of Watercolor Paintings
    (Association for Computing Machinery, Inc (ACM), 2017) Aharoni-Mack, Elad; Shambik, Yakov; Lischinski, Dani; Holger Winnemoeller and Lyn Bartram
    The color palette used by an artist when creating a painting is an important tool for expressing emotion, directing attention, and more. However, choosing a palette is an intricate task that requires considerable skill and experience. In this work, we introduce a new tool designed to allow artists to experiment with alternative color palettes for existing watercolor paintings. This could be useful for generating alternative renditions for an existing painting, or for aiding in the selection of a palette for a new painting, related to an existing one. Our tool first estimates the original pigment-based color palette used to create the painting, and then decomposes the painting into a collection of pigment channels, each corresponding to a single palette color. In both of these tasks, we employ a version of the Kubelka-Munk model, which predicts the reflectance of a given mixture of pigments. Each channel in the decomposition is a piecewise-smooth map that specifies the concentration of one of the colors in the palette across the image. Another estimated map specifies the total thickness of the pigments across the image. The mixture of these pigment channels, also according to the Kubelka- Munk model, reconstructs the original painting. The artist is then able to manipulate the individual palette colors, obtaining results by remixing the pigment channels at interactive rates.
  • Thumbnail Image
    Item
    Edge- and substrate-based effects for watercolor stylization
    (Association for Computing Machinery, Inc (ACM), 2017) Montesdeoca, Santiago E.; Seah, Hock Soon; Bénard, Pierre; Vergne, Romain; Thollot, Joëlle; Rall, Hans-Martin; Benvenuti, Davide; Holger Winnemoeller and Lyn Bartram
    We investigate characteristic edge- and substrate-based effects for watercolor stylization. These two fundamental elements of painted art play a significant role in traditional watercolors and highly influence the pigment's behavior and application. Yet a detailed consideration of these specific elements for the stylization of 3D scenes has not been attempted before. Through this investigation, we contribute to the field by presenting ways to emulate two novel effects: dry-brush and gaps & overlaps. By doing so, we also found ways to improve upon well-studied watercolor effects such as edge- darkening and substrate granulation. Finally, we integrated con- trollable external lighting influences over the watercolorized result, together with other previously researched watercolor effects. These effects are combined through a direct stylization pipeline to produce sophisticated watercolor imagery, which retains spatial coherence in object-space and is locally controllable in real-time.
  • Thumbnail Image
    Item
    Example-Based Brushes for Coherent Stylized Renderings
    (Association for Computing Machinery, Inc (ACM), 2017) Zheng, Ming; Milliez, Antoine; Gross, Markus; Sumner, Robert W.; Holger Winnemoeller and Lyn Bartram
    Painterly stylization is the cornerstone of non-photorealistic render- ing. Inspired by the versatility of paint as a physical medium, exist- ing methods target intuitive interfaces that mimic physical brushes, providing artists the ability to intuitively place paint strokes in a digital scene. Other work focuses on physical simulation of the interaction between paint and paper or realistic rendering of wet and dry paint. In our work, we leverage the versatility of example- based methods that can generate paint strokes of arbitrary shape and style based on a collection of images acquired from physical media. Such ideas have gained popularity since they do not require cumbersome physical simulation and achieve high fidelity without the need of a specific model or rule set. However, existing methods are limited to the generation of static 2D paintings and cannot be applied in the context of 3D painting and animation where paint strokes change shape and length as the camera viewport moves. Our method targets this shortcoming by generating temporally- coherent example-based paint strokes that accommodate to such length and shape changes. We demonstrate the robustness of our method with a 2D painting application that provides immediate feedback to the user and show how our brush model can be ap- plied to the screen-space rendering of 3D paintings on a variety of examples.
  • Thumbnail Image
    Item
    Depth-aware Neural Style Transfer
    (Association for Computing Machinery, Inc (ACM), 2017) Liu, Xiao-Chang; Cheng, Ming-Ming; Lai, Yu-Kun; Rosin, Paul L.; Holger Winnemoeller and Lyn Bartram
    Neural style transfer has recently received signi cant a ention and demonstrated amazing results. An e cient solution proposed by Johnson et al. trains feed-forward convolutional neural networks by de ning and optimizing perceptual loss functions. Such methods are typically based on high-level features extracted from pre-trained neural networks, where the loss functions contain two components: style loss and content loss. However, such pre-trained networks are originally designed for object recognition, and hence the high-level features o en focus on the primary target and neglect other details. As a result, when input images contain multiple objects potentially at di erent depths, the resulting images are o en unsatisfactory because image layout is destroyed and the boundary between the foreground and background as well as di erent objects becomes obscured. We observe that the depth map e ectively re ects the spatial distribution in an image and preserving the depth map of the content image a er stylization helps produce an image that preserves its semantic content. In this paper, we introduce a novel approach for neural style transfer that integrates depth preservation as additional loss, preserving overall image layout while performing style transfer.
  • Thumbnail Image
    Item
    Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?
    (Association for Computing Machinery, Inc (ACM), 2017) Semmo, Amir; Isenberg, Tobias; Döllner, Jürgen; Holger Winnemoeller and Lyn Bartram
    In this meta paper we discussimage-based artistic rendering (IB-AR)based onneural style transfer(NST) and argue, while NST may represent a paradigm shift for IB-AR, that it also has to evolve as an interactive tool that considers the design aspects and mecha- nisms of artwork production. IB-AR received signifficant attention in the past decades for visual communication, covering a plethora of techniques to mimic the appeal of artistic media. Example-based renderingrepresents one the most promising paradigms in IB-AR to (semi-)automatically simulate artistic media with high fidelity, but so far has been limited because it relies on pre-defined image pairs for training or informs only low-level image features for texture transfers. Advancements in deep learning showed to alleviate these limitations by matching content and style statistics via activations of neural network layers, thus making a generalized style trans- fer practicable. We categorize style transfers within the taxonomy of IB-AR, then propose a semiotic structure to derive a technical research agenda for NSTs with respect to the grand challenges of NPAR. We finally discuss the potentials of NSTs, thereby identifying applications such as casual creativity and art production.
  • Thumbnail Image
    Item
    Real-Time Panorama Maps
    (Association for Computing Machinery, Inc (ACM), 2017) Brown, S. Alex; Samavati, Faramarz; Holger Winnemoeller and Lyn Bartram
    Panorama maps are stylized paintings of terrain often seen at tourist destinations. They are difficult to create since they are both artistic and grounded in real geographic data. In this paper we present techniques for rendering real-world data in the style of Heinrich Berann's panorama maps in a real-time application. We analyse several of Berann's paintings to identify the artistic elements used. We use this analysis to form algorithms that mimic the panorama map style, focusing on replicating the terrain deformation, distorted projection, terrain colouring, tree brush strokes, water rendering, and atmospheric scattering. In our approach we use freely available digital earth data to render interactive panorama maps without needing further design work.
  • Thumbnail Image
    Item
    Whole-Cloth Quilting Patterns from Photographs
    (Association for Computing Machinery, Inc (ACM), 2017) Liu, Chenxi; Hodgins, Jessica; McCann, James; Holger Winnemoeller and Lyn Bartram
    Whole-cloth quilts are decorative and functional artifacts made of plain cloth embellished with complicated stitching patterns. We describe a method that can automatically create a sewing pattern for a whole-cloth quilt from a photograph. Our technique begins with a segmented image, extracts desired and optional edges, and creates a continuous sewing path by approximately solving the Rural Postman Problem (RPP). In addition to many example quilts, we provide visual and numerical comparisons to previous single- line illustration approaches.
  • Thumbnail Image
    Item
    Quantifying Visual Abstraction ality for Stipple Drawings
    (Association for Computing Machinery, Inc (ACM), 2017) Spicker, Marc; Hahn, Franz; Lindemeier, Thomas; Saupe, Dietmar; Deussen, Oliver; Holger Winnemoeller and Lyn Bartram
    We investigate how the perceived abstraction quality of stipple illustrations is related to the number of points used to create them. Since it is di cult to nd objective functions that quantify the visual quality of such illustrations, we gather comparative data by a crowdsourcing user study and employ a paired comparison model to deduce absolute quality values. Based on this study we show that it is possible to predict the perceived quality of stippled representations based on the properties of an input image. Our results are related to Weber-Fechner's law from psychophysics and indicate a logarithmic relation between numbers of points and perceived abstraction quality. We give guidance for the number of stipple points that is typically enough to represent an input image well.
  • Thumbnail Image
    Item
    A generic framework for the structured abstraction of images
    (Association for Computing Machinery, Inc (ACM), 2017) Faraj, Noura; Xia, Gui-Song; Delon, Julie; Gousseau, Yann; Holger Winnemoeller and Lyn Bartram
    Structural properties are important clues for non-photorealistic representations of digital images. erefore, image analysis tools have been intensively used either to produce stroke-based render- ings or to yield abstractions of images. In this work, we propose to use a hierarchical and geometrical image representation, called a topographic map, made of shapes organized in a tree structure. ere are two main advantages of this analysis tool. Firstly, it is able to deal with all scales, so that every shape of the input image is represented. Secondly, it accounts for the inclusion properties within the image. By iteratively performing simple local operations on the shapes (removal, rotation, scaling, replacement. . . ), we are able to generate abstract renderings of digital photographs ranging from geometrical abstraction and painting-like e ects to style trans- fer, using the same framework. In particular, results show that it is possible to create abstract images evoking Malevitch's Suprematist school, while remaining grounded in the structure of digital images, by replacing all the shapes in the tree by simple geometric shapes.
  • Thumbnail Image
    Item
    Mixed Illumination Analysis in Single Image for Interactive Color Grading
    (Association for Computing Machinery, Inc (ACM), 2017) Duchêne, Sylvain; Aliaga, Carlos; Pouli, Tania; Pérez, Patrick; Holger Winnemoeller and Lyn Bartram
    Colorists often use keying or rotoscoping tools to access and edit particular colors or parts of the scene. Although necessary, this is a time-consuming and potentially imprecise process, as it is not possible to fully separate the influence of light sources in the scene from the colors of objects and actors within it. To simplify this process, we present a new solution for automatically estimating the color and influence of multiple illuminants, based on image variation analysis. Using this information, we present a new color grading tool for simply and interactively editing the colors of de- tected illuminants, which fits naturally in color grading workflows. We demonstrate the use of our solution in several scenes, evaluating the quality of our results by means of a psychophysical study.
  • Thumbnail Image
    Item
    Benchmarking Non-Photorealistic Rendering of Portraits
    (Association for Computing Machinery, Inc (ACM), 2017) Rosin, Paul L.; Mould, David; Berger, Itamar; Collomosse, John; Lai, Yu-Kun; Li, Chuan; Li, Hua; Shamir, Ariel; Wand, Michael; Wang, Tinghuai; Winnem, Holger; Holger Winnemoeller and Lyn Bartram
    We present a set of images for helping NPR practitioners evaluate their image-based portrait stylisation algorithms. Using a standard set both facilitates comparisons with other methods and helps ensure that presented results are representative. We give two levels of di culty, each consisting of 20 images selected systematically so as to provide good coverage of several possible portrait characteristics. We applied three existing portraitspeci c stylisation algorithms, two generalpurpose stylisation algorithms, and one general learn ing based stylisation algorithm to the rst level of the benchmark, corresponding to the type of constrained images that have o ften been used in portraitspeci c work. We found that the existing methods are generally e ective on this new image set, demon strating that level one of the benchmark is tractable; challenges remain at level two. Results revealed several advantages conferred by portraitspeci c algorithms over generalpurpose algorithms: portraitspeci c algorithms can use domainspeci c information to preserve key details such as eyes and to eliminate extraneous details, and they have more scope for semantically meaningful abstraction due to the underlying face model. Finally, we pro vide some thoughts on systematically extending the benchmark to higher levels of di fficulty.
  • Thumbnail Image
    Item
    A taxonomy of motion applications in data visualization
    (Association for Computing Machinery, Inc (ACM), 2017) Arenas, Irene de la Torre -; Cruz, Pedro; Holger Winnemoeller and Lyn Bartram
    We propose a new taxonomy that explains the roles of motion in data visualization, focusing especially on their communicative aspects. Our taxonomy clarifies the main axis in how visualization designers can employ motion in data portrayal.
  • Thumbnail Image
    Item
    Shading with Painterly Filtered Layers: A Technique to Obtain Painterly Portrait Animations
    (Association for Computing Machinery, Inc (ACM), 2017) Castaneda, Saif; Akleman, Ergun; Holger Winnemoeller and Lyn Bartram
    In this manuscript, we describe a process that can be used to create still and/or animated portrait paintings to be shown in Expressive Art Exhibit. Our process consists of two stages: (1) Creation of control textures for a Barycentric shader by using color information gathered from photographs to provide realistic looking skin rendering; (2) Filtering and compositing the layers of images that are obtained by control textures, which correspond to effects such as diffuse, specular and ambient. To demonstrate proof-of-concept, we have created a few rigid body animations of painterly portraits under different lighting conditions.
  • Thumbnail Image
    Item
    Modeling Go: A mobile sketch-based modeling system for extracting objects
    (Association for Computing Machinery, Inc (ACM), 2017) Lai, Chun-An; Chiang, Pei-Ying; Holger Winnemoeller and Lyn Bartram
    This article presents an easy to use mobile application which allows users to create 3D digital copies of their interested objects anywhere and anytime. An advanced 3-sweep modeling technique is developed to construct 3D primitives not only from generalized cylinder and cuboid, but also objects with symmetrical or non-uniformly scaled profiles. In addition, our system supports the texture and structure refinement which combine results created from multiple source images. The constructed 3D model will be the combination of our 3D primitives. The combined result can preserve more features which may not be seen from a single photo.
  • Thumbnail Image
    Item
    Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces
    (Association for Computing Machinery, Inc (ACM), 2017) Altıok, Ozan Can; Sezgin, Tev k Metin; Holger Winnemoeller and Lyn Bartram
    From a user interaction perspective, speech and sketching make a good couple for describing motion. Speech allows easy speci cation of content, events and relationships, while sketching brings in spatial expressiveness. Yet, we have insu cient knowledge of how sketching and speech can be used for motionbased video retrieval, because there are no existing retrieval systems that support such interaction. In this paper, we describe a WizardofOz protocol and a set of tools that we have developed to engage users in a sketch and speechbased video retrieval task. We report how the tools and the protocol t together using ''retrieval of soccer videos'' as a use case scenario. Our so ware is highly customizable, and our protocol is easy to follow. We believe that together they will serve as a convenient and powerful duo for studying a wide range of multimodal use cases.
  • Thumbnail Image
    Item
    Sketch and Shade : An interactive assistant for sketching and shading
    (Association for Computing Machinery, Inc (ACM), 2017) Parakkat, Amal Dev; Joshi, Sarang Anil; Pundarikaksha, Uday Bondi; Muthuganapathy, Ramanathan; Holger Winnemoeller and Lyn Bartram
    We present a drawing assistant for sketching and for assisting users in shading a hand drawn sketch. The augmented reality based system uses a sketch made by a professional and uses it to help inexperienced users to do sketching and shading. The input image is converted to a set of points based on simple heuristics for providing a “connect the dots'' interface for a user to aid sketching. With the help of a 2.5D mesh generated by our algorithm, the system assists the user by providing information about the colors that can be given in different parts of the sketch. The system was tested with users of different age groups and skill levels, indicating its usefulness.