• Login
    View Item 
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 38 (2019)
    • 38-Issue 7
    • View Item
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 38 (2019)
    • 38-Issue 7
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Light Field Video Compression and Real Time Rendering

    Thumbnail
    View/Open
    v38i7pp265-276.pdf (14.99Mb)
    lfv_final.mp4 (150.7Mb)
    Date
    2019
    Author
    Hajisharif, Saghi ORCID
    Miandji, Ehsan
    Larsson, Per
    Tran, Kiet
    Unger, Jonas ORCID
    Pay-Per-View via TIB Hannover:

    Try if this item/paper is available.

    Metadata
    Show full item record
    Abstract
    Light field imaging is rapidly becoming an established method for generating flexible image based description of scene appearances. Compared to classical 2D imaging techniques, the angular information included in light fields enables effects such as post-capture refocusing and the exploration of the scene from different vantage points. In this paper, we describe a novel GPU pipeline for compression and real-time rendering of light field videos with full parallax. To achieve this, we employ a dictionary learning approach and train an ensemble of dictionaries capable of efficiently representing light field video data using highly sparse coefficient sets. A novel, key element in our representation is that we simultaneously compress both image data (pixel colors) and the auxiliary information (depth, disparity, or optical flow) required for view interpolation. During playback, the coefficients are streamed to the GPU where the light field and the auxiliary information are reconstructed using the dictionary ensemble and view interpolation is performed. In order to realize the pipeline we present several technical contributions including a denoising scheme enhancing the sparsity in the dataset which enables higher compression ratios, and a novel pruning strategy which reduces the size of the dictionary ensemble and leads to significant reductions in computational complexity during the encoding of a light field. Our approach is independent of the light field parameterization and can be used with data from any light field video capture system. To demonstrate the usefulness of our pipeline, we utilize various publicly available light field video datasets and discuss the medical application of documenting heart surgery.
    BibTeX
    @article {10.1111:cgf.13835,
    journal = {Computer Graphics Forum},
    title = {{Light Field Video Compression and Real Time Rendering}},
    author = {Hajisharif, Saghi and Miandji, Ehsan and Larsson, Per and Tran, Kiet and Unger, Jonas},
    year = {2019},
    publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.13835}
    }
    URI
    https://doi.org/10.1111/cgf.13835
    https://diglib.eg.org:443/handle/10.1111/cgf13835
    Collections
    • 38-Issue 7

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA
     

     

    Browse

    All of Eurographics DLCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    BibTeX | TOC

    Create BibTeX Create Table of Contents

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA