3DOR 15

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/12281

Browse

Browsing 3DOR 15 by Subject "Design Methodology"

Now showing 1 - 1 of 1
  • Thumbnail Image
    Item
    Towards Scientific Benchmarks: On Increasing the Credibility of Benchmarks
    (The Eurographics Association, 2015) Gundersen, Odd Erik; I. Pratikakis and M. Spagnuolo and T. Theoharis and L. Van Gool and R. Veltkamp
    Problem: Increasing the credibility of results from scientific benchmarks. Goal: Specify what exactly is required in order for a benchmark to be scientific. Contribution: (i) Specification of what it entails for a benchmark to be scientific, (ii) a metric for measuring the replicability of an experiment, (iii) a metric for measuring the replicability of a set of experiments, and (iv) Analysis of the replicability of SHREC 2015. Result: Replicability of SHREC 2015 can be increased by open sourcing the methods compared and improving documentation.