GCH 2024 - Eurographics Workshop on Graphics and Cultural Heritage

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/3607042

Browse

Now showing 1 - 20 of 34

AI-Driven Classification of a Design Photographic Archive
(The Eurographics Association, 2024) Rodriguez Echavarria, Karina; Samaroudi, Myrsini; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
The paper presents a workflow for deploying an Artificial Intelligence (AI) classification of a previously unclassified photographic collection, the Design Archive's glass plate negatives. This involved fine-tuning the DinoV2 self-supervised image retrieval system with a domain-expert taxonomy to classify approximately 10K images within 40 classes. As such, it addresses challenges relevant to the curation, analysis and discovery of large-scale visual collections. A 3D visualisation was implemented for users to access the outputs presenting images as data points using the Uniform Manifold Approximation and Projection for Dimension Reduction (UMAP) to project the embeddings of the neural network. The paper demonstrates the advantages of this approach and reflects how users can participate in the AI processes making them more transparent and trustable.
Applying BRDF Monotonicity for Refined Shading Normal Extraction from Multi-Light Image Collections
(The Eurographics Association, 2024) Pintus, Ruggero; Zorcolo, Antonio; Gobbetti, Enrico; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Multi-Light Image Collections (MLICs) are often transformed into geometric normals and BRDF normals for visual exploration under novel illumination. However, discrepancies between the chosen BRDF space and the complete optical behavior of objects, along with the possible presence of non-local lighting effects in measurements, often lead to sub-optimal visual outcomes even with the most accurate geometric normal recovery. In this paper, we introduce a modular component designed to convert the geometric normals into well-behaved shading normals, under the common and general assumption that the reflectance must be a monotonic function of the angle between the shading normal and the bisector of lighting and viewing directions. Since it does not require the coupling of shape and material estimation, the module allows seamless integration into existing reconstruction pipelines, supporting the mixing and matching of Photometric Stereo methods, BRDF models, and BRDF fitters. The performance and versatility of the approach are demonstrated through experiments.
Building Heritage Material Passports (BHMPs): digitalisation of Made in Italy's Heritage techniques for more Resilient Communities
(The Eurographics Association, 2024) Mazza, Arianna; Bernardo, Graziella; Guida, Antonella; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
The whole of Italy is characterized by small towns at risk of complete depopulation with a widespread and remarkable cultural heritage. These places, still little known and valued, are the testimony of the unique way of living and inhabiting the places belonging to the multifaceted wealth of Made in Italy. The work focuses on the knowledge and rediscovery of local materials and construction techniques using digital tools as a driver of sustainable development and resilience of small communities according to new models of the circular economy. The paper presents some preliminary results of research activities aimed at developing a proof-of-concept of Building Heritage Materials Passport (BHMPs) for the case study of the incannucciata construction technique found in the Rabatana, the ancient Arab district of the little town of Tursi in the Province of Matera (Basilicata, Italy).
Co-Presence with Skeletons: A Multi-User Immersive Augmented Reality Demonstration in Cultural Heritage
(The Eurographics Association, 2024) Bitter, Jessica L.; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
In this demonstration description, a prototype is presented that addresses the problem of isolation caused by single-user Augmented Reality (AR) applications used on cultural heritage (CH) sites. Using Microsoft's HoloLens 2 and Android smartphones, multiple visitors can experience the playful AR space together. Visitors follow a virtual guide together whereby authors can customize to how many users the system reacts, and engage in a labeling game in which visitors can collaboratively match Latin names and human bones to physical vertebrates' bones.
Colour Fidelity-respecting Workflow for Digital Cultural Heritage Preservation and Documentation
(The Eurographics Association, 2024) Barbero-Álvarez, Miguel Antonio; Brenner, Simon; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Colour is considered a representative characteristic of material cultural heritage pieces, especially when documenting them. Especially under digitalization processes, colour needs to be handled and preserved with care, given that digital tools may introduce uncontrolled variations in its representation, if not irreversibly lose it to certain degrees. This work aims to present an empirical workflow in order to successfully respect colour integrity when performing photogrammetry as a cultural heritage documentation asset. An experimental battery based on different combinations of acquisition conditions, RGB debayering, calibration and photogrammetry is presented, and based on the most successful parameters, conclusions are drawn for building guidelines for the optimum performance. The fact that control must be held over all processes to avoid undesired losses of information has been regarded as the highest priority, with the sole exception of the unpredictable colour blending operations during the proper photogrammetry. This paper ultimately demonstrates that preservation of colour information can be achieved on an excellent degree, and that having control over the factors of acquisition and colour digitalization parameters contributes to its success.
Computer-Assisted Collaborative Fragment Matching of Incomplete Stone Artifacts
(The Eurographics Association, 2024) Houska, Peter; Masur, Alessandra; Kloiber, Simon; Lengauer, Stefan; Karl, Stephan; Preiner, Reinhold; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Archaeological artifacts are often only preserved in fragments. Their reassembly is thus a common task for conservators and archaeologists. Unfortunately, this reassembly process is anything but trivial. Major complicating factors are given if fragments are (1) eroded and weathered, (2) incomplete and missing, and (3) expose little to no geometric surface features or surface-color variations. Artifacts made of white marble, which was generally used in antiquity, pose an additional challenge for reassembly due to (4) their weight and (5) the fragility of the crystalline material. This holds for both freestanding marble sculptures and relief stones or otherwise decorated slabs. In this work, we focus on the reassembly problem of marble slabs with a flat surface, for which fragments are pre-oriented such that their top faces point upward. While computer-based reassembly algorithms exist, they are typically tuned for specific types of artifacts and rely on joining fragments based on a combination of a geometric and surface-color correspondence. Hence, methods that reassemble broken and deteriorated white marble slabs typically perform worse than the respective domain experts. Due to the foreseeable shortcomings of reassembly algorithms when applied to eroded, incomplete, and widely feature-less white marble fragments, we refrain from designing an algorithm for the specific problem at hand. Instead, we incorporate a large number of users from the broad public in the reassembly process. To that end, we provide an intuitive interactive web platform that allows users access to 3D digital twins of the Christian marble-slab fragments. Transferring the fragments to the virtual domain also enables the introduction of algorithmic automatisms to assist the users in the process. In this paper, we present the system design and the provided basic geometric automatisms, and report on their efficiency and utilization in an ongoing large-scale citizen-science experiment that involves several thousand users.
Creating Location-based Visual Presence Experiences for Museums with Immersive Technology
(The Eurographics Association, 2024) Spierling, Ulrike; Bitter, Jessica L.; Kräuter, Noura; Liu, Yu; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
This Poster (accompanying demos) presents an overview of creative approaches and considerations in the design research process of exploring different feelings of immersion and presence through Augmented Reality with headmounted devices in a museum. It shows ongoing work in the EU-funded project LoGaCulture (Locative Games in Cultural Heritage), in particular in the practical research that develops case studies for a Natural History museum. We summarise design criteria, concepts and prototypical implementations regarding the qualities of presence, playfulness and usability.
Dancing through Time: Walking through a Dance Audiovisual Archive
(The Eurographics Association, 2024) Alliata, Giacomo; Kenderdine, Sarah; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Dancing through Time is an interactive installation created to discover the Prix de Lausanne archive, a collection of dance performance recordings over fifty-one years. It consists of a 4k-touch screen mounted on a twelve-meter rail, allowing visitors to walk through the fifty-one editions of the Prix de Lausanne dance competition. This paper presents the installation and the results of an extensive evaluation of users' questionnaires. Our main findings validate Dancing through Time in terms of User Experience and User Engagement, indicating that receiving prior instructions only affects the latter. Furthermore, the interaction logs with the application inform us of the benefits of browsing through the entire collection thanks to the affordances of the interactive system. Finally, we extracted different users' interaction behaviours to understand better how visitors engaged with Dancing through Time in the situated context of the 2024 edition of the Prix.
DeepHadad: Enhancing the Readability of Ancient Northwest Semitic Inscriptions
(The Eurographics Association, 2024) Aioanei, Andrei C.; Klein, Jonathan; Klein, Konstantin M.; Hunziker-Rodewald, Regine R.; Michels, Dominik L.; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
We present DeepHadad, a novel deep learning approach to improve the readability of severely damaged ancient Northwest Semitic inscriptions. By leveraging concepts of displacement maps and image-to-image translation, DeepHadad effectively recovers text from barely recognizable inscriptions, such as the one on the Hadad statue. A main challenge is the lack of pairs of well-preserved and damaged glyphs as training data since each available glyph instance has a unique shape and is not available in different states of erosion. We overcome this issue by generating synthetic training data through a simulated erosion process, on which we then train a neural network that successfully generalizes to real data. We demonstrate significant improvements in readability and historical authenticity compared to existing methods, opening new avenues for AI-assisted epigraphic analysis.
DeepTex: Deep Learning-Based Texturing of Image-Based 3D Reconstructions
(The Eurographics Association, 2024) Neumann, Kai Alexander; Santos, Pedro; Fellner, Dieter W.; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Image-based 3D reconstruction is a commonly used technique for measuring the geometry and color of objects or scenes based on images. While the geometry reconstruction of state-of-the-art approaches is mostly robust against varying lighting conditions and outliers, these pose a significant challenge for calculating an accurate texture map. This work proposes a deep-learning based texturing approach called ''DeepTex'' that uses a custom learned blending method on top of a traditional mosaic-based texturing approach. The model was trained using a custom synthetic data generation workflow and showed a significantly increased accuracy when generating textures in the presence of outliers and non-uniform lighting.
A Demonstration of Cultural Heritage Re-enactment: Volumetric Depiction of Sibylla Merian
(The Eurographics Association, 2024) Kräuter, Noura; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
This demo presents the ''Sibylla Merian'' case study, part of the LoGaCulture project, which investigates the use of volumetric filmed characters to enhance cultural heritage (CH) experiences through head-mounted augmented reality (AR) environments. Utilizing state-of-the-art volumetric video (VV) techniques, the case study aims to create immersive and interactive exhibits by integrating human hologram figures into three-dimensional spaces, bringing historical narratives to life with the authenticity of live actors' performances. By capturing these performances and adapting them for 3D virtual spaces, the case study seeks to enhance both the realism and emotional engagement of AR experiences and connection to history. Additionally, this work evaluates the feasibility and limitations of the current tools available for such advanced applications.
Demonstration of Playful Interaction Patterns for Head-mounted Device-based AR Experiences in Cultural Heritage
(The Eurographics Association, 2024) Liu, Yu; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
This proposal explores AR applications with engaging interaction patterns to provide immersive and entertaining museum experiences. Focusing on cultural heritage, this demonstration showcases innovative interaction patterns for navigation and exhibit activation. The navigation interaction pattern uses dynamic visual and auditory cues, while the exhibit activation interaction pattern incorporates playful orca-inspired elements. Implemented in Unity3D and deployed on HoloLens 2, the demonstration effectively balances usability and entertainment, enhancing visitor engagement and showcasing new AR possibilities for museums.
Documenting Dunhuang Dance Using Motion Capture Technology
(The Eurographics Association, 2024) Wang, Zeyu; He, Chengan; Yan, Zhe; Wang, Jiashun; Wang, Yingke; Liu, Junhua; Shen, Angela; Zeng, Mengying; Rushmeier, Holly; Xu, Huazhe; Yu, Borou; Lu, Chenchen; Wang, Eugene Y.; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
This paper introduces a pipeline for documenting Chinese Classical Dunhuang Dance using motion capture technology. Our captured dataset includes full-body movements documented across eight categories, totaling 40 minutes of professional dance (preview available at https://cislab.hkust-gz.edu.cn/projects/chang-e/). The dataset supports creative applications for Dunhuang dance culture, showcased in a new media immersive exhibition. We used motion inbetweening to concatenate dance sequences and synchronized them with music through retiming techniques, enhancing rhythm and harmony. Visual effects were applied to digital dancers, achieving visually appealing results that echo Buddhist meditation and bodily cognition. The Chang-E dataset enables digital preservation and creative reimagination of Dunhuang dance, offering highquality data and an interdisciplinary collaboration framework for future graphics and cultural heritage research.
Enriching Medieval 4D Models with Interactive Narratives
(The Eurographics Association, 2024) Andujar, Carlos; Cayuela, Begoña; Lorés Otzet, Immaculada; Bosch, Carles; Guardia, Milagros; Munoz-Pandiella, Imanol; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Digital technologies are increasingly used in cultural heritage preservation and dissemination, but some monuments pose significant challenges due to substantial historical architectural and pictorial changes. This paper introduces a method to enrich multi-layered, multi-phase 3D models of cultural heritage with art history knowledge. This is achieved through imagebased annotations, interactive narratives, points of interest, text, and audio, creating guided tours of the monument's historical phases. The approach is user-friendly for art historians, requiring no programming skills for defining such elements. A pilot user evaluation demonstrated its effectiveness in enhancing visitor engagement and understanding, and allowed improving the final web-based application and narratives.
The Fabric of Mixed-Reality Museal Spaces
(The Eurographics Association, 2024) Ohl, Stephan; Wagner, Martin; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Recent advances in eXtended Reality (XR) technology give museums many novel and exciting possibilities for designing interactive exhibition spaces. This short article overviews MIREMUS, a theory that formalizes and unifies the abstract description of such mixed-reality museal spaces. Spatial computing devices can mix real space and digital content in a multitude of different ways. MIREMUS provides a systematic description that has been developed with archeological and cultural heritage museums in mind. Emphasis is put on describing changes over time and qualitatively distinguishing between factual artifacts and hypothesized context. Furthermore, MIREMUS is based on a conceptual abstraction of tele-immersion. This enables us to systematically describe novel museum concepts that join multiple real locations with virtual content into one distributed museal space.
A First Digital Reconstruction of the so-Called Armor of Theoderic
(The Eurographics Association, 2024) Collina, Federica; Fabbri, Francesca; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Cultural heritage is continuously subject to numerous risk factors that threaten and compromise its integrity, hence the need to activate effective risk mitigation practices. Increasingly, digital methodologies are contributing to this field, which enables the combination of operations for documentation, preservation, and enhancement of cultural heritage. The same techniques can be profitably and equally applied for now lost objects reconstruction: together with verified historical sources, using these technologies would allow the recovery of models as consistent and faithful. Based on this meta disciplinary approach between historical-philological research and digital technologies, a reconstruction project of the so-called armor of Theoderic is proposed. Different workflows and the data collected and produced will be made explicitly open, allowing cooperation processes in an Open Science perspective. This first 3D model of the so-called armor of Theoderic may be the basis for multiple possible uses to make an iconic object of great cultural significance usable again to the public and the scientific community.
GCH 2024: Frontmatter
(The Eurographics Association, 2024) Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Immersive Exploration of Ancestral Graphs with TamVR - Design, Evaluation, and Application to Marie Antoinette
(The Eurographics Association, 2024) Baikova, Ekaterina; Schreck, Tobias; Preiner, Reinhold; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
Ancestral information, or historic family information, is instrumental in understanding the origin of families and persons. The ancestral information of European nobility is of key importance to understanding historic properties and developments of regions, countries, and their interrelationships. Genealogical information is hence a historic and cultural heritage of highest importance. While historic ancestral information is typically well-curated by historians, its exploration, analysis, and exhibition is often limited by existing tools, especially, limitations of exploring and visualizing ancestral graphs. Recent graph visualization offers advanced visualization and interaction facilities to efficiently and effectively navigate and explore ancestral data sets. The previously introduced Topographic Attribute Maps (TAM) visualization integrates relationship and timeline information in a dense topographic visualization. While the original implementation was focused on desktop-based visual exploration, we propose an immersive analytics design and implementation. We introduce a novel, appropriate and information-rich landscape and settlement/family metaphor and belonging interaction and exploration facilities. Our design supports the engaging and at the same time, effective perception of rich ancestral relationship and temporal data properties. The navigation and mapping facilities invite users to explore the ancestral graph information.We show the usage and effectiveness of our immersive approach by a use case discussion and qualitative feedback obtained from evaluation sessions.
LanternOperAR: Integrating Gamification and Visualization to Engage with Yue Opera in a Hybrid Gift
(The Eurographics Association, 2024) Xu, Ningning; Chen, Yifei; Ma, Teng; Mao, Qinglin; Huang, Xinlie; Zhou, Haibo; Sun, Xu; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
LanternOperAR is a hybrid gift designed to engage with Yue Opera in a handheld experience. With a physical installation and a digital application, users can interact with cultural content through meaningful visualizations and gamified interaction. In this paper, we detail the design process, including the methodologies for processing, analyzing, and presenting cultural data, as well as the presenting the physical prototype. Our evaluation supplies empirical evidence and practical guidelines on designing hybrid gifts that transcend traditional cultural products to promote cultural heritage in interactive experiences. It provides valuable insights to researchers and practitioners in the cultural application area.
MiDRASH - A Project for Computational Analysis of Medieval Hebrew Manuscripts
(The Eurographics Association, 2024) Vasyutinsky Shapira, Daria; Kurar-Barakat, Berat; Gogawale, Sharva; Suliman, Mohammad; Dershowitz, Nachum; Corsini, Massimiliano; Ferdani, Daniele; Kuijper, Arjan; Kutlu, Hasan
MiDRASH is an international effort that aims to construct a groundbreaking interdisciplinary methodology for a global approach to the study of the treasure trove of medieval literary manuscripts in Hebrew script. It studies materiality, textuality, transmission and historical contexts of the digitized manuscripts in Hebrew, Aramaic, Judeo-Arabic and other vernacular languages.

Browse

Browsing GCH 2024 - Eurographics Workshop on Graphics and Cultural Heritage by Title

Results Per Page

Sort Options