The IlluminAI project: a deep neural network and immersive visualization system to enhance illuminated manuscripts

Simple item page
dc.contributor.authorMinisini, Valeriaen_US
dc.contributor.authorGosti, Giorgioen_US
dc.contributor.authorFanini, Brunoen_US
dc.contributor.editorCampana, Stefanoen_US
dc.contributor.editorFerdani, Danieleen_US
dc.contributor.editorGraf, Holgeren_US
dc.contributor.editorGuidi, Gabrieleen_US
dc.contributor.editorHegarty, Zackaryen_US
dc.contributor.editorPescarin, Sofiaen_US
dc.contributor.editorRemondino, Fabioen_US
dc.date.accessioned2025-09-05T20:25:45Z
dc.date.available2025-09-05T20:25:45Z
dc.date.issued2025
dc.description.abstractIn museum and archive digital catalogues, illuminated manuscript pages can often be found within heterogeneous groups of reproductions, coexisting with other types of artworks and objects. With them, figurative miniatures share the depicted subjects that are recognizable, regardless of the medium used, for their specific iconography. Thanks to the use of a visual vocabulary still common today, illuminations are also the element that mostly attracts the non-academic public, making the often-incomprehensible content partly accessible despite the language. The paper will present IlluminAI, a project still in progress, which aims at the enhancement of late medieval and Renaissance illuminated codices using artificial intelligence through an immersive visualization system capable of automatically recognizing manuscript sheets, analyzing their content, and relating specimens with similar illustrations or artworks from the same theme. After some brief references to contextualize the work, we will expose the first completed phase of the research focusing on the original dataset composition before outlining the chosen semi-automatic labeling strategy and the interactive machine learning approach. This was used to create with transfer learning a model able to recognize manuscript pages and identify inside of them five characteristic layout elements. We will then switch to the second ongoing part of the project with the design of the immersive Web3D system, based on the open-source ATON framework, that will give users the possibility to explore, inspect, compare and query large amounts of images in a three-dimensional space. The data aggregation criteria and the presentation modes will be described with particular attention to the spatial organization and novel 3D interfaces.en_US
dc.description.sectionheadersExtracting Knowledge from Digitized Assets
dc.description.seriesinformationDigital Heritage
dc.identifier.doi10.2312/dh.20253119
dc.identifier.isbn978-3-03868-277-6
dc.identifier.pages4 pages
dc.identifier.urihttps://doi.org/10.2312/dh.20253119
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/dh20253119
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Applied computing → Fine arts; Computing methodologies → Activity recognition and understanding; Humancentered computing → Visual analytics
dc.subjectApplied computing → Fine arts
dc.subjectComputing methodologies → Activity recognition and understanding
dc.subjectHumancentered computing → Visual analytics
dc.titleThe IlluminAI project: a deep neural network and immersive visualization system to enhance illuminated manuscriptsen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
dh20253119.pdf
Size:
834.15 KB
Format:
Adobe Portable Document Format
Download
Collections
Track 05 – Analysis and Interpretation