Reference‐based Screentone Transfer via Pattern Correspondence and Regularization

Simple item page
dc.contributor.authorLi, Zhanshengen_US
dc.contributor.authorZhao, Nanxuanen_US
dc.contributor.authorWu, Zongweien_US
dc.contributor.authorDai, Yihuaen_US
dc.contributor.authorWang, Junleen_US
dc.contributor.authorJing, Yanqingen_US
dc.contributor.authorHe, Shengfengen_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2023-10-06T11:58:53Z
dc.date.available2023-10-06T11:58:53Z
dc.date.issued2023
dc.description.abstractAdding screentone to initial line drawings is a crucial step for manga generation, but is a tedious and human‐laborious task. In this work, we propose a novel data‐driven method aiming to transfer the screentone pattern from a reference manga image. This not only ensures the quality, but also adds controllability to the generated manga results. The reference‐based screentone translation task imposes several unique challenges. Since manga image often contains multiple screentone patterns interweaved with line drawing, as an abstract art, this makes it even more difficult to extract disentangled style code from the reference. Also, finding correspondence for mapping between the reference and the input line drawing without any screentone is hard. As screentone contains many subtle details, how to guarantee the style consistency to the reference remains challenging. To suit our purpose and resolve the above difficulties, we propose a novel Reference‐based Screentone Transfer Network (RSTN). We encode the screentone style through a 1D stylegram. A patch correspondence loss is designed to build a similarity mapping function for guiding the translation. To mitigate the generated artefacts, a pattern regularization loss is introduced in the patch‐level. Through extensive experiments and a user study, we have demonstrated the effectiveness of our proposed model.en_US
dc.description.number6
dc.description.sectionheadersORIGINAL ARTICLES
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14800
dc.identifier.issn1467-8659
dc.identifier.urihttps://doi.org/10.1111/cgf.14800
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14800
dc.publisher© 2023 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.subjectmanga
dc.subjectscreentone
dc.subjectReference‐based
dc.subjectpatch correspondence
dc.subjectpattern regularization
dc.titleReference‐based Screentone Transfer via Pattern Correspondence and Regularizationen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
v42i6_26_14800.pdf
Size:
4.49 MB
Format:
Adobe Portable Document Format
Download
Collections
42-Issue 6