paint-brush
Deep Geometrized Cartoon Line Inbetweening: Our Approachby@idempotent
112 reads

Deep Geometrized Cartoon Line Inbetweening: Our Approach

by Idempotent Tech
Idempotent Tech HackerNoon profile picture

Idempotent Tech

@idempotent

It produces the same result when performed multiple times. It...

July 24th, 2024
Read on Terminal Reader
Read this story in a terminal
Print this story
Read this story w/o Javascript
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

AnimeInbet: A novel approach for inbetweening line drawings using geometric graphs, enhancing detail preservation with the MixamoLine240 dataset.
featured image - Deep Geometrized Cartoon Line Inbetweening: Our Approach
1x
Read by Dr. One voice-avatar

Listen to this story

Idempotent Tech HackerNoon profile picture
Idempotent Tech

Idempotent Tech

@idempotent

It produces the same result when performed multiple times. It produces the same result when performed multiple times.

About @idempotent
LEARN MORE ABOUT @IDEMPOTENT'S
EXPERTISE AND PLACE ON THE INTERNET.
0-item

STORY’S CREDIBILITY

Academic Research Paper

Academic Research Paper

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Authors:

(1) Li Siyao, S-Lab, Nanyang Technological University;

(2) Tianpei Gu, Lexica and Work completed at UCLA;

(3) Weiye Xiao, Southeast University;

(4) Henghui Ding, S-Lab, Nanyang Technological University;

(5) Ziwei Liu, S-Lab, Nanyang Technological University;

(6) Chen Change Loy, S-Lab, Nanyang Technological University and a Corresponding Author.

Abstract and 1. Introduction

  1. Related Work
  2. Mixamo Line Art Dataset
  3. Our Approach
  4. Experiment
  5. Conclusion and References

4. Our Approach

image


Figure 6: Vertex Geometric Embedding. The goal is to obtain discriminative and meaningful features to describe each vertex.

Figure 6: Vertex Geometric Embedding. The goal is to obtain discriminative and meaningful features to describe each vertex.


image


Geometrizing Line Drawings. The process of creating artwork has become largely digital, allowing for direct export in vectorized format. However, for line drawings that only appear in raster images, there are various commercial software and open-source research projects available [40, 36, 15, 12] that can be used to convert the raster images into the required vectorized input format. We will ablate the performance of line vectorization in our experiments.


Figure 7: Vertex Correspondence Transformer. SA and CA represent self-attention and cross-attention, respectively.

Figure 7: Vertex Correspondence Transformer. SA and CA represent self-attention and cross-attention, respectively.

4.1. Vertex Geometric Embedding

Discriminative features for each vertex are desired to achieve accurate graph matching. Line graphs are different from general graphs as the spatial position of endpoint vertices, in addition to the topology of connections, determines the geometric shape of the line. The geometric graph embedding for line art is hence designed to comprise three parts: 1) image contextual embedding, 2) positional embedding, and 3) topological embedding, as shown in Figure 6.


image

4.2. Vertex Correspondence Transformer

We use geometric features F0 and F1 to establish a vertexwise correspondence between G0 and G1. Specifically, we compute a correlation matrix between vertex features and identify the matching pair as those with the highest value across both the row and the column of the matrix. Prior to this step, we apply a Transformer that aggregates the mutual consistency both intra- and inter-graph.


Mutual Aggregation. Following [24, 31], we employ a cascade of alternating self- and cross-attention layers to aggregate the vertex feature. In a self-attention layer, all queries, keys and values are derived from the single source feature,


image


image

4.3. Repositioning Propagation

image


image

4.4. Visibility Prediction and Graph Fusion

image

4.5. Learning

image


This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license.


L O A D I N G
. . . comments & more!

About Author

Idempotent Tech HackerNoon profile picture
Idempotent Tech@idempotent
It produces the same result when performed multiple times. It produces the same result when performed multiple times.

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite
Idempotent
X REMOVE AD