Table of Links Abstract and 1. Introduction Abstract and 1. Introduction Related Works


MaGGIe
3.1. Efficient Masked Guided Instance Matting
3.2. Feature-Matte Temporal Consistency


Instance Matting Datasets
4.1. Image Instance Matting and 4.2. Video Instance Matting


Experiments
5.1. Pre-training on image data
5.2. Training on video data


Discussion and References Related Works Related Works Related Works MaGGIe
3.1. Efficient Masked Guided Instance Matting
3.2. Feature-Matte Temporal Consistency MaGGIe 3.1. Efficient Masked Guided Instance Matting 3.1. Efficient Masked Guided Instance Matting 3.2. Feature-Matte Temporal Consistency 3.2. Feature-Matte Temporal Consistency Instance Matting Datasets
4.1. Image Instance Matting and 4.2. Video Instance Matting Instance Matting Datasets Instance Matting Datasets 4.1. Image Instance Matting and 4.2. Video Instance Matting 4.1. Image Instance Matting and 4.2. Video Instance Matting Experiments
5.1. Pre-training on image data
5.2. Training on video data Experiments Experiments 5.1. Pre-training on image data 5.1. Pre-training on image data 5.2. Training on video data 5.2. Training on video data Discussion and References Discussion and References Discussion and References Supplementary Material Supplementary Material Architecture details


Image matting
8.1. Dataset generation and preparation
8.2. Training details
8.3. Quantitative details
8.4. More qualitative results on natural images


Video matting
9.1. Dataset generation
9.2. Training details
9.3. Quantitative details
9.4. More qualitative results Architecture details Architecture details Architecture details Image matting
8.1. Dataset generation and preparation
8.2. Training details
8.3. Quantitative details
8.4. More qualitative results on natural images Image matting 8.1. Dataset generation and preparation 8.1. Dataset generation and preparation 8.2. Training details 8.2. Training details 8.3. Quantitative details 8.3. Quantitative details 8.4. More qualitative results on natural images 8.4. More qualitative results on natural images Video matting
9.1. Dataset generation
9.2. Training details
9.3. Quantitative details
9.4. More qualitative results Video matting 9.1. Dataset generation 9.1. Dataset generation 9.2. Training details 9.2. Training details 9.3. Quantitative details 9.3. Quantitative details 9.4. More qualitative results 9.4. More qualitative results 4.1. Image Instance Matting We derived the Image Human Instance Matting 50K (IHIM50K) training dataset from HHM50K [50], featuring multiple human subjects. This dataset includes 49,737 synthesized images with 2-5 instances each, created by compositing human foregrounds with random backgrounds and modifying alpha mattes for guidance binary masks. For benchmarking, we used HIM2K [49] and created the Mask HIM2K (M-HIM2K) set to test robustness against varying mask qualities from available instance segmentation models (as shown in Fig. 3). Details on the generation process are available in the supplementary material. Image Human Instance Matting 50K (IHIM50K) Mask HIM2K (M-HIM2K) 4.2. Video Instance Matting Our video instance matte dataset, synthesized from VM108 [57], VideoMatte240K [33], and CRGNN [52], includes subsets V-HIM2K5 for training and V-HIM60 for testing. We categorized the dataset into three difficulty levels based on instance overlap. Table 2 shows some details of the synthesized datasets. Masks in training involved dilation and erosion on binarized alpha mattes. For testing, masks are generated using XMem [8]. Further details on dataset synthesis and difficulty levels are provided in the supplementary material. VideoMatte240K HIM2K5 Authors:
(1) Chuong Huynh, University of Maryland, College Park (chuonghm@cs.umd.edu);
(2) Seoung Wug Oh, Adobe Research (seoh,jolee@adobe.com);
(3) Abhinav Shrivastava, University of Maryland, College Park (abhinav@cs.umd.edu);
(4) Joon-Young Lee, Adobe Research (jolee@adobe.com). Authors: Authors: (1) Chuong Huynh, University of Maryland, College Park (chuonghm@cs.umd.edu); (2) Seoung Wug Oh, Adobe Research (seoh,jolee@adobe.com); (3) Abhinav Shrivastava, University of Maryland, College Park (abhinav@cs.umd.edu); (4) Joon-Young Lee, Adobe Research (jolee@adobe.com). This paper is available on arxiv under CC by 4.0 Deed (Attribution 4.0 International) license. This paper is available on arxiv under CC by 4.0 Deed (Attribution 4.0 International) license. available on arxiv available on arxiv

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Quant

Adobe

Video Instance Matting: V-HIM60 Dataset and Difficulty Levels

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

3D Mapping Initialization: Using RGB-D Images and Camera Parameters

Evolution of Matting: From Traditional Sampling to MaGGIe's Instance Approach

It Is Okay If You Don't Know What You Like. We Do (feat. Deep Recommendation Algorithms)

10 Machine Learning, Data Science, and Deep Learning Courses for Programmers in 2020

10 Computer Vision Startups on Product Hunt with the Most Upvotes

10 Best Entry Level Machine Learning Tutorials

3D Mapping Initialization: Using RGB-D Images and Camera Parameters

Evolution of Matting: From Traditional Sampling to MaGGIe's Instance Approach

It Is Okay If You Don't Know What You Like. We Do (feat. Deep Recommendation Algorithms)

10 Machine Learning, Data Science, and Deep Learning Courses for Programmers in 2020

10 Computer Vision Startups on Product Hunt with the Most Upvotes

10 Best Entry Level Machine Learning Tutorials

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps