Table of Links Abstract and 1. Introduction Abstract and 1. Introduction Few-Shot Personalized Instance Recognition
Object-Conditioned Bag of Instances
Experimental Results
Conclusion
References Few-Shot Personalized Instance Recognition Few-Shot Personalized Instance Recognition Object-Conditioned Bag of Instances Object-Conditioned Bag of Instances Experimental Results Experimental Results Conclusion Conclusion References References 2. FEW-SHOT PERSONALIZED INSTANCE RECOGNITION In our setup, we aim at personalizing generic object detection models to recognize objects by a set of instance-level labels. In the analyses, we implement the model Mo by YOLOv8, pre-train the model on MSCOCO [20] and then on To, which contains samples from Open-Images-V7 (OIV7) [21] of the same object-level classes as in the personal dataset Ti ; i.e., such that f(·) exists. We used the default learning parameters [11] for pre-training. We design several setups whereby we assign a few samples to the training set and the remaining ones to the testing (80%) and validation (20%) sets. Datasets. We use CORe50 [6] or iCubWorld Transformations (iCWT) [22] as the personalized recognition datasets. CORe50: we consider a subset of 45 personal instances (i.e., |Ci | = 45) belonging to 9 object-level classes (i.e., |Co| = 9), acquired over 11 variable-background sequences, i.e., different domains (see Fig. 1). iCWT: we consider a subset of 9 object-level classes with 10 personal instances each acquired under 5 sequences with diverse affine transformations of the items. On both datasets, we restrict the personalization stage to the frames being correctly labelled by YOLOv8n, maintaining a balanced number of samples per instance and per sequence. Datasets 3. OBJECT-CONDITIONED BAG OF INSTANCES We propose a lightweight module that can be integrated into any object detection network. Our solution is based on three key components: (i) an object detection network, with (ii) a multi-order statistical augmentation of embeddings for (iii) instance-level recognition via an OBoI. Next, we outline how we construct our OBoI to personalize object detectors pretrained on To on the server side (see Fig. 2). The overall pipeline can be thought of as an Object-conditioned Bag of Instances (OBoI) since generic categorylevel output is converted to specific personal-level output via conditional nearest prototype selection. Our setup and method are fully compatible with the key requirement of continually learning new instances over time [6, 5, 16, 24, 25, 26]; whenever a user presents a new instance to be recognized, we can include new instance-level prototypes in the OBoI at any time with no accuracy degradation with respect to the case where all instances are available from the beginning of the adaptation process. Object-conditioned Bag of Instances Authors:
(1) Umberto Michieli, Samsung Research UK;
(2) Jijoong Moon, Samsung Research Korea;
(3) Daehyun Kim, Samsung Research Korea;
(4) Mete Ozay, Samsung Research UK. Authors: Authors: (1) Umberto Michieli, Samsung Research UK; (2) Jijoong Moon, Samsung Research Korea; (3) Daehyun Kim, Samsung Research Korea; (4) Mete Ozay, Samsung Research UK. This paper is available on arxiv under CC by 4.0 Deed (Attribution 4.0 International) license. This paper is available on arxiv under CC by 4.0 Deed (Attribution 4.0 International) license. available on arxiv available on arxiv

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Add New Items, Not New Weights - Personalize Detection Without Backprop

Boost Few-Shot Instance Accuracy 12% Without Fine-Tuning

Instancing.TECH

Too Long; Didn't Read

Boost your HackerNoon story @ $159.99! 🚀

Few-Shot Personalization of YOLOv8 with Object-Conditioned Bags of Instances

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

A Coarse-to-Fine Approach to Text-Guided 3D Localization Without Ground Truth

10 Security Products to Protect Your Smart Home

10 Must-Try Open Source Tools for Machine Learning

10 Computer Vision Startups on Product Hunt with the Most Upvotes

10 Biggest Image Datasets for Computer Vision

A Coarse-to-Fine Approach to Text-Guided 3D Localization Without Ground Truth

10 Security Products to Protect Your Smart Home

10 Must-Try Open Source Tools for Machine Learning

10 Computer Vision Startups on Product Hunt with the Most Upvotes

10 Biggest Image Datasets for Computer Vision

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps