Prove Identity, Inc. ("Prove"), the global leader in digital identity, announced today the appointment of Mitch Bompey as Chief Legal Officer. Bompey, who recently served as General Counsel and Chief Risk Officer at Addepar, a fintech data platform, brings ...

Prove Identity Appoints Mitch Bompey as Chief Legal Officer

NEW YORK, Oct. 4, 2023 /PRNewswire/ -- Forter, the Trust Platform for digital commerce, has joined the Shopify Plus Certified App Program, bringing its industry-leading fraud management, payment optimization and chargeback recovery solutions to Shopify ...

Forter Joins Shopify Plus Certified App Program to Provide Industry-Leading Fraud Prevention to the World's Biggest Brands

The volume of healthcare information grows daily with estimates that by 2025, the compound annual growth will reach 36%. Clinicians rely upon medical librarians for trusted clinical content and as the data grows, so do the demands of the job. To examine ...

Wolters Kluwer Webinar With the Medical Library Association Hosts Medical Librarians Discussing Burnout

BioBam, the leading bioinformatics software company, is pleased to announce OmicsBox 3.1, its latest version packed with innovative features designed to empower ...

BioBam Launches OmicsBox 3.1: Revolutionizing Omics Data Analysis

Now in its 20 th year, Cybersecurity Awareness Month is highlighting the growing importance of cybersecurity in our daily lives and encouraging individuals and businesses to take important steps to stay safe online LOS ALTOS, Calif., Oct. 2, 2023 ...

Contrast Security Announces Commitment to Growing Global Cybersecurity Success during Cybersecurity Awareness Month 2023

TAIPEI, Oct. 1, 2023 /CNW/ -- Base's new killer DApp, the decentralized social network Friend.tech, is breaking transaction records with record adoption, but is being targeted by hackers and scammers through phishing attacks.To raise awareness of the ...

Friend.Tech and Base Anti-Phishing Boosted By CoolWallet's Web3 SmartScan

ThinkData Works, a leading data catalog provider, is pleased to announce it placed No. 320 on the 2023 Report on Business ranking of Canada's Top Growing Companies. Canada's Top Growing Companies ranks Canadian companies on three-year revenue growth ...

ThinkData Works Places No. 320 on the Globe and Mail's Fifth-Annual Ranking of Canada's Top Growing Companies

Victoria, Seychelles, Sept. 29, 2023 (GLOBE NEWSWIRE) -- Bitget, top crypto derivatives and copy trading exchange, has announced an expanded partnership with Banxa, the popular fiat-to-crypto gateway. This move comes as the exchange affirms its position ...

Bitget Partners With Banxa to Simplify Crypto Purchases

Quectel Wireless Solutions, a global IoT solutions provider, is pleased to introduce the EM060K-EA LTE-Advanced Cat 6 module, offered for the EMEA, APAC and Brazil markets. The module, which is available in the M.2 form factor, measuring 30.0mm x 42.0mm x ...

Quectel Introduces EM060K-EA LTE-Advanced Cat 6 Module

NEW YORK, Sept. 27, 2023 /PRNewswire/ -- SMX (Security Matters) PLC (NASDAQ: SMX; SMXWW), an innovative company specializing in digitization of physical objects to foster a circular and closed loop economy, has announced a collaborative strategic ...

Domaine des Massifs and SMX have Formed a Strategic Collaboration to Revolutionize Traceability.

Morphlabs

morphlabs

Meet the Winners of Startups in North and Central America

The performance of deep neural nets made a big step forward in the last two decades. Every year, new architectures are devised that beat state-of-the-art results. However, only improving architectures won’t work without a quality dataset. The dataset has a big impact on final performance. Collecting and labeling diverse, accurate datasets may be laborious and expensive, and existing datasets usually don’t cover the whole variety of real data distribution, so data augmentation techniques are used. In this article, I will show how your dataset of human faces can be enriched by 3D geometry transformation to improve the performance of your model. Open source code implementation is provided below[1]. Data augmentation is a technique that increases the amount of data by applying different modifications to samples. Generic image augmentation can be divided into two categories: geometric transformations and color transformations. Geometric transformations consist of scaling, cropping, flipping, rotation, translation, etc. While color transformations consist of color jittering, noise adding, grayscaling, brightness/contrast adjustment, etc. Let’s think about how we can augment an image if we know that there’s a human face. How do we distinguish one person from another? There are face features that constitute identity, like skin color, face shape, haircut, wrinkles, eye color, etc. One of the most distinguishable is the face shape. So, if we change the shape of the input face image, it will be a slightly different person for a trainable model. So, let’s use this property to augment our dataset. We will alter the geometry of a face by using the 3D Morphable Model (3DMM), specifically the FLAME[2] model. 3DMM is a three-dimensional mesh that has parameters to manipulate its shape, pose, and expression. 3DMM is constructed from three-dimensional meshes that have been registered by real people. Thus, it can represent the distribution of real face shapes. Under the hood, it consists of the mean shape and a set of principal components that specify the directions of change for shape and expression. Alpha and beta are parameters of the model. Before changing the face shape, we need to find parameters of 3DMM that correspond to our input photo. There are several methods to do that, like optimization to landmarks, photometric optimization, or regression models to predict parameters in one step. I used 2D landmark optimization as it has a simple implementation and gives accurate results in a reasonable time. Facial landmarks were detected on the input image with the Dlib face detection model. Adam optimization algorithm was used with MSE loss for landmarks to fit 3DMM into the face image. It took about 150 iterations to converge. Now, we are ready to modify the geometry of the face. First of all, we already have a three-dimensional mesh aligned with our face image. Сhanging 3DMM’s shape parameters leads to a shift of mesh vertices in image space. Knowing that shifts, we can use it to move the pixels of the image. To get a dense map of shifts, I used the OpenGL library, where I rendered 3DMM mesh with shifts in x and y directions instead of vertex color. There is one thing left to consider, how to handle pixels that were out of the face mesh area. For this purpose, I used extrapolation, which smoothly connects the changed face with a static background. As long as we have dense shift maps for x and y directions, we can apply them to any type of label like facial landmarks, segmentation masks, or paired images. You can see examples of face augmentation with geometric transformation in the figure below. If you want to know more details, I invite you to source code[1]. Now, you can try it on your datasets. This augmentation technique will help you to improve a model making it stable to input variations. In this article, we learned about 3D geometric transformation, but besides it, there are texture modifications which are further improvements of face datasets, which in the next article. References [1] GitHub code. https://github.com/ainur699/face_data_augmentation [2] FLAME model. https://flame.is.tue.mpg.de/index.html The performance of deep neural nets made a big step forward in the last two decades. Every year, new architectures are devised that beat state-of-the-art results. However, only improving architectures won’t work without a quality dataset. The dataset has a big impact on final performance. Collecting and labeling diverse, accurate datasets may be laborious and expensive, and existing datasets usually don’t cover the whole variety of real data distribution, so data augmentation techniques are used. In this article, I will show how your dataset of human faces can be enriched by 3D geometry transformation to improve the performance of your model. Open source code implementation is provided below[1]. Data augmentation is a technique that increases the amount of data by applying different modifications to samples. Generic image augmentation can be divided into two categories: geometric transformations and color transformations. Geometric transformations consist of scaling, cropping, flipping, rotation, translation, etc. While color transformations consist of color jittering, noise adding, grayscaling, brightness/contrast adjustment, etc. Let’s think about how we can augment an image if we know that there’s a human face. How do we distinguish one person from another? There are face features that constitute identity, like skin color, face shape, haircut, wrinkles, eye color, etc. One of the most distinguishable is the face shape. So, if we change the shape of the input face image, it will be a slightly different person for a trainable model. So, let’s use this property to augment our dataset. We will alter the geometry of a face by using the 3D Morphable Model (3DMM), specifically the FLAME[2] model. 3DMM is a three-dimensional mesh that has parameters to manipulate its shape, pose, and expression. 3DMM is constructed from three-dimensional meshes that have been registered by real people. Thus, it can represent the distribution of real face shapes. Under the hood, it consists of the mean shape and a set of principal components that specify the directions of change for shape and expression. Alpha and beta are parameters of the model. Before changing the face shape, we need to find parameters of 3DMM that correspond to our input photo. There are several methods to do that, like optimization to landmarks, photometric optimization, or regression models to predict parameters in one step. I used 2D landmark optimization as it has a simple implementation and gives accurate results in a reasonable time. Facial landmarks were detected on the input image with the Dlib face detection model. Adam optimization algorithm was used with MSE loss for landmarks to fit 3DMM into the face image. It took about 150 iterations to converge. Now, we are ready to modify the geometry of the face. First of all, we already have a three-dimensional mesh aligned with our face image. Сhanging 3DMM’s shape parameters leads to a shift of mesh vertices in image space. Knowing that shifts, we can use it to move the pixels of the image. To get a dense map of shifts, I used the OpenGL library, where I rendered 3DMM mesh with shifts in x and y directions instead of vertex color. There is one thing left to consider, how to handle pixels that were out of the face mesh area. For this purpose, I used extrapolation, which smoothly connects the changed face with a static background. As long as we have dense shift maps for x and y directions, we can apply them to any type of label like facial landmarks, segmentation masks, or paired images. You can see examples of face augmentation with geometric transformation in the figure below. If you want to know more details, I invite you to source code[1]. Now, you can try it on your datasets. This augmentation technique will help you to improve a model making it stable to input variations. In this article, we learned about 3D geometric transformation, but besides it, there are texture modifications which are further improvements of face datasets, which in the next article. References References [1] GitHub code. https://github.com/ainur699/face_data_augmentation https://github.com/ainur699/face_data_augmentation https://github.com/ainur699/face_data_augmentation [2] FLAME model. https://flame.is.tue.mpg.de/index.html https://flame.is.tue.mpg.de/index.html https://flame.is.tue.mpg.de/index.html

Stories, News & Mentions about MORPHLABS

Categories

Trending Topics

Stories, News & Mentions about MORPHLABS

Morphlabs’s Stories on HackerNoon

Morphlabs's News & Mentions

Categories

Trending Topics