Authors:
(1) Wenxuan Wang, The Chinese University of Hong Kong, Hong Kong, China;
(2) Haonan Bai, The Chinese University of Hong Kong, Hong Kong, China
(3) Jen-tse Huang, The Chinese University of Hong Kong, Hong Kong, China;
(4) Yuxuan Wan, The Chinese University of Hong Kong, Hong Kong, China;
(5) Youliang Yuan, The Chinese University of Hong Kong, Shenzhen Shenzhen, China
(6) Haoyi Qiu University of California, Los Angeles, Los Angeles, USA;
(7) Nanyun Peng, University of California, Los Angeles, Los Angeles, USA
(8) Michael Lyu, The Chinese University of Hong Kong, Hong Kong, China. Table of Links Abstract 1 Introduction 2 Background 3 Approach and Implementation 3.1 Seed Image Collection and 3.2 Neutral Prompt List Collection 3.3 Image Generation and 3.4 Properties Assessment 3.5 Bias Evaluation 4 Evaluation 4.1 Experimental Setup 4.2 RQ1: Effectiveness of BiasPainter 4.3 RQ2 - Validity of Identified Biases 4.4 RQ3 - Bias Mitigation 5 Threats to Validity 6 Related Work 7 Conclusion, Data Availability, and References 3 APPROACH AND IMPLEMENTATION In this section, we present BiasPainter, a metamorphic testing framework designed for measuring the social bias in image generation models. BiasPainter uses photos of different persons as seed images and adopts various prompts to let image generation models edit the seed images. The key insight is that the gender/race/age of the person in the photo should not be modified too much under the gender/race/age-neutral prompts. Otherwise, a spurious correlation between gender/race/age and other properties (e.g. career) exists in the model. Namely, a suspicious bias is detected. For example, if an image generation model tends to convert more female photos to male photos under the prompt "a photo of a lawyer", a bias about lawyers on gender is detected. Figure 2 depicts the framework of BiasPainter, which consists of five stages: (1) Seed Image Collection: collect photos of people across different races, genders and ages as seed images. (2) Neutral Prompt List Collection: collect and annotate different prompts from various topics. (3) Image Generation: For each seed image, input different prompts to image generation models for generating images. (4) Properties Assessment: Adopt methods to access the race, gender and age properties for the seed image and generated images. (5) Bias Detection: Detect the potential social bias with the metamorphic relation. This paper is available on arxiv under CC0 1.0 DEED license. Authors: (1) Wenxuan Wang, The Chinese University of Hong Kong, Hong Kong, China; (2) Haonan Bai, The Chinese University of Hong Kong, Hong Kong, China (3) Jen-tse Huang, The Chinese University of Hong Kong, Hong Kong, China; (4) Yuxuan Wan, The Chinese University of Hong Kong, Hong Kong, China; (5) Youliang Yuan, The Chinese University of Hong Kong, Shenzhen Shenzhen, China (6) Haoyi Qiu University of California, Los Angeles, Los Angeles, USA; (7) Nanyun Peng, University of California, Los Angeles, Los Angeles, USA (8) Michael Lyu, The Chinese University of Hong Kong, Hong Kong, China. Authors: Authors: (1) Wenxuan Wang, The Chinese University of Hong Kong, Hong Kong, China; (2) Haonan Bai, The Chinese University of Hong Kong, Hong Kong, China (3) Jen-tse Huang, The Chinese University of Hong Kong, Hong Kong, China; (4) Yuxuan Wan, The Chinese University of Hong Kong, Hong Kong, China; (5) Youliang Yuan, The Chinese University of Hong Kong, Shenzhen Shenzhen, China (6) Haoyi Qiu University of California, Los Angeles, Los Angeles, USA; (7) Nanyun Peng, University of California, Los Angeles, Los Angeles, USA (8) Michael Lyu, The Chinese University of Hong Kong, Hong Kong, China. Table of Links Abstract Abstract 1 Introduction 1 Introduction 2 Background 2 Background 3 Approach and Implementation 3 Approach and Implementation 3.1 Seed Image Collection and 3.2 Neutral Prompt List Collection 3.1 Seed Image Collection and 3.2 Neutral Prompt List Collection 3.3 Image Generation and 3.4 Properties Assessment 3.3 Image Generation and 3.4 Properties Assessment 3.5 Bias Evaluation 3.5 Bias Evaluation 4 Evaluation 4 Evaluation 4.1 Experimental Setup 4.1 Experimental Setup 4.2 RQ1: Effectiveness of BiasPainter 4.2 RQ1: Effectiveness of BiasPainter 4.3 RQ2 - Validity of Identified Biases 4.3 RQ2 - Validity of Identified Biases 4.4 RQ3 - Bias Mitigation 4.4 RQ3 - Bias Mitigation 5 Threats to Validity 5 Threats to Validity 6 Related Work 6 Related Work 7 Conclusion, Data Availability, and References 7 Conclusion, Data Availability, and References 3 APPROACH AND IMPLEMENTATION In this section, we present BiasPainter, a metamorphic testing framework designed for measuring the social bias in image generation models. BiasPainter uses photos of different persons as seed images and adopts various prompts to let image generation models edit the seed images. The key insight is that the gender/race/age of the person in the photo should not be modified too much under the gender/race/age-neutral prompts. Otherwise, a spurious correlation between gender/race/age and other properties (e.g. career) exists in the model. Namely, a suspicious bias is detected. For example, if an image generation model tends to convert more female photos to male photos under the prompt "a photo of a lawyer", a bias about lawyers on gender is detected. Figure 2 depicts the framework of BiasPainter, which consists of five stages: (1) Seed Image Collection: collect photos of people across different races, genders and ages as seed images. Seed Image Collection: (2) Neutral Prompt List Collection: collect and annotate different prompts from various topics. (3) Image Generation: For each seed image, input different prompts to image generation models for generating images. Image Generation: (4) Properties Assessment: Adopt methods to access the race, gender and age properties for the seed image and generated images. Properties Assessment: (5) Bias Detection: Detect the potential social bias with the metamorphic relation. Bias Detection: This paper is available on arxiv under CC0 1.0 DEED license. This paper is available on arxiv under CC0 1.0 DEED license. available on arxiv

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Seed Image and Neutral Prompt List Collection

A Comprehensive Overview of Image Generation Models: From GANs to Diffusion Techniques

MediaBias.TECH

Too Long; Didn't Read

Make resilience your competitive advantage

Think Your AI Is Fair? BiasPainter Might Just Change Your Mind

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

Bias in Machine Learning Models for Depression Detection

Pay attention to that man behind the curtain

AI Is Inherently Neutral - It Is Human Beings Who Are Biased, and the Machines Merely Replicate Them

AI Is Not the Concern - It’s AI Developers You Should Be Worried About

Are Smart Cities a Threat to Data Privacy?

Bias in Machine Learning Models for Depression Detection

Pay attention to that man behind the curtain

AI Is Inherently Neutral - It Is Human Beings Who Are Biased, and the Machines Merely Replicate Them

AI Is Not the Concern - It’s AI Developers You Should Be Worried About

Are Smart Cities a Threat to Data Privacy?

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps