paint-brush
Scientists Use Portraits and Balls to Test an AI’s Relighting Abilitiesby@autoencoder
New Story

Scientists Use Portraits and Balls to Test an AI’s Relighting Abilities

tldt arrow

Too Long; Didn't Read

Researchers at Beeble AI have developed a method for improving how light and shadows can be applied to human portraits in digital images.
featured image - Scientists Use Portraits and Balls to Test an AI’s Relighting Abilities
Auto Encoder: How to Ignore the Signal Noise HackerNoon profile picture

Authors:

(1) Hoon Kim, Beeble AI, and contributed equally to this work;

(2) Minje Jang, Beeble AI, and contributed equally to this work;

(3) Wonjun Yoon, Beeble AI, and contributed equally to this work;

(4) Jisoo Lee, Beeble AI, and contributed equally to this work;

(5) Donghyun Na, Beeble AI, and contributed equally to this work;

(6) Sanghyun Woo, New York University, and contributed equally to this work.

Editor's Note: This is Part 12 of 14 of a study introducing a method for improving how light and shadows can be applied to human portraits in digital images. Read the rest below.


Appendix

B. User Study Interface

Our user study interface is outlined as follows: Participants are shown an input image next to a diffused ball under the target environment map lighting. The primary objective is to compare our relighting results with baseline methods, as depicted in Fig. 11. Evaluation focuses on three criteria: 1. Consistency of lighting, 2) Preservation of facial details, and 3) Retention of the original identity. This comparison aims to determine which image best matches the lighting of the diffused ball while also maintaining facial details and original identity. To ensure unbiased evaluations, we randomized the order of presentation. Participants evaluated 30 random samples from a set of 256. This dataset included 32 portraits from the FFHQ dataset [25], each illuminated under eight distinct lighting conditions.


Figure 11. User Study Interface comparing relighting results with prior approaches, focusing on consistency in lighting, preservation of facial details, and retention of original identity.


This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license.