AI + Ar

Building a digital beauty advisor using AR and AI.

My Makeup Artist is a mobile-web-ready end-to-end experience powered by AR and AI, giving consumers a first-to-market virtual makeup artist experience combining face analysis, virtual try-on and product recommendations.

Powering brand results through data-driven consumer experiences. Honoured winner at 24th Webby Awards for Technical Achievement Award.

Challenge

Understand customers when they are searching for inspiration to create whatever version of themselves. We decided to develop a tool that would allow them to try on full-face beauty looks rather than a single product and make these looks instantly shoppable

Unlocking audience needs

Since MaxFactor is a global brand, we needed a broader view of the problem, including cultural and skin tone differences across the countries where the brand operates. In the months to come, our mission was to create presumptive designs that would help define the project.

JTBD

The main barrier to creating personas was that motivations varied with the location; however, beyond how they manage their time or their looks for different events, what we found was a motivation driven by taking an elevated version of themselves and a lack of makeup knowledge to get it.

Hey there, this is the default text for a new paragraph. Feel free to edit this paragraph by clicking on the yellow edit icon. After you are done just click on the yellow checkmark button on the top right. Have Fun!

The journey

Sketching out our product vision allowed us to break down the problem domain into discrete problems and formulate testable hypotheses around the issues that our solution must solve at first.

Behavioural data +

Facial scanning =

AI-powered personalised recommendations

Value

The goal was to create an environment of confidence, helping customers not just to find out the makeup that better fits their facial features, but also learn about themselves to make them look at their best.

“You guys did a tremendous job at humanizing it, it doesn’t feel like a robot”

Face scanning

Face scanning analyses and maps users' facial features to create a unique profile. We mapped out 5.400 facial feature permutations.

Ai recommendation engine

AI recognizes facial features to product attributes to command the recommendation algorithm. Then, it refines recommendations for users based on other users behavioural patterns boosting the overall conversion performance over time.

Ar virtual try-on

Allows to try on makeup virtually using AR in realtime and overlap different products to check the result, but also learn how to apply and tricks according to user's facial features.

Outcomes

The number of interactions during the first month exceeded all expectations, and the shopping-end rate reached 17%. In 2020, My makeup artist honoured winner at 24th Webby Awards for Technical Achievement Award.

Nanodoce

the alter ego behind Fernando Magan.

©nanodoce 2024
Please note that most projects are subject to a confidentiality agreement.