Wildbytes, an interactive experiential agency that makes a living by crafting physical experiences powered by cutting-edge digital technology, recently completed the first ever face projection mapping performance showcased at a live event. The result was incredible.
Projections mapping uses regular video projectors to project images upon a 3D object rather than the flat screen that we have become accustomed to. It turns common objects of any shape into interactive displays. By utilizing mapping software, projectors can be transformed into 3D projection mapping devices in order to add more dynamic and awe-inspiring visual components to everyday objects. Companies often use projection mapping at large events or corporate lobbies in order to tout the advancement of their technological prowess.
Our sister site, Commercial Integrator, has covered various different ways that companies have utilized 3D projection mapping, including most recently at the United Nations Climate Conference, where the Eiffel Tower became a backdrop for a 3D projection designed to raise awareness about global reforestation.
For the face-mapping project, Sephora contacted Wildbytes and asked the company to design the biggest launch in the history of Sephora Spain, in order to promote Kat Von D Beauty. Wildbytes delivered a never-before-seen 3D face projection mapping show as the driving force of an integrated campaign. The company explains:
Projected visual effects and digital makeup transformed the face of celebrity tattoo artist Kat Von D before a crowded audience. We designed a 360 campaign to activate the tattoo artist fan base in Spain, and boost awareness around Kat Von D Beauty: Influencers, unboxings, social contests and other pieces were part of the master plan. They all drove massive attention to the launch. The event blended digital makeup, design, artistry, a string quartet, and technology in a live face mapping performance, representing Kat Von D´s process of artistic creation.
The unique quality of this show comes with the real-time projection mapping over a human breathing face, seen live. While architectural projection mapping shows and even some face projection mapping videos have been created before, never has it been done live in front of a show. The projector renders a 3D model of the performer on stage, and using a 5-camera head tracking system, it follows the face movements of the performer in real-time, at 240 frames per second. This creates a second layer of ever-evolving visual effects that are overlaid on top of the skin, augmenting it in real-time.
The video features no post-production whatsoever. Everything that appears on Kat Von D’s face happened live in front of an audience. Watch below: