Fraunhofer HHI and UFA GmbH presented Germany’s first test production for volumetric film at NAB in Las Vegas. The movie Gateway to Infinity, which is designed to allow viewers to walk right into it, uses the “3D Human Body Reconstruction (3DHBR)” technology.

This reconstruction method makes it possible to generate dynamic 3D models of people that appear natural, going far beyond the conventional animation of virtual characters. Recordings of gestures, facial expressions, and textures can be visualized in detail in the 3D models. In this first test shoot, facial expressions and moving clothing were reconstructed naturally and accurately. The person is then integrated into a virtual scene. Viewers with virtual reality glasses can therefore view these virtualized people at very close range and from various perspectives. Thus the viewer is immersed directly in the scene, experiencing the story close up and personally.

Fraunhofer HHI cooperated with UFA for the test production. This partnership is also aimed at developing a professional production process that makes it possible to quickly generate dynamic 3D models of high quality. The huge volumes of data for a volumetric film are recorded with a number of specially constructed cameras, posing new challenges for the exploitation chains in production. Fraunhofer HHI is currently planning to build a fully functional VR production studio for “3D Human Body Reconstruction (3DHBR)”.