AI-powered talent tracking makes wearables obsolete

It is the first product of Zero Density’s new brand Traxis, which was set up to address the challenges of tracking and open new possibilities in virtual production. Deploying talentS makes beacons or wearables obsolete, giving users greater flexibility and ease of movement in virtual studios.

It uses artificial intelligence and the power of Nvidia’s GPU Tensor Cores to extract the talent’s precise 3D location from the image. The tracking data is then sent to Reality Engine to create accurate reflections, refractions and the virtual shadows of the talent inside the 3D space. It should allow greater realism in virtual studio and augmented reality productions, making it easier to merge the virtual and physical.

The system sends data through industry-standard FreeD protocol and integrates with the Reality ecosystem and any other FreeD compatible platform, out of the box.

Traxis talentS can also be utilised in other applications besides virtual studio, such as augmented reality in sports and live events. For example, AR graphics for statistics could be enhanced above a boxer during a live boxing match. It can also enable robotic lights to automatically track a specific dancer during live performance.

Going live with talentS should take only minutes following unboxing as it comes as a pre-calibrated and preinstalled system. It can supplied with optional optic filters that help remove physical reflections that might cause false detections. The stereoscopic camera can be positioned anywhere in the studio and is a lightweight system that can be installed on a truss or mounted on a tripod. A mounting kit and safety cables come as standard.