R01_Ronin Live VR, Guayaba

"Ronin (浪人)* is the latest audiovisual project by virtual artist Guayaba. It is a concert that takes place simultaneously IRL and in VR Chat. In his residency, we developed the tracking system to be able to transmit his body movements to the virtual environment in real time.

The goal of the residency was to achieve accurate tracking of both Guayaba's body movements within the different worlds he visited on the VRChat platform and the facial movements that allowed us to appreciate the avatar moving his mouth during the performance. For this we combined two tracking systems: 3 lighthouse trackers for legs and hips, and inside-out tracking for hands and head.

The project was presented at the MMMAD Festival within the programme MMMAD+ Art and Technology Conference, which took place at Medialab Matadero from 10-12 May 2024, and at the Immaterial Festival, which took place at Tabakalera from 16-18 May 2024.