MoCap W1 '25: Introduction and Big Changes

It was an exciting start to the semester because there have been some impressive updates to the university's MoCap resources. The biggest change is that we will not be using the Cortex system to record the data anymore as a new software called Shogun by Vicon was introduced to us. Another new asset for AUT is a Virtual Production Studio which includes an advanced camera setup that can relay a live feed of a 3D environment while filming live action simultaneously.

Our brief is the recreate a scene from the 2004 movie 'I, Robot' starring Will Smith. The scene we will be working on is an interrogation scene featuring Detective Del Spooner

and Sonny the Robot. The scene is 24 seconds long.

The scene is acted between a live actor (Detectice Del Spooner aka Will Smith) and a virtual robot (Sonny). For our assignment, Detective Del Spooner will be acted by a virtual actor (vactor), and Sonny will be acted via live action. This means the motion capture work will be done for the detective, a flip of the roles in the original film.

We formed groups of four-five. My group consists of Jasmine James, Reyna Paul, Medina Aulia and Izzy Stemson. Jasmine is our nominated MoCap actress.

The key differences between Vicon Shogun and Cortex include:

• the use of 16 cameras instead of 24 

• a larger tracking area – full floor instead of the grid

• finger tracking 

• variety of visual performers (not just bones)

• A-pose instead of T-pose 

• much more accurate – minimal-to-no data cleanup 

• tracks straight into Unreal Engine  

Our vactor will be created using Metahuman like we used in Performance Capture. We will use photogrammetry to capture of performer's features 

The production schedule for the semester looks something like this:

1. Photogrammetry session (group) - capture, metahuman 

2. Performance Capture session (group) 

3. Apply mocap and Faceware data to metahuman (individual) 

4. Virtual Production session (group) - choose one metahuman, live action performance 

5. Cinematic and editing (individual)

From all of this, I'm super excited and intrigued for the semester ahead.

Here are some images from our induction sessions in the new and improved studio spaces.

First look at the new camera setup in the Virtual Production Studio.

The feed from the camera featuring a digital environment and our live action actor, Kane Giffiths.

The new Motion Capture Lab setup, featuring a slightly different mocap suit modelled by Jasmine Voss. A fight scene featuring Evelyn Brown.

The visual feed from Vicon Shogun. The display of the actor shows a more realistic digital model.

Prop integration in Vicon Shogun.