Real-time Tracking for Live Preview

Introduction

Real-time Preview feature allows to perform tracking in real-time speed and instantly transfer motion to a 3D character for live preview right at the time of recording.

This feature allows iPi Recorder to communicate to iPi Mocap Studio software in a way similar to Distributed Recording to send data necessary for tracking. iPi Mocap Studio performs tracking and motion transfer at real-time speed. Feature benefits:

• User can see how the motion will look like on a 3D character at the time of performance.
• Ability to improve motion accordingly at the time of acting and recording without the need to redo multiple iterations of recording and offline tracking.

Note: Current version support only recording with single depth sensor. Adding support for multiple depth sensors is planned for Fall 2018.

Overview

The feature works like this:

• iPi Recorder broadcasts data necessary for tracking via network.
• iPi Mocap Studio connects to broadcasting iPi Recorder to start receiving data.
• iPi Mocap Studio performs tracking and motion transfer to a 3D character.
• Live tracking results can then be stored to disk for additional offline post-processing.

Recording

• Prepare for recording as usual and click Live Broadcast button.

  

• Waiting for live connection dialog will appear. You can change network adapter used for communication in necessary.

  File:realtime-preview-select-network-adapter