Difference between revisions of "Real-time Tracking for Live Preview"

From iPi Docs
Jump to: navigation, search
Line 31: Line 31:
 
* (Optional) Select target character for motion tranfer at '''Export''' tab.
 
* (Optional) Select target character for motion tranfer at '''Export''' tab.
 
* Press '''Connect''' button at '''Live''' tab.
 
* Press '''Connect''' button at '''Live''' tab.
*:[[File:realtime-connect-button.png|center]]
+
*:[[File:realtime-connect-button.png|center|border]]
 
* Press '''OK''' button at '''Select Recording PCs''' dialog.
 
* Press '''OK''' button at '''Select Recording PCs''' dialog.
 
*:[[File:realtime-connect-dialog.png|center]]
 
*:[[File:realtime-connect-dialog.png|center]]
 
* Live tracking and motion tranfer will start
 
* Live tracking and motion tranfer will start
 
* Press '''Start Recording''' / '''Stop Recording''' to start / stop recording .iPiVideo and .iPiMotion files
 
* Press '''Start Recording''' / '''Stop Recording''' to start / stop recording .iPiVideo and .iPiMotion files
*:[[File:realtime-preview-studio-live.png|center]]
+
*:[[File:realtime-preview-studio-live.png|center|border]]
 
* Press '''Disconnect''' to stop live session
 
* Press '''Disconnect''' to stop live session

Revision as of 11:44, 30 June 2018

Introduction

Real-time Preview feature allows to perform tracking in real-time speed and instantly transfer motion to a 3D character for live preview right at the time of recording.

This feature allows iPi Recorder to communicate to iPi Mocap Studio software in a way similar to Distributed Recording to send data necessary for tracking. iPi Mocap Studio performs tracking and motion transfer at real-time speed. Feature benefits:

  • User can see how the motion will look like on a 3D character at the time of performance.
  • Ability to improve motion accordingly at the time of acting and recording without the need to redo multiple iterations of recording and offline tracking.
Note.png
Note: Current version support only recording with single depth sensor. Adding support for multiple depth sensors is planned for Fall 2018.

Overview

The feature works like this:

  • iPi Recorder broadcasts data necessary for tracking via network.
  • iPi Mocap Studio connects to broadcasting iPi Recorder to start receiving data.
  • iPi Mocap Studio performs tracking and motion transfer to a 3D character.
  • Live tracking results can then be stored to disk for additional offline post-processing.

Recording

  • Prepare for recording as usual and click Live Broadcast button.
    realtime-preview-start-broadcast.png
  • Waiting for live connection dialog will appear. You can change network adapter used for communication in necessary.
    realtime-preview-select-network-adapter.png
  • To stop broadcast, you need to click Cancel Live Broadcast button in the dialog.

Realtime Preview

  • Run iPi Mocap Studio and click Live button at the toolbar to enter live mode.
    realtime-studio-live-mode-1.png
  • Specify actor height at Actor tab.
  • (Optional) Select target character for motion tranfer at Export tab.
  • Press Connect button at Live tab.
    realtime-connect-button.png
  • Press OK button at Select Recording PCs dialog.
    realtime-connect-dialog.png
  • Live tracking and motion tranfer will start
  • Press Start Recording / Stop Recording to start / stop recording .iPiVideo and .iPiMotion files
    realtime-preview-studio-live.png
  • Press Disconnect to stop live session