Difference between revisions of "Real-time Tracking for Live Preview"
From iPi Docs
(Added a note about supported cameras) |
|||
| (15 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
| + | {{EditionFeature|Basic}} | ||
| + | |||
=== Introduction === | === Introduction === | ||
| − | '''Real-time Preview''' feature allows to perform tracking | + | {{Note|This feature is available only for depth sensor(s) and doesn't support RGB cameras.}} |
| + | |||
| + | '''Real-time Preview''' feature allows to perform tracking with the real-time speed and instantly transfer motion to a 3D character for live preview right at the time of recording. | ||
| − | This feature allows [[iPi Recorder]] to communicate to [[iPi Mocap Studio]] software in a way similar to [[Distributed Recording]] to send data necessary for tracking. [[iPi Mocap Studio]] performs tracking and motion transfer | + | This feature allows [[iPi Recorder]] to communicate to [[iPi Mocap Studio]] software in a way similar to [[Distributed Recording]] to send data necessary for tracking. [[iPi Mocap Studio]] performs tracking and motion transfer with the real-time speed. Feature benefits: |
* User can see how the motion will look like on a 3D character at the time of performance. | * User can see how the motion will look like on a 3D character at the time of performance. | ||
* Ability to improve motion accordingly at the time of acting and recording without the need to redo multiple iterations of recording and offline tracking. | * Ability to improve motion accordingly at the time of acting and recording without the need to redo multiple iterations of recording and offline tracking. | ||
| − | |||
| − | |||
=== Overview === | === Overview === | ||
| Line 18: | Line 20: | ||
=== Recording === | === Recording === | ||
| − | * Prepare for recording as usual and click ''' | + | * Prepare for recording as usual and click '''Start Broadcast''' button. |
| + | *:{{Note|If you use [[Distributed Recording]] first connect to slaves and click '''Start Broadcast''' button on master computer.}} | ||
*:[[File:realtime-preview-start-broadcast.png|center]] | *:[[File:realtime-preview-start-broadcast.png|center]] | ||
| − | * ''' | + | * Computer(s) will switch to '''Broadcasting''' mode. You can change network adapter used for communication in necessary. |
| − | *:[[File:realtime-preview- | + | *:[[File:realtime-preview-broadcasting.png|center]] |
| − | * To stop broadcast, you need to click ''' | + | * To stop broadcast, you need to click '''Stop Broadcast''' button. |
=== Realtime Preview === | === Realtime Preview === | ||
| Line 29: | Line 32: | ||
*:[[File:realtime-studio-live-mode-1.png|center]] | *:[[File:realtime-studio-live-mode-1.png|center]] | ||
* Specify actor height at '''Actor''' tab. | * Specify actor height at '''Actor''' tab. | ||
| − | * (Optional) Select | + | * If you use multiple sensors for recording, load scene at '''Scene''' tab. |
| + | * (Optional) Select target character for motion tranfer at '''Export''' tab. | ||
* Press '''Connect''' button at '''Live''' tab. | * Press '''Connect''' button at '''Live''' tab. | ||
| − | * Press ''' | + | *:[[File:realtime-connect-button-1.png|center|border]] |
| − | * Live tracking and motion tranfer will start | + | * Press '''OK''' button at '''Select Recording PCs''' dialog. |
| − | * Press '''Start Recording''' to | + | *:[[File:realtime-connect-dialog-1.png|center]] |
| + | * Live tracking and motion tranfer will start. | ||
| + | * You can specify path and filename template to record results of live tracking. [[iPi Mocap Studio]] will record ''.iPiMotion'' file, [[iPi Recorder]] will record ''.iPiVideo'' file. | ||
| + | * Press '''Start Recording''' / '''Stop Recording''' to start / stop recording ''.iPiVideo'' and ''.iPiMotion'' files. | ||
| + | {{Note|'''.iPiMotion''' and '''.iPiVideo''' files will have the same name, but path to '''.iPiVideo''' file is set in [[iPi Recorder]]]. }} | ||
* Press '''Disconnect''' to stop live session | * Press '''Disconnect''' to stop live session | ||
| + | *:[[File:realtime-preview-studio-live.png|center|thumb|528px]] | ||
| + | |||
| + | === Create New Project from Live Session Results === | ||
| + | It's as simple as this — open recorded ''.iPiMotion'' file in [[iPi Mocap Studio]]. | ||
| + | {{Tip|If ''.iPiVideo'' file resides in different directory you will be asked to find it manually.}} | ||
Latest revision as of 05:31, 22 June 2022
Contents
Introduction
Real-time Preview feature allows to perform tracking with the real-time speed and instantly transfer motion to a 3D character for live preview right at the time of recording.
This feature allows iPi Recorder to communicate to iPi Mocap Studio software in a way similar to Distributed Recording to send data necessary for tracking. iPi Mocap Studio performs tracking and motion transfer with the real-time speed. Feature benefits:
- User can see how the motion will look like on a 3D character at the time of performance.
- Ability to improve motion accordingly at the time of acting and recording without the need to redo multiple iterations of recording and offline tracking.
Overview
The feature works like this:
- iPi Recorder broadcasts data necessary for tracking via network.
- iPi Mocap Studio connects to broadcasting iPi Recorder to start receiving data.
- iPi Mocap Studio performs tracking and motion transfer to a 3D character.
- Live tracking results can then be stored to disk for additional offline post-processing.
Recording
- Prepare for recording as usual and click Start Broadcast button.
- Note: If you use Distributed Recording first connect to slaves and click Start Broadcast button on master computer.
- Computer(s) will switch to Broadcasting mode. You can change network adapter used for communication in necessary.
- To stop broadcast, you need to click Stop Broadcast button.
Realtime Preview
- Run iPi Mocap Studio and click Live button at the toolbar to enter live mode.
- Specify actor height at Actor tab.
- If you use multiple sensors for recording, load scene at Scene tab.
- (Optional) Select target character for motion tranfer at Export tab.
- Press Connect button at Live tab.
- Press OK button at Select Recording PCs dialog.
- Live tracking and motion tranfer will start.
- You can specify path and filename template to record results of live tracking. iPi Mocap Studio will record .iPiMotion file, iPi Recorder will record .iPiVideo file.
- Press Start Recording / Stop Recording to start / stop recording .iPiVideo and .iPiMotion files.
- Press Disconnect to stop live session
Create New Project from Live Session Results
It's as simple as this — open recorded .iPiMotion file in iPi Mocap Studio.
