Difference between revisions of "Using Tracking Data from Depth Sensors"

From iPi Docs
Jump to: navigation, search
Line 28: Line 28:
  
 
{{Note|If you stand back to sensor, embedded tracking will detect gaze direction opposite to actual, so automatically detected inital pose will be incorrect and you'll have to manually fix this in [[iPi Mocap Studio]].}}
 
{{Note|If you stand back to sensor, embedded tracking will detect gaze direction opposite to actual, so automatically detected inital pose will be incorrect and you'll have to manually fix this in [[iPi Mocap Studio]].}}
 +
 +
=== Using Sensor Tracking Data ===
 +
 +
==== Detecting Number of Actors and Actor Heights ====
 +
 +
When creating a new project from recorded [[.iPiVideo File Extension|'''.iPiVideo''']] file, you need to specify number of actors and their heghts. These numbers are detected based on tracking data. You just need to check them during project creation, as embedded tracking algorithms are not very accurate. Correct the numbers if necessary.
 +
 +
{|
 +
|[[Image:Create-project-set-actors-number.png|thumb|center|500px|Setting number of actors]]
 +
|[[Image:Create-project-set-actor-height.png|thumb|center|500px|Setting actor height]]
 +
|}

Revision as of 03:08, 20 November 2015

Note.png
Note: Depth sensors provide body tracking data based on embedded tracking algorithms. The accuracy of such tracking is rather low and far below requirements of professional-level motion capture solutions. Tracking provided by iPi Mocap Studio is based on iPi Soft's algorithms and do not use tracking data from sensors. However, sensor's tracking can be effectively used to improve workflow.

We record and use tracking data from Kinect 2 sensors. The data are used for:

  • Detecting number of actors
  • Detecting actor heights
  • Detecting T-Poses and creation of takes
  • Setting initial pose for detected T-poses
  • Setting inital pose for first frame of Region-of-Interest
  • Warning on presense of people in sensor view during background recording

Recording Sensor Tracking Data

T-Pose in first sensor

iPi Recorder records tracking data provided by depth sensor for further use in iPi Mocap Studio.

Note.png
Note: As soon as embedded tracking algorithms work well only when actor faces the sensor and each sensor works indepndently from others, for T-Pose and takes creation we only use data from first sensor.

To make the most of sensors' tracking data, please follow this recommendations during recording:

  • Strike T-Pose before each take
  • You have to stay in T-Pose at least for one second
  • Face first sensor in T-Pose
  • If you have several actors, each of them should face first sensor
Tip.png
Tip: In case when capture area does not allow to face the sensor, you can stay at an angle to sensor. Make sure that arms and legs are not occluded from sensor.
Note.png
Note: If you stand back to sensor, embedded tracking will detect gaze direction opposite to actual, so automatically detected inital pose will be incorrect and you'll have to manually fix this in iPi Mocap Studio.

Using Sensor Tracking Data

Detecting Number of Actors and Actor Heights

When creating a new project from recorded .iPiVideo file, you need to specify number of actors and their heghts. These numbers are detected based on tracking data. You just need to check them during project creation, as embedded tracking algorithms are not very accurate. Correct the numbers if necessary.

Setting number of actors
Setting actor height
Retrieved from "https://docs.ipisoft.com/index.php?title=Using_Tracking_Data_from_Depth_Sensors&oldid=1023"