Manual Clean-up - Revision history

Pavel at 12:47, 2 July 2018

2018-07-02T12:47:36Z

Pavel at 12:46, 2 July 2018

2018-07-02T12:46:45Z

Pavel at 12:42, 2 July 2018

2018-07-02T12:42:37Z

Pavel at 18:02, 1 November 2014

2014-11-01T18:02:58Z

Pavel at 17:00, 1 November 2014

2014-11-01T17:00:39Z

Pavel: Created page with "Once initial tracking is performed on all (or part) of your video, you can begin cleaning out tracking errors (if any). Post-processing should be applied after clean-up. ==..."

2014-11-01T16:26:36Z

Created page with "Once initial tracking is performed on all (or part) of your video, you can begin cleaning out tracking errors (if any). Post-processing should be applied after clean-up. ==..."

New page

Once initial tracking is performed on all (or part) of your video, you can begin cleaning out tracking errors (if any). Post-processing should be applied after clean-up.

=== Cleaning up tracking gaps ===

Tracking errors usually happen in a few specific video frames and propagate to multiple subsequent frames, resulting in tracking gaps. Examples of problematic frames:
* Occlusion (like one hand not visible in any of the cameras)
* Indistinctive pose (like hands folded on chest).
* Very fast motion with motion blur.
To clean up a sequence of incorrect frames (a tracking gap), you should use backward tracking:
# Go toward the last frame of tracking gap, to a frame where actor pose is distinctive (no occlusion, no motion blur etc.).
# If necessary, use '''Rotate''', '''Move''' and '''IK''' (Inverse Kinematics) tools to edit character pose to match actor pose on video.
# Turn off '''Trajectory Filtering''' (set it to zero) so that it does not interfere with your editing.
# Click '''Refit Pose''' button to get a better fit of character pose.
# Click '''Track Backward''' button.
# Stop backward tracking as soon as it comes close to the nearest good frame.
# If necessary, go back to remaining parts of tracking gap and use forward and backward tracking to clean them up.

=== Cleaning up individual frames ===

To clean up individual frames you should use a combination of editing tools ('''Rotate''', '''Move''' and '''I'''nverse '''K'''inematics) and '''Refit Pose''' button.

{{Note|after '''Refit Pose''' operation [[iPi Mocap Studio]] automatically applies '''Trajectory Filtering''' to produce a smooth transition between frames. As the result, pose in current frame is affected by nearby frames. This may look confusing. If you want to see exact result of '''Refit Pose''' operation in current frame you should turn off '''Trajectory Filtering''' (set it to zero), but do not forget to change it back to suitable value later.}}

=== Tracking errors that cannot be cleaned up using iPi Studio ===

Not all tracking errors can be cleaned up in [[iPi Mocap Studio]] using automatic tracking and '''Refit Pose''' button.
* Frames immediately affected by occlusion sometimes cannot be corrected. Recommended workarounds:
** Manually edit problematic poses (not using '''Refit Pose''' button).
** Record a new video of the motion and try to minimize occlusion.
** Record a new video of the motion using more cameras.
* Frames immediately affected by motion blur sometimes cannot be corrected. Recommended workarounds:
** Manually edit problematic poses (not using '''Refit Pose''' button).
** Edit problematic poses in some external animation editor.
** Record a new video of the motion using higher framerate.
* Frames affected by strong shadows on the floor sometimes cannot be corrected. Typical example is push-ups. This is a limitation of current version of markerless mocap technology. iPi Soft is working to improve tracking in future versions of [[iPi Mocap Studio]].

@@ Line 21: / Line 21: @@
 * Tracking will be done for selected body parts only.
 * Unselected body parts will keep the same rotations.
-[[Image:Tracking_tab_individual_body_parts.png]]
+[[Image:Tracking_tab_individual_body_parts.png|thumb|387px|border]]
 === Cleaning up individual frames ===

← Older revision		Revision as of 17:00, 1 November 2014
Line 1:		Line 1:
−	Once initial tracking is performed on all (or part) of your video, you can begin cleaning out tracking errors (if any). ~~Post-processing~~ should be applied after clean-up.	+	Once initial tracking is performed on all (or part) of your video, you can begin cleaning out tracking errors (if any). [[Automatic Refinement and Filtering]] should be applied after clean-up.

	=== Cleaning up tracking gaps ===		=== Cleaning up tracking gaps ===

@@ Line 2: / Line 2: @@
 === Cleaning up tracking gaps ===
+[[Image:Tracking_tab_cleanup.png|thumb|420px|Clean-up Steps]]
 Tracking errors usually happen in a few specific video frames and propagate to multiple subsequent frames, resulting in tracking gaps. Examples of problematic frames:
 * Occlusion (like one hand not visible in any of the cameras)
@@ Line 8: / Line 8: @@
 * Very fast motion with motion blur.
 To clean up a sequence of incorrect frames (a tracking gap), you should use backward tracking:
 # Go toward the last frame of tracking gap, to a frame where actor pose is distinctive (no occlusion, no motion blur etc.).
 # If necessary, use '''Rotate''', '''Move''' and '''IK''' (Inverse Kinematics) tools to edit character pose to match actor pose on video.
@@ Line 18: / Line 17: @@
 === Individual body parts tracking ===
 In most cases tracking errors affect some of limbs. ''Individual Body Parts Tracking'' settings on '''Tracking''' tab allow to redo tracking specified body parts.
 * Tracking will be done for selected body parts only.
 * Unselected body parts will keep the same rotations.
 === Cleaning up individual frames ===

@@ Line 16: / Line 16: @@
 # Stop backward tracking as soon as it comes close to the nearest good frame.
 # If necessary, go back to remaining parts of tracking gap and use forward and backward tracking to clean them up.
 === Cleaning up individual frames ===