AI-based Tracking - Revision history

Pavel at 14:36, 3 April 2024

2024-04-03T14:36:39Z

Pavel at 14:17, 3 April 2024

2024-04-03T14:17:45Z

Pavel at 06:10, 6 September 2023

2023-09-06T06:10:52Z

Pavel at 06:09, 6 September 2023

2023-09-06T06:09:50Z

Pavel at 06:09, 6 September 2023

2023-09-06T06:09:28Z

Pavel at 06:08, 6 September 2023

2023-09-06T06:08:32Z

Pavel at 06:07, 6 September 2023

2023-09-06T06:07:59Z

Pavel at 06:07, 6 September 2023

2023-09-06T06:07:15Z

Pavel at 06:04, 6 September 2023

2023-09-06T06:04:48Z

Pavel at 06:02, 6 September 2023

2023-09-06T06:02:20Z

@@ Line 109: / Line 109: @@
 === Tracking with Auto-recover option ===
-This feature is more intellectual implementation of [[Automatic tracking errors fixing]].
+This feature is more intellectual implementation of [[#Automatic tracking errors fixing]].
 It is regularly compares the result of standard tracking with tracking that uses AI-detected pose as initial guess. If AI-based result is better, it uses it in the current frame and retacks back until it can improve tracking result. So if tracking error occurs, it is automatically detected, and misdetected frames are fixed. In most cases, this provides better tracking result and allows to avoid propagation of tracking errors to the subsequent frames.
@@ Line 119: / Line 119: @@
 Additional time is required to compare with AI-based result and re-tracking, but this may save a lot of time as you would not need manual error fixing.
-<center>[[File:tracking-ai-auto-recover-1.png]]</center>
+<center>[[File:tracking-ai-auto-recover-2.png]]</center>
 {{Note|This approach is applicable even when AI-based tracking is not selected for any body part.}}

← Older revision		Revision as of 14:17, 3 April 2024
Line 104:		Line 104:

	This option applies '''Detect Pose (AI)''' followed by '''Refit Pose''' actions for each frame in Forward/Backward directions, starting from the current frame.		This option applies '''Detect Pose (AI)''' followed by '''Refit Pose''' actions for each frame in Forward/Backward directions, starting from the current frame.
		+
		+	{{Note\|This approach is applicable even when AI-based tracking is not selected for any body part.}}
		+
		+	=== Tracking with Auto-recover option ===
		+
		+	This feature is more intellectual implementation of [[Automatic tracking errors fixing]].
		+	It is regularly compares the result of standard tracking with tracking that uses AI-detected pose as initial guess. If AI-based result is better, it uses it in the current frame and retacks back until it can improve tracking result. So if tracking error occurs, it is automatically detected, and misdetected frames are fixed. In most cases, this provides better tracking result and allows to avoid propagation of tracking errors to the subsequent frames.
		+
		+	How to track with Auto-Recover option:
		+	* Just select '''Algorithm''' option
		+	** Fast with Auto-recover (AI-based)
		+	** or Standard with Auto-recover (AI-based)
		+
		+	Additional time is required to compare with AI-based result and re-tracking, but this may save a lot of time as you would not need manual error fixing.
		+
		+	<center>[[File:tracking-ai-auto-recover-1.png]]</center>

	{{Note\|This approach is applicable even when AI-based tracking is not selected for any body part.}}		{{Note\|This approach is applicable even when AI-based tracking is not selected for any body part.}}

@@ Line 99: / Line 99: @@
 * Then click '''Refit Pose''' button to refine detected pose
-In most cases, it should fix pose in the selected frame. But what to do when there are many sequential frames with erroneous poses? First, it is worth to try re-tracking in different direction from the fixed pose. It could help. If not then new '''Auto Fix Pose (AI-based)''' tracking option should be applied.
+In most cases, it should fix pose in the selected frame. But what if there are many sequential frames with erroneous poses? First, it is worth to try re-tracking in different direction from the fixed pose. It could help. If not then new '''Auto Fix Pose (AI-based)''' tracking option should be applied.
 <center>[[File:tracking-auto-fix-pose-ai.png]]</center>

@@ Line 94: / Line 94: @@
 === Automatic tracking errors fixing ===
-AI-based pose detection can help in fixing of tracking errors:
+AI-based pose detection can help fixing tracking errors:
 * Choose frame with erroneous pose after tracking
 * Click '''Detect Pose (AI)''' button to set pose roughly based on AI detectors

@@ Line 94: / Line 94: @@
 === Automatic tracking errors fixing ===
-As was stated before, AI-based pose detection can help in fixing of tracking errors:
+AI-based pose detection can help in fixing of tracking errors:
 * Choose frame with erroneous pose after tracking
 * Click '''Detect Pose (AI)''' button to set pose roughly based on AI detectors

@@ Line 86: / Line 86: @@
 === Applying only AI-based tracking ===
-When one chooses AI-based tracking for Head/Hands/Feet, it applies during standard Tracking Forward/Backward pass along with iPi incremental tracking for full body. But when tracking has already been performed and there is no need to re-track frames in ROI, one can apply only AI-based tracking for Head/Hands/Feet (depending on selected settings for them). To do it, click on down arrow in the right part of '''Track Forward/Backward''' buttons and choose '''AI-based Only''' item in drop-down menu. This could be helpful during experiments with different AI options because it allows applying changes fast.
+When one chooses AI-based tracking for Head/Hands/Feet, it applies during standard Tracking Forward / Backward pass along with iPi incremental tracking for full body. But when tracking has already been performed and there is no need to re-track frames in ROI, one can apply only AI-based tracking for Head/Hands/Feet (depending on selected settings for them). To do it, click on down arrow in the right part of '''Track Forward/Backward''' buttons and choose '''AI-based Only''' item in drop-down menu. This could be helpful during experiments with different AI options because it allows applying changes fast.
 <center>[[File:tracking-ai-based-only.png]]</center>

@@ Line 80: / Line 80: @@
 === AI-based hands tracking ===
-In addition to feet and head, AI-based tracking can be applied to hands. Currently, only rotations for hands is supported. Neither thumb nor fingers positions are tracked. Use key framing for fingers, as before. In addition, accuracy of hands rotations determined by AI-based algorithms depends on hands visibility in cameras.
+In addition to feet and head, AI-based tracking can be applied to hands. Currently, only rotations for hands is supported. Neither thumb nor fingers positions are tracked. Use [[Hand_Keyframing|key framing]] for fingers, as before. In addition, accuracy of hands rotations determined by AI-based algorithms depends on hands visibility in cameras.
 <center>[[File:tracking-settings-hands-ai.png]]</center>
-−
 === Applying only AI-based tracking ===

@@ Line 76: / Line 76: @@
 === AI-based head tracking ===
-Similar to feet tracking, head position can be tracked with the aid of iPi proprietary algorithms or based on AI detectors. Again, for some videos (especially depth ones) AI-based approach can be more accurate than iPi one.
+Similar to feet tracking, head position can be tracked with the aid of iPi proprietary algorithms or based on AI detectors. Again, for some videos (especially depth ones) AI-based approach can be more accurate.
 === AI-based hands tracking ===

@@ Line 54: / Line 54: @@
 === Detect Pose and Height (AI) ===
-'''Detect Pose and Height (AI)''' is available on '''Actor''' tab as an item in drop-down menu under '''Auto Adjust Actor Pose''' button. This feature works similar to the previous one but in addition to pose detection, it estimates actor’s height. The accuracy of such detection depends on pose, cameras views, etc. In most cases, it is better to set height manually if you know it. However, you can try it and decide for your own is it useful or not.
+'''Detect Pose and Height (AI)''' is available on '''Actor''' tab as an item in drop-down menu under '''Auto Adjust Actor Pose''' button. This feature works similar to the previous one but in addition to pose detection, it estimates actor’s height. The accuracy of such detection depends on pose, cameras views, etc. In most cases, it is better to set height manually if you know it. However, you can give it a  try and see if it works for you.
 <center>[[File:actor-detect-pose-and-height-ai.png]]</center>
-−
 === AI-based feet tracking ===