Difference between revisions of "Depth Sensors Comparison"
(http->httpS) |
(Orbbec Femto Bolt/Mega) |
||
| Line 4: | Line 4: | ||
* '''Modern depth sensors''': | * '''Modern depth sensors''': | ||
| + | ** [https://www.orbbec.com/products/tof-camera/femto-bolt Orbbec Femto Bolt] / [https://www.orbbec.com/products/tof-camera/femto-mega Mega] | ||
** [https://azure.microsoft.com/en-in/services/kinect-dk/ Azure Kinect] | ** [https://azure.microsoft.com/en-in/services/kinect-dk/ Azure Kinect] | ||
** MS Kinect 2 ([https://www.amazon.com/gp/product/B00INAX3Q2/ref=as_li_tl?ie=UTF8&tag=wwwipisoftcom-20&camp=1789&creative=9325&linkCode=as2&creativeASIN=B00INAX3Q2&linkId=da247a196e84f14c2b61c08d18af20d9 XBOX One Kinect] sensor plus [https://www.amazon.com/gp/product/B01GVE4YB4/ref=as_li_tl?ie=UTF8&tag=wwwipisoftcom-20&camp=1789&creative=9325&linkCode=as2&creativeASIN=B01GVE4YB4&linkId=9badef6020066e1ff88608b3bdd77734 Kinect Adapter for Windows]) | ** MS Kinect 2 ([https://www.amazon.com/gp/product/B00INAX3Q2/ref=as_li_tl?ie=UTF8&tag=wwwipisoftcom-20&camp=1789&creative=9325&linkCode=as2&creativeASIN=B00INAX3Q2&linkId=da247a196e84f14c2b61c08d18af20d9 XBOX One Kinect] sensor plus [https://www.amazon.com/gp/product/B01GVE4YB4/ref=as_li_tl?ie=UTF8&tag=wwwipisoftcom-20&camp=1789&creative=9325&linkCode=as2&creativeASIN=B01GVE4YB4&linkId=9badef6020066e1ff88608b3bdd77734 Kinect Adapter for Windows]) | ||
| Line 12: | Line 13: | ||
<center><table border=0><tr> | <center><table border=0><tr> | ||
| − | <td width=" | + | <td width="15%"><center>[[Image:FemtoBolt_1.jpg|thumb|Orbbec Femto Bolt]]</center></td> |
| − | <td width="2 | + | <td width="2%"></td> |
| − | <td width=" | + | <td width="15%"><center>[[Image:AzureKinect.jpg|thumb|Azure Kinect (Kinect for Azure)]]</center></td> |
| − | <td width="2 | + | <td width="2%"></td> |
| − | <td width=" | + | <td width="15%"><center>[[Image:Kinect-2-for-XboxOne.jpg|thumb|Kinect 2 (Kinect for XBOX One)]]</center></td> |
| − | <td width="2 | + | <td width="2%"></td> |
| − | <td width=" | + | <td width="15%"><center>[[Image:RealSenseL515.jpg|thumb|Intel RealSense L515]]</center></td> |
| − | <td width="2 | + | <td width="2%"></td> |
| − | <td width=" | + | <td width="15%"><center>[[Image:RealSenseD455.jpg|thumb|Intel RealSense D455]]</center></td> |
| + | <td width="2%"></td> | ||
| + | <td width="15%"><center>[[Image:Orbbec-Astra.jpg|thumb|Orbbec Astra (PRO)]]</center></td> | ||
</tr></table></center> | </tr></table></center> | ||
| − | As to modern depth sensors, Azure Kinect | + | As to modern depth sensors, Azure Kinect and Orbbec Femto Bolt/Mega sensors are the best choice for full body motion capture, while MS Kinect 2 (Kinect for XBOX One) sensor is also good enough. The quality and accuracy of depth maps from Orbbec Femto Bolt/Mega, Azure Kinects and MS Kinects 2 are the best in market. |
* '''First generation depth sensors''': | * '''First generation depth sensors''': | ||
| Line 62: | Line 65: | ||
| 1 || Azure Kinect || $400 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || NFOV: 65°<br/>WFOV: 120° || NFOV: 640x576 (very good quality!)<br/>WFOV: 512x512 || 30 || USB 3.0 || yes || optional || yes (1/4″) || [https://www.youtube.com/watch?v=t9n15G-1Eu4 1], [https://www.youtube.com/watch?v=tP_cv52gzdA 2], [https://www.youtube.com/watch?v=n05e7LV1XkA 3], [https://www.youtube.com/watch?v=v6hK38p3a6k 4], [https://www.youtube.com/watch?v=SJ_ita7TVQI 5] | | 1 || Azure Kinect || $400 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || NFOV: 65°<br/>WFOV: 120° || NFOV: 640x576 (very good quality!)<br/>WFOV: 512x512 || 30 || USB 3.0 || yes || optional || yes (1/4″) || [https://www.youtube.com/watch?v=t9n15G-1Eu4 1], [https://www.youtube.com/watch?v=tP_cv52gzdA 2], [https://www.youtube.com/watch?v=n05e7LV1XkA 3], [https://www.youtube.com/watch?v=v6hK38p3a6k 4], [https://www.youtube.com/watch?v=SJ_ita7TVQI 5] | ||
|- | |- | ||
| − | | 2 || | + | | 2 || Orbbec Femto Bolt || $400 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || NFOV: 65°<br/>WFOV: 120° || NFOV: 640x576 (good quality)<br/>WFOV: 512x512 || 30 || USB 3.0 || yes || optional || yes (1/4″) || |
|- | |- | ||
| − | | 3 || | + | | 3 || Kinect 2 (Kinect for XBOX One) || $160 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || 60° || 512x424 (good quality) || 30 || USB 3.0 || yes || required || yes (1/4″) || [https://www.youtube.com/watch?v=DrtxP7HfCQY 1], [https://www.youtube.com/watch?v=S-KH5MYzyIg 2], [https://www.youtube.com/watch?v=arcpZSctZ0Y 3], [https://www.youtube.com/watch?v=K2_vs2XXskM 4], [https://www.youtube.com/watch?v=BMuZ3P1FCwk 5], [https://www.youtube.com/watch?v=2_Z0TOHf0zI 6] |
|- | |- | ||
| − | | 4 || Intel RealSense | + | | 4 || Intel RealSense L515 || $350 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || 55° || up to 1024x768 || 30 || USB 3.0 || yes || not required || yes (1/4″) || [https://www.youtube.com/watch?v=oZmu3OkQZcM 1] |
|- | |- | ||
| − | | 5 || | + | | 5 || Intel RealSense D455 || $240 || [https://en.wikipedia.org/wiki/Structured_light Infrared Coded Structured Light] combined with stereo RGB matching || 57° || up to 1280x720 (but noisy!) || up to 90 || USB 3.0 || yes || not required || yes (1/4″) || [https://www.youtube.com/watch?v=brUmSDhlqc0 1] |
|- | |- | ||
| − | | 6 || | + | | 6 || First-gen depth sensors || from $30 || [https://en.wikipedia.org/wiki/Structured_light Infrared Coded Structured Light] || 45° || 640x480 (interpolated, actual: 320x240 or even less) || 30 || USB 2.0 || yes || not required (except Kinect v1) || no || [https://www.youtube.com/watch?v=Ey3xJOf9xDI 1], [https://www.youtube.com/watch?v=GCu8KTrC4sc 2], [https://www.youtube.com/watch?v=XvRP7qXCBCA 3], [https://www.youtube.com/watch?v=msRtIZX529Q 4] |
|- | |- | ||
| − | | 7 || | + | | 7 || Orbbec Astra (PRO) || $160 || [https://en.wikipedia.org/wiki/Structured_light Infrared Coded Structured Light] || 45° || 640x480 (interpolated, actual: 320x240 or even less) || 30 || USB 2.0 || yes || not required || yes (M6 not 1/4″) || |
|- | |- | ||
| − | | 8 || ASUS Xtion 2 || $270 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || 52° (can be mounted in vertical position for 74°) || 640x480 (interpolated: actual is less than 320x240) || 30 || USB 3.0 || yes || not required || yes (1/4″, dual at bottom and side) || | + | | 8 || Intel RealSense D435 || $180 || [https://en.wikipedia.org/wiki/Structured_light Infrared Coded Structured Light] combined with stereo RGB matching || 65.5° (only 42° for RGB) || up to 1280x720 (but very noisy, inaccurate and with a lot of artifacts like waves and blur!) || up to 90 || USB 3.0 || yes || not required || yes (1/4″) || |
| + | |- | ||
| + | | 9 || ASUS Xtion 2 || $270 || [https://en.wikipedia.org/wiki/Time-of-flight_camera Time-of-Flight] || 52° (can be mounted in vertical position for 74°) || 640x480 (interpolated: actual is less than 320x240) || 30 || USB 3.0 || yes || not required || yes (1/4″, dual at bottom and side) || | ||
|} | |} | ||
| Line 100: | Line 105: | ||
* Requires USB 3.0 controller | * Requires USB 3.0 controller | ||
* Requires Windows 10 64-bit (doesn't work in Windows 7, 8 and 8.1) | * Requires Windows 10 64-bit (doesn't work in Windows 7, 8 and 8.1) | ||
| + | * Out of stocks | ||
| + | |- | ||
| + | | 2 || Orbbec Femto Bolt || | ||
| + | * Mostly the same as Azure Kinect | ||
| + | || | ||
| + | * High price | ||
| + | * Poor overlapping between color and depth images in WFOV depth modes | ||
| + | * Doesn't like certain fabrics (e.g. shiny) | ||
| + | * Orbbec SDK is not stable enough, and still has some bugs and issues | ||
|- | |- | ||
| − | | | + | | 3 || Kinect 2 (Kinect for XBOX One) || |
* Good-enough FOV | * Good-enough FOV | ||
* Relatively high resolution of depth and RGB video | * Relatively high resolution of depth and RGB video | ||
| Line 117: | Line 131: | ||
* Does not work on Windows 7 (requires Windows 8 and higher) | * Does not work on Windows 7 (requires Windows 8 and higher) | ||
|- | |- | ||
| − | | | + | | 4 || Intel RealSense L515 || |
* Good resolution and quality of depth map | * Good resolution and quality of depth map | ||
* Very compact | * Very compact | ||
| Line 129: | Line 143: | ||
* Pricy | * Pricy | ||
|- | |- | ||
| − | | | + | | 5 || Intel RealSense D455 || |
* Up to 90 FPS | * Up to 90 FPS | ||
* High resolution of depth map | * High resolution of depth map | ||
| Line 142: | Line 156: | ||
* Short USB-cables (use active USB 3.0 repeaters to overcome this drawback) | * Short USB-cables (use active USB 3.0 repeaters to overcome this drawback) | ||
|- | |- | ||
| − | | | + | | 6 || First-generation Depth Sensors || |
* Ensures tracking quality comparable with that of Kinect 2, but hardware requirements are not so strong | * Ensures tracking quality comparable with that of Kinect 2, but hardware requirements are not so strong | ||
* Requires USB 2.0 controller | * Requires USB 2.0 controller | ||
| Line 155: | Line 169: | ||
* No mount for tripod | * No mount for tripod | ||
|- | |- | ||
| − | | | + | | 7 || Orbbec Astra (PRO) || |
:''See above (as 1st gen. depth sensors)'' | :''See above (as 1st gen. depth sensors)'' | ||
:Plus: | :Plus: | ||
| Line 165: | Line 179: | ||
* Non-standard tripod mount — '''M6''' instead of '''1/4″''' | * Non-standard tripod mount — '''M6''' instead of '''1/4″''' | ||
|- | |- | ||
| − | | | + | | 8 || Intel RealSense D435 || |
* Up to 90 FPS | * Up to 90 FPS | ||
* High resolution of depth map | * High resolution of depth map | ||
| Line 176: | Line 190: | ||
* RGB camera has significantly lower FOV | * RGB camera has significantly lower FOV | ||
|- | |- | ||
| − | | | + | | 9 || ASUS Xtion 2 || |
* Time-of-Flight like Kinect 2 | * Time-of-Flight like Kinect 2 | ||
* Good field-of-view (FOV) | * Good field-of-view (FOV) | ||
| Line 188: | Line 202: | ||
|} | |} | ||
| − | The winners are Azure Kinect and Kinect 2 (Kinect for XBOX One). Intel RealSense L515 and D455 can be also used. | + | The winners are Azure Kinect, Orbbec Femto Bolt/Mega and Kinect 2 (Kinect for XBOX One). Intel RealSense L515 and D455 can be also used. |
== Drivers and Software Libraries == | == Drivers and Software Libraries == | ||
| Line 194: | Line 208: | ||
The following sensors don't require special drivers and software to be recognized in [[iPi Recorder]]: | The following sensors don't require special drivers and software to be recognized in [[iPi Recorder]]: | ||
* Azure Kinect | * Azure Kinect | ||
| + | * Orbbec Femto Bolt/Mega | ||
* Intel RealSense D400, L500 series | * Intel RealSense D400, L500 series | ||
* ASUS Xtion 2 | * ASUS Xtion 2 | ||
Latest revision as of 11:47, 13 June 2024
Depth Sensors Support
iPi Recorder supports the following depth sensors:
- Modern depth sensors:
- Orbbec Femto Bolt / Mega
- Azure Kinect
- MS Kinect 2 (XBOX One Kinect sensor plus Kinect Adapter for Windows)
- Important! Multiple MS Kinect 2 (Kinect for XBOX One) sensors can be connected to a PC with libfreenect2 library. With Microsoft SDK v2, each Kinect should be connected to a separate computer and Distributed Recording utilized.

- Intel RealSense L515
- Intel RealSense D455
- Orbbec Astra (PRO)
As to modern depth sensors, Azure Kinect and Orbbec Femto Bolt/Mega sensors are the best choice for full body motion capture, while MS Kinect 2 (Kinect for XBOX One) sensor is also good enough. The quality and accuracy of depth maps from Orbbec Femto Bolt/Mega, Azure Kinects and MS Kinects 2 are the best in market.
- First generation depth sensors:
- MS Kinect v1 (Kinect for Windows sensor or Microsoft Xbox 360 Kinect Sensor sensor plus adapter)
- ASUS Xtion and ASUS Xtion Live devices (and also PRO modifications for developers)
- PrimeSense Carmine 1.08
First generation depth sensors are almost outdated but still usable. For example, Orbbec Astra (PRO) has totally the same depth quality and resolution as these outdated sensors. For this reason you can use for example MS Kinect v1 sensor(s) and get exactly the same results as with Orbbec Astra sensor(s). If needed you can find more information about these sensors in documentation for previous version of iPi Motion Capture.
- Outdated and not recommended depth sensors:
Comparison
Main features of depth sensors:
| Place | Sensor | Price (approx) | Technology | Depth FOV (vertical) | Depth Resolution | Depth FPS | Interface | Multiple Sensors per single PC | External Power Supply | Tripod Mount | Example |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Azure Kinect | $400 | Time-of-Flight | NFOV: 65° WFOV: 120° |
NFOV: 640x576 (very good quality!) WFOV: 512x512 |
30 | USB 3.0 | yes | optional | yes (1/4″) | 1, 2, 3, 4, 5 |
| 2 | Orbbec Femto Bolt | $400 | Time-of-Flight | NFOV: 65° WFOV: 120° |
NFOV: 640x576 (good quality) WFOV: 512x512 |
30 | USB 3.0 | yes | optional | yes (1/4″) | |
| 3 | Kinect 2 (Kinect for XBOX One) | $160 | Time-of-Flight | 60° | 512x424 (good quality) | 30 | USB 3.0 | yes | required | yes (1/4″) | 1, 2, 3, 4, 5, 6 |
| 4 | Intel RealSense L515 | $350 | Time-of-Flight | 55° | up to 1024x768 | 30 | USB 3.0 | yes | not required | yes (1/4″) | 1 |
| 5 | Intel RealSense D455 | $240 | Infrared Coded Structured Light combined with stereo RGB matching | 57° | up to 1280x720 (but noisy!) | up to 90 | USB 3.0 | yes | not required | yes (1/4″) | 1 |
| 6 | First-gen depth sensors | from $30 | Infrared Coded Structured Light | 45° | 640x480 (interpolated, actual: 320x240 or even less) | 30 | USB 2.0 | yes | not required (except Kinect v1) | no | 1, 2, 3, 4 |
| 7 | Orbbec Astra (PRO) | $160 | Infrared Coded Structured Light | 45° | 640x480 (interpolated, actual: 320x240 or even less) | 30 | USB 2.0 | yes | not required | yes (M6 not 1/4″) | |
| 8 | Intel RealSense D435 | $180 | Infrared Coded Structured Light combined with stereo RGB matching | 65.5° (only 42° for RGB) | up to 1280x720 (but very noisy, inaccurate and with a lot of artifacts like waves and blur!) | up to 90 | USB 3.0 | yes | not required | yes (1/4″) | |
| 9 | ASUS Xtion 2 | $270 | Time-of-Flight | 52° (can be mounted in vertical position for 74°) | 640x480 (interpolated: actual is less than 320x240) | 30 | USB 3.0 | yes | not required | yes (1/4″, dual at bottom and side) |
Major Pros and Cons of depth sensors:
| Place | Sensor | Pros | Cons |
|---|---|---|---|
| 1 | Azure Kinect |
|
|
| 2 | Orbbec Femto Bolt |
|
|
| 3 | Kinect 2 (Kinect for XBOX One) |
|
|
| 4 | Intel RealSense L515 |
|
|
| 5 | Intel RealSense D455 |
|
|
| 6 | First-generation Depth Sensors |
|
|
| 7 | Orbbec Astra (PRO) |
|
|
| 8 | Intel RealSense D435 |
|
|
| 9 | ASUS Xtion 2 |
|
|
The winners are Azure Kinect, Orbbec Femto Bolt/Mega and Kinect 2 (Kinect for XBOX One). Intel RealSense L515 and D455 can be also used.
Drivers and Software Libraries
The following sensors don't require special drivers and software to be recognized in iPi Recorder:
- Azure Kinect
- Orbbec Femto Bolt/Mega
- Intel RealSense D400, L500 series
- ASUS Xtion 2
That is, you can simply plug in these sensors to computer and make recordings in iPi Recorder without need to install any drivers or SDK's.
Other sensors require special drivers and/or software libraries/SDK to be installed:
- MS Kinect 2 (Kinect for XBOX One) requires MS Kinect SDK 2.0:
- MS Kinect v1 (Kinect for Windows and Kinect for XBOX 360) requires MS Kinect SDK 1.8:
- Orbbec Astra (PRO) requires special drivers:
- ASUS Xtion / ASUS Xtion Live / PrimeSense Carmine require OpenNI 1.5.4.0 and sensor drivers 5.1.2.1: