Quick Start Guide for Multiple Depth Sensors Configuration

Video Tutorial

Jimer Lins’ tutorial (motion capture for SFM)

Note: This tutorial is for Version 2. New tutorials are under construction

For the Impatient

Get Hardware

• Get the depth sensors.
  • To choose the model see Depth Sensors Comparison.
• Get computer with DirectX 11 videocard
  • For Microsoft Kinect 2 (or Kinect for XBOX One with PC adapter):
    • 64-bit Windows 8+ is required
    • USB 3.0 controller is required

      

      Important! Using multiple Kinect 2 is possible via libfreenect2 library or with the help of Distributed Recording.

  • For Microsoft Kinect, ASUS Xtions and PrimeSense Carmine:
    • At least two USB 2.0 or 3.0 controllers are required. Each sensor should be connected through its own controller.

Install

• Download iPi Recorder and iPi Mocap Studio.
• Install iPi Recorder and iPi Mocap Studio.

Record

Setup

• Find a suitable space: not less than 8 by 8 feet (2.5 by 2.5 meters).
• Connect sensors to a PC, point it at the actor and use iPi Recorder to record your performance.

Note: Two sensors cannot be connected through one and the same USB 2.0/3.0 controller.

• Point all sensors to the center of capture area. Actor should be fully visible in all sensors in capture area.
  • For two depth sensors the angle between them can be in the range 60-90 degrees, or near to 180 degrees.
  • Three depth sensors ideally should be placed at apexes of equilateral triangle with sides equal to about 6 metersю

Record Calibration Sequence

• For calibration, use Mini Maglite flashlight (or similar) as a marker, and use iPi Recorder to record calibration video
• Move the marker slowly through your entire capture volume (front-top-right-bottom-left-back-top-right-bottom-left). Start from top and move the marker in a descending spiral motion.

Record Action Sequence

• Actor should be dressed in casual slim clothing, avoid shiny fabrics.
• Record video of actor's performance. Please ensure that the whole body including arms and legs is visible during the performance in both sensors. Start from a T-pose. Then goes actor’s performance.

Track

• Run iPi Mocap Studio.
• Create calibration project from calibration video and process it using Calibrate button.
• Create action project from action video and process actor performance video.
• Import your character into iPi Mocap Studio (File > Import Target Character) to adapt the animation for your character rig.
• Export your animation in a desired format.

For more details see User Guide for Multiple Depth Sensors Configuration.