Quick Start Guide for Multiple Action Cameras Configuration
From iPi Docs
Get Hardware
- For recording get:
- the action cameras or other stand-alone camcorders (a minimum of three)
- all cameras must have big enough field-of-view and fixed optics (in other case auto-focus and zoom features must be turned off in advance)
- also, all cameras must support one and the same pair of resolution and FPS
- 720p (1280 x 720) resolution is recommended for full body motion capture needs in most cases (except very large capture area)
- 60 or 90 FPS is optimal for capturing of most of the motions
- see Cameras and Accessories#Action_Cameras for details
- tripods or other attachments to fix cameras
- a flashlight (Mini Maglite or Sony Move are recommended) for calibration needs
- measuring tape or laser distance measuring tool to determine heights of cameras over floor/ground (for scale)
- the action cameras or other stand-alone camcorders (a minimum of three)
- For processing get:
- computer with DirectX 11 capable videocard (gaming-class GPU is highly recommended)
- see Cameras and Accessories#Video_Card for details
- SD-card reader to copy video from action cameras to computer (alternatively you can use USB cord, but SD-card reader provides much higher speed as a rule)
- computer with DirectX 11 capable videocard (gaming-class GPU is highly recommended)
Install
Prepare
- Mark each camera by some unique nickname (number/letter/color/code)
- you can use masking tape or sticky labels for these needs
- example of names:
- 1, 2, 3, ...
- A, B, C, ...
- red, orange, yellow, ...
- Harry, Ron, Hermione, ...
- Choose and set recording parameters on each camera (field-of-view, resolution, FPS)
- remember, that resolution and FPS must be one and the same on each camera
- Calibrate camera-optics for each camera using Calibrate Camera Optics tool in iPi Recorder. Save results to files with names which contain camera's nickname, resolution and field-of-view settings (for example: cameraA-720p-wide.iPiCam)
- see How to Calibrate Camera Optics for details
Record
Setup
- Find a suitable space: as a rule not less than 13 by 13 feet (4 by 4 meters) but it depends on cameras field-of-view (wider field-of-view allows to record in smaller room).
- Fix all cameras and point them to the center of capture area. Actor should be fully visible in all cameras in capture area.
- examples of configurations can be found here
- It is convenient to mark on the floor/ground boundaries of area where actor is fully visible. This is your capture area.
- you can use electric tape or masking tape for these needs
- Measure height of each camera over floor/ground. Write down these values somewhere like:
camera A - 1.12 m camera B - 1.65 m camera C - 1.22 m ...
Record Calibration Sequence
To determine mutual position of cameras special calibration procedure is used:
- Turn off the lights or at least turn the lights down low
- Start recording on each camera
- Let each camera to record at least few seconds of clear scene (no moving objects, no glowing marker) for background evaluation needs
- Enter to the center of capture area and turn on your glowing marker (Mini Maglite or Sony Move)
- Important! At this moment marker must be visible in all cameras for synchronization needs (see below).

-
- Move the marker slowly through your entire capture volume (front-top-right-bottom-left-back-top-right-bottom-left). Start from top and move the marker in a descending spiral motion.
- Touch to the floor (ground) by marker at least four different points.
- For details see User Guide for Multiple PS Eye Cameras Configuration#Step 2: Record Calibration Video.
- use some remote control or smartphone application over Wi-Fi connection to start/stop recording
- or don't stop recording at all until the end of all action sequences.
For details see How to Record Video with Action Cameras.
Record Action Sequence
- Actor should be dressed in a slim solid-color clothing:
- recommended clothing: long-sleeve shirt, blue jeans or trousers, black shoes
- deep, saturated colors are preferable
- ideally, pants and shirt should be different colors
- clothes colors must have good contrast with background.
- Record video of actor's performance:
- please ensure that the whole body including arms and legs is visible during the performance in both sensors
- start from a T-pose
- then goes actor’s performance
- Before or after actor performance record clear scene (no actor, no moving objects) for at least few seconds. This part of video will be used to evaluate background during creation of multi-camera video (see below).
- Also you need to record some very short and good visible in all cameras "event" like flash of light from external camera flash. It is recommended to record such "event" at least two times: before and after actor's performance. This "event" will be used to synchronize videos from different cameras during building of multi-camera video(s) (see below).
Build Multi-Camera Synced Video(s)
In comparison to web-cameras this is an extra manual step which is rather time consuming: you have to build multi-camera .iPiVideo file(s) from individual MP4/AVI/MOV/MPEG files recorded by each camcorder.
> TODO: describe steps here
Process in iPi Mocap Studio
As soon as you create synchronized multi-cameras videos, you can process them in iPi Mocap Studio. And this processing is exactly the same as for the video recorded by iPi Recorder from web-cameras like Sony PS Eye.
Process Calibration Video
- Run iPi Mocap Studio.
- Create new calibration project from calibration video.
- Adjust selection on time line which is called Region-of-Interest (ROI) that is it contains only frames where marker is visible.
- Press Calibrate button.
- Evaluate quality of calibration.
- Adjust scene scale based on measured heights of cameras over floor/ground.
- Save results.
For more info see User Guide for Multiple PS Eye Cameras Configuration#Step 5: Process Calibration Video in iPi Mocap Studio.
Process Action Video
- Run iPi Mocap Studio.
- Create new action project from action video.
- Adjust light position and parameters. It is very important for good tracking quality! For details see User Guide for Multiple PS Eye Cameras Configuration#Tracking Tips and Tricks for Multiple PS Eye Cameras.
- Go to the frame with T-pose.
- Manually align model with image in each camera.
- Adjust actor appearance (manually and/or automatically).
- Run tracking by clicking Track Forward button.
- Manually fix tracking errors if any. For details see Manual Clean-up.
- Apply Refine Forward/Backward and Jitter Remover to improve animation. For details see Automatic Refinement and Filtering.
- Import your character into iPi Mocap Studio (File > Import Target Character) to adapt the animation for your character rig.
- Export your animation in a desired format.