Sample Videos and Projects (four GoPro)

From iPi Docs
Jump to: navigation, search

Here you can find sample videos and animations captured with the aid of four GoPro action cameras:

  • cam1 and cam2 — GoPro HERO4 Silver
  • cam3 and cam4 — GoPro HERO4 Session
GoPro-HERO4.jpg GoPro-HERO4.jpg   GoPro-HERO4-Session.jpg    GoPro-HERO4-Session.jpg

The following settings were used for recording:

  • Resolution: 720p (1280x720)
  • FOV: Wide
  • FPS: 60
Tip.png
Tip: Short description of overall process of recording and processing can be found in Quick Start Guide for Multiple Action Cameras Configuration.

Camera Optics Calibration Video

sample-four-gopro-cam1-calibration.jpg

Each individual action camera must be calibrated before usage in motion capture session. Below you can find calibration videos (.MP4 files) and results of calibration (.iPiCam files) for each camera:

Camera Calibration Video (.MP4) Camera Parameters (.iPiCam) Recommended Frames for Calibration Recommended Scale for Undistorting
cam1 cam1-720p-wide.MP4 (13 MByte) cam1-720p-wide.iPiCam (407 Byte) 50, 880, 1360, 1780, 2110 0.80
cam2 cam2-720p-wide.MP4 (11 MByte) cam2-720p-wide.iPiCam (410 Byte) 1, 380, 840, 1220, 2016 0.80
cam3 cam3-720p-wide.MP4 (41 MByte) cam3-720p-wide.iPiCam (412 Byte) 1, 340, 1260, 2420, 2910, 3680, 4490, 5120 0.80
cam4 cam4-720p-wide.MP4 (32 MByte) cam4-720p-wide.iPiCam (409 Byte) 1, 410, 1100, 1950, 2660, 3320, 3510, 4130 0.80

How to use:

  • Download and install iPi Recorder.
  • Download .MP4 video files from the above table.
  • Run iPi Recorder, click Calibrate Camera Optics in toolbar.
  • For each camera (.MP4 video file):
    • Switch to CALIBRATION tab.
    • Click Open Video button in toolbar, choose appropriate video file.
    • Select a few frames for calibration using timeline and Toggle Current Frame button. You can use recommended frames from the above table or choose frames you like.
    • Click Run Calibration button.
    • Now you see results of calibration. You can adjust scale.
    • Save results to .iPiCam file.

For more information see How to Calibrate Camera Optics.

Scene Calibration Sequence

sample-four-gopro-scene-calibration.jpg

While camera optics calibration is used to determine intrinsic parameters of each camera and can be done once, scene calibration is a process of computing accurate mutual camera positions and orientations in space and should be done for each new cameras setup/configuration. A small glowing object called marker is used for scene calibration.

Below you can find individual .MP4 video files from each camera with calibration sequence:

Camera Video with Marker (.MP4) Recommended Sync Frame
cam1 calib-cam1.mp4 (5 MByte) 685
cam2 calib-cam2.mp4 (14 MByte) 3743
cam3 calib-cam3.mp4 (25 MByte) 2514
cam4 calib-cam4.mp4 (30 MByte) 1739

How to build synchronized multi-camera video:

  • Download .MP4 video files from the above table.
  • Run iPi Recorder, click Build Combined Video in toolbar.
  • For each video (i.e. camera) in order from cam1 to cam4 do the following steps:
    • Click Add Video in toolbar, choose appropriate video file.
    • Click on PROPERTIES button in the top area of image from camera.
    • Click Load button in section camera parameters in the left panel, choose appropriate .iPiCam file from the previous section (for example, cam3-720p-wide.iPiCam for calib-cam3.mp4 video).
    • Click Edit button in section sync frame in the left panel, choose the first frame where marker becomes visible (see Recommended Sync Frame column), click Set to Current Frame button in toolbar, switch back to BUILD tab.
  • Now video is combined and synchronized but we have to evaluate background (clear scene without marker and moving objects):
    • Choose region on timeline where marker is not visible (for example: from 95 to 665 frames).
    • Click Evaluate Background button in toolbar.
  • You're ready to save result to .iPiVideo file:
    • Choose region to be saved: you can save the whole video or only part where marker is visible (for example: from 690 to 6960 frames).
    • Click Save Combined Video button in toolbar.

Below you can find .iPiVideo file created using this procedure:

     iPiVideoIcon-128.png   ↓ Download video file ↓
four-gopro-calibration.iPiVideo
525 MByte
    
 
iPiCalibIcon-128.png   ↓ Download calibration file ↓
four-gopro-calibration.iPiCalib
280 KByte

How to use these files:

  • Download and install iPi Mocap Studio.
  • Download both above files and put them all in one and the same folder on your hard drive.
  • Run iPi Mocap Studio, click Open button or press Ctrl+O and select four-gopro-calibration.iPiCalib file downloaded on the previous step.
  • Now you can "play" with resulting calibration data in iPi Mocap Studio.
  • If you want to try to process source video file by yourself then:
    • click New button or press Ctrl+N;
    • select four-gopro-calibration.iPiVideo file downloaded before;
    • choose Calibration project type;
    • switch to Calibration tab and push Calibrate button;
    • to adjust scene scale use the following parameters:
      • the height of first camera over ground plane is about 1.12 m

Action Sequence

As soon as scene parameters found (that is, scene calibration performed) you can record and process video with motions (action video).

Below you can find individual .MP4 video files from each camera with calibration sequence:

Camera Video with Marker (.MP4) Recommended Sync Frame
cam1 action-cam1.mp4 (9 MByte) 3940
cam2 action-cam2.mp4 (40 MByte) 3534
cam3 action-cam3.mp4 (25 MByte) 3573
cam4 action-cam4.mp4 (20 MByte) 3570

How to build synchronized multi-camera video:

  • Download .MP4 video files from the above table.
  • Run iPi Recorder, click Build Combined Video in toolbar.
  • For each video (i.e. camera) in order from cam1 to cam4 do the following steps:
    • Click Add Video in toolbar, choose appropriate video file.
    • Click on PROPERTIES button in the top area of image from camera.
    • Click Load button in section camera parameters in the left panel, choose appropriate .iPiCam file from the previous section (for example, cam3-720p-wide.iPiCam for action-cam3.mp4 video).
    • Click Edit button in section sync frame in the left panel, choose frame where illumination from on-camera flash is visible (see Recommended Sync Frame column in the above table), click Set to Current Frame button in toolbar, switch back to BUILD tab.
  • Now video is combined and synchronized but we have to evaluate background (clear scene without marker and moving objects):
    • Choose region on timeline where scene is almost clear (for example: from 3681 to 3733 frames).
    • Click Evaluate Background button in toolbar.
  • You're ready to save result to .iPiVideo file:
    • Choose region to be saved: you can save the whole video or only part with required motions (for example: from 75 to 3435 frames).
    • Click Save Combined Video button in toolbar.

Below you can find .iPiVideo file created using this procedure:

     iPiVideoIcon-128.png   ↓ Download video file ↓
four-gopro-action.iPiVideo
680 MByte
    
 
iPiMotionIcon-128.png   ↓ Download project file ↓
four-gopro-action.iPiMotion
3 MByte

How to use these files:

  • Download both files and put them into one folder on your hard drive.
  • Run iPi Mocap Studio, click Open button or press Ctrl+O and select four-gopro-action.iPiMotion file downloaded on the previous step.
  • Now you can "play" with resulting animation in iPi Mocap Studio, import your target character and export resulting animation based on the following instructions.
  • If you want to try to process source video file yourself then:
    • click New button or press Ctrl+N;
    • select four-gopro-action.iPiVideo file downloaded before;
    • choose Action project type;
    • choose the following file as scene parameters: four-gopro-calibration.iPiCalib (see previous section)
    • set the following parameters of actor:
      • Gender = Male
      • Height = 1.76 m
      • Clothing model = T-Shirt over Long-sleeve Shirt
    • then you can process the video:
      • adjust light position and parameters (It is very important for good tracking quality!)
      • go to the frame with T-pose
      • manually align model with image in each camera
      • adjust actor appearance (manually and/or automatically)
      • run tracking by clicking Track Forward button
      • manually fix tracking errors if any
      • apply Refine Forward/Backward and Jitter Remover to improve animation

Exported Animation

You can export animation from sample project using free trial version of iPi Mocap Studio: see Animation Export article.

If you don't want to install and run iPi Mocap Studio, below you can find sample animation files for different rigs and in different formats. All these files are produced by iPi Mocap Studio from this sample project.

  • Default iPi Rig
FileExtensionBVH.png ↓ BVH Animation ↓
FileExtensionFBX.png ↓ FBX ↓
FileExtensionDAE.png ↓ COLLADA ↓
FileExtensionSMD.png ↓ Valve Source Engine SMD ↓
FileExtensionDMX.png ↓ Valve Source Engine DMX ↓
  • Motion Builder
FileExtensionBVH.png ↓ BVH Animation ↓
FileExtensionFBX.png ↓ FBX ↓
  • 3ds Max Biped
FileExtensionBVH.png ↓ BVH Animation ↓
  • Source Film Maker and Valve Source Engine
FileExtensionSMD.png ↓ Droid Character in SMD Format ↓
FileExtensionDMX.png ↓ Spy Character in DMX Format ↓