Computer Laboratory

Projects

Skydiving video: comparison of techniques

Skydiving video: comparison of techniques (5.9 MB)

This video shows clips from the skydiving stereo video.

Top:
Input video as red-cyan anaglyhph.

Middle:
Disparity maps computed using our DCB grid on a per-frame basis.
Note the high-frequency flickering caused by per-frame processing.

Bottom:
Disparity maps computed using our temporal DCB grid, integrating temporal evidence over a 5-frame window.
Note the reduced flickering compared to the per-frame appraoch above.

Source video copyright 2008 Eric Deren, Dzignlight Studios.

Noisy synthetic videos: comparison of techniques

Noisy synthetic videos: comparison of techniques (16.6 MB)

The video shows a sequence of 5 video clips, each based on one of our new synthetic stereo videos with ground truth disparities: book, street, tanks, temple and tunnel.

The individual sub-videos are (clockwise from top-left):

  1. Left view of input video, with additive Gaussian noise (sigma=20) to simulate thermal imaging noise of real cameras.
  2. Disparity maps computed using Yoon & Kweon's adaptive support weights (PAMI 2006) on a per-frame basis. Run with left-right consistency checking (see code for details).
  3. Disparity maps computed using our DCB grid on a per-frame basis.
  4. Disparity maps computed using our temporal DCB grid, integrating temporal evidence over a 5-frame window. Note that it redoces flickering and errors for most datasets.
  5. Disparity maps computed using our full-kernel DCB grid on a per-frame basis.
  6. Ground truth disparity maps for the left view.

Note that the streaks are introduced by the infilling step that follows the left-right consistency check.
The more streaks, the less consistent a technique’s disparity estimates.

Dichromatic DCB Grid: full-size images

Dichromatic DCB Grid: full-size images (0.5 MB)

Full-size versions of the cropped images in Figure 2 (which considers the benefit of adding a second colour axis).

Dichromatic DCB Grid: full-size images

Spatial-depth super-resolution: additional results (0.3 MB)

Additional results that consider the full-kernel DCB and dichromatic DCB grid for use in Yang et al.’s spatial-depth super-resolution framework.

These were not included in the paper due to space constraints.

Back to the project page.

    Technical information
    =====================

    Information about video codecs
    ------------------------------
    Compressor : ffdshow tryouts [1] (Beta 6 from 2008-12-21 [2])
    Encoder    : MPEG-4 (using libavcodec internally)
    FOURCC     : XVID

    Using default settings, except as stated below.

    All videos play correctly in:
      - Windows Media Player 11 (Windows Vista, with ffdshow tryouts)
      - VLC 1.0 (Windows Vista)
      - DivX Player 2.2 (Mac OS X Snow Leopard)
      - Quicktime X (Mac OS X Snow Leopard)

    01-skydiving-comparison.avi
    ---------------------------
    Resolution : 480 x 818 pixels
    Enc. Mode  : One-Pass, 89% quality

    02-planes-comparison.avi
    ---------------------------
    Resolution : 480 x 1088 pixels
    Enc. Mode  : One-Pass, 89% quality

    03-noisy-synthetic-videos.avi
    -----------------------------
    Resolution : 968 x 484 pixels (80% size of original clips)
    Enc. Mode  : One-Pass, 85% quality

    [1] http://ffdshow-tryout.sourceforge.net/download.php
    [2] http://downloads.sourceforge.net/ffdshow-tryout/ffdshow_beta6_rev2527_20081219.exe