Rafał Mantiuk *

Projects

This is a selection of the major projects. A complete list of publications can be found here.

Project imageTowards a quality metric for dense light fields

We investigate whether 2D quality metrics can predict the distortions that can be found in light field applications.

Project imageReview of HDR video tone-mapping

The report contains a review of recent video tone mapping operators, oulining the most important trends and characteristics of the proposed methods.

Project imageLuma HDRv: High dynamic range video codec

The Luma HDRv is a video codec based on VP9, which uses a perceptually motivated method to encode high dynamic range (HDR) video. Source code avauilable.

Project imageA model of local adaptation

A model predicting the adapting luminance in complex scenes.

Project imageReal-time noise-aware tone mapping

Video tone mapping that controls the visibility of the noise, adapts to display and viewing environment, minimizes contrast distortions, preserves or enhances image details, and can be run in real-time without preprocessing.

Project imageEncoding for HDR pixels

Psychophysical evaluation of several encoding schemes for high dynamic range pixel values.

Project imageDepth from HDR

We investigate what is the likely cause of enhanced appearance on 3D-ness on HDR displays.

Project imageSimulating and compensating changes in appearance between day and night vision

The method that can reproduce the appearance of night scenes on bright displays or compensate for night vision on dark displays.

Project imageLearning to predict localized distortions in rendered images

A new data-driven full-reference image quality metric intended for detecting rendering artefacts and their location in an image. The metric utilises a large number of features from quality metrics (SSIM, HDR-VDP-2), computer vision (HOG, BOW) and statistics.

Project imageEvaluation of tone mapping for HDR-video

Eleven tone mapping operators are evaluated and compared to investigate the major challenges and problems in video tone mapping.

Project imageMonocular depth cues on an HDR display

A number of monocular depth cues are compared in a subjective experiment to evaluate the accuracy of intuitive depth ordering. Contrast and brightness on an HDR display were found to be one of the most effective depth cues when no other depth cues are available.

Project imageGaze-driven object tracking

To efficiently deploy eye-tracking within 3D graphics applications, we present a new probabilistic method that predicts the patterns of user’s eye fixations in animated 3D scenes from noisy eye-tracker data.

Project imageWeaknesses of image quality metrics

The new per-pixel image quality dataset with computer graphics artifacts shows disapointing performance of both simple (PSNR, MSE, sCIE-Lab) and advanced (SSIM, MS-SSIM, HDR-VDP-2) quality metrics.

Project imageHDR display

Unlike standard LCD or Plasma displays, a high dynamic range (HDR) display is capable of showing images of very high contrast (up to 250,000:1) and peak brightness (up to 2,400 cd/m^2). As a result, the images and video shown on such as display look very realistic and appealing.

Project imageHDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions

A metric for predicting visible differences (discrimination) and image quality (mean-opinion-score) in high dynamic range images. The metric is carefully calibrated and extensively tested against actual experimental data, ensuring the highest possible accuracy.

Project imageGlare encoding of high dynamic range images

HDR images are captured in a single exposure with standard cameras by encoding information about the saturated pixels in a glare. The glare is produced by a cross-screen (star) filter, making it amenable to tomographic reconstruction.

Project imageBlur-aware image downsizing

Digital viewfinder in cameras does not show depth-of-field, lack of sharpness or motion blur, which is normally visible in a full-size image. Based on blur-matching experimental data, the algorithm produces lower resolution images while preserving apperent blur.

Project imageVisualizing High Dynamic Range Images in a Web Browser

A method for displaying HDR images with exposure control in a web browser. The project page includes a toolkit for generating web pages with HDR images.

Project imageColor correction in tone mapping

Color distortions due to tone-mapping are corrected by adjusting image color saturation. A model of color adjustment is built based on the data from an appearance-matching experiment.

Project imageDisplay adaptive tone-mapping

A tone-mapping algorithm that is controlled by a super-threshold visual metric. The solution takes into account display limitations, such as brightness, black level, and reflected ambient light.

Project imageDynamic Range Independent Image Quality Assessment

A visual metric that is mostly invariant to contrast and tone-scale manipulations. It can detect loss of visible contrast, amplification of invisible contrast and contrast reversal.

Project imageEnhancement of Bright Video Features for High Dynamic Range Display

A semi-automatic method for classification of reflective and emissive objects in video, followed by brightness enhancement for display on high dynamic range displays.

Project imageModeling a Generic Tone-Mapping Operator

A generic model of a local tone-mapping operator is fit to a pair of LDR and HDR images. The model is applied for backward compatible HDR image compression, analysis of tone-mapping operators and synthesis of new operators from existing ones.

Project imageBrightness of Glare Illusion

The perceived brightness of the glare illusion is measured in a brightness matching experiment. A simple Gaussian convolution is shown to produce similar brightness boost as a physically correct PSF model of the eye optics.

For older projects visit the MPI HDR Projects web page or go to the publication list and click on the 'project page' link.