Department of Computer Science and Technology

Course pages 2018–19

Advanced Graphics and Image Processing

Principal lecturer: Dr Rafal Mantiuk
Taken by: Part II CST 75%

No. of lectures and practical classes: 14
Prerequisite courses: Programming in C.
Capacity: 30-50

Aims

Advanced Graphics covers topics related to processing, perception and display of images. The focus of the course is on the algorithms behind new emerging display technologies, such as virtual reality, augmented reality, and high dynamic range displays. It complements two computer graphics courses, Introduction to Graphics and Further Graphics, by introducing problems that became the part of graphics pipeline: tone-mapping, post-processing, displays and models of visual perception.

Lectures

  • GP-GPU: scheduling and thread mapping, reductions.
  • Advanced image processing: edge-stopping filters, pyramids, optimization-based image processing.
  • Beyond 2D: stereo rendering and light fields.
  • Models of visual perception: visual system, brightness perception, detection and discrimination, contrast sensitivity function, contrast constancy, perceptually uniform spaces, depth perception.
  • High Dynamic Range and tone mapping: dynamic range, display model, methods of tone-mapping.
  • Display technologies: 2D displays, 3D displays, temporal display characteristic, HDR displays.
  • Virtual and Augmented Reality: display technologies, VR rendering, orientation tracking, pose tracking, perceptual considerations, panoramic imaging.

Objectives

By the end of the course students should be able to:

  • implement real-time image processing methods on a GPU (OpenCL);
  • design and implement a tone-mapping algorithm;
  • describe the limitations of display technologies (dynamic range, brightness, visual comfort, VR simulation sickness) and how they can be addressed using computational methods (tone-mapping, HDR displays);
  • describe the limitations of the visual system and how those limitation can be exploited in computer graphics and image processing.

Recommended reading

Hainich, R. & Bimber, O. (2016) Displays: Fundamentals and Applications. CRC Press (2nd ed.).
Boreskov, A. & Shikin, E. (2013) Computer Graphics: From Pixels to Programmable Graphics Hardware. CRC Press.
Reinhard, E., et. al. (2010) High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. Morgan Kaufmann (2nd ed.).