Department of Computer Science and Technology

Course pages 2018–19

Advanced Graphics and Image Processing

Principal lecturer: Dr Rafal Mantiuk
Taken by: MPhil ACS, Part III
Code: L352
Hours: 16 (10 lectures, 2 small group seminars, 2 practicals)
Class limit: 16 students
Prerequisites: Programming in C

Aims

Advanced Graphics covers topics related to processing, perception and display of images. The focus of the course is on the algorithms behind new emerging display technologies, such as virtual reality, augmented reality, and high dynamic range displays. It complements two computer graphics courses, Introduction to Graphics and Further Graphics, by introducing problems that became the part of graphics pipeline: tone-mapping, post-processing, displays and models of visual perception.

Lectures

  • GP-GPU: scheduling and thread mapping, reductions.
  • Advanced image processing: edge-stopping filters, pyramids, optimization-based image processing.
  • Beyond 2D: stereo rendering and light fields.
  • Models of visual perception: visual system, brightness perception, detection and discrimination, contrast sensitivity function, contrast constancy, perceptually uniform spaces, depth perception.
  • High Dynamic Range and tone mapping: dynamic range, display model, methods of tone-mapping.
  • Display technologies: 2D displays, 3D displays, temporal display characteristic, HDR displays.
  • Virtual and Augmented Reality: display technologies, VR rendering, orientation tracking, pose tracking, perceptual considerations, panoramic imaging.

Objectives

By the end of the course students should be able to:

  • implement real-time image processing methods on a GPU (OpenCL);
  • design and implement a tone-mapping algorithm;
  • describe the limitations of display technologies (dynamic range, brightness, visual comfort, VR simulation sickness) and how they can be addressed using computational methods (tone-mapping, HDR displays);
  • describe the limitations of the visual system and how those limitation can be exploited in computer graphics and image processing.

Recommended reading

Hainich, R. & Bimber, O. (2016) Displays: Fundamentals and Applications. CRC Press (2nd ed.).
Boreskov, A. & Shikin, E. (2013) Computer Graphics: From Pixels to Programmable Graphics Hardware. CRC Press.
Reinhard, E., et. al. (2010) High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. Morgan Kaufmann (2nd ed.).

Coursework

Mini-project

Practical work

2 practical exercises

Assessment

2 practical exercises worth a portion of the grade (30%). Mini-project (70%).

This course is borrowed from Part II of the Computer Science Tripos. As such, assessment will be adjusted to an appropriate level for those enrolled for Part III of the Tripos or the M.Phil in Advanced Computer Science. Further information about assessment and practicals will follow at the first lecture.