	Information Theory and Coding Old Home Page

Computer Laboratory > Course material 2002-03 > Info Theory > Old Home Page

This is the old index page for the course, from the Lent Term. The new index page, with revision information, is here

Information Theory and Coding
2002-03

Principal lecturer: Dr Neil Dodgson (nad@cl.cam.ac.uk)
Taken by: Part II

Syllabus
Past exam questions
(Note: this page contains information about which parts of the past questions are relevant to this year's syllabus)

Background Material

It would be useful if you revised the material in Lectures 1-4 of the Part IA Probability course, looked over the Fourier material in the Part IB Continuous Mathematics course (Sections 2 and 4.1) and had a quick flick through the background material in the Part IB Computer Graphics and Image Processing course (Section 1).

Lecture Notes

The notes for Markus Kuhn's part of the course are available on a separate page.

The handouts for the final part of Neil Dodgson's part of the course are available in two sizes:

The handout distributed in Lecture 15 (February 19) which is 16 pages long.
An extended version of the handout (32 pages) which contains a worked example on the number of quantisation levels required for images (Section 1.2.1), a long worked example showing how Fourier transforms can be used for image scaling (Section 2), and three extra proofs of various things to do with Fourier transforms (Appendices B, C, and D).

There are no handouts for the rest Dr Dodgson's part of the course, because he closely followed Chapters 2, 3, 5, and 8 of the the course textbook, Cover and Thomas. It is essential that you have access to a textbook on Information Theory, even if it is not Cover and Thomas. Some alternatives are listed here. It is recommended that you have access to Cover and Thomas which, although expensive (nearly Ł70), is available in over twenty of the Cambridge libraries. For more information on the course textbook and the alternatives look here.

Previous years' material

Dr Daugman's lecture notes from last year (PDF, 1.2MB). Sections 1-5 are the relevant ones for this year's syllabus.
Dr Daugman has kindly updated his Learning Guide (PDF, 175kB) to include all past exam questions and their answers (see the exam questions page to see which past questions are relevant to this year's syllabus).
Dr Daugman's Information Theory web page from last year's course is also still available.

Supervision material

Past exam questions. Details of which exam questions are relevant may be found here.
Selected exercises from Chapter 2 of Cover and Thomas (PDF, 44kB). These cover the four lectures from 26 Jan to 3 Feb, 2003.
Selected exercises from Chapters 3 and 5 of Cover and Thomas (PDF, 46kB). These cover the four lectures from 5 Feb to 12 Feb, 2003.
Selected exercises from Chapter 8 of Cover and Thomas plus exercises from Markus Kuhn's three lectures and the Sampling Theory lecture (PDF, 52kB). These cover the three lectures from 20 to 24 Jan, 2003 and the four lectures from 14 to 21 Feb, 2003.

There are solution notes available for supervisors for the first two sets of exercises (e-mail me). Thanks to Sven Ostring for preparing the first two exercise sheets and their solution notes.

Examination questions 2003 - some clarifications

Markus Kuhn's part of the course is examinable. Students will be expected to understand the general principles presented by Markus but not the details of the various coding systems discussed.
The exam questions may test any of the following:
- understanding (do you know what you are talking about?)
- application (can you actually do the calculations?)
- proofs of theorems
However, exam questions are only supposed to take half an hour to complete, so the longer proofs obviously cannot be used as exam questions.



© 2003 Neil A. Dodgson Please send any comments to Neil Dodgson Page last updated on 24-Mar-2003 at 14:18 by Neil Dodgson

Information Theory and Coding2002-03