CS/ECE/Math 729, Information Theory - Fall 2018
Nigel Boston
Contact Information
3619 Engineering Hall, 303 Van Vleck
Telephone: 265-3817, 263-4753.
E-mail: boston@engr.wisc.edu
Homepage
Course Syllabus
Office Hours: M 3-4 in 3619 EH, W 2-3 in 3619 EH, or Th 1:30-2:30 in 303 VV, or by appointment.
Text
Elements of Information Theory, Second Edition, by Thomas M. Cover and Joy A. Thomas, available free online through Wiley Online Library.
Interesting Links
Ed Witten on Information Theory
Probability distributions and maximum entropy
Course objectives
Definition of measures of information and their properties, capacity of discrete and continuous channels with noise, source and channel coding theorems, fundamentals of channel coding, noiseless source coding, and source coding with a fidelity criterion. Enroll Info: ECE 331 or Math 431 or cons inst
Sections
- Main Lecture: MWF, 9:55-10:45, 2239 Engineering Hall.
Grading Policy
The HW will be worth 10%, each midterm 20%, and the final 50% of your grade.
If you score 90% or higher, you will get an A; if you score 80% or higher, you will at least get a B;
if you score 70% or higher, you will at least get a C; if you score 60% or higher, you will at least
get a D.
Homework Assignments
Homework will be set most Fridays and be due the following Friday (in class- I will not go looking for or accept homeworks
in my mailboxes and offices around campus). You are encouraged to discuss
the exercises with your classmates but the work you hand in should be your own.
- HW1, due Fri, Sep 14
- HW2, due Fri, Sep 21
- HW3, due Fri, Sep 28
- HW4, due Fri, Oct 5
- HW5, due Fri, Oct 19
- HW6, due Fri, Oct 26
- HW7, due Fri, Nov 2
- HW8, due Fri, Nov 9
- HW9, due Fri, Nov 30
- HW10, due Fri, Dec 7
Midterms
Midterms will be in class on Friday, Oct 12, and Friday, Nov 16. If you have a McBurney visa, then please meet
me as soon as possible (certainly at least two weeks before the 1st midterm) so I can arrange accommodation.
Final
- Final - 7:25pm, Monday, December 17, in 2540 EH.