2009-2010 University Catalog 
  
  Catalog Home
  About George Mason University
  Admission
  Tuition, Expenses, and Financial Aid
  Academic Policies
  Student Rights and Responsibilities
  General Policies
  University Academic Programs and Resources
  University General Education
  Institute for Conflict Analysis and Resolution
  College of Education and Human Development
  College of Health and Human Services
  College of Humanities and Social Sciences
  Krasnow Institute for Advanced Study
  School of Management
  School of Public Policy
  College of Science
  College of Visual and Performing Arts
  Volgenau School of Information Technology and Engineering
  Programs of Study
  Programs by Department
  Courses
  Course Information Directory
  Administration and Faculty
HELP
2009-2010 University Catalog

IT 886 - Information Theory

Credits: 3
Cross-Listed with ECE 751

Introduces the mathematical theory of communication systems. Topics include entropy; relative entropy and mutual information; Shannon-McMillan-Breiman theorem and applications to data compression; entropy rate and source coding theorem; Huffman, arithmetic and Lempel-Ziv codes; method of types; channel capacity and channelcoding theorem; joint source-channel coding theorem; differential entropy; Gaussian channel; rate distortion theory; and vector quantization.

Prerequisites
ECE 630 or STAT 644 or equivalent, or permission of instructor.

Hours of Lecture or Seminar per week
3
Hours of Lab or Studio per week
0