2011-2012 University Catalog 
  
  Catalog Home
  About George Mason University
  Admission
  Tuition, Expenses, and Financial Aid
  School of Law
  Academic Policies
  Student Rights and Responsibilities
  General Policies
  Schedule of Classes
  University Academic Programs and Resources
  Transcript Key
  University General Education
  School for Conflict Analysis and Resolution
  College of Education and Human Development
  College of Health and Human Services
  College of Humanities and Social Sciences
  Krasnow Institute for Advanced Study
  School of Management
  School of Public Policy
  College of Science
  College of Visual and Performing Arts
  Volgenau School of Engineering
  Programs of Study
  Programs by Department
  Bachelor's/Accelerated Master's Programs
  Courses
  Administration and Faculty
HELP
2011-2012 University Catalog

ECE 751 - Information Theory

Credits: 3 (NR)
Introduces information theory, which is mathematical theory of communication systems. Topics include measures of information such as entropy, relative entropy, and mutual information; Shannon-McMillan-Breiman theorem and applications to data compression; entropy rate and source coding theorem; Huffman, arithmetic and Lempel-Ziv codes; method of types, channel capacity, and channel-coding theorem; joint source-channel coding theorem; differential entropy; Gaussian channel; rate distortion theory; and vector quantization.

Equivalent to IT 886

Prerequisite(s): ECE 528 or permission of instructor.

Hours of Lecture or Seminar per week: 3
Hours of Lab or Studio per week: 0