Goals and objectives  Course Outcomes  

1.  Understand the fundamentals of information theory so that the beauty and utility of information science can be exposed 
A1

2.  Understand the fundamental limits in communication system 
A1

3.  Apply the equipped knowledge of information theory to various disciplines in information science 
A1

Class schedule  HW assignments (Including preparation and review of the class.)  Amount of Time Required  

1.  Introduction to Information theory and its applications  Selfinvestigation on information theory  190分 
2.  Introduction to probability  Selfinvestigation on probability  190分 
3.  Entropy  Relative Entropy  Mutual Entropy (I)  Read chapter 2 in the textbook  190分 
4.  Entropy  Relative Entropy  Mutual Entropy (II)  Read chapter 2 in the textbook  190分 
5.  Asymptotic Equipartition Property and Entropy Rate of a stochastic process  Read chapter 3 and 4 in the textbook  190分 
6.  Data compression (I)  Read chapter 5 in the textbook  190分 
7.  Data compression (II)  Read chapter 5 in the textbook  190分 
8.  Midterm exam and discussions on the solutions  Preparation for midterm exam  190分 
9.  Channel capacity (I)  Read chapter 7 in the textbook  190分 
10.  Channel Capacity (II)  Read chapter 7 in the textbook  190分 
11.  Differential Entropy  Read chapter 8 in the textbook  190分 
12.  Gaussian channel  Read chapter 9 in the textbook  190分 
13.   Rate distortion theory  practical applications of information theory 
Read chapter 10 in the textbook  190分 
Investigate concepts in machine learning, image compression and blockchain technology  
14.  Final exam and discussions on the solutions  Preparation for final exam  190分 
Total.      2660分 
Midterm  Final  Total.  

1.  10%  25%  35% 
2.  10%  25%  35% 
3.  10%  20%  30% 
Total.  30%  70%   
Work experience  Work experience and relevance to the course content if applicable 

N/A  N/A 