Goals and objectives  Course Outcomes  

1.  The students can understand the fundamentals of information theory so that the beauty and utility of information science can be exposed 
A1

2.  The students can understand the fundamental limits in communication system. The students can apply the equipped knowledge of information theory to various disciplines in information science 
A1

3.  The students themselves can develop good attitude during studying, e.g., proactively discuss with classmates and lecturer, attend the class in time, submit the assignment in time, no cheating during the exam. 
A1

Class schedule  HW assignments (Including preparation and review of the class.)  Amount of Time Required  

1.  Introduction to Information quantification and probability & statistic  Selfinvestigation on information theory  190分 
2.  Entropy, Joint entropy and conditional entropy  Selfinvestigation on probability  190分 
3.  Relative Entropy and Mutual Entropy  Read chapter 2 in the textbook  190分 
4.  Data processing inequality, sufficient statistic and Fano's inequality  Read chapter 2 in the textbook  190分 
5.  Asymptotic Equipartition Property  Read chapter 3 and 4 in the textbook  190分 
6.  Entropy Rate of a stochastic process (II)  Read chapter 3 and 4 in the textbook  190分 
7.  Midterm exam and discussions on the solutions  Read chapter 5 in the textbook  190分 
8.  Data compression (I)  Preparation for midterm exam  190分 
9.  Data compression (II)  Read chapter 5 in the textbook  190分 
10.  Channel Capacity (I)  Read chapter 7 in the textbook  190分 
11.  Channel Capacity (II)  Read chapter 7 in the textbook  190分 
12.  Gaussian channel and Differential Entropy  Read chapter 8 and 9 in the textbook  190分 
13.   Rate distortion theory  practical applications of information theory 
Read chapter 10 in the textbook  190分 
Investigate concepts in machine learning, image compression and blockchain technology  
14.  Final exam and discussions on the solutions  Preparation for final exam  190分 
Total.      2660分 
Midterm  Final  Attitude during class  Total.  

1.  15%  20%  0%  35% 
2.  15%  30%  0%  45% 
3.  0%  0%  20%  20% 
Total.  30%  50%  20%   
Work experience  Work experience and relevance to the course content if applicable 

N/A  N/A 