Goals and objectives | Course Outcomes | |
---|---|---|
1. | Understand the fundamentals of information theory so that the beauty and utility of information science can be exposed |
A-1
|
2. | Understand the fundamental limits in communication system |
A-1
|
3. | Apply the equipped knowledge of information theory to various disciplines in information science |
A-1
|
Class schedule | HW assignments (Including preparation and review of the class.) | Amount of Time Required | |
---|---|---|---|
1. | Introduction to Information theory and its applications Introduction to probability |
Self-investigation on information theory | 190分 |
2. | Entropy - Relative Entropy - Mutual Entropy (I) | Self-investigation on probability | 190分 |
3. | Entropy - Relative Entropy - Mutual Entropy (II) | Read chapter 2 in the textbook | 190分 |
4. | Entropy - Relative Entropy - Mutual Entropy (III) | Read chapter 2 in the textbook | 190分 |
5. | Asymptotic Equipartition Property and Entropy Rate of a stochastic process (I) | Read chapter 3 and 4 in the textbook | 190分 |
6. | Asymptotic Equipartition Property and Entropy Rate of a stochastic process (II) | Read chapter 3 and 4 in the textbook | 190分 |
7. | Data compression (I) | Read chapter 5 in the textbook | 190分 |
8. | Mid-term exam and discussions on the solutions | Preparation for mid-term exam | 190分 |
9. | Data compression (II) | Read chapter 5 in the textbook | 190分 |
10. | Channel Capacity (I) | Read chapter 7 in the textbook | 190分 |
11. | Channel Capacity (II) | Read chapter 7 in the textbook | 190分 |
12. | Gaussian channel and Differential Entropy | Read chapter 8 and 9 in the textbook | 190分 |
13. | - Rate distortion theory - practical applications of information theory |
Read chapter 10 in the textbook | 190分 |
Investigate concepts in machine learning, image compression and blockchain technology | |||
14. | Final exam and discussions on the solutions | Preparation for final exam | 190分 |
Total. | - | - | 2660分 |
Mid-term | Final | Total. | |
---|---|---|---|
1. | 10% | 25% | 35% |
2. | 10% | 25% | 35% |
3. | 10% | 20% | 30% |
Total. | 30% | 70% | - |
Work experience | Work experience and relevance to the course content if applicable |
---|---|
N/A | N/A |