Mobile phone technologies and internet technologies make extreme service for human beings.
Information theory is the base of above technologies. This subject grants basic knowledge of information theory including probability theories, coding and decoding of information and so on.
Information theory is the base of above technologies. This subject grants basic knowledge of information theory including probability theories, coding and decoding of information and so on.
- Understanding the mathematical models of information sources (Schedule 1-3 )
- Understanding the physical meaning of source coding (Schedule 4-8)
- Understanding the relationship between communication path and mutual information (Schedule 9-10)
- Understanding the physical meaning of Coding of communication path (Schedule 11)
- Understanding the error detection and correction (Schedule 12-13)
| Class schedule | HW assignments (Including preparation and review of the class.) | Amount of Time Required | |
|---|---|---|---|
| 1. | Guidance | Read the relevant chapters in the text book | 60minutes |
| ・History of information theory ・Basics of information |
105minutes | ||
| 2. | probability theory (1) | Read the relevant chapters in the text book | 60minutes |
| ・Sets ・Probabilistic space |
45minutes | ||
| ・Conditional probability ・Random variable |
60minutes | ||
| 3. | probability theory (2) | Read the relevant chapters in the text book | 60minutes |
| ・Mean and variance | 60minutes | ||
| ・Bayes' theorem ・Markov theory |
45minutes | ||
| 4. | Amount of information and Entropy (1) | Read the relevant chapters in the text book | 60minutes |
| ・Amount of information and Entropy | 60minutes | ||
| ・Combinatory entropy and conditional entropy ・Mutual information |
45minutes | ||
| 5. | Amount of information and Entropy(2) | Read the relevant chapters in the text book | 60minutes |
| ・Entropy of Markov source ・Structure of information compression systems |
45minutes | ||
| ・Shanon and Fano encoding ・Prefix coding ・Kraft's inequality |
60minutes | ||
| 6. | Source coding(1) | Read the relevant chapters in the text book | 60minutes |
| ・The average codeword length ・ Limitations of average codeword length |
105minutes | ||
| 7. | Source coding(2) | Read the relevant chapters in the text book | 60minutes |
| ・Huffman coding ・Run Length coding ・Universal coding |
105minutes | ||
| 8. | Mid-semester exam and question analysis | Study for mid-semester exam | 200minutes |
| Mid-semester exam | 60minutes | ||
| Discussion on exam questions | 45minutes | ||
| 9. | Communication path Mutual information(1) | Read the relevant chapters in the text book | 60minutes |
| ・Mathematical model of communication path ・Memoryless channel |
105minutes | ||
| 10. | Communication path Mutual information(2) |
Read the relevant chapters in the text book | 60minutes |
| ・Mutual information ・Communication channel capacity |
105minutes | ||
| 11. | Coding of communication path | Read the relevant chapters in the text book | 60minutes |
| ・Example of communication path coding ・Error detection of communication path coding |
105minutes | ||
| 12. | Error-detecting and correcting code (1) | Read the relevant chapters in the text book | 60minutes |
| ・Channel coding theories ・Examples of channel coding |
|||
| 13. | Error-detecting and correcting code (2) | Read the relevant chapters in the text book | 60minutes |
| ・Decoding models ・Theories of error detecting and correcting |
|||
| 14. | Semester final exam and question analysis | Study for semester final exam | 200minutes |
| Final exam | 60minutes | ||
| Discussion on final exam questions | 45minutes | ||
| Total. | - | - | 2380minutes |
| Mid-semester exam | Final exam | Assignments | Total. | |
|---|---|---|---|---|
| 1. | 8% | 8% | 6% | 22% |
| 2. | 8% | 8% | 6% | 22% |
| 3. | 6% | 6% | 6% | 18% |
| 4. | 6% | 6% | 8% | 20% |
| 5. | 6% | 6% | 6% | 18% |
| Total. | 34% | 34% | 32% | - |
Assignments 20%，Mid-semester exam 40%, Semester final exam 40%
Passing mark:60
Passing mark:60
- Office hours: 10.40am-12.40pm Tuesday
Email to: chintaka@sic.shibaura-it.ac.jp
- Course that cultivates an ability for utilizing knowledge
- Course that cultivates a basic problem-solving skills
Last modified : Wed Oct 17 06:40:13 JST 2018