For years, multimedia has been touching most aspects of Computer Science and Engineering fields and forms an important component of image processing, computer vision, computer network, real-time systems, retrieval, and so on. Therefore, comprehensive knowledge in multimedia is rapidly becoming a necessity, emphasizing the importance of this course. There are three major parts covered in this class: Multimedia data representation, multimedia data compression, multiple view geometry applications, multimedia communications, and networking, etc. As the outcomes of this course, students will be facilitated a strong knowledge foundation supporting them in doing research in numerous hot topics of multimedia technologies (e.g., image and video processing, video streaming networking, etc.)
The aim of this course is to provide fundamental knowledge of multimedia in conjunction with real applications
| Goals and objectives | Course Outcomes | |
|---|---|---|
| 1. | Understand the fundamentals of multimedia representation |
A-1
|
| 2. | Understand the concepts in multiple view geometry applications |
A-1
|
| 3. | Understand the multimedia communication and content sharing over computer networks |
A-1
|
| Class schedule | HW assignments (Including preparation and review of the class.) | Amount of Time Required | |
|---|---|---|---|
| 1. | Introduction & digital image fundamentals | Read section 1 and 2 in the textbook 1 | 380分 |
| 2. | Introduction & digital image fundamentals (continue...) | Read section 1 and 2 in the textbook 1 | 380分 |
| 3. | Intensity transformation & spatial filtering | Read section 3 in the textbook 1 | 380分 |
| 4. | Filtering in the frequency domain | Read section 4 in the textbook 1 | 380分 |
| 5. | Image restoration & reconstruction | Read section 5 in the textbook 1 | 380分 |
| 6. | Color Image Processing | Read section 6 in the textbook 1 | 380分 |
| 7. | Image transform and Image compression | Read section 7 and 8 in the textbook 1 | 380分 |
| 8. | Mid-term exam and discussions on the solutions | Preparation for mid-term exam | 380分 |
| 9. | Image segmentation | Read section 10 in textbook 1 | 380分 |
| 10. | Feature extraction | Read section 11 in textbook 1 | 140分 |
| 240分 | |||
| 11. | - A tour of Multiple view geometry | Reading section 2 in textbook 2 | 380分 |
| Investigate for external materials for camera calibration, stereo vision | |||
| 12. | - Plenoptic Function - Immersive Imaging (omnidirectional imaging and light field imaging, etc.) |
Read the paper: Adelson, E.H. and Bergen, J.R., 1991. The plenoptic function and the elements of early vision (Vol. 2). Vision and Modeling Group, Media Laboratory, Massachusetts Institute of Technology. |
380分 |
| Self-investigation on 360 video and light field imaging, virtual reality, augmented reality | |||
| 13. | Machine Learning and its application in multimedia processing | Self-investigation on machine learning | 120分 |
| Read section12 in textbook 1 | 240分 | ||
| 14. | Final exam and discussions on the solutions | Preparation for final exam | 380分 |
| Total. | - | - | 5300分 |
| Mid-term | Final | Total. | |
|---|---|---|---|
| 1. | 15% | 20% | 35% |
| 2. | 15% | 20% | 35% |
| 3. | 0% | 30% | 30% |
| Total. | 30% | 70% | - |
Midterm exam (30%) and Final Exam (70%) are the criteria of the grade. More than 60% of the total score is needed for getting
the course credit.
<Note>
Students are marked absent from the class if they are late regardless of the delay time.
If students are absent from more than one third of the total number of classes, the credit of this course cannot be given to them.
Even though students are absent from the class whatever the reason, e.g. sickness, delay of public transportation systems, forgetting to bring the student ID card, it is counted as absence.
<Note>
Students are marked absent from the class if they are late regardless of the delay time.
If students are absent from more than one third of the total number of classes, the credit of this course cannot be given to them.
Even though students are absent from the class whatever the reason, e.g. sickness, delay of public transportation systems, forgetting to bring the student ID card, it is counted as absence.
1. Digital Image processing 4e, Gonzalez Rafael 2017
2. Multiple view geometry in Computer vision, 2nd edition, Richard Hartley, 2004
2. Multiple view geometry in Computer vision, 2nd edition, Richard Hartley, 2004
Linear Algebra
Introduction to computer networks
Information Literacy
Information Processing
Introduction to computer networks
Information Literacy
Information Processing
- Weekdays: From 10:00 - 16:30 by email or face-to-face discussion at 4F-Research building office. Making an appointment beforehand is highly recommended.
- Course that cultivates an ability for utilizing knowledge
| Work experience | Work experience and relevance to the course content if applicable |
|---|---|
| N/A | N/A |
Last modified : Mon Sep 27 04:03:53 JST 2021