教学目的、要求

预修课程

教材
Proceedings of ACM Multimedia Conference Proceedings of IEEE International Conference on Multimedia & Expo Proceedings of Pacific-Rim Conference on Multimedia
主要内容
Over the past decade, we have seen the explosive growth in the amount of available multimedia information in our daily lives. This trend necessitates the development of emerging and advanced technologies for efficient media analysis, indexing, retrieval, classification, summarization and repurposing. Since humans tend to use high-level semantic concepts when querying and browsing multimedia databases, it is critical to develop techniques for semantic media analysis. The aim of this course is to provide a comprehensive overview of the technical achievements in the research area of media analysis and applications. This course will be divided into three parts. The first part will introduce the basic concepts and fundamental techniques for media analysis, including multimedia taxonomy, representation, compression and standards. The second part will cover content-based multimedia indexing and retrieval techniques, including feature extraction methods, machine learning methods, the state of the art in content-based audio/image/video retrieval, and international benchmarks for media analysis evaluation. The third part will introduce the latest research achievements in two advanced areas of media analysis: music analysis and sports video analysis. For music analysis, we will discuss music segmentation, music structure analysis, music genre classification and music/music video summarization. For sports video analysis, we will focus on structure analysis, event detection and summarization, content adaptation and enhancement. We will also show the demos related to specific techniques. Based on the current technologies used in media analysis and the demands from real-world applications, future promising directions and research challenges will be discussed at the end of the course. This course is intended for students interested in gaining an overall understanding of media analysis and applications, and especially it will benefit to those students whose research topics will be along this direction.