Publications
Detailed Information
Analysis of Visual and Musical Tempo Congruence in Commercial Motion Pictures : 상업영화 속 음악 장면에서 시각적, 음악적 템포의 정량적 관계 분석
DC Field | Value | Language |
---|---|---|
dc.contributor.advisor | 이교구 | - |
dc.contributor.author | 김연화 | - |
dc.date.accessioned | 2017-07-19T10:55:31Z | - |
dc.date.available | 2017-07-19T10:55:31Z | - |
dc.date.issued | 2015-02 | - |
dc.identifier.other | 000000026429 | - |
dc.identifier.uri | https://hdl.handle.net/10371/133181 | - |
dc.description | 학위논문 (석사)-- 서울대학교 융합과학기술대학원 : 융합과학부, 2015. 2. 이교구. | - |
dc.description.abstract | The amount of multimedia including movies in existence has become so extensive that dealing with these data cannot be performed easily. Previous studies have explored the relationship between visual and auditory signals in multimedia data using CV (Computer Vision) and MIR (Music Information Retrieval) techniques. This thesis focuses on the temporal correlation between music and video signals in commercial motion pictures.
Tempo means the speed of music the rate of activity. Musical tempo is created by temporal periodicity and visual speed is created through spatial variance or salient event intervals. This means another indicator to combine musical and visual tempo scale is needed. We refer to this as Tempo Index. In this research, multimodal tempo relationship is analyzed by estimating each tempo index of training data. Visual tempo derived from combination of motion vector magnitude, shot length, and visual activity index. Musical tempo is estimated by calculating beat intervals. To match visual and musical tempo, two indices are converted to tempo indices referring to study of Motion tempo and multisensory integration. All features used as the ground truth are compensated manually after automated computation. The experimental result shows that there exists a linear relationship between proposed two tempo indicators. This global tempo congruency is evaluated by analyzing other film data and user survey. The result of this study is expected to provide clues for further multimedia contents research. | - |
dc.description.tableofcontents | Table of Contents
Abstract i Table of Contents ii List of Tables iv List of Figures v 1 Introduction 1 1.1 Motivation 1 1.2 Goal 6 2 Literature Review 9 2.1 Theoretical Framework 9 2.1.1 Characteristics of Audio-visual Features in Films 9 2.1.2 Audiovisual Tempo Formation 10 2.1.3 Audiovisual Tempo of Musical Scenes 12 2.2 Related Works 13 3 Methodology 16 3.1 Pilot Test 16 3.2 Components of the Process 20 3.3 Experimental Design 22 3.3.1 Feature Extraction 22 3.3.2 Tempo Estimation 31 3.3.3 Tempo Index 33 4 Results and Discussion 35 4.1 Quantitative Analysis 35 4.2 Qualitative Analysis 45 5 User Survey 48 6 Conclusion 57 6.1 Summary and Contribution 57 6.2 Limitations and Future Works 59 Bibliography 61 Abstract in Korean 67 Appendix 69 | - |
dc.format | application/pdf | - |
dc.format.extent | 2760847 bytes | - |
dc.format.medium | application/pdf | - |
dc.language.iso | en | - |
dc.publisher | 서울대학교 대학원 | - |
dc.subject | audiovisual movie tempo congruence | - |
dc.subject.ddc | 620 | - |
dc.title | Analysis of Visual and Musical Tempo Congruence in Commercial Motion Pictures | - |
dc.title.alternative | 상업영화 속 음악 장면에서 시각적, 음악적 템포의 정량적 관계 분석 | - |
dc.type | Thesis | - |
dc.contributor.AlternativeAuthor | Yeonhwa Kim | - |
dc.description.degree | Master | - |
dc.citation.pages | vi, 70 | - |
dc.contributor.affiliation | 융합과학기술대학원 융합과학부 | - |
dc.date.awarded | 2015-02 | - |
- Appears in Collections:
- Files in This Item:
Item View & Download Count
Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.