互動裝置與表演科技

臺北科技大學 115-1 學期課程，課號 366459。

課程大綱

This course will explore the possibilities and developments of using interactive technology in contemporary performing arts and installation design. It will introduce forms and aesthetics of interactive performance, computer vision and listening, real-time video processing, and real-time audio synthesis. Through proposing and executing actual performance projects and interdisciplinary collaboration, students will have the opportunity to integrate interactive technology, interactive installations, and performing arts. The course will emphasize project proposal and conceptualization, performance scripting, stage and interactive installation design, and interactive audio-visual application design. 本課程將探討互動科技運用於當代表演藝術、裝置設計之可能性與相關發展，並介紹互動表演形式與美學、電腦視覺與電腦聆聽、即時影像處理、即時音訊合成等，藉由實際展演計畫之提案與執行，透過跨領域合作，讓學生有機會將互動科技、互動裝置、表演藝術三者結合。本課程將注重展演計畫之提案與發想、表演之腳本安排、舞台與互動裝置設計、互動影音應用設計等。

課程進度

Week 1: Course Introduction, Overview of Max/MSP/Jitter Interactive Audio-Visual Systems、Plugdata Audio System、Touch Designer Week 2: AM, FM, Basic Data Interpolation Week 3: sound file playback (sequentially / simultaneously / randomly ) Week 4: Interaction Between Keyboard and Sound Week 5: Interaction Between Mouse and Sound Week 6: Volume Detection and Interaction; Pitch Detection and Interaction; Week 7: Mouse-Controlled Pentatonic Scale Arpeggio (Advanced Project) Week 8: Connecting iPhone with OSC Messages, Sound Interaction; Connection of External MIDI Controllers, Week 9: Preliminary Proposal Report for Final Project Week 10: Preliminary Proposal Report for Final Project Week 11: Introduction to Touch Designer; Frame Difference Detection to Trigger Visual Effects Week 12: Mediapipe hand gesture recognition to trigger sound Week 13: ISF Shader in Touchdesigner Week 14: Amplitude to Trigger Point Cloud; Week 15: On-site Demonstration and Oral Presentation of Final Project; Project Video Introduction Week 16: On-site Demonstration and Oral Presentation of Final Project; Project Video Introduction

評量方式

Class Participation (30%), Midterm Report (30%), Final Project (40%)

教材

【遵守智慧財產權觀念，請使用正版教科書，不得使用非法影印教科書】 使用外文原文書：否 Max/MSP/Jitter User Manual