電腦圖學與擴增實境

臺北科技大學 114-2 學期課程，課號 359936。

課程大綱

人工智慧（AI）和擴增實境（AR）技術已經以可識別的形式存在了70多年，並且最近經歷了快速成長。 AI在AR應用中被廣泛使用，其中最典型的例子之一就是電玩遊戲。人工智慧已經以多種方式應用於視訊遊戲，包括世界建構、尋路、資料探勘和玩家體驗建模。一個特別有趣的應用是使用人工智慧、機器學習和深度學習來產生內容。由於電玩遊戲是 AR 最受歡迎的應用程式之一，主流遊戲中使用的 AI 技術越來越多地融入 AR 體驗中。 在本課程中，學生將學習如何使用 Unity 3D 開發視訊遊戲應用程序，Unity 3D 是一個功能強大的跨平台 3D 引擎，可提供用戶友好的開發環境。課程將向學生介紹AR應用中常用的AI演算法和工具，例如ChatGPT、自然語言處理（NLP）和物件辨識。本課程涵蓋的人工智慧最令人興奮的方面之一是強化學習。學生將透過 Unity ML-Agents 計畫來探索這個概念，這是開始使用強化學習最容易獲得且最吸引人的方式之一。學生將學習使用 ML-Agents 訓練 Unity 遊戲物件並應用這些技術來創建智慧行為。 最後，課程將重點介紹如何使用人工智慧、機器學習和深度學習來產生 AR 中的內容。學生將獲得創建環境元素、音樂和其他組件的實踐經驗，使他們能夠將創新和沈浸式的 AR 體驗變為現實。 Artificial intelligence (AI) and augmented reality (AR) technologies have existed in recognizable forms for more than 70 years and have recently experienced rapid growth. AI is commonly used in AR applications, with one of the most typical examples being video games. AI has been applied to video games in numerous ways, including world-building, pathfinding, data mining, and player experience modeling. A particularly intriguing application is the use of AI, machine learning, and deep learning for content generation. Since video games are among the most popular applications of AR, AI technologies used in mainstream games are increasingly being integrated into AR experiences. In this course, students will learn how to develop video game applications using Unity 3D, a powerful cross-platform 3D engine that offers a user-friendly development environment. The course will introduce students to AI algorithms and tools commonly used in AR applications, such as ChatGPT, natural language processing (NLP), and object recognition. One of the most exciting aspects of Artificial Intelligence covered in this course is Reinforcement Learning. Students will explore this concept through the Unity ML-Agents project, one of the most accessible and engaging ways to begin working with Reinforcement Learning. Students will learn to train Unity game objects using ML-Agents and apply these techniques to create intelligent behaviors. Finally, the course will focus on how AI, machine learning, and deep learning can be used to generate content in AR. Students will gain hands-on experience creating environmental elements, music, and other components, enabling them to bring innovative and immersive AR experiences to life.

課程進度

1 2/27 Holiday 2 3/6 Introduction to VR/AR/XR/Unity 3 3/13 Lecture 1: The Unity VR Project Setup 4 3/20 Lecture 2: Computer Graphics 5 3/27 Lecture 3: AR Development 6 4/3 Holiday 7 4/10 Lecture 4: AI in Unity 8 4/17 Lecture 5: AI in VR/AR 9 4/24 Mid-term 10 5/1 Holiday 11 5/8 Lecture 6: Unity AI: ML Agents Mid-term discussion and Demo 12 5/15 Lecture 7: AI-powered AR/VR 13 5/22 Lecture 8: Paper Presentation: NLP 14 5/29 Lecture 9: Paper Presentation: Object Recognition 15 6/5 Lecture 10: Paper Presentation: AI Story 16 6/12 Lecture 11: Paper Presentation: AI Music 17 6/19 Holiday 18 6/26 Final Project Presentation (online class)

評量方式

Credit Distribution • Individual Assignment/Project (40%) o (5%) Project #1: Unity Setup o (10%) Project #2: VR Room o (10%) Project #3: AR app o (10%) Project #4: Hummingbird • Mid-Term Project (20%): Hugging Face/Paper • Team/Final Project (35%): AR + LLM+ ML Agent o (5%) Project proposal o (5%) Project mid-term report o (5%) Project presentation o (20%) Project final report • In-Class Activity (10%)

教材

【遵守智慧財產權觀念，請使用正版教科書，不得使用非法影印教科書】 使用外文原文書：是 Steven M. LaValle. Virtual Reality. To be published by Cambridge University Press. (available online: http://lavalle.pl/vr/ )