|
課程名稱 |
互動系統設計與實作
Interactive System Design and Implementation |
|
開課學期 |
113-1 |
|
授課對象 |
電機資訊學院 資訊工程學研究所 |
|
授課教師 |
鄭龍磻 |
|
課號 |
CSIE5646 |
|
課程識別碼 |
922EU4950 |
|
班次 |
|
|
學分 |
3.0 |
|
全/半年 |
半年 |
|
必/選修 |
選修 |
|
上課時間 |
星期四7,8,9(14:20~17:20) |
|
上課地點 |
|
|
備註 |
本課程以英語授課。上課教室：學新523.
總人數上限：24人 |
|
|
|
|
課程簡介影片 |
|
|
核心能力關聯 |
核心能力與課程規劃關聯圖 |
|
課程大綱
|
|
為確保您我的權利,請尊重智慧財產權及不得非法影印
|
|
課程概述 |
This course provides instruction in building cutting-edge interactive systems and guides to design futuristic experiences. Students gather in Make Reality Space in a studio fomat to construct software and hardware prototypes. Topics for each semester may change and evolve towards ultimate reality (see more at www.lungpancheng.tw).
In this semester, this course focuses on mixed reality technologies. Specifically, students use Meta Quest 3, Intel Realsense cameras, computer vision toolkits, 3D printed props, and Unity game engines to connect both the physical and virtual worlds.
In a group project, students design and build their own interactive hardware/software prototypes and present them in a live demo at the end of term. |
|
課程目標 |
The grade of this course is heavily based on the demos. Lists of requried interactions and _bonus_ interactions will be tested while demoing.
In the first half of the crouse, TAs deliever clear instructions as labs to walk through the process of building and designing the system for the required interactions.
In the second half of the course, TAs and the professor meet each team in a form of 30-minute scrum each week.
Strudents can choose to develop their own group projects or build from the base projects listed below.
For those base projects, the required interactions will be according to the papers.
For those own projects, the required interactions will be specified through the course.
A is guaranteed if all required interactions have been smoothly passed.
A+ is juried by peers, TAs and the professor based on _bonus_ interactions. |
|
課程要求 |
The following course are recommended to be taken to boost up your speed in making prototype systems.
CSIE3311 Computer System Laboratory
EE1006 Cornerstone EECS Design and Implementation
The maximum number of teams is 8 (in a group of 3 = 24 people) due to the limited number of devices.
There are only limited number of laptops to be borrowed, so bring your own laptop if possible. |
|
預期每週課後學習時數 |
6-10 hours |
|
Office Hours |
每週四 13:00~18:00 |
|
指定閱讀 |
Here are the list of papers as the bases of group projects.
Mutual Human Actuation
paper: https://dl.acm.org/doi/10.1145/3126594.3126667
video: https://www.youtube.com/watch?v=JKGdQjx-_BI
VRoamer
paper: https://ieeexplore.ieee.org/document/8798074
video: https://www.youtube.com/watch?v=QSvJuBxPtpc
Scene Responsiveness for Visuotactile Illusions in Mixed Reality
paper: https://dl.acm.org/doi/10.1145/3586183.3606825
video: https://www.youtube.com/@mokari/videos
Reality Rifts
paper: https://dl.acm.org/doi/10.1145/3544548.3581454
video: https://www.youtube.com/watch?v=68oIgasJ0hs
Impossible Staircase
paper: https://ieeexplore.ieee.org/document/9417791
video: https://www.youtube.com/watch?v=-0X_joLK0to
Causality-preserving Asynchronous Reality
paper: https://dl.acm.org/doi/10.1145/3491102.3501836
video: https://www.youtube.com/watch?v=U5dZlmQYIgs
Context-Aware Online Adaptation of Mixed Reality Interfaces
paper: https://dl.acm.org/doi/abs/10.1145/3332165.3347945
video: https://www.youtube.com/watch?v=heAGuCsWs9o
RealityCanvas
paper: https://dl.acm.org/doi/10.1145/3586183.3606716
video: https://www.youtube.com/watch?v=HVOgH1quDsc
|
|
參考書目 |
Brave NUI world: designing natural user interfaces for touch and gesture
https://books.google.com.tw/books?id=ID0L0EI79-YC&lpg=PP1&ots=0a0xGddR5-&dq=info%3ABlUtMwxwgD4J%3Ascholar.google.com&lr&pg=PP1#v=onepage&q&f=false
3D user interfaces: theory and practice
https://books.google.com.tw/books?id=fxWSDgAAQBAJ&lpg=PT16&ots=tpZML6BVHp&dq=info%3AhClyNV0p8LgJ%3Ascholar.google.com&lr&pg=PT16#v=onepage&q&f=false
|
|
評量方式
(僅供參考) |
|
No. |
項目 |
百分比 |
說明 |
|
1. |
Labs |
40% |
20% = 5% x 4 progress reports
20% midterm demo |
2. |
Project |
60% |
40% = 5% x 8 progress reports
20% final demo |
|
|
針對學生困難提供學生調整方式 |
|
上課形式 |
提供學生彈性出席課程方式 |
|
作業繳交方式 |
書面報告取代口頭報告, 口頭報告取代書面報告, 團體報告取代個人報告 |
|
考試形式 |
書面(口頭)報告取代考試 |
|
其他 |
|
|
|
週次 |
日期 |
單元主題 |
|
第1週 |
9/5 |
Introduction to interactive systems |
|
第2週 |
9/12 |
Connecting physical and virtual reality
Lab 1- calibrating systems |
|
第3週 |
9/19 |
More computer vision
*Group formation deadline
Lab 2- marker detection |
|
第4週 |
9/26 |
Designing interactive experience- storyboarding
Lab 3- Unity collision and logic |
|
第5週 |
10/3 |
Designing interactive experiences- interaction techniques
Lab 4- Unity basic animations, sounds, and lighting |
|
第6週 |
10/10 |
Nationa Day- No class |
|
第7週 |
10/17 |
at UIST 2024 |
|
第8週 |
10/24 |
Midterm Demo Day |
|
第9週 |
10/31 |
Project sprint-1 |
|
第10週 |
11/7 |
Project sprint-2 |
|
第11週 |
11/14 |
Project sprint-3 |
|
第12週 |
11/21 |
Project sprint-4 |
|
第13週 |
11/28 |
Project sprint-5 |
|
第14週 |
12/5 |
Project sprint-6 |
|
第15週 |
12/12 |
Project sprint-7 |
|
第16週 |
12/19 |
Final Demo Day |