課程名稱 |
消息理論 Information Theory |
開課學期 |
105-1 |
授課對象 |
電機資訊學院 電機工程學研究所 |
授課教師 |
王奕翔 |
課號 |
EE5028 |
課程識別碼 |
921EU1190 |
班次 |
|
學分 |
3 |
全/半年 |
半年 |
必/選修 |
選修 |
上課時間 |
星期三2,3,4(9:10~12:10) |
上課地點 |
博理114 |
備註 |
本課程以英語授課。 總人數上限:46人 |
課程網頁 |
http://homepage.ntu.edu.tw/~ihwang/Teaching/Fa16/IT.html |
課程簡介影片 |
|
核心能力關聯 |
本課程尚未建立核心能力關連 |
課程大綱
|
為確保您我的權利,請尊重智慧財產權及不得非法影印
|
課程概述 |
Information Theory is a senior (undergraduate) level course designed for students who are interested in the quantitative fundamental limits of information. What is information and how to quantify information? What is the ultimate data compression rate and what is the ultimate transmission rate of communication? In this course, we introduce the fascinating theory originated from Claude E. Shannon, which addresses the above fundamental questions in communication theory. We will develop methods and coding techniques to achieve these fundamental limits. Finally, we will also demonstrate the application of information theory to other fields, including statistics (hypothesis testing and estimation) and statistical inferences |
課程目標 |
1. Introduce basic topics in information theory, including measures of information, source coding theorem, channel coding theorem, and source-channel separation.
2. Develop methods and coding techniques to achieve these fundamental limits.
3. Show applications of information theory beyond communications, especially in high dimensional statistics and statistical inferences. |
課程要求 |
Prerequisite: Probability, Linear Algebra,
Optional: Random Processes, Communication Systems
Homework (30%), Midterm (30%), Final (40%) |
預期每週課後學習時數 |
|
Office Hours |
|
指定閱讀 |
Lectures will be based on lecture notes and slides. Further information about assigned readings will be provided in the first lecture. |
參考書目 |
1. T. Cover and J. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006.
2. R. Gallager, Information Theory and Reliable Communications, Wiley, 1968.
3. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems, Second Edition, Cambridge University Press, 2011. |
評量方式 (僅供參考) |
No. |
項目 |
百分比 |
說明 |
1. |
Homework |
30% |
|
2. |
Midterm |
30% |
|
3. |
Final |
40% |
|
|
週次 |
日期 |
單元主題 |
第1週 |
9/14 |
Introduction; Measures of Information |
第2週 |
9/21 |
Measures of Information |
第3週 |
9/28 |
No Lecture (I-Hsiang out of town) |
第4週 |
10/05 |
Lossless Source Coding |
第5週 |
10/12 |
Lossless Source Coding |
第6週 |
10/19 |
Noisy Channel Coding |
第7週 |
10/26 |
Noisy Channel Coding |
第8週 |
11/02 |
Lossy Source Coding |
第9週 |
11/09 |
Lossy Source Coding |
第10週 |
11/16 |
Midterm |
第11週 |
11/23 |
Polar Coding |
第12週 |
11/30 |
Polar Coding |
第13週 |
12/07 |
Statistical Decision Theory |
第14週 |
12/14 |
Statistical Decision Theory |
第15週 |
12/21 |
Information Theory and Statistics |
第16週 |
12/28 |
Information Theory and Statistics |
第17週 |
1/04 |
Advanced Topics |
|