EE 708 Information Theory and Coding (Spring 2016-17)
Course Instructor:Sibi Raj B Pillai
Course Name: EE 708 Information Theory and Coding
Credits: 6
Course Type: Institute Elective
Prerequisites:
Course Name: EE 708 Information Theory and Coding
Credits: 6
Course Type: Institute Elective
Prerequisites:
No formal prerequisite. Probability theory and linear algebra are heavily used. The course is quite abstract so be ready for that plus a lot of mathematical manipulations.
Pro Tips:
Course Content:
Information Measures (Entropy etc.)
Source Coding: (The focus was on loss-less encoding; lossy coding was only mentioned)
Channel Coding: Capacity, Channels with state, Compound Channels
Information Theory and Wireless communication
Network Information Theory: Multiple Access and Broadcast
New Applications like Bioinformatics, Energy Harvesting, Statistical Physics were mentioned in the course content but were unfortunately NOT covered
Books: Cover and Thomas is a widely used book for information theory and was more than enough for the course.
Source Coding: (The focus was on loss-less encoding; lossy coding was only mentioned)
Channel Coding: Capacity, Channels with state, Compound Channels
Information Theory and Wireless communication
Network Information Theory: Multiple Access and Broadcast
New Applications like Bioinformatics, Energy Harvesting, Statistical Physics were mentioned in the course content but were unfortunately NOT covered
Books: Cover and Thomas is a widely used book for information theory and was more than enough for the course.
Lectures: No attendance requirements. For the first few lectures the Prof. would come up with a game/puzzle and we would be introduced to a new information theory concept through that! It was fun! Later the lectures involved either loads of mathematics or discussions on what methods could be used to optimize the engineering. Only blackboards were used and there was no attendence policy. The Prof. was extremely good, would answer all questions very well and would take an individual interest in every student's learning. There was one guest lecture by a Professor from TIFR.
Assignments: We had graded assignments. Three of them. Also every week we had a tutorial class.
Exams: Exams were open note-book. We had only one quiz (before midsem). I do not remember the weightages.
Assignments: We had graded assignments. Three of them. Also every week we had a tutorial class.
Exams: Exams were open note-book. We had only one quiz (before midsem). I do not remember the weightages.
Attend all lectures. Each lecture leads to the next so it is best not to lose the flow. Also there won't be any slides to fall back on.
Do the tutorials diligently and make sure to familiarize yourself with the mathematical manipulation of entropy, conditional entropy, etc. early in the course. There are lots of "tricks" that are used again and again.
Make sure you understand the physical assumption behind each step. Later on in the course many systems would be studied with only slight and subtle differences from the general information-channel and then there would be one or two mathematical steps that would need to be modified.
Personal Comments: Prof. Sibi Raj Pillai is one of the best Professors I have come across so I highly recommend taking a course with him.
Do the tutorials diligently and make sure to familiarize yourself with the mathematical manipulation of entropy, conditional entropy, etc. early in the course. There are lots of "tricks" that are used again and again.
Make sure you understand the physical assumption behind each step. Later on in the course many systems would be studied with only slight and subtle differences from the general information-channel and then there would be one or two mathematical steps that would need to be modified.
Personal Comments: Prof. Sibi Raj Pillai is one of the best Professors I have come across so I highly recommend taking a course with him.
Respondent: Abhijeet Melkani
Comments
Post a Comment