Discrete-time Markov Chains and Poisson Processes

By Prof. Ayon Ganguly, Prof. Subhamay Saha | IIT Guwahati

Learners enrolled: 491

In this course we will cover discrete-time Markov chains and Poisson Processes. Knowledge of calculus and basic probability is essential for this course. The mathematical rigor of the course will be at an undergraduate level. We will cover from basic definition to limiting probabilities for discrete -time Markov chains. We will discuss in detail Poisson processes, the simplest example of a continuous-time Markov chain. The course will involve a lot of illustrative examples and worked out problems.

PRE-REQUISITE : Basic Probability,Calculus

INDUSTRY SUPPORT : Supply Chain, Communications.

INTENDED AUDIENCE : Undergraduate students of Science and Engineering. Many postgraduate students as well as industry professionals dealing with stochastic modelling may find the course useful.

Summary

Course Status :	Completed
Course Type :	Core
Duration :	8 weeks
Category :	Mathematics
Credit Points :	2
Level :	Undergraduate/Postgraduate
Start Date :	24 Jan 2022
End Date :	18 Mar 2022
Enrollment Ends :	07 Feb 2022
Exam Date :	27 Mar 2022 IST

Note: This exam date is subjected to change based on seat availability. You can check final exam date on your hall ticket.

Page Visits

Course layout

Week 1:Introduction to Discrete-time Markov Chains

Week 2:Communication
Week 3:Hitting Times
Week 4:Classification of States

Week 5:Stationary Distribution

Week 6:Limit Theorems

Week 7:Exponential Distribution and Counting Processes

Week 8:Poisson Processes

Books and references

1.S. M. Ross, Introduction to Probability Models, 11^th Ed., Academic Press, 2014.

2.J. R. Norris, Markov Chains, Cambridge University Press, 2012.

Instructor bio

Prof. Ayon Ganguly

IIT Guwahati

Dr. Ayon Ganguly is an Assistant Professor in the Department of Mathematics, IIT Guwahati. His area of expertise is Statistics. He has offered courses on probability and statistics, stochastic processes, time series analysis to the B.Tech. (Mathematics and Computing) and M.Sc. (Mathematics and Computing) students of IIT Guwahati.

Prof. Subhamay Saha

Dr. Subhamay Saha is an Assistant Professor in the Department of Mathematics, IIT Guwahati. His area of expertise is Probability and Stochastic Processes. He has offered courses on probability, stochastic processes, stochastic calculus to the B.Tech. (Mathematics and Computing) and M.Sc. (Mathematics and Computing) students of IIT Guwahati.

Course certificate

The course is free to enroll and learn from. But if you want a certificate, you have to register and write the proctored exam conducted by us in person at any of the designated exam centres.

The exam is optional for a fee of Rs 1000/- (Rupees one thousand only).

Date and Time of Exams: 27 March 2022 Morning session 9am to 12 noon; Afternoon Session 2pm to 5pm.

Registration url: Announcements will be made when the registration form is open for registrations.

The online registration form has to be filled and the certification exam fee needs to be paid. More details will be made available when the exam registration form is published. If there are any changes, it will be mentioned then.

Please check the form for more details on the cities where the exams will be held, the conditions you agree to when you fill the form etc.

CRITERIA TO GET A CERTIFICATE

Average assignment score = 25% of average of best 6 assignments out of the total 8 assignments given in the course.

Exam score = 75% of the proctored certification exam score out of 100

Final score = Average assignment score + Exam score

YOU WILL BE ELIGIBLE FOR A CERTIFICATE ONLY IF AVERAGE ASSIGNMENT SCORE >=10/25 AND EXAM SCORE >= 30/75. If one of the 2 criteria is not met, you will not get the certificate even if the Final score >= 40/100.

Certificate will have your name, photograph and the score in the final exam with the breakup.It will have the logos of NPTEL and IIT Guwahati.
It will be e-verifiable at nptel.ac.in/noc.

Only the e-certificate will be made available. Hard copies will not be dispatched.

Once again, thanks for your interest in our online courses and certification. Happy learning.

- NPTEL team