Stochastic Models & Optimisation


Aims

  • Students should understand the review of Markov processes, renewal theory, regenerative processes, queuing theory and applications to inventory and maintenance models.
  • Students should understand and be able to apply basic concepts and techniques of stochastic processes to model logistic problems

Information

  1. Poisson processes
  2. Renewal theory and regenerative processes
  3. Discrete-time Markov chains
  4. Continuous-time Markov chains
  5. Queueing models
  6. Markov decision processes

(with applications to inventory and maintenance models)

Extra

It is not allowed to use a programmable calculator during the (re-)examination.

Changes compared to previous years:

In response to preferences indicated by students that took the course last year, the exercise sessions will be replaced by (more) office hours.

Assessment

Written (re-)examination with essay questions (100%)

Materials

H.C.Tijms. A first course in stochastic models, Wiley, New York, 2003.