IOE+316+Homework+1

IOE+316+Homework+1 - (a) ( ) 1 3 2 5 x x = ? (b) ( ) x x 2...

Info iconThis preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
1 Homework #1 IOE 316 - Introduction to Markov Processes - Winter 2010 Homework #1 (2 pages) Answers are due before start of class on Tuesday, March 16, 2010 1. A robot at a manufacturing plant occasionally fails. Each day, the robot is either up (operating state) or down (failed state). Transitions between states occur according to a stationary discrete-time Markov chain. The transition probability matrix for the robot between the up and down states, from one day to the next, is shown below. Up Down 4 . 0 6 . 0 1 . 0 9 . 0 Down Up (a) What is the transition probability matrix from Monday to Wednesday? (b) The probability that the robot is up on Wednesday is 85.2%. What was the probability that it was up on Monday? 2. Multiply the following matrices:
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Background image of page 2
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: (a) ( ) 1 3 2 5 x x = ? (b) ( ) x x 2 5 1 3 = ? (c) ? 5 3 4 7 2 1 8 3 2 = x 2 3. A stationary discrete-time Markov chain has 3 states, and the following transition probability matrix P from one step in time to the next (i.e, from time 0 to time 1) . = 4 . 6 . 9 . 1 . 5 . 3 . 2 . P (a) Sketch the state transition diagram for the Markov chain. (b) What is the transition probability matrix from time 0 to time 2 ? (c) What is the transition probability matrix from time 0 to time 4 ?...
View Full Document

Page1 / 2

IOE+316+Homework+1 - (a) ( ) 1 3 2 5 x x = ? (b) ( ) x x 2...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online