Hw2-ORIE3510_S12_solns

# Hw2-ORIE3510_S12_solns - ORIE 3510 Homework 2 Solutions...

This preview shows pages 1–3. Sign up to view the full content.

ORIE 3510 – Homework 2 Solutions Instructor: Mark E. Lewis due Wednesday February 8, 2012 (ORIE Hallway drop box) 1. Diagram for each Markov chain with the given transition matrix: 0.7 1/4 1/3 i) iii) 0.3 1 2 0.5 1 1/4 2 0.5 1/4 1/4 1/3 0.25 1/3 ii) 3 0.25 3 4 0.5 1/2 0.5 1/2 1 1 1 2 0.5 2. First, note that each X n can take value in { 0 , 1 , 2 , 3 , 4 } . Since the coins have equal probability of showing head, we have that X n +1 = ( X n + B (4 - X n , 0 . 4) if X n 3, B (4 , 0 . 4) if X n = 4, where B ( n, p ) denotes a binomial random variable with parameters n (number of trials) and p (probability of success). From this, we can see that the distribution of X n +1 given X 0 , . . . , X n only depends on X n , i.e. P ( X n +1 = x n +1 | X 0 = x 0 , . . . , X n = x n ) = P ( X n +1 = x n +1 | X n = x n ) So { X n , n 1 } is a Markov chain with state space { 0 , 1 , 2 , 3 , 4 } . Let b ( k ; n, p ) = P ( B ( n, p ) = k ) = n k p k (1 - p ) n - k , then the transition matrix has the folowing entries p ij = b ( j - i ; 4 - i, 0 . 4) if j i and i 3, b ( j ; 4 , 0 . 4) if i = 4, 0 otherwise , 1

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
where 0 i, j 4. We have that the transition matrix is P = 0 . 1296 0 . 3456 0 . 3456 0 . 1536 0 . 0256 0 . 0000 0 . 2160 0 . 4320 0 . 2880 0 . 0640 0 . 0000 0 . 0000 0 . 3600 0 . 4800 0 . 1600 0 . 0000 0 . 0000 0 . 0000 0 . 6000 0 . 4000 0 . 1296 0 . 3456 0 . 3456 0 . 1536 0 . 0256 3. First, note that when Y n
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### What students are saying

• As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

Kiran Temple University Fox School of Business ‘17, Course Hero Intern

• I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

Dana University of Pennsylvania ‘17, Course Hero Intern

• The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

Jill Tulane University ‘16, Course Hero Intern