hw52 - μ ε for value V ( s, x ). Then, one divides the...

Info iconThis preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
MAE 288A Assignment 2 Due Thursday, 22 Oct., 2009 1. (10) Consider the discrete-time stochastic control problem with dynam- ics ξ t +1 = t + Bu t + w t , ξ t 0 = x and cost criterion J ( t 0 , x ; u · ) = E T - 1 s t = t 0 b 1 2 ξ T t t + 1 2 u T t Du t B + 1 2 ξ T T T . Let u · be a minimizing control, and let the value function be denoted by V ( t, x ) for all t ∈ { t 0 , t 0 + 1 , . . ., T } and x IR n . Let the control take values in k , and let the noise process consist of independent, identically distributed, normal random variables (taking values in IR n ) with mean 0 and covariance matrix Q . Consider the special case A = b 0 2 3 0 B , B = b 0 3 B , C = b 1 0 0 1 B , D = 2 E = b 4 0 0 4 B , Q = b 2 0 0 1 B . Let T = 4 and t 0 = 1. Find V ( t, x ) and the optimal feedback control for t ∈ { 1 , 2 , 3 } . 2. (10) Complete the second half of the proof of the theorem (±nite time- horizon dynamic programming principle) given in class. One method is to use of an ε -optimal control,
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Background image of page 2
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: μ ε for value V ( s, x ). Then, one divides the sum over [ s, T − 1] into segments over [ s, t − 1] and [ t, T − 1]. The cost over [ t, T ] with this controller is certainly higher than the value given initial time t and the state at that time. 3. (5) Let f 1 , f 2 be convex functions mapping IR n into IR . Let g . = f 1 ⊕ f 2 . That is, let g ( x ) = f 1 ( x ) ⊕ f 2 ( x ) = max { f 1 ( x ) , f 2 ( x ) } for all x ∈ IR n . Prove that g is convex. 1 4. (5) Suppose f : IR → IR is convex. Let ¯ x ∈ argmin { f } . Is f monoton-ically increasing on [¯ x, ∞ )? If so, prove it. If not, provide a counterex-ample. 2...
View Full Document

This note was uploaded on 08/02/2010 for the course MAE 289 taught by Professor Mceneaney,w during the Spring '08 term at UCSD.

Page1 / 2

hw52 - μ ε for value V ( s, x ). Then, one divides the...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online