L31_Non-Linear Programming Problems - Unconstrained Optimization - KKT Conditions

L31_Non-Linear Programming Problems - Unconstrained Optimization - KKT Conditions

Info icon This preview shows pages 1–11. Sign up to view the full content.

View Full Document Right Arrow Icon
    CLASSICAL OPTIMIZATION THEORY Quadratic forms Let = n x x x X . . 2 1 be a n-vector.
Image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
    Let A = ( a ij ) be a n×n symmetric matrix. We define the k th order principal minor as the k × k determinant kk k k k k a a a a a a a a a . .. . . . .. . .. 2 1 2 22 21 1 12 11
Image of page 2
    Positive semi definite if X T AX ≥ 0 for all X. Positive definite if X T AX > 0 for all X ≠ 0. Negative semi definite if X T AX ≤ 0 for all X . Negative definite if X T AX < 0 for all X ≠ 0. Then the quadratic form 2 1 2 ii i ij i j i i j n a x a x x ≤ < ≤ = + ∑ ∑ X A X X Q T = ) ( (or the matrix A) is called
Image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
    A necessary and sufficient condition for A (or Q ( X )) to be : Negative definite ( negative semi definite ) if k th principal minor of A has the sign of (-1) k , k =1,2,…,n ( k th principal minor of A is zero or has the sign of (-1) k , k =1,2,…,n ) Positive definite ( positive semi definite ) is that all the n principal minors of A are > 0 ( ≥ 0).
Image of page 4
    Let f ( X )= f ( x 1 , x 2 ,…, x n ) be a real-valued function of the n variables x 1 , x 2 ,…, x n (we assume that f ( X ) is at least twice differentiable ). 0 0 ( ) ( ) f X h f X + r ε j h ) ,.., , ( 2 1 n h h h h = r 0 0 0 0 1 1 2 2 ( , ,.., ) n n X h x h x h x h + = + + + r A point X 0 is said to be a local maximum of f ( X ) if there exists an ε > 0 such that for all Here and 0 0 0 0 1 2 ( , ,.., ) n X x x x =
Image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
    X 0 is said to be a local minimum of f ( X ) if there exists an ε > 0 such that X X f X f 2200 ) ( ) ( 0 ) ( ) ( 0 0 X f h X f + r X 0 is called an absolute maximum or global maximum of f ( X ) if   for all X 0 is called an absolute minimum or global minimum of f ( X ) if   0 ( ) ( ) f X f X X 2200 ε j h
Image of page 6
    Theorem A necessary condition for X 0 to be an optimum point of f ( X ) is that 0 ) ( 0 = X f i x f (that is all the first order partial derivatives are zero at X 0 .) 0 ) ( 0 = X f Definition is called a stationary point of f ( X ) (potential candidate for local maximum or local minimum). A point X 0 for which
Image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
    Let X 0 be a stationary point of f ( X ). A sufficient condition for X 0 to be a local minimum of f ( X ) is that the Hessian matrix H ( X 0 ) is positive definite; local maximum of f ( X ) is that the Hessian matrix H ( X 0 ) is negative definite . Theorem
Image of page 8
    Here H ( X ) is the n×n matrix whose i th row are j f x 2 2 2 2 1 1 2 1 2 2 2 2 1 2 2 2 2 2 2 2 1 2 . . . . . . . . . . n n n n n f f f x x x x x f f f x x x x x f f f x x x x x ∂ ∂ ∂ ∂ ∂ ∂ i.e. H ( X ) = with respect to x i . the partial derivates of ( j =1,2,..n) ( i =1,2,..n)
Image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
    Problem 3 set 20.1A page 705 Find the stationary points of the function f ( x 1 , x 2 , x 3 ) = 2 x 1 x 2 x 3 4 x 1 x 3 2 x 2 x 3 + x 1 2 + x 2 2 + x 3 2 2 x 1 - 4 x 2 + 4 x 3 And hence find the extrema of f ( X ) 4 2 2 4 2 4 2 2 2 2 2 4 2 3 2 1 2 1 3 2 3 3 1 2 1 3 3 2 1 + + - - = - + - = - + - = x x x x x x f x x x x x f x x x x
Image of page 10
Image of page 11
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern