svd_2009_10_07_02_2up

svd_2009_10_07_02_2up - 7-1 Singular Values and Matrix...

Info iconThis preview shows pages 1–4. Sign up to view the full content.

View Full Document Right Arrow Icon
7 - 1 Singular Values and Matrix Norms S. Lall, Stanford 2009.10.07.02 7. Singular Values and Matrix Norms Geometry of linear maps The singular value decomposition (SVD) Interpretation of the SVD Matrix properties via the SVD, rank, range and null space Example: testing achievability of desired outputs for control The SVD and the control ellipsoid Example: forces applied to a hovercraft Summary: svd, control and estimation The matrix norm, and inequalities Example: matrix norm and estimation Minimal-rank approximation Example: minimal-rank approximation Example: image compression 7 - 2 Singular Values and Matrix Norms S. Lall, Stanford 2009.10.07.02 The key points of this section there is an ellipsoid for control problems, which tells which directions have strong and weak actuator authority ellipsoids in both control and estimation problems arise because of the geometry of linear transformations the singular value decomposition gives a way to both compute and understand this geometry the svd also gives us a way to pick out the essential features of any linear map, and simplify it by remove the unessentials
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
7 - 3 Singular Values and Matrix Norms S. Lall, Stanford 2009.10.07.02 Geometry of Linear Maps v 1 v 2 û 1 u 1 û 2 u 2 ! an extremely important fact: every matrix A R m × n maps the unit ball in R n to an ellipsoid in R m S = n x R n ± ± k x k ≤ 1 o AS = n Ax ± ± x S o 7 - 4 Singular Values and Matrix Norms S. Lall, Stanford 2009.10.07.02 singular values and singular vectors Frst, assume A R m × n is skinny and full rank v 1 v 2 û 1 u 1 û 2 u 2 ! the numbers σ 1 , . . . , σ n are called the singular values of A by convention, σ i > 0 the vectors u 1 , . . . , u n are called the left singular vectors of A these are unit vectors along the principal semiaxes of AS the vectors v 1 , . . . , v n are called the right singular vectors of A these are the preimages of the principal semiaxes, deFned so that Av i = σ i u i
Background image of page 2
7 - 5 Singular Values and Matrix Norms S. Lall, Stanford 2009.10.07.02 The Thin Singular Value Decomposition we have A R m × n , skinny and full rank, and Av i = σ i u i for 1 i n let ˆ U = ± u 1 u 2 · · · u n ² ˆ Σ = σ 1 σ 2 . . . σ n V = ± v 1 v 2 · · · v n ² in matrix form, the above equation is AV = ˆ U ˆ Σ and since V is orthogonal A = ˆ U ˆ Σ V T called the thin (or reduced) SVD of A V T = A U ê Î ê 7 - 6 Singular Values and Matrix Norms S. Lall, Stanford 2009.10.07.02 The Full Singular Value Decomposition we can add extra orthonormal columns to ˆ U to make U = ± u 1 u 2 · · · u m ² an orthogonal matrix; we also add extra rows of zeros to ˆ Σ , so A = U Σ V T V T = A U Î this is the (full) singular value decomposition of A every matrix A has a singular value decomposition; if A is not full rank, then some of the diagonal entries of Σ
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 4
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 08/23/2010 for the course EE 263 taught by Professor Boyd,s during the Fall '08 term at Stanford.

Page1 / 15

svd_2009_10_07_02_2up - 7-1 Singular Values and Matrix...

This preview shows document pages 1 - 4. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online