Iterative Methods and
Iterative
Multigrid
Part 3: Methods based on the
two-sided Lanczos algorithm
Short Recurrence Methods?
Short
GMRES optimal in iterations but expensive in time and
memory if many
Convergence bounds for CG
Consider case where one eigenvalue n much larger than others.
2 n 1
n 1
Construct better polynomial than T m
information.
/T m
n 1
n 1
using this
For example, polynomial t
Introduction Iterative Methods
Eric de Sturler
Department of Mathematics, Virginia Tech
sturler@vt.edu
http:/www.math.vt.edu/people/sturler
Iterative Methods for Linear Systems: Basics to Research
Num
Convergence bounds for CG
Consider the CG residual and from that the CG error.
CG: r m = b A(x 0 + z m ) = r 0 Az m , where z m c Km (A, r 0 ).
This gives polynomial r m = r 0 AP m1 (A )r 0 = (I AP m1
Fixed-Point Iterations,
Krylov Spaces, and Krylov Methods
Fixed-Point Iterations
Solve nonsingular linear system: Ax = b
(solution x = A1b )
Solve an approximate, but simpler system: Mx 0 = b x 0 = M
Iterative Methods for
Iterative
Linear Systems
Comparisons of methods for
model problems
GMRES - Computational Cost
GMRES: Ax = b
choose x 0 (e.g. x 0 = 0 ) and tol
r 0 = b Ax 0 ; k = 0; v 1 = r 0 /r
Iterative Methods and
Multigrid
Part 3: Preconditioning
2000 Eric de Sturler
Preconditioning
The general idea behind preconditioning is that convergence of
some method for the linear system Ax = b can
Multigrid Methods
Convergence Proof and Analysis
2003 by Eric de Sturler. All rights reserved.
Fixed Point Iterations
First we make some general observations about fixed point iterations.
Consider th
Iterative Methods and
Multigrid
Part 4: Local mode analysis
2000 Eric de Sturler
Local mode analysis
How to analyze smoothing behavior for more general problems and
relaxations: local mode (normal mod
Iterative Methods and
Multigrid
Part 1: Introduction to Multigrid
2000 Eric de Sturler
1
12/02/09
MG01.prz
Basic Iterative Methods (1)
Nonlinear equation: f(x) = 0
Rewrite as x = F(x) , and iterate xi
Department of Computer Science,
University of Illinois at Urbana-Champaign
Probing for Schur Complements and
Preconditioning Generalized
Saddle-Point Problems
Eric de Sturler,
sturler@cs.uiuc.edu,
htt
Iterative Methods and
Multigrid
Part 3: Preconditioning: Based on
Domain Decomposition
2000 Eric de Sturler
Domain Decomposition Book
Significant parts of this discussion come from the (excellent) boo
Synopsis of Numerical Linear Algebra
Eric de Sturler
Department of Mathematics, Virginia Tech
sturler@vt.edu
http:/www.math.vt.edu/people/sturler
Iterative Methods for Linear Systems: Basics to Rese