lecture10.pdf - ECE 3040 Lecture 10 Digital Machine Round-off Errors © Prof Mohamad Hassoun This lecture covers the following topics Total error in a

lecture10.pdf - ECE 3040 Lecture 10 Digital Machine...

This preview shows page 1 - 9 out of 21 pages.

ECE 3040 Lecture 10: Digital Machine Round-off Errors © Prof. Mohamad Hassoun This lecture covers the following topics: Total error in a numerical method Round-off error in the evaluation of simple formulas Binary floating-point representation of numbers The source of round-off errors Truncation error vs round-off error in numerical differentiation
Image of page 1

Subscribe to view the full document.