Schedule

The schedule is provisional and subject to change.

Class Date Topic Reading Assigned Due
/ Preliminaries - Scientific computing - Well-posedness - Sources of error - Absolute vs. relative error - data vs. computational error - truncation vs. rounding error
Conditioning - Stability - Forward and backward error - Stability and accuracy - Floating point general system
Floating point - normalization - UFL, OFL, subnormals, rounding, machine prescision
Heath, Chapter 1
Lecture 1 notes
Lecture 2 notes
Lecture 3 notes
/
/ Homework 1
/ Floating point math - rounding error analysis - cancellation - matrix-vector multiplication - outer product - range - nullspace - rank
Solving linear systems - Existence and Uniqueness of solutions - Vector and Matrix Norms
Conditioning of Ax = b - Cond(A) - Residual
Heath, Chapter 2
Lecture 4 notes
Lecture 5 notes
Lecture 6 notes
/
/
/ Triangular systems - Forward/Backward Substitution - LU factorization
LU - Operation Count - Instability - Pivoting
LU with partial and complete pivoting - Special systems - SPD systems - Cholesky factorization
Heath, Sections 2.4, 2.5
Lecture 7 notes
Lecture 8 notes
Lecture 9 notes
Homework 2 Homework 1
/
/
/ Orthogonality - SVD
SVD and rank - Projectors
Overdetermined systems - Least Squares - QR decomposition
Heath Sections 3.1-3.6
Lecture 10 notes
Lecture 11 notes
Lecture 12 notes
/ Homework 2
/ Homework 3
/ Least squares and QR - Gram-Schmidt orthogonalization - Householder Reflectors - Householder QR
Practice Midterm
Midterm

Lecture 13 notes
Practice Midterm and Solutions
/
/
/ Eigenvalue Problems
Power Iteration - Inverse Iteration - Rayleigh Quotient Iteration - Simultaneous Iteration
Deflation - Gerschgorin's Theorem
Heath, Sections 4.1, 4.2, 4.4, 4.5
Lecture 14 notes
Lecture 15 notes
Lecture 16 notes
Homework 3
/
/
/ Nonlinear Equations - Root Finding - Iterative Methods - Bisection Method
Fixed Point Iteration - Newton's Method
Secant Method - Safeguarded Methods - Systems of Nonlinear Euqations - Newton's Method - Secant-updating Methods
Heath Sections 5.1-5.5.4, 5.5.7, 5.6.1-5.6.3
Lecture 17 notes
Lecture 18 notes
Lecture 19 notes
/
/ Homework 4
/ Optimization - unconstrained - one-dimensional - multi-dimensional
Conditioning - Golden section search - Newton's Method - Steepest Descent
Newton's Method (multi-dimensional) - Quasi-Newton Methods
Heath Sections 6.1, 6.2.2., 6.3, 6.4.1, 6.4.3, 6.5.2-6.5.5
Lecture 20 notes
Lecture 21 notes
Lecture 22 notes
/
/
- / HOLIDAY
Conjugate Gradients
Heath 6.5.6
Shewchuk 1-4, 7-8
Lecture 23 notes
Lecture 24 notes
/ Homework 4
/
/ Iterative Methods - Preconditioning
Practice Final
Final
Heath 11.5.1-11.5.3, 11.5.5
Lecture 25 notes
Practice Final and Solutions
Homework 5
/
/
- / FINALS WEEK Extra Credit
- / Homework 5
- / Extra Credit