- Publisher: Cambridge University Press
- Online publication date: November 2017
- Print publication year: 2017
- Online ISBN: 9781316544938
- https://doi.org/10.1017/9781316544938

- Publisher: Cambridge University Press
- Online publication date: November 2017
- Print publication year: 2017
- Online ISBN: 9781316544938
- https://doi.org/10.1017/9781316544938

This self-contained introduction to numerical linear algebra provides a comprehensive, yet concise, overview of the subject. It includes standard material such as direct methods for solving linear systems and least-squares problems, error, stability and conditioning, basic iterative methods and the calculation of eigenvalues. Later chapters cover more advanced material, such as Krylov subspace methods, multigrid methods, domain decomposition methods, multipole expansions, hierarchical matrices and compressed sensing. The book provides rigorous mathematical proofs throughout, and gives algorithms in general-purpose language-independent form. Requiring only a solid knowledge in linear algebra and basic analysis, this book will be useful for applied mathematicians, engineers, computer scientists, and all those interested in efficiently solving linear problems.

'Wendland delivers an introductory textbook on numerical linear algebra intended for advanced undergraduate and graduate students in applied mathematics. The book covers fairly standard material in this area; it includes error analysis and ill-conditioning, direct and iterative methods for the solution of linear systems of equations, least squares problems, and eigenvalue problems. Additional advanced topics that are not usually covered in introductory textbooks include multipole expansions, domain decomposition methods, and compressive sensing. The book is generally theoretical and mathematically rigorous in its approach. Algorithms are given only in pseudocode. … The text will be of interest primarily to instructors and students in graduate numerical linear algebra courses.'

B. Borchers Source: Choice

'Wendland’s book provides the reader with rigorous and clean proofs throughout the text. There are a lot of new concepts being presented that can spark the interest of a student who wishes to take numerical linear algebra and can also serve as an excellent resource for an independent study. If you are considering a new text for your numerical linear algebra class or wish to supplement with another resource, I would recommend giving this book a review.'

Peter Olszewski Source: MAA Reviews

Contents

References

[1] 2008. Numerical linear algebra. New York: Springer. Translated from the 2002 French original by Karim Trabelsi. , and

[2] 1951. The principle of minimized iteration in the solution of the matrix eigenvalue problem. Quart. Appl. Math., 9, 17–29.

[3] 1993. Approximate nearest neighbor searching. Pages 271–280 of: Proceedings of the 4th Annual ACM-SIAM Symposium on Discrete Algorithms. New York: ACM Press. , and

[4] 1995. Approximate range searching. Pages 172–181 of: Proceedings of the 11th Annual ACM Symposium on Computational Geometry. New York: ACM Press. , and

[5] 1985. A survey of preconditioned iterative methods for linear systems of algebraic equations. BIT, 25(1), 166–187.

[6] 1994. Iterative solution methods. Cambridge: Cambridge University Press.

[7] 1984. Finite element solution of boundary value problems. Orlando FL: Academic Press. , and

[8] 1986. On the rate of convergence of the preconditioned conjugate gradient method. Numer. Math., 48(5), 499–523. , and

[9] 2013. The road to deterministic matrices with the restricted isometry property. J. Fourier Anal. Appl., 19(6), 1123–1149. , , , and

[10] 2008. A simple proof of the restricted isometry property for random matrices. Constr. Approx., 28(3), 253–263. , , , and

[11] 1997. A short course on fast multipole methods. Pages 1–37 of: , , , and (eds.), Wavelets, multilevel methods and elliptic PDEs. 7th EPSRC numerical analysis summer school, University of Leicester, Leicester, GB, July 8–19, 1996. Oxford: Clarendon Press. , and

[12] 2000. Approximation of boundary element matrices. Numer. Math., 86(4), 565–589.

[13] 2008. Hierarchical matrices – A means to efficiently solve elliptic boundary value problems. Berlin: Springer.

[14] 2011. Adaptive cross approximation of multivariate functions. Constr. Approx., 34(2), 149–179.

[15] 2014. Comparison of some reduced representation approximations. Pages 67–100 of: Reduced order methods for modeling and computational reduction. Cham: Springer. , , and

[16] 2002. Preconditioning techniques for large linear systems: a survey. J. Comput. Phys., 182(2), 418–477.

[17] 1999. A comparative study of sparse approximate inverse preconditioners. Appl. Numer. Math., 30(2–3), 305–340. , and

[18] 2000. Robust approximate inverse preconditioning for the conjugate gradient method. SIAM J. Sci.Comput., 22(4), 1318–1332. , , and

[19] 1996. A sparse approximate inverse preconditioner for the conjugate gradient method. SIAM J. Sci. Comput., 17(5), 1135–1149. , , and

[20] 1996. Numerical methods for least squares problems. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[21] 2015. Numerical methods in matrix computations. Cham: Springer.

[22] 2004. Convex optimization. Cambridge: Cambridge University Press. , and

[23] 1977. Multi-level adaptive solutions to boundary-value problems. Math. Comp., 31(138), 333–390.

[24] 1985. Algebraic multigrid (AMG) for sparse matrix equations. Pages 257–284 of: Sparsity and its applications (Loughborough, 1983). Cambridge: Cambridge University Press. , , and

[25] 1994. The Mathematical Theory of Finite Element Methods. 3rd edn. New York: Springer. , and

[26] 1987. Introduction. Pages 1–30 of: Multigrid methods. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM). , and

[27] 2000. A multigrid tutorial. 2nd edn. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM). , , and

[28] 1995. A survey of preconditioned iterative methods. Harlow: Longman Scientific & Technical.

[29] 2006. Compressive sampling. Pages 1433–1452 of: International Congress of Mathematicians. Vol. III. Zürich: European Mathematical Society.

[30] 2008. The restricted isometry property and its implications for compressed sensing. C. R. Math. Acad. Sci. Paris, 346(9–10), 589–592.

[31] 2005. Decoding by linear programming. IEEE Trans. Inform. Theory, 51(12), 4203–4215. , and

[32] 2008. An introduction to compressive sampling. IEEE Signal Processing Magazine, 25(2), 21–30. , and

[33] 2006. Stable signal recovery from incomplete and inaccurate measurements. Comm. Pure Appl. Math., 59(8), 1207–1223. , , and

[34] 1994. A quasi-minimal residual variant of the Bi-CGSTAB algorithm for nonsymmetric systems. SIAM J. Sci. Comput., 15(2), 338–347. , , , , and

[35] 2002. Fast evaluation of radial basis functions: Methods for generalised multiquadrics in Rn. SIAM J. Sci. Comput., 23, 1272–1310. , , and

[36] 1998. Approximate inverse preconditioners via sparse– sparse iterations. SIAM J. Sci. Comput., 19(3), 995–1023. , and

[37] 1990. Matrix multiplication via arithmetic progressions. J. Symboli. Comput., 9(3), 251–280. , and

[38] 1992. Approximate inverse preconditionings for sparse linear systems. International Journal of Computer Mathematics, 44(1–4), 91–110. , , and

[39] 1991. Approximate inverse preconditioning for nonsymmetric sparse systems. Pages 101–111 of: Advances in numerical partial differential equations and optimization (Mérida, 1989). Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM). , , and

[40] 1996. Iterative methods for solving Ax = b, GMRES/FOM versus QMR/BiCG. Adv. Comput. Math., 6(1), 1–24.

[41] 2010. Numerical linear algebra and applications. 2nd edn. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[42] 2012. Introduction to compressed sensing. Pages 1–64 of: Compressed sensing. Cambridge: Cambridge University Press. , , , and

[43] 1997. Computational Geometry. Berlin: Springer. , , , and

[44] 1997. Applied numerical linear algebra. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[45] 2007. Deterministic constructions of compressed sensing matrices. J. Complexity, 23(4–6), 918–925.

[46] 2006. Compressed sensing. IEEE Trans. Inform. Theory, 52(4), 1289–1306.

[47] 2014. Finite elements and fast iterative solvers: with applications in incompressible fluid dynamics. 2nd edn. Oxford: Oxford University Press. , , and

[48] 2011. Alternating projection methods. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM). , and

[49] 1984. Necessary and sufficient conditions for the existence of a conjugate gradient method. SIAM J. Numer. Anal., 21(2), 352–362. , and

[50] 2011. Polynomial based iteration methods for symmetric linear systems. Philadelphia, PA: Society for Industrial and AppliedMathematics (SIAM). Reprint of the 1996 original.

[51] 1976. Conjugate gradient methods for indefinite systems. Pages 73–89 of: Numerical analysis (Proceedings of the 6th Biennial Dundee Conference, University of Dundee, Dundee, 1975). Berlin: Springer.

[52] 2015. Numerical linear algebra with applications. Amsterdam: Elsevier/ Academic Press.

[53] 2011. Compressive sensing. Pages 187–228 of: (ed.), Handbook of Mathematical Methods in Imaging. New York: Springer. , and

[54] 2013. A mathematical introduction to compressive sensing. New York: Birkhäuser/Springer. , and

[55] 1964. An introduction to numerical linear algebra. Oxford: Clarendon Press.

[56] 1961/1962a. The QR transformation: a unitary analogue to the LR transformation. I. Comput. J., 4, 265–271.

[57] 1961/1962b. The QR transformation. II. Comput. J., 4, 332–345.

[58] 1992. Conjugate gradient-type methods for linear systems with complex symmetric coefficient matrices. SIAM J. Sci. Statist. Comput., 13(1), 425–448.

[59] 1993. A transpose-free quasi-minimal residual algorithm for non-Hermitian linear systems. SIAM J. Sci. Comput., 14(2), 470–482.

[60] 1991. QMR: a quasi-minimal residual method for non-Hermitian linear systems. Numer. Math., 60(3), 315–339. , and

[61] 1993. An implementation of the look-ahead Lanczos algorithm for non-Hermitian matrices. SIAM J. Sci. Comput., 14(1), 137–158. , , and

[62] 1994. On vector-valued inequalities of the Marcinkiewicz–Zygmund, Herz and Krivine type. Math. Nachr., 167, 95–129. , and

[63] 1982. On the numerical radius and its applications. Linear Algebra Appl., 42, 263–284. , and

[64] 1965. Calculating the singular values and pseudoinverse of a matrix. J. Soc. Indust. Appl. Math. Ser. B Numer. Anal., 2, 205–224. , and

[65] 1970. Singular value decomposition and least squares solutions. Numer. Math., 14(5), 403–420. , and

[66] 2013. Matrix computations. 4th edn. Baltimore, MD: Johns Hopkins University Press. , and

[67] 1979. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics, 21(2), 215–223. , , and

[68] 1998. Sparse approximate-inverse preconditioners using norm-minimization techniques. SIAM J. Sci. Comput., 19(2), 605–625. , and

[69] 1997. Iterative methods for solving linear systems. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[70] 1994. Multilevelmethoden als Iterationsverfahren über Erzeugendensystemen. Stuttgart: B. G. Teubner.

[71] 1995. On the abstract theory of additive and multiplicative Schwarz algorithms. Numer. Math., 70(2), 163–180. , and

[72] 1997. Parallel preconditioning with sparse approximate inverses. SIAM J. Sci. Comput., 18(3), 838–853. , and

[73] 2007. A brief introduction to Krylov space methods for solving linear systems. Pages 53–62 of: , , and (eds.), Frontiers of Computational Science. Berlin: Springer.

[74] 1985. Multi-grid methods and applications. Berlin: Springer.

[75] 1994. Iterative solution of large sparse systems of equations. New York: Springer. Translated and revised from the 1991 German original.

[76] 1999. A sparse matrix arithmetic based on H-matrices. I. Introduction to H-matrices. Computing, 62(2), 89–108.

[77] 2015. Hierarchical matrices: algorithms and analysis. Heidelberg: Springer.

[78] 2002. Data-sparse approximation by adaptive H2- matrices. Computing., 69(1), 1–35. , and

[79] 2002. An introduction to hierarchical matrices. Mathematic. Bohemica, 127(2), 229–241. , , and

[80] 2000. On H2-matrices. Pages 9–29 of: Lectures on applied mathematics (Munich, 1999). Berlin: Springer. , , and

[81] 1992. Analysis of discrete ill-posed problems by means of the L-curve. SIAM Rev., 34(4), 561–580.

[82] 1958. On the speed of convergence of cyclic and quasicyclic Jacobi methods for computing eigenvalues of Hermitian matrices. J. Soc. Indust. Appl. Math., 6, 144–162.

[83] 1952. Methods of conjugate gradients for solving linear systems. J. Research Nat. Bur. Standards, 49, 409–436 (1953). , and

[84] 1990. Exploiting fast matrix multiplication within the level 3 BLAS. ACM Trans. Math. Software, 16(4), 352–368.

[85] 2002. Accuracy and stability of numerical algorithms. 2nd edn. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[86] 1958. Unitary triangularization of a nonsymmetric matrix. J. Assoc. Comput. Mach., 5, 339–342.

[87] 1993. Factorized sparse approximate inverse preconditionings. I. Theory. SIAM J. Matrix Anal. Appl., 14(1), 45–58. , and

[88] 2011. Fast evaluation of multiquadric RBF sums by a Cartesian treecode. SIAM J. Sci. Comput., 33(5), 2341–2355. , and

[89] 1950. An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. J. Research Nat. Bur. Standards, 45, 255–282.

[90] 1952. Solution of systems of linear equations by minimizediterations. J. Research Nat. Bur. Standards, 49, 33–53.

[91] 2010. An overlapping additive Schwarz preconditioner for interpolation on the unit sphere with spherical basis functions. Journal of Complexity, 26, 552–573. , and

[92] 2013. Krylov subspace methods – Principles and analysis. Oxford: Oxford University Press. , and

[93] 1997. On the norms of operators in the real and the complex case. Pages 67–71 of: Proceedings of the Second Seminar on Banach Spaces and Related Topics. Kitakyushu: Kyushu Institute of Technology.

[94] 1977. An iterative solution method for linear systems of which the coefficient matrix is a symmetric M-matrix. Math. Comp., 31(137), 148–162. , and

[95] 1999. Numerik linearer Gleichungssysteme – Eine Einführung in moderne Verfahren. Braunschweig: Friedrich Vieweg & Sohn.

[96] 2001. Efficient preconditioning of linear systems arising from the discretization of hyperbolic conservation laws. Adv. Comput. Math., 14(1), 49–73. , and

[97] 1984. Methods for solving incorrectly posed problems. New York: Springer. Translated from the Russian by A. B. Aries, Translation edited by Z. Nashed.

[98] 1959. A quantitative formulation of Sylvester's law of inertia. Proc. Nat. Acad. Sci. U.S.A., 45, 740–744.

[99] 1975. Solutions of sparse indefinite systems of linear equations. SIAM J. Numer. Anal., 12(4), 617–629. , and

[100] 1998. The symmetric eigenvalue problem. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM). Corrected reprint of the 1980 original.

[101] 1966. An elementary proof of the power inequality for the numerical radius. Michigan Math. J., 13, 289–291.

[102] 1999. Domain decomposition methods for partial differential equations. New York: Clarendon Press. , and

[103] 1994. Highly parallel preconditioners for general sparse matrices. Pages 165–199 of: Recent advances in iterative methods. New York: Springer.

[104] 2003. Iterative methods for sparse linear systems. 2nd edn. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[105] 1986. GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Statist. Comput., 7(3), 856–869. , and

[106] 2000. Iterative solution of linear systems in the 20th century. J. Comput. Appl. Math., 123(1-2), 1–33. , and

[107] 2005. Numerische Mathematik. 5th edn. Berlin: Springer. , and

[108] 2002. Numerical Analysis: A Mathematical Introduction. Oxford: Oxford University Press.

[109] 2002. Flexible inner–outer Krylov subspace methods. SIAM J. Numer. Anal., 40(6), 2219–2239. , and

[110] 2005. On the occurrence of superlinear convergence of exact and inexact Krylov subspace methods. SIAM Rev., 47(2), 247–272. , and

[111] 2007. Recent computational developments in Krylov subspace methods for linear systems. Numer. Linear Algebr. Appl., 14(1), 1–59. , and

[112] 1993. BiCGstab(l) for linear equations involving unsymmetric matrices with complex spectrum. Electron. Trans. Numer. Anal., 1(Sept.), 11–32 (electronic only). , and

[113] 1977. Practical and mathematical aspects of the problem of reconstructing objects from radiographs. Bull. Amer. Math. Soc., 83, 1227–1270. , , and

[114] 1989. CGS, a fast Lanczos-type solver for nonsymmetric linear systems. SIAM J. Sci. Statist. Comput., 10(1), 36–52.

[115] 2008/09. IDR(s): a family of simple and fast algorithms for solving large nonsymmetric systems of linear equations. SIAM J. Sci. Comput., 31(2), 1035–1062. , and

[116] 2005. Lösungsverfahren für lineare Gleichungssysteme. Wiesbaden: Teubner.

[117] 1998. Matrix algorithms. Volume I: Basic decompositions. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[118] 2001. Matrix algorithms. Volume II: Eigensystems. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).

[119] 1990. Matrix perturbation theory. Boston, MA: Academic Press. , and

[120] 1969. Gaussian elimination is not optimal. Numer. Math., 13, 354–356.

[121] 2003. An introduction to numerical analysis. Cambridge: Cambridge University Press. , and

[122] 1996. Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B, 58(1), 267–288.

[123] 2005. Domain decomposition methods – algorithms and theory. Berlin: Springer. , and

[124] 1997. Numerical linear algebra. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM). , and

[125] 2001. Multigrid. San Diego, CA: Academic Press. With contributions by A. Brandt P., Oswald and K. Stüben. , , and

[126] 1994. Concurrent scientific computing. New York: Springer.

[127] 1992. Bi-CGSTAB: a fast and smoothly converging variant of Bi-CG for the solution of nonsymmetric linear systems. SIAM J. Sci. Statist. Comput., 13(2), 631–644.

[128] 2009. Iterative Krylov methods for large linear systems. Cambridge: Cambridge University Press. Reprint of the 2003 original.

[129] 2000. Matrix iterative analysis. Expanded edn. Berlin: Springer.

[130] 2007. Preconditioning and convergence in the right norm. Int. J. Comput. Math., 84(8), 1199–1209.

[131] 2015. Preconditioning. Acta Numer., 24, 329–376.

[132] 2010. Fundamentals of matrix computations. 3rd edn. Hoboken, NJ: John Wiley & Sons.

[133] 2005. Scattered data approximation. Cambridge: Cambridge University Press.

[134] 1992a. Numerische Mathematik. Band 1: Lineare und nichtlineare Gleichungssysteme, Interpolation, numerische Integration. Braunschweig: Friedrich Vieweg & Sohn.

[135] 1992b. Numerische Mathematik. Band 2: Eigenwertaufgaben, lineare Optimierungsaufgaben, unrestringierte Optimierungsaufgaben. Braunschweig: Friedrich Vieweg & Sohn.

[136] 1983. On Ostrowski's generalization of Sylvester's law of inertia. Linear Algebra Appl., 52/53, 739–741.

[137] 1992. Iterative methods by space decomposition and subspace correction. SIAM Rev., 34(4), 581–613.

[138] 2008. Bregman iterative algorithms for l1-minimization with applications to compressed sensing. SIAM J. Imagin. Sci., 1(1), 143–168. , , , and

[139] 1970. Convergence properties of the symmetric and unsymmetric successive overrelaxation methods and related methods. Math. Comp., 24, 793–807.

[140] 1971. Iterative Solution of Large Linear Systems. New York: Academic Press.

* Views captured on Cambridge Core between #date#. This data will be updated every 24 hours.

Usage data cannot currently be displayed