The Newsletter is a key element in further enhancing the value of the journal to the inverse problems community. So why not be a part of this exciting forum by sending to our Bristol office material suitable for inclusion under any of the categories mentioned above. Your contributions will be very welcome.
Book review
Rank-Deficient and Discrete Ill-Posed Problems, Numerical Aspects of Linear Inversion P C Hansen 1998 Philadelphia: SIAM 247 pp ISBN 0-89871-403-6 $44.00
For more than ten years, Per Christian Hansen has been one of the leading experts in the field of numerical linear algebra for discrete ill-posed problems. In this monograph he presents a detailed and comprehensive description of the state-of-the-art techniques for solving linear equations for this class of ill-conditioned problems.
In the first chapter, the author carefully distinguishes between rank-deficient and (discrete) ill-posed problems Ax=b in terms of the singular values of the matrix A. Rank-deficient problems are characterized by those matrices having a cluster of small singular values which are well separated from the other singular values. Ill-posed problems do not have this property, i.e. the singular values decay gradually to zero with no particular gap between them. They arise naturally from the discretization of integral equations of the first kind while rank-deficient matrices can be considered as perturbations of singular but well-conditioned matrices B in the sense that is not too large. (Here denotes the Moore - Penrose inverse of B.) In section 1.2 he summarizes basic facts on ill-posed problems described by integral equations of the first kind. Emphasis is placed on singular value decomposition as the basic tool for its analysis. The principle of regularization is introduced for both continuous and discrete problems. At the end of this chapter the author formulates four test examples: the first, from signal processing, leads to a rank-deficient problem, the second is the computation of the second derivative and is the discretization of a modestly ill-posed problem. The last two examples are discretizations of integral equations with analytic kernels and lead to highly ill-posed problems.
Chapter 2 presents the essential tools for the analysis of discrete ill-posed problems which are fundamental throughout the book. A central role is played, as indicated above, by singular value decomposition and its various generalizations including a brief survey on their numerical computations.
In chapter 3, rank-deficient problems are treated. For this class of problems the notion of the numerical -rank of a matrix makes sense and leads to a natural regularization concept. Perturbation bounds and the efficient computation by truncated SVD or QR decompositions are explained and illustrated by a number of numerical examples.
In contrast, the regularization of ill-posed problems derived from the discretization of integral equations of the first kind is more difficult. In chapter 4, the author introduces filter factors, the resolution matrix, and the L-curve approach as useful regularization tools.
The author distinguishes between direct and iterative regularization methods. In chapter 5 he studies the first class of methods among which the Tikhonov regularization is the most popular. For each of these methods he formulates perturbation bounds and discusses the numerical aspects. In the reviewer's opinion, a highlight of this chapter is the illustrative examples at the end where the different regularization schemes are compared with each other.
The iterative regularization methods are the subject of chapter 6. Emphasis is placed on conjugate gradient methods. The implementation of the standard CG algorithm by means of the Lanczos bidiagonalization algorithm is explained and various modifications are discussed. The author reviews results on regularization and convergence properties and devotes one section to the Lanczos bidiagonalization algorithm in finite precision.
Finally, chapter 7 surveys methods for choosing the regularization parameter, a problem of obvious importance. Classical discrepancy principles are discussed as well as more recent modifications, methods based on error estimation, generalized cross-validation, and the L-curve criterion.
An impressive bibliography of 378 references completes this monograph. As the author points out in the preface, this book is not intended to be an introduction into either the field of inverse problems or numerical linear algebra. It is not a textbook. The monograph contains almost no proofs but always references to the literature. It is the purpose of the book to give a survey of state-of-the-art numerical methods for solving rank-deficient or discrete ill-posed problems.
In the referee's opinion there is no other book around which serves this goal even nearly as well as this one. This work truly fills a gap in the literature on inverse problems and ill-posed problems and is strongly recommended for every applied mathematician or engineer who has to solve rank-deficient or ill-posed problems numerically.
A Kirsch University of Karlsruhe