This study discusses the methods, algorithms and implementation techniques involved in the computational solution of unconstrained minimization problem :
min x ∈ Rn f : Rn −! R
Where Rn denotes the n-dimensional Euclidean space.
The main goal in this study was to implement an easy-to-use software package running in personal computers for unconstrained minimization of multidimensional functions. This software package includes C language implementations of six minimization methods (listed below), an user-interface for entering each minimization problem, and an interface to a general software system called MathematicaTM
which is used for plotting the problem function and the minimization route. The following minimization methods are discussed here :
- Parabolic interpolation in one-dimension
- Downhill simplex method in multidimensions
- Direction set method in multidimensions
- Variable metric method in multidimensions
- Conjugate gradients method in multidimensions
- Modified steepest descent method in multidimensions
The first part of this study discusses the theoretical background of the minimization algorithms to be implemented in the software package. The second part introduces the overall design of the minimization software and in greater detail describes the individual software modules, which, as a whole, implement the software package. The third part introduces the techniques for testing the minimization algorithms, describes the set of test problems, and discusses the test results.