We propose a gradient-based method for quadratic programming problems with a single linear constraint and bounds on the variables. Inspired by the gradient projection conjugate gradient (GPCG) algorithm for bound-constrained convex quadratic programming [J. J. Moré and G. Toraldo, SIAM J. Optim., 1 (1991), pp. 93-113], our approach alternates between two phases until convergence: an identication phase, which performs gradient projection iterations until either a candidate active set is identified or no reasonable progress is made, and an unconstrained minimization phase, which reduces the objective function in a suitable space defined by the identication phase, by applying either the conjugate gradient method or a recently proposed spectral gradient method. However, the algorithm differs from GPCG not only because it deals with a more general class of problems, but mainly for the way it stops the minimization phase. This is based on a comparison between a measure of optimality in the reduced space and a measure of bindingness of the variables that are on the bounds, defined by extending the concept of proportional iterate, which was proposed by some authors for box-constrained problems. If the objective function is bounded, the algorithm converges to a stationary point thanks to a suitable application of the gradient projection method in the identification phase. For strictly convex problems, the algorithm converges to the optimal solution in a finite number of steps even in the case of degeneracy. Extensive numerical experiments show the effectiveness of the proposed approach.
A Two-Phase gradient method for quadratic programming problems with a single linear constraint and bounds on the variables / di Serafino, Daniela; Toraldo, Gerardo; Viola, Marco; Barlow, Jesse. - In: SIAM JOURNAL ON OPTIMIZATION. - ISSN 1052-6234. - 28:4(2018), pp. 2809-2838. [10.1137/17M1128538]
A Two-Phase gradient method for quadratic programming problems with a single linear constraint and bounds on the variables
Toraldo, Gerardo;Viola, Marco;
2018
Abstract
We propose a gradient-based method for quadratic programming problems with a single linear constraint and bounds on the variables. Inspired by the gradient projection conjugate gradient (GPCG) algorithm for bound-constrained convex quadratic programming [J. J. Moré and G. Toraldo, SIAM J. Optim., 1 (1991), pp. 93-113], our approach alternates between two phases until convergence: an identication phase, which performs gradient projection iterations until either a candidate active set is identified or no reasonable progress is made, and an unconstrained minimization phase, which reduces the objective function in a suitable space defined by the identication phase, by applying either the conjugate gradient method or a recently proposed spectral gradient method. However, the algorithm differs from GPCG not only because it deals with a more general class of problems, but mainly for the way it stops the minimization phase. This is based on a comparison between a measure of optimality in the reduced space and a measure of bindingness of the variables that are on the bounds, defined by extending the concept of proportional iterate, which was proposed by some authors for box-constrained problems. If the objective function is bounded, the algorithm converges to a stationary point thanks to a suitable application of the gradient projection method in the identification phase. For strictly convex problems, the algorithm converges to the optimal solution in a finite number of steps even in the case of degeneracy. Extensive numerical experiments show the effectiveness of the proposed approach.File | Dimensione | Formato | |
---|---|---|---|
diSerafino,Toraldo,Viola,Barlow_SIOPT2018.pdf
solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
691 kB
Formato
Adobe PDF
|
691 kB | Adobe PDF | Contatta l'autore |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.