| Title:
|
A new nonmonotone adaptive trust region algorithm (English) |
| Author:
|
Kamandi, Ahmad |
| Author:
|
Amini, Keyvan |
| Language:
|
English |
| Journal:
|
Applications of Mathematics |
| ISSN:
|
0862-7940 (print) |
| ISSN:
|
1572-9109 (online) |
| Volume:
|
67 |
| Issue:
|
2 |
| Year:
|
2022 |
| Pages:
|
233-250 |
| Summary lang:
|
English |
| . |
| Category:
|
math |
| . |
| Summary:
|
We propose a new and efficient nonmonotone adaptive trust region algorithm to solve unconstrained optimization problems. This algorithm incorporates two novelties: it benefits from a radius dependent shrinkage parameter for adjusting the trust region radius that avoids undesirable directions and exploits a new strategy to prevent sudden increments of objective function values in nonmonotone trust region techniques. Global convergence of this algorithm is investigated under some mild conditions. Numerical experiments demonstrate the efficiency and robustness of the proposed algorithm in solving a collection of unconstrained optimization problems from the CUTEst package. (English) |
| Keyword:
|
unconstrained optimization |
| Keyword:
|
nonmonotone trust region |
| Keyword:
|
adaptive radius |
| Keyword:
|
global convergence |
| Keyword:
|
CUTEst package |
| MSC:
|
90C26 |
| MSC:
|
90C30 |
| MSC:
|
90C55 |
| idZBL:
|
Zbl 07511503 |
| idMR:
|
MR4396686 |
| DOI:
|
10.21136/AM.2021.0122-20 |
| . |
| Date available:
|
2022-03-25T08:23:48Z |
| Last updated:
|
2024-05-06 |
| Stable URL:
|
http://hdl.handle.net/10338.dmlcz/149568 |
| . |
| Reference:
|
[1] Ahookhosh, M., Amini, K.: A nonmonotone trust region method with adaptive radius for unconstrained optimization problems.Comput. Math. Appl. 60 (2010), 411-422. Zbl 1201.90184, MR 2665646, 10.1016/j.camwa.2010.04.034 |
| Reference:
|
[2] Ahookhosh, M., Amini, K., Peyghami, M. R.: A nonmonotone trust-region line search method for large-scale unconstrained optimization.Appl. Math. Modelling 36 (2012), 478-487. Zbl 1236.90077, MR 2835025, 10.1016/j.apm.2011.07.021 |
| Reference:
|
[3] Ayanzadeh, R., Mousavi, S., Halem, M., Finin, T.: Quantum annealing based binary compressive sensing with matrix uncertainty.Available at https://arxiv.org/abs/1901.00088 (2019), 15 pages. |
| Reference:
|
[4] Chen, R., Menickelly, M., Scheinberg, K.: Stochastic optimization using a trust-region method and random models.Math. Program. 169 (2018), 447-487. Zbl 1401.90136, MR 3800867, 10.1007/s10107-017-1141-8 |
| Reference:
|
[5] Conn, A. R., Gould, N. I. M., Toint, P. L.: Trust Region Methods.MPS/SIAM Series on Optimization 1. SIAM, Philadelphia (2000). Zbl 0958.65071, MR 1774899, 10.1137/1.9780898719857 |
| Reference:
|
[6] Deng, N. Y., Xiao, Y., Zhou, F. J.: Nonmonotonic trust region algorithm.J. Optim. Theory Appl. 76 (1993), 259-285. Zbl 0797.90088, MR 1203903, 10.1007/BF00939608 |
| Reference:
|
[7] Dolan, E. D., Moré, J. J.: Benchmarking optimization software with performance profiles.Math. Program. 91 (2002), 201-213. Zbl 1049.90004, MR 1875515, 10.1007/s101070100263 |
| Reference:
|
[8] Esmaeili, H., Kimiaei, M.: A trust-region method with improved adaptive radius for systems of nonlinear equations.Math. Methods Oper. Res. 83 (2016), 109-125. Zbl 1333.90126, MR 3464191, 10.1007/s00186-015-0522-0 |
| Reference:
|
[9] Gould, N. I. M., Lucidi, S., Roma, M., Toint, P. L.: Solving the trust-region subproblem using the Lanczos method.SIAM J. Optim. 9 (1999), 504-525. Zbl 1047.90510, MR 1686795, 10.1137/S1052623497322735 |
| Reference:
|
[10] Gould, N. I. M., Orban, D., Toint, P. L.: CUTEst: A constrained and unconstrained testing environment with safe threads for mathematical optimization.Comput. Optim. Appl. 60 (2015), 545-557. Zbl 1325.90004, MR 3320935, 10.1007/s10589-014-9687-3 |
| Reference:
|
[11] Grippo, L., Lampariello, F., Lucidi, S.: A nonmonotone line search technique for Newton's method.SIAM J. Numer. Anal. 23 (1986), 707-716. Zbl 0616.65067, MR 0849278, 10.1137/0723046 |
| Reference:
|
[12] Hong, M., Razaviyayn, M., Luo, Z. Q., Pang, J.-S.: A unified algorithmic framework for block-structured optimization involving big data: With applications in machine learning and signal processing.IEEE Signal Processing Magazine 33 (2016), 57-77. 10.1109/MSP.2015.2481563 |
| Reference:
|
[13] Kamandi, A., Amini, K., Ahookhosh, M.: An improved adaptive trust-region algorithm.Optim. Lett. 11 (2017), 555-569. Zbl 1367.90102, MR 3610242, 10.1007/s11590-016-1018-4 |
| Reference:
|
[14] Moré, J. J., Sorensen, D. C.: Computing a trust region step.SIAM J. Sci. Stat. Comput. 4 (1983), 553-572. Zbl 0551.65042, MR 0723110, 10.1137/0904038 |
| Reference:
|
[15] Nocedal, J., Wright, S. J.: Numerical Optimization.Springer Series in Operations Research and Financial Engineering. Springer, New York (2006). Zbl 1104.65059, MR 2244940 |
| Reference:
|
[16] Peyghami, M. R., Tarzanagh, D. A.: A relaxed nonmonotone adaptive trust region method for solving unconstrained optimization problems.Comput. Optim. Appl. 61 (2015), 321-341. Zbl 1326.90081, MR 3349838, 10.1007/s10589-015-9726-8 |
| Reference:
|
[17] Schnabel, R. B., Eskow, E.: A new modified Cholesky factorization.SIAM J. Sci. Stat. Comput. 11 (1990), 1136-1158. Zbl 0716.65023, MR 1068501, 10.1137/0911064 |
| Reference:
|
[18] Shen, J., Mousavi, S.: Least sparsity of $p$-norm based optimization problems with $p>1$.SIAM J. Optim. 28 (2018), 2721-2751. Zbl 06951736, MR 3858810, 10.1137/17M1140066 |
| Reference:
|
[19] Shi, Z.-J., Guo, J.: A new trust region method with adaptive radius.Comput. Optim. Appl. 41 (2008), 225-242. Zbl 1216.90086, MR 2447894, 10.1007/s10589-007-9099-8 |
| Reference:
|
[20] Shi, Z., Wang, S.: Nonmonotone adaptive trust region method.Eur. J. Oper. Res. 208 (2011), 28-36. Zbl 1229.90206, MR 2737860, 10.1016/j.ejor.2010.09.007 |
| Reference:
|
[21] Steihaug, T.: The conjugate gradient method and trust regions in large scale optimization.SIAM J. Numer. Anal. 20 (1983), 626-637. Zbl 0518.65042, MR 0701102, 10.1137/0720042 |
| Reference:
|
[22] Xue, Y., Liu, H., Liu, Z.: An improved nonmonotone adaptive trust region method.Appl. Math., Praha 64 (2019), 335-350. Zbl 07088744, MR 3956176, 10.21136/AM.2019.0138-18 |
| Reference:
|
[23] Zhang, X., Zhang, J., Liao, L.: An adaptive trust region method and its convergence.Sci. China, Ser. A 45 (2002), 620-631. Zbl 1105.90361, MR 1911178 |
| Reference:
|
[24] Zhou, Q., Hang, D.: Nonmonotone adaptive trust region method with line search based on new diagonal updating.Appl. Numer. Math. 91 (2015), 75-88. Zbl 1310.65070, MR 3312325, 10.1016/j.apnum.2014.12.009 |
| . |
