| Title:
|
Adaptive fractional distributed optimization algorithm with directed spanning trees (English) |
| Author:
|
Peng, Huaijin |
| Author:
|
Wei, Yiheng |
| Author:
|
Zhou, Shuaiyu |
| Author:
|
Yue, Dongdong |
| Language:
|
English |
| Journal:
|
Kybernetika |
| ISSN:
|
0023-5954 (print) |
| ISSN:
|
1805-949X (online) |
| Volume:
|
61 |
| Issue:
|
3 |
| Year:
|
2025 |
| Pages:
|
377-403 |
| Summary lang:
|
English |
| . |
| Category:
|
math |
| . |
| Summary:
|
Distributed optimization has garnered significant attention in past decade, yet existing algorithms mainly rely on Laplacian matrix information for parameter settings, limiting their adaptability and applicability. To design the fully distributed algorithm, this paper uses an adaptive weight framework based on directed spanning trees (DST), which not only solves the consensus optimization problem but also can be extended to solve the resource allocation problem. The innovative integration of Nabla fractional calculus further improves performance, enabling efficient discrete-time distributed optimization. Moreover, The proposed algorithms optimality and convergence properties have been rigorously analyzed, which demonstrates that they can converge to the optimal solution of the problem under consideration. Finally, numerical simulations are conducted to validate the algorithm's feasibility and superiority. (English) |
| Keyword:
|
distribute optimization |
| Keyword:
|
fractional calculus |
| Keyword:
|
directed graphs |
| Keyword:
|
directed spanning trees |
| Keyword:
|
resource allocation |
| Keyword:
|
fully distributed |
| MSC:
|
05C05 |
| MSC:
|
05C20 |
| MSC:
|
26A33 |
| MSC:
|
90C26 |
| DOI:
|
10.14736/kyb-2025-3-0377 |
| . |
| Date available:
|
2025-07-14T09:37:08Z |
| Last updated:
|
2025-07-14 |
| Stable URL:
|
http://hdl.handle.net/10338.dmlcz/153033 |
| . |
| Reference:
|
[1] Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers..Found. Trends Machine Learn. 3 (2011), 1, 1-122. 10.1561/2200000016 |
| Reference:
|
[2] Bullo, F., Cortés, J., Martinez, S.: Distributed control of robotic networks: a mathematical approach to motion coordination algorithms..Princeton University Press, Princeton 2009. MR 2524493 |
| Reference:
|
[3] Chen, Y. Q., Gao, Q., Wei, Y. H., Wang, Y.: Study on fractional order gradient methods..Appl. Math. Comput. 314 (2017), 310-321. MR 3683875, |
| Reference:
|
[4] Cheng, S. S., Liang, S.: Distributed optimization for multi-agent system over unbalanced graphs with linear convergence rate..Kybernetika 56 (2020), 3, 559-577. MR 4131743, |
| Reference:
|
[5] Cheng, S. S., Liang, S., Fan, Y.: Distributed solving Sylvester equations with fractional order dynamics..Control Theory Technol. 19 (2021), 2, 249-259. MR 4264963, |
| Reference:
|
[6] Ding, D. R., Han, Q. L., Ge, X. H.: Distributed filtering of networked dynamic systems with non-gaussian noises over sensor networks: a survey..Kybernetika 56 (2020), 1, 5-34. MR 4091782 |
| Reference:
|
[7] Gharesifard, B., Cortés, J.: Distributed continuous-time convex optimization on weight-balanced digraphs..IEEE Trans. Automat. Control 59 (2014), 3, 781-786. MR 3188487, |
| Reference:
|
[8] Hong, X. L., Wei, Y. H., Zhou, S. Y., Yue, D. D.: Nabla fractional distributed optimization algorithms over undirected/directed graphs..J. Franklin Inst. 361 (2024), 3, 1436-1454. MR 4689320, |
| Reference:
|
[9] Huang, J. Y., Zhou, S. Y., Tu, H., Yao, Y. H., Liu, Q. S.: Distributed optimization algorithm for multi-robot formation with virtual reference center..IEEE/CAA J. Automat. Sinica 9 (2022), 4, 732-734. |
| Reference:
|
[10] Humblet, P.: A distributed algorithm for minimum weight directed spanning trees..IEEE Trans. Commun. 31 (1983), 6, 756-762. |
| Reference:
|
[11] Kia, S. S., Cortés, J., Martínez, S.: Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication..Automatica 55 (2015), 254-264. MR 3336675, |
| Reference:
|
[12] Li, Z. H., Ding, Z. T., Sun, J. Y., Li, Z. K.: Distributed adaptive convex optimization on directed graphs via continuous-time algorithms..IEEE Trans. Automat. Control 63 (2018), 5, 1434-1441. MR 3800537, |
| Reference:
|
[13] Liang, S., Wang, L. Y., Yin, G.: Fractional differential equation approach for convex optimization with convergence rate analysis..Optimiz. Lett. 45 (2019), 9, 145-155. MR 4055308 |
| Reference:
|
[14] Lin, P., Ren, W., Farrell, J. A.: Distributed continuous-time optimization: Nonuniform gradient gains, finite-time convergence, and convex constraint set..IEEE Trans. Automat. Control 62 (2017), 5, 2239-2253. MR 3641443, |
| Reference:
|
[15] Liu, Q. S., Yang, S. F., Hong, Y. G.: Constrained consensus algorithms with fixed step size for distributed convex optimization over multiagent networks..IEEE Trans. Automat. Control 62 (2017), 8, 4259-4265. MR 3684371, |
| Reference:
|
[16] Molzahn, D. K., Dörfler, F., Sandberg, H., Low, S. H., Chakrabarti, S., Baldick, R., Lavaei, J.: A survey of distributed optimization and control algorithms for electric power systems..IEEE Trans. Smart Grid 8 (2017), 6, 2941-2962. |
| Reference:
|
[17] Nedić, A., Ozdaglar, A.: Distributed subgradient methods for multi-agent optimization..IEEE Trans. Automat. Control 54 (2009), 1, 48-61. MR 2478070, |
| Reference:
|
[18] Ni, W., Wang, X. L.: Averaging approach to distributed convex optimization for continuous-time multi-agent systems..Kybernetika 52 2016), 6, 898-913. MR 3607853, |
| Reference:
|
[19] Ni, X. T., Wei, Y. H., Zhou, S. Y., Tao, M.: Multi-objective network resource allocation method based on fractional PID control..Signal Process. 227 (2025), 109717. |
| Reference:
|
[20] Pu, S., Shi, W., Xu, J., Nedic, A.: Pushpull gradient methods for distributed optimization in networks..IEEE Trans. Automat. Control 66 (2021), 1, 1-16. MR 4210391, 10.1109/TAC.2020.2972824 |
| Reference:
|
[21] Pu, Y. F., Zhou, J. L., Zhang, Y., Zhang, N., Huang, G., Siarry, P.: Fractional extreme value adaptive training method: fractional steepest descent approach..IEEE Trans. Neural Networks Learn. Systems 26 (2015), 4, 653-662. MR 3452478, |
| Reference:
|
[22] Ren, W., Cao, Y. C.: Distributed Coordination of Multi-Agent Networks: Emergent Problems, Models, and Issues..Springer Science and Business Media, 2010. |
| Reference:
|
[23] Song, Y. W., Cao, J. D., Rutkowski, L.: A fixed-time distributed optimization algorithm based on event-triggered strateg..IEEE Trans. Network Sci. Engrg. 9 (2021), 3, 1154-1162. MR 4431468, |
| Reference:
|
[24] Touri, B., Gharesifard, B.: A modified saddle-point dynamics for distributed convex optimization on general directed graphs..IEEE Trans. Automat. Control 65 (2020), 7, 3098-3103. MR 4120572, |
| Reference:
|
[25] Varagnolo, D., Zanella, F., Cenedese, A., Pillonetto, G., Schenato, L.: Newton-Raphson consensus for distributed convex optimization..IEEE Trans. Automat. Control 61 (2016), 4, 994-1009. MR 3483531, |
| Reference:
|
[26] Wang, D., Gao, Z. Z.: Distributed finite-time optimization algorithms with a modified Newton-Raphson method..Neurocomputing 536 (2023), 73-79. |
| Reference:
|
[27] Wang, Y. H., Lin, P., Qin, H. S.: Distributed classification learning based on nonlinear vector support machines for switching networks..Kybernetika 53 (2017), 4, 595-611. MR 3730254, |
| Reference:
|
[28] Wang, X. Y., Wang, G. D., Li, S. H.: Distributed finite-time optimization for integrator chain multiagent systems with disturbances..IEEE Trans. Automat. Control 65 (2020), 12, 5296-5311. MR 4184855, |
| Reference:
|
[29] Wei, Y. H., Chen, Y. Q.: Converse Lyapunov theorem for nabla asymptotic stability without conservativeness..IEEE Trans. Systems Man Cybernet.: Systems 52 (2022), 4, 2676-2687. |
| Reference:
|
[30] Wei, Y. H., Kang, Y., Yin, W. D., Wang, Y.: Generalization of the gradient method with fractional order gradient direction..J. Franklin Inst. 357 (2020), 4, 2514-2532. MR 4077858, |
| Reference:
|
[31] Wei, Y. D., Wei, Y. H., Chen, Y. Q., Wang, Y.: Mittag-Leffler stability of nabla discrete fractional order dynamic systems..Nonlinear Dynamics 101 (2020), 407-417. |
| Reference:
|
[32] Wei, Y. H., Zhao, L. L., Zhao, X., Cao, J. D.: Fractional difference inequalities for possible Lyapunov functions: A review..Fract. Calculus Appl. Anal. (2024). MR 4806296, |
| Reference:
|
[33] Xin, R., Khan, U. A.: A linear algorithm for optimization over directed graphs with geometric convergence..IEEE Control Systems Lett. 2 (2018), 3, 315-320. MR 4208622, |
| Reference:
|
[34] Yang, X. L., Zhao, W. M., Yuan, J. X., Chen, T., Zhang, C., Wang, L. Q.: Distributed optimization for fractional-order multi-agent systems based on adaptive backstepping dynamic surface control technology..Fractal Fractional 6 (2022), 11, 642. |
| Reference:
|
[35] Yue, D. D., Baldi, S., Cao, J. D., Schutter, B. De: Distributed adaptive optimization with weight-balancing..IEEE Trans. Automat. Control 67 (2022), 4, 2068-2075. MR 4402434, |
| Reference:
|
[36] Yue, D. D., Baldi, S., Cao, J. D., Li, Q., Schutter, B. De: A directed spanning tree adaptive control solution to time-varying formations..IEEE Trans. Control Network Syst. 8 (2021), 2, 690-701. MR 4320626, |
| Reference:
|
[37] Zeng, Y. K., Wei, Y. H., Zhou, S. Y., Yue, D. D.: Distributed optimization via active disturbance rejection control: a nabla fractional design..Kybernetika 60 (2024), 1, 90-109. MR 4730702, |
| Reference:
|
[38] Yue, D. D., Baldi, S., Cao, J. D., Li, Q., Schutter, B. De: Distributed adaptive resource allocation: an uncertain saddle-point dynamics viewpoint..IEEE/CAA J. Automat. Sinica 10 (2023), 12, 2209-2221. MR 4339192, |
| Reference:
|
[39] Zhang, J., Liu, L., Wang, X. H., Ji, H. B.: Fully distributed algorithm for resource allocation over unbalanced directed networks without global Lipschitz condition..IEEE Trans. Automat. Control 68 (2022), 8, 5119-5126. MR 4621780, |
| Reference:
|
[40] Zheng, Y. L., Liu, Q. S.: A review of distributed optimization: Problems, models and algorithms..Neurocomputing 483 (2022), 446-459. |
| Reference:
|
[41] Zhou, S. Y., Wei, Y. H., Liang, S., Cao, J.: A gradient tracking protocol for optimization over nabla fractional multi-agent systems..IEEE Trans. Signal Inform. Process. Networks 10 (2024), 500-512. MR 4756370, |
| . |
