Advances in meta-heuristic methods for large-scale black-box optimization problems
-
摘要: 大型复杂工程装备的优化设计通常为高复杂度、高维度的优化问题，即所谓的大规模黑箱优化问题，其特点是目标函数和/或约束函数解析式不可知且设计变量维度很高。近年来，大规模黑箱优化问题在各领域引起了学者们的兴趣，而元启发式算法被认为是求解该问题的有效方法。为此，全面总结了近年来求解该问题的元启发式算法的研究进展，包括使用与不使用分解策略的元启发式算法，以及处理大规模昂贵优化问题的代理模型辅助元启发式算法，并指出了针对此问题的元启发式求解方法未来可能的研究方向。Abstract: The optimal design of complex engineering equipment usually faces high-complexity, high-dimensional optimization problems – the so-called "large-scale black-box optimization problems (LBOPs)" – which are characterized by unavailable mathematical expressions of objective functions and/or constraint functions, and high dimensionality of design variables. The LBOPs have attracted the interest of scholars in various fields in recent years, and meta-heuristic algorithms are considered effective methods for solving these problems. This paper comprehensively summarizes recent research progress in meta-heuristic algorithms for solving LBOPs, including meta-heuristic algorithms with and without decomposition strategies, and meta-heuristic algorithms for handling computationally expensive large-scale optimization problems. Finally, possible future research directions of meta-heuristic methods for solving LBOPs are proposed.
-
图 5 代理模型与元启发式算法交互示意图
Figure 5. Diagram of interaction between surrogate modle and meta-heuristic algorithm
表 1 大规模黑箱优化问题元启发式算法研究文献汇总
Table 1. Summary of research advances using meta-heuristic algorithms for LBOPs
下载: 导出CSV
表 2 合作协同进化算法研究文献汇总
Table 2. Summary of research advances of CCEA
下载: 导出CSV
-
[1] 卢溦. 双体滑行艇水动力性能优化设计及预报[D]. 哈尔滨: 哈尔滨工程大学, 2013.LU W. The optimization design and prediction of hydrodynamic performance of catamaran planing crafts[D]. Harbin: Harbin Engineering University, 2013 (in Chinese). [2] 毕晓君, 王朝. 基于MOEA/D的船舶水动力性能优化[J]. 哈尔滨工程大学学报, 2018, 39(10): 1681–1687, 1694.BI X J, WANG C. Ship hydrodynamic performance optimization based on MOEA/D[J]. Journal of Harbin Engineering University, 2018, 39(10): 1681–1687, 1694 (in Chinese). [3] 常琦. 基于描述性计算和直接计算方法的油船结构优化设计[D]. 哈尔滨: 哈尔滨工程大学, 2019.CHANG Q. Strcutural optimization for oil tankers based on descriptive and direct calculation[D]. Harbin: Harbin Engineering University, 2019 (in Chinese). [4] 孟松. 基于改进粒子群算法的油船结构优化研究[D]. 大连: 大连海事大学, 2019.MENG S. Oil tanker structure optimization research based on improved particle swarm optimization algorithm[D]. Dalian: Dalian Maritime University, 2019 (in Chinese). [5] 宋翔, 余培汛, 白俊强, 等. 基于Hanson噪声模型的螺旋桨气动与噪声优化设计[J]. 西北工业大学学报, 2020, 38(4): 685–694. doi: 10.3969/j.issn.1000-2758.2020.04.001SONG X, YU P X, BAI J Q, et al. Aerodynamic and aeroacoustic optimization of propeller based on Hanson noise model[J]. Journal of Northwestern Polytechnical University, 2020, 38(4): 685–694 (in Chinese). doi: 10.3969/j.issn.1000-2758.2020.04.001 [6] BLUM C, ROLI A. Metaheuristics in combinatorial optimization: overview and conceptual comparison[J]. ACM Computing Surveys, 2003, 35(3): 268–308. doi: 10.1145/937503.937505 [7] HOLLAND J H. Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence[M]. Cambridge, MA: MIT Press, 1992. [8] STORN R, PRICE K. Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces[J]. Journal of Global Optimization, 1997, 11(4): 341–359. doi: 10.1023/A:1008202821328 [9] EBERHART R, KENNEDY J. A new optimizer using particle swarm theory[C]//MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science. Nagoya, Japan: IEEE, 1995: 39–43. [10] RECHENBERG I. Evolutionsstrategien[M]//SCHNEIDER B, RANFT U. Simulations method en in Der Medizin Und Biologie. Berlin, Heidelberg: Springer, 1978: 83–114. [11] TANG K, LI X D, SUGANTHAN P N, et al. Benchmark functions for the CEC'2010 special session and competition on large-scale global optimization[EB/OL]. (2010-01-08)[2021-03-29]Hefei, China: Nature Inspired Computation and Applications Laboratory, USTC, 2010. https://titan.csit.rmit.edu.au/~e46507/publications/lsgo-cec10.pdf. [12] ZHANG J Q, SANDERSON A C. Jade: Adaptive differential evolution with optional external archive[J]. IEEE Transactions on Evolutionary Computation, 2009, 13(5): 945–958. doi: 10.1109/TEVC.2009.2014613 [13] TAKAHAMA T, SAKAI S. Large scale optimization by differential evolution with landscape modality detection and a diversity archive[C]//2012 IEEE Congress on Evolutionary Computation. Brisbane, QLD, Australia: IEEE, 2012: 1–8. [14] BREST J, ZAMUDA A, BOSKOVIC B, et al. High-dimensional real-parameter optimization using self-adaptive differential evolution algorithm with population size reduction[C]//2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). Hong Kong, China: IEEE, 2008: 2032–2039. [15] WANG Y, CAI Z X, ZHANG Q F. Enhancing the search ability of differential evolution through orthogonal crossover[J]. Information Sciences, 2012, 185(1): 153–177. doi: 10.1016/j.ins.2011.09.001 [16] ZAMUDA A, BREST J, BOSKOVIC B, et al. Large scale global optimization using differential evolution with self-adaptation and cooperative co-evolution[C]//2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). Hong Kong, China: IEEE, 2008: 3718–3725. [17] YANG Z Y, TANG K, YAO X. Scalability of generalized adaptive differential evolution for large-scale continuous optimization[J]. Soft Computing, 2011, 15(11): 2141–2155. doi: 10.1007/s00500-010-0643-6 [18] 徐广治. 非线性群智能优化及其应用研究[D]. 北京: 北京邮电大学, 2019.XU G Z. Research on nonlinear swarm intelligence optimization and application[D]. Beijing: University of Posts and Telecommunications, 2019 (in Chinese). [19] GARCÍA-MARTÍNEZ C, RODRÍGUEZ F J, LOZANO M. Role differentiation and malleable mating for differential evolution: An analysis on large-scale optimisation[J]. Soft Computing, 2011, 15(11): 2109–2126. doi: 10.1007/s00500-010-0641-8 [20] ZHAO S Z, SUGANTHAN P N, DAS S. Self-adaptive differential evolution with multi-trajectory search for large-scale optimization[J]. Soft Computing, 2011, 15(11): 2175–2185. doi: 10.1007/s00500-010-0645-4 [21] YOU X M. Differential evolution with a new mutation operator for solving high dimensional continuous optimization problems[J]. Journal of Computational Information Systems, 2010, 6(9): 3033–3039. [22] GOMEZ J, GARCIA A, SILVA C. COFRE: A fuzzy rule coevolutionary approach for multiclass classification problems[C]//2005 IEEE Congress on Evolutionary Computation. Edinburgh, UK: IEEE, 2005: 1637–1644. [23] PIOTROWSKI A P, NAPIORKOWSKI J J, KICZKO A. Differential evolution algorithm with separated groups for multi-dimensional optimization problems[J]. European Journal of Operational Research, 2012, 216(1): 33–46. doi: 10.1016/j.ejor.2011.07.038 [24] RAHNAMAYAN S, TIZHOOSH H R, SALAMA M M A. Opposition-based differential evolution[J]. IEEE Transactions on Evolutionary Computation, 2008, 12(1): 64–79. doi: 10.1109/TEVC.2007.894200 [25] WEBER M, NERI F, TIRRONEN V. Shuffle or update parallel differential evolution for large-scale optimization[J]. Soft Computing, 2011, 15(11): 2089–2107. doi: 10.1007/s00500-010-0640-9 [26] YILDIZ Y E, TOPAL A O. Large scale continuous global optimization based on micro differential evolution with local directional search[J]. Information Sciences, 2019, 477: 533–544. doi: 10.1016/j.ins.2018.10.046 [27] BREST J, BOŠKOVIĆ B, ZAMUDA A, et al. Self-adaptive differential evolution algorithm with a small and varying population size[C]//2012 IEEE Congress on Evolutionary Computation. Brisbane, QLD, Australia: IEEE, 2012, . [28] HIBA H, IBRAHIM A, RAHNAMAYAN S. Large-scale optimization using center-based differential evolution with dynamic mutation scheme[C]//2019 IEEE Congress on Evolutionary Computation (CEC). Wellington, New Zealand: IEEE, 2019: 3189–3196. [29] YANG Q, CHEN W N, DA DENG J, et al. A level-based learning swarm optimizer for large-scale optimization[J]. IEEE Transactions on Evolutionary Computation, 2018, 22(4): 578–594. doi: 10.1109/TEVC.2017.2743016 [30] HSIEH S T, SUN T Y, LIU C C, et al. Solving large scale global optimization using improved particle swarm optimizer[C]//2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). Hong Kong, China: IEEE, 2008: 1777–1784. [31] GARCÍA-NIETO J, ALBA E. Restart particle swarm optimization with velocity modulation: A scalability test[J]. Soft Computing, 2011, 15(11): 2221–2232. doi: 10.1007/s00500-010-0648-1 [32] CHENG R, JIN Y C. A competitive swarm optimizer for large scale optimization[J]. IEEE Transactions on Cybernetics, 2015, 45(2): 191–204. doi: 10.1109/TCYB.2014.2322602 [33] 周建宏. 面向大规模全局优化问题的元启发式算法研究[D]. 无锡: 江南大学, 2017.ZHOU J H. Study of meta-heuristic algorithm for large scale global optimization problems[D]. Wuxi: Jiangnan University, 2017 (in Chinese). [34] CHU W, GAO X G, SOROOSHIAN S. Handling boundary constraints for particle swarm optimization in high-dimensional search space[J]. Information Sciences, 2011, 181(20): 4569–4581. doi: 10.1016/j.ins.2010.11.030 [35] WANG H, WU Z J, RAHNAMAYAN S, et al. Enhancing particle swarm optimization using generalized opposition-based learning[J]. Information Sciences, 2011, 181(20): 4699–4714. doi: 10.1016/j.ins.2011.03.016 [36] TIAN Y, ZHENG X T, ZHANG X Y, et al. Efficient large-scale multiobjective optimization based on a competitive swarm optimizer[J]. IEEE Transactions on Cybernetics, 2020, 50(8): 3696–3708. doi: 10.1109/TCYB.2019.2906383 [37] HUANG H, LV L, YE S J, et al. Particle swarm optimization with convergence speed controller for large-scale numerical optimization[J]. Soft Computing, 2019, 23(12): 4421–4437. doi: 10.1007/s00500-018-3098-9 [38] WANG Z J, ZHAN Z H, YU W J, et al. Dynamic group learning distributed particle swarm optimization for large-scale optimization and its application in cloud workflow scheduling[J]. IEEE Transactions on Cybernetics, 2020, 50(6): 2715–2729. doi: 10.1109/TCYB.2019.2933499 [39] DENG H B, PENG L Z, ZHANG H B, et al. Ranking-based biased learning swarm optimizer for large-scale optimization[J]. Information Sciences, 2019, 493: 120–137. doi: 10.1016/j.ins.2019.04.037 [40] MOLINA D, LOZANO M, HERRERA F. MA-SW-chains: Memetic algorithm based on local search chains for large scale continuous global optimization[C]//IEEE Congress on Evolutionary Computation. Barcelona, Spain: IEEE, 2010: 1–8. [41] MOLINA D, LOZANO M, GARCÍA-MARTÍNEZ C, et al. Memetic algorithms for continuous optimisation based on local search chains[J]. Evolutionary Computation, 2010, 18(1): 27–63. doi: 10.1162/evco.2010.18.1.18102 [42] LATORRE A, MUELAS S, PEÑA J M. Large scale global optimization: Experimental results with mos-based hybrid algorithms[C]//2013 IEEE Congress on Evolutionary Computation (CEC). Cancun, Mexico: IEEE, 2013: 2742–2749. [43] BOLUFÉ-RÖHLER A, CHEN S. Extending minimum population search towards large scale global optimization[C]//2014 IEEE Congress on Evolutionary Computation (CEC). Beijing, China: IEEE, 2014: 845–852. [44] ROS R, HANSEN N. A simple modification in CMA-ES achieving linear time and space complexity[C]//Parallel Problem Solving from Nature-PPSN X. Berlin, Heidelberg: Springer, 2008, 5199: 296. [45] MOLINA D, LOZANO M, SÁNCHEZ A M, et al. Memetic algorithms based on local search chains for large scale continuous optimisation problems: Ma-ssw-chains[J]. Soft Computing, 2011, 15(11): 2201–2220. doi: 10.1007/s00500-010-0647-2 [46] TSENG L Y, CHEN C. Multiple trajectory search for large scale global optimization[C]//2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). Hong Kong, China: IEEE, 2008. [47] WANG Y, LI B. A restart univariate estimation of distribution algorithm: Sampling under mixed gaussian and levy probability distribution[C]//2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). Hong Kong, China: IEEE, 2008: 3917–3924. [48] BAŞ E, ÜLKER E. Improved social spider algorithm for large scale optimization[J]. Artificial Intelligence Review, 2020. [49] LI Z H, ZHANG Q F, LIN X, et al. Fast covariance matrix adaptation for large-scale black-box optimization[J]. IEEE Transactions on Cybernetics, 2020, 50(5): 2073–2083. doi: 10.1109/TCYB.2018.2877641 [50] POTTER M A, DE JONG K A. A cooperative coevolutionary approach to function optimization[M]//DAVIDOR Y, SCHWEFEL H P, MÄNNER R. International Conference on Evolutionary Computation the Third Conference on Parallel Problem Solving from Nature. Jerusalem. Israel: Springer, 1994: 249–257. [51] YANG Z Y, TANG K, YAO X. Large scale evolutionary optimization using cooperative coevolution[J]. Information Sciences, 2008, 178(15): 2985–2999. doi: 10.1016/j.ins.2008.02.017 [52] YANG Z Y, TANG K, YAO X. Multilevel cooperative coevolution for large scale optimization[C]//2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). Hong Kong, China: IEEE, 2008. [53] OMIDVAR M N, LI X D, YANG Z Y, et al. Cooperative co-evolution for large scale optimization through more frequent random grouping[C]//IEEE Congress on Evolutionary Computation (CEC). Barcelona, Spain: IEEE, 2010. [54] LI X D, YAO X. Tackling high dimensional nonseparable optimization problems by cooperatively coevolving particle swarms[C]//2009 IEEE Congress on Evolutionary Computation. Trondheim, Norway: IEEE, 2009. [55] YANG Z Y, ZHANG J Q, TANG K, et al. An adaptive coevolutionary differential evolution algorithm for large-scale optimization[C]//2009 IEEE Congress on Evolutionary Computation. Trondheim, Norway: IEEE, 2009. [56] REN Y F, WU Y. An efficient algorithm for high-dimensional function optimization[J]. Soft Computing, 2013, 17(6): 995–1004. doi: 10.1007/s00500-013-0984-z [57] RAY T, YAO X. A cooperative coevolutionary algorithm with correlation based adaptive variable partitioning[C]//2009 IEEE Congress on Evolutionary Computation. Trondheim, Norway: IEEE, 2009. [58] SINGH H K, RAY T. Divide and conquer in coevolution: a difficult balancing act[M]//Agent-Based Evolutionary Search. Berlin, Heidelberg, Germany: Springer, 2010: 117–138. [59] CHEN W X, WEISE T, YANG Z Y, et al. Large-scale global optimization using cooperative coevolution with variable interaction learning[M]//SCHAEFER R, COTTA C, KOŁODZIEJ J, et al. PPSN'10: Proceedings of the 11th International Conference on Parallel Problem Solving from Nature: Part II. Berlin, Heidelberg: Springer, 2010, 6239: 300–309. [60] OMIDVAR M N, LI X D, YAO X. Cooperative co-evolution with delta grouping for large scale non-separable function optimization[C]//IEEE Congress on Evolutionary Computation (CEC). Barcelona, Spain: IEEE, 2010. [61] OMIDVAR M N, LI X D, MEI Y, et al. Cooperative co-evolution with differential grouping for large scale optimization[J]. IEEE Transactions on Evolutionary Computation, 2014, 18(3): 378–393. doi: 10.1109/TEVC.2013.2281543 [62] MEI Y, OMIDVAR M N, LI X D, et al. A competitive divide-and-conquer algorithm for unconstrained large-scale black-box optimization[J]. ACM Transactions on Mathematical Software, 2016, 42(2): 13. [63] SUN Y, KIRLEY M, HALGAMUGE S K. Extended differential grouping for large scale global optimization with direct and indirect variable interactions[C]//GECCO'15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation. New York, NY, USA: ACM, 2015: 313–320. [64] OMIDVAR M N, YANG M, MEI Y, et al. DG2: A faster and more accurate differential grouping for large-scale black-box optimization[J]. IEEE Transactions on Evolutionary Computation, 2017, 21(6): 929–942. doi: 10.1109/TEVC.2017.2694221 [65] 刘礼文. 求解大规模全局优化问题的高效算法研究[D]. 西安: 西安电子科技大学, 2019.LIU L W. Research on efficient algorithms for solving large scale global optimization problems[D]. Xi'an: Xidian University, 2019 (in Chinese). [66] SUN Y, KIRLEY M, HALGAMUGE S K. A recursive decomposition method for large scale continuous optimization[J]. IEEE Transactions on Evolutionary Computation, 2018, 22(5): 647–661. doi: 10.1109/TEVC.2017.2778089 [67] SUN Y, LI X D, ERNST A, et al. Decomposition for large-scale optimization problems with overlapping components[C]//2019 IEEE Congress on Evolutionary Computation (CEC). Wellington, New Zealand: IEEE, 2019: 326–333. [68] SUN Y, OMIDVAR M N, KIRLEY M, et al. Adaptive threshold parameter estimation with recursive differential grouping for problem decomposition[C]//Proceedings of the Genetic and Evolutionary Computation Conference. New York, NY, USA: ACM, 2018: 889–896. [69] YANG M, ZHOU A M, LI C H, et al. An efficient recursive differential grouping for large-scale continuous problems[J]. IEEE Transactions on Evolutionary Computation, 2021, 25(1): 159–171. doi: 10.1109/TEVC.2020.3009390 [70] TSUTSUI S, GOLDBERG D E. Simplex crossover and linkage identification: Single-stage evolution vs. Multi-stage evolution[C]//Proceedings of the 2002 Congress on Evolutionary Computation CEC'02 (Cat. No. 02TH8600). Honolulu, HI, USA: IEEE, 2002: 974–979. [71] SUN J J, DONG H B. Cooperative co-evolution with correlation identification grouping for large scale function optimization[C]//2013 IEEE Third International Conference on Information Science and Technology (ICIST). Yangzhou, China: IEEE, 2013: 889–893. [72] SUN Y, KIRLEY M, HALGAMUGE S K. Quantifying variable interactions in continuous optimization problems[J]. IEEE Transactions on Evolutionary Computation, 2017, 21(2): 249–264. doi: 10.1109/TEVC.2016.2599164 [73] YU T L, GOLDBERG D E, SASTRY K, et al. Dependency structure matrix, genetic algorithms, and effective recombination[J]. Evolutionary Computation, 2009, 17(4): 595–626. doi: 10.1162/evco.2009.17.4.17409 [74] LI X D, YAO X. Cooperatively coevolving particle swarms for large scale optimization[J]. IEEE Transactions on Evolutionary Computation, 2012, 16(2): 210–224. doi: 10.1109/TEVC.2011.2112662 [75] LICHBACH M I. The Cooperator's Dilemma[M]. Ann Arbor: University of Michigan Press, 1996. [76] PANAIT L, LUKE S. Selecting informative actions improves cooperative multiagent learning[C]//Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems. New York, NY, USA: ACM, 2006: 760–766. [77] LUKE S, SULLIVAN K, ABIDI F. Large scale empirical analysis of cooperative coevolution[C]//Proceedings of the 13th Annual Conference Companion on Genetic and Evolutionary Computation. New York, NY, USA: ACM, 2011: 151–152. [78] DE OLIVEIRA F B, ENAYATIFAR R, SADAEI H J, et al. A cooperative coevolutionary algorithm for the multi-depot vehicle routing problem[J]. Expert Systems with Applications, 2016, 43: 117–130. doi: 10.1016/j.eswa.2015.08.030 [79] PANAIT L, LUKE S, HARRISON J F. Archive-based cooperative coevolutionary algorithms[C]//GECCO’06: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation. New York, NY, USA: ACM, 2006: 345–352. [80] TAN K C, YANG Y J, GOH C K. A distributed cooperative coevolutionary algorithm for multiobjective optimization[J]. IEEE Transactions on Evolutionary Computation, 2006, 10(5): 527–549. doi: 10.1109/TEVC.2005.860762 [81] AU C K, LEUNG H F. Investigating collaboration methods of random immigrant scheme in cooperative coevolution[C]//2009 IEEE Congress on Evolutionary Computation. Trondheim, Norway: IEEE, 2009: 2700–2707. [82] GLORIEUX E, SVENSSON B, DANIELSSON F, et al. Improved constructive cooperative coevolutionary differential evolution for large-scale optimisation[C]//2015 IEEE Symposium Series on Computational Intelligence. Cape Town, South Africa: IEEE, 2015: 1703–1710. [83] SON Y S, BALDICK R. Hybrid coevolutionary programming for nash equilibrium search in games with local optima[J]. IEEE Transactions on Evolutionary Computation, 2004, 8(4): 305–315. doi: 10.1109/TEVC.2004.832862 [84] SEREDYNSKI F. Loosely coupled distributed genetic algorithms[M]//DAVIDOR Y, SCHWEFEL H P, MÄNNER R. International Conference on Evolutionary Computation the Third Conference on Parallel Problem Solving from Nature Jerusalem. Jerusalem, Israel: Springer, 1994: 514–523. [85] MA X L, LIU F, QI Y T, et al. A multiobjective evolutionary algorithm based on decision variable analyses for multiobjective optimization problems with large-scale variables[J]. IEEE Transactions on Evolutionary Computation, 2016, 20(2): 275–298. doi: 10.1109/TEVC.2015.2455812 [86] PANAIT L, LUKE S. A comparative study of two competitive fitness functions[C]// Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002). CA: Morgan Kaufmann, 2002: 503–511. [87] PANAIT L, WIEGAND R P, LUKE S. Improving coevolutionary search for optimal multiagent behaviors[C]//Proceedings of the 18th International Joint Conference on Artificial Intelligence. San Francisco, CA, USA: ACM, 2003: 653–660. [88] BUCCI A, POLLACK J B. On identifying global optima in cooperative coevolution[C]//GECCO 05: Genetic and Evolutionary Computation Conference. Washington DC, USA: ACM, 2005: 539–544. [89] SHI M. Comparison of sorting algorithms for multi-fitness measurement of cooperative coevolution[C]//Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference. Montréal, Québec, Canada: ACM, 2009: 2583–2588. [90] SHI M, GAO S. Reference sharing: A new collaboration model for cooperative coevolution[J]. Journal of Heuristics, 2017, 23(1): 1–30. doi: 10.1007/s10732-016-9322-9 [91] SHI M, WU H F. Pareto cooperative coevolutionary genetic algorithm using reference sharing collaboration[C]//GECCO09: Genetic and Evolutionary Computation Conference. New York, NY, USA: ACM, 2009: 867–874. [92] MORIARTY D E, MIIKKULAINEN R. Forming neural networks through efficient and adaptive coevolution[J]. Evolutionary Computation, 1997, 5(4): 373–399. doi: 10.1162/evco.1997.5.4.373 [93] WIEGAND R P, LILES W C, DE JONG K A. An empirical analysis of collaboration methods in cooperative coevolutionary algorithms[C]//Proceedings of the 3rd Annual Conference on Genetic and Evolutionary Computation (GECCO). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 2001: 1235–1245. [94] FICICI S G, POLLACK J B. Pareto optimality in coevolutionary learning[M]//KELEMEN J, SOSÍK P. 6th European Conference, ECAL 2001. Prague, Czech Republic: Springer, 2001, 2159: 316–325. [95] DE JONG E D. Towards a bounded pareto-coevolution archive[C]//Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No. 04TH8753). Portland, OR, USA: IEEE, 2004: 2341–2348. [96] HAMEED A, CORNE D, MORGAN D, et al. Large-scale optimization: Are co-operative co-evolution and fitness inheritance additive?[C]//2013 13th UK Workshop on Computational Intelligence (UKCI). Guildford, UK: IEEE, 2013: 104–111. [97] HAMEED A H A, KONONOVA A, CORNE D. Engineering fitness inheritance and co-operative evolution into state-of-the-art optimizers[C]//2015 IEEE Symposium Series on Computational Intelligence. Cape Town, South Africa: IEEE, 2015: 1695–1702. [98] GOH C K, TAN K C. A competitive-cooperative coevolutionary paradigm for dynamic multiobjective optimization[J]. IEEE Transactions on Evolutionary Computation, 2009, 13(1): 103–127. doi: 10.1109/TEVC.2008.920671 [99] IORIO A W, LI X D. A cooperative coevolutionary multiobjective algorithm using non-dominated sorting[M]//Genetic and Evolutionary Computation Conference-Gecco 2004, Pt 1, Proceedings. Seattle, WA, USA: Springer, 2004, 3102: 537–548. [100] TAN K C, LEE T H, YANG Y J, et al. A cooperative coevolutionary algorithm for multiobjective optimization[C]//2004 IEEE International Conference on Systems, Man & Cybernetics (IEEE Cat. No. 04CH37583). Hague, Netherland: IEEE, 2004: 1926–1931. [101] WIEGAND R P. Applying diffusion to a cooperative coevolutionary model[C]// International Conference on Parallel Problem Solving from Nature. Springer, Berlin, Heidelberg, 1998: 560–569. [102] OMIDVAR M N, LI X D, YAO X. Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms[C]//Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation. New York, NY, USA: ACM, 2011: 1115–1122. [103] OMIDVAR M N, KAZIMIPOUR B, LI X D, et al. Cbcc3—a contribution-based cooperative co-evolutionary algorithm with improved exploration/exploitation balance[C]//2016 IEEE Congress on Evolutionary Computation (CEC). Vancouver, BC, Canada: IEEE, 2016: 3541–3548. [104] 关世伟. 大规模全局优化问题的高效算法研究[D]. 西安: 西安电子科技大学, 2018.GUAN S W. Efficient algorithms for large scale global optimization[D]. Xi'an: Xidian University, 2018 (in Chinese). [105] CUI M J, LI L, SHI M J. A selective biogeography-based optimizer considering resource allocation for large-scale global optimization[J]. Computational Intelligence and Neuroscience, 2019: 1240162. [106] MÜHLENBEIN H, PAAß G. From recombination of genes to the estimation of distributions I. Binary parameters[C]//International Conference on Evolutionary Computation—The 4th International Conference on Parallel Problem Solving from Nature. Berlin, Germany: Springer, 1996: 178–187. [107] PELIKAN M, GOLDBERG D E, CANTÚ-PAZ E. BOA: The bayesian optimization algorithm[C]//GECCO'99: Proceedings of the 1st Annual Conference on Genetic and Evolutionary Computation. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1999: 525–532. [108] HARIK G R, LOBO F G, GOLDBERG D E. The compact genetic algorithm[J]. IEEE Transactions on Evolutionary Computation, 1999, 3(4): 287–297. doi: 10.1109/4235.797971 [109] Baluja S. Population-based incremental learning. a method for integrating genetic search based function optimization and competitive learning[R]. Carnegie-Mellon Univ Pittsburgh Pa Dept of Computer Science, 1994. [110] DONG W S, CHEN T S, TIŇO P, et al. Scaling up estimation of distribution algorithms for continuous optimization[J]. IEEE Transactions on Evolutionary Computation, 2013, 17(6): 797–822. doi: 10.1109/TEVC.2013.2247404 [111] XU Q, SANYANG M L, KABÁN A. Large scale continuous EDA using mutual information[C]//2016 IEEE Congress on Evolutionary Computation (CEC). Vancouver, BC, Canada: IEEE, 2016: 3718–3725. [112] YANG P, TANG K, YAO X. Turning high-dimensional optimization into computationally expensive optimization[J]. IEEE Transactions on Evolutionary Computation, 2018, 22(1): 143–156. doi: 10.1109/TEVC.2017.2672689 [113] YANG P, TANG K, YAO X. A parallel divide-and-conquer-based evolutionary algorithm for large-scale optimization[J]. IEEE Access, 2019, 7: 163105–163118. doi: 10.1109/ACCESS.2019.2938765 [114] MÜHLENBEIN H, MAHNIG T. FDA-a scalable evolutionary algorithm for the optimization of additively decomposed functions[J]. Evolutionary Computation, 1999, 7(4): 353–376. doi: 10.1162/evco.1999.7.4.353 [115] ZHANG Q F. On stability of fixed points of limit models of univariate marginal distribution algorithm and factorized distribution algorithm[J]. IEEE Transactions on Evolutionary Computation, 2004, 8(1): 80–93. doi: 10.1109/TEVC.2003.819431 [116] SCHAFFER J D, MORISHIMA A. An adaptive crossover distribution mechanism for genetic algorithms[C]//Proceedings of the Second International Conference on Genetic Algorithms on Genetic Algorithms and Their Application. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc, 1987: 36–40. [117] LEVENICK J. Metabits: Generic endogenous crossover control[C]//Proceedings of the Sixth International Conference on Genetic Algorithms. San Francisco, CA, United States: Morgan Kaufmann Publishers Inc., 1995. [118] SMITH J, FOGARTY T C. Recombination strategy adaptation via evolution of gene linkage[C]//Proceedings of IEEE International Conference on Evolutionary Computation. Nagoya, Japan: IEEE, 1996: 826–831. [119] SOLIS F J, WETS R J B. Minimization by random search techniques[J]. Mathematics of Operations Research, 1981, 6(1): 19–30. doi: 10.1287/moor.6.1.19 [120] HANSEN N, OSTERMEIER A. Completely derandomized self-adaptation in evolution strategies[J]. Evolutionary Computation, 2001, 9(2): 159–195. doi: 10.1162/106365601750190398 [121] OMIDVAR M N, LI X D. A comparative study of CMA-ES on large scale global optimisation[C]//23rd Australasian Joint Conference on Artificial Intelligence. Adelaide, Australia: Springer, 2010. [122] MAHDAVI S, SHIRI M E, RAHNAMAYAN S. Metaheuristics in large-scale global continues optimization: A survey[J]. Information Sciences, 2015, 295: 407–428. doi: 10.1016/j.ins.2014.10.042 [123] LATORRE A, MUELAS S, PEÑA J M. A comprehensive comparison of large scale global optimizers[J]. Information Sciences, 2015, 316: 517–549. doi: 10.1016/j.ins.2014.09.031 [124] WEISE T, CHIONG R, TANG K. Evolutionary optimization: Pitfalls and booby traps[J]. Journal of Computer Science and Technology, 2012, 27(5): 907–936. doi: 10.1007/s11390-012-1274-4 [125] AUGER A, HANSEN N, MAUNY N, et al. Bio-inspired continuous optimization: the coming of age[C]//CEC 2007. Piscataway, NJ, USA: [s.n.], 2007. [126] TOINT P L. Test problems for partially separable optimization and results for the routine pspmin[R]. Belgium: The University of Namur, Department of Mathematics, 1983. [127] MA X L, LI X D, ZHANG Q F, et al. A survey on cooperative co-evolutionary algorithms[J]. IEEE Transactions on Evolutionary Computation, 2019, 23(3): 421–441. doi: 10.1109/TEVC.2018.2868770 [128] TEZUKA M, MUNETOMO M, AKAMA K. Linkage identification by nonlinearity check for real-coded genetic algorithms[M]//DEB K. Genetic and Evolutionary Computation Conference. Seattle, WA, USA: Springer, 2004, 3103: 222–233. [129] PENG X G, JIN Y C, WANG H D. Multimodal optimization enhanced cooperative coevolution for large-scale optimization[J]. IEEE Transactions on Cybernetics, 2019, 49(9): 3507–3520. doi: 10.1109/TCYB.2018.2846179 [130] SAYED E, ESSAM D, SARKER R. Using hybrid dependency identification with a memetic algorithm for large scale optimization problems[C]//9th International Conference, SEAL 2012. Hanoi, Vietnam: Springer, 2012: 168–177. [131] WEICKER K, WEICKER N. On the improvement of coevolutionary optimizers by learning variable interdependencies[C]//Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406). Washington, DC, USA: IEEE, 1999: 1627–1632. [132] WU X J, WANG Y P, LIU J H, et al. A new hybrid algorithm for solving large scale global optimization problems[J]. IEEE Access, 2019, 7: 103354–103364. doi: 10.1109/ACCESS.2019.2931824 [133] CAI X W, GAO L, LI X Y. Efficient generalized surrogate-assisted evolutionary algorithm for high-dimensional expensive problems[J]. IEEE Transactions on Evolutionary Computation, 2020, 24(2): 365–379. doi: 10.1109/TEVC.2019.2919762 [134] YANG Z, QIU H B, GAO L, et al. A surrogate-assisted particle swarm optimization algorithm based on efficient global optimization for expensive black-box problems[J]. Engineering Optimization, 2019, 51(4): 549–566. doi: 10.1080/0305215X.2018.1477940 [135] BOUHLEL M A, BARTOLI N, REGIS R, et al. Efficient global optimization for high-dimensional constrained problems by using the kriging models combined with the partial least squares method[J]. Engineering Optimization, 2018, 50(12): 2038–2053. doi: 10.1080/0305215X.2017.1419344 [136] JIN Y C. Surrogate-assisted evolutionary computation: Recent advances and future challenges[J]. Swarm and Evolutionary Computation, 2011, 1(2): 61–70. doi: 10.1016/j.swevo.2011.05.001 [137] ZHAN D W, XING H L. Expected improvement for expensive optimization: A review[J]. Journal of Global Optimization, 2020, 78(3): 507–544. doi: 10.1007/s10898-020-00923-x [138] LIU B, ZHANG Q F, GIELEN G G E. A gaussian process surrogate model assisted evolutionary algorithm for medium scale expensive optimization problems[J]. IEEE Transactions on Evolutionary Computation, 2014, 18(2): 180–192. doi: 10.1109/TEVC.2013.2248012 [139] SUN C L, DING J L, ZENG J C, et al. A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems[J]. Memetic Computing, 2018, 10(2): 123–134. doi: 10.1007/s12293-016-0199-9 [140] TENNE Y, IZUI K, NISHIWAKI S. Dimensionality-reduction frameworks for computationally expensive problems[C]//2010 IEEE Congress on Evolutionary Computation. Barcelona, Spain: IEEE, 2010. [141] SUN C L, JIN Y C, CHENG R, et al. Surrogate-assisted cooperative swarm optimization of high-dimensional expensive problems[J]. IEEE Transactions on Evolutionary Computation, 2017, 21(4): 644–660. doi: 10.1109/TEVC.2017.2675628 [142] YU H B, TAN Y C, ZENG J C, et al. Surrogate-assisted hierarchical particle swarm optimization[J]. Information Sciences, 2018, 454-455: 59–72. doi: 10.1016/j.ins.2018.04.062 [143] FU G X, SUN C L, TAN Y, et al. A surrogate-assisted evolutionary algorithm with random feature selection for large-scale expensive problems[M]//BÄCK T, PREUSS M, DEUTZ A, et al. Parallel Problem Solving from Nature – PPSN XVI. Cham: Springer, 2020: 125–139. [144] 陈祺东. 基于QPSO算法求解复杂优化问题的策略研究[D]. 无锡: 江南大学, 2020.CHEN Q D. Strategies of solving complex optimization problems based on QPSO algorithm[D]. Wuxi: Jiangnan University, 2020 (in Chinese). [145] WANG X J, WANG G G, SONG B W, et al. A novel evolutionary sampling assisted optimization method for high-dimensional expensive problems[J]. IEEE Transactions on Evolutionary Computation, 2019, 23(5): 815–827. doi: 10.1109/TEVC.2019.2890818 [146] DONG H C, DONG Z M. Surrogate-assisted grey wolf optimization for high-dimensional, computationally expensive black-box problems[J]. Swarm and Evolutionary Computation, 2020, 57: 100713. doi: 10.1016/j.swevo.2020.100713 [147] WERTH B, PITZER E, AFFENZELLER M. Enabling high-dimensional surrogate-assisted optimization by using sliding windows[C]//Proceedings of the Genetic and Evolutionary Computation Conference Companion. Berlin, Germany, Deutschland: ACM, 2017: 1630–1637. [148] REN Z G, PANG B, WANG M Y, et al. Surrogate model assisted cooperative coevolution for large scale optimization[J]. Applied Intelligence, 2019, 49(2): 513–531. doi: 10.1007/s10489-018-1279-y [149] BLANCHARD J, BEAUTHIER C, CARLETTI T. A surrogate-assisted cooperative co-evolutionary algorithm for solving high dimensional, expensive and black box optimization problems[M]//RODRIGUES H C, HERSKOVITS J, MOTA SOARES C M, et al. EngOpt 2018 Proceedings of the 6th International Conference on Engineering Optimization. Cham: Springer, 2019: 41–52. [150] BLANCHARD J, BEAUTHIER C, CARLETTI T. A surrogate-assisted cooperative co-evolutionary algorithm using recursive differential grouping as decomposition strategy[C]//2019 IEEE Congress on Evolutionary Computation (CEC). Wellington, New Zealand: IEEE, 2019: 689–696. [151] DE FALCO I, CIOPPA A D, TRUNFIO G A. Investigating surrogate-assisted cooperative coevolution for large-scale global optimization[J]. Information Sciences, 2019, 482: 1–26. doi: 10.1016/j.ins.2019.01.009 -
点击查看大图
图(5) / 表(3)
计量
- 文章访问数: 1017
- HTML全文浏览量: 235
- PDF下载量: 188
- 被引次数: 0
