Hybrid Optimisation with Quantum Inspired Evolutionary Algorithm in Multiple Drop Test Simulation – Metamodel Selection and Hyperparameter tuning
Abstract
This study introduces a hybrid optimization framework for the multi-drop testing of a lithium-ion battery enclosure. The framework integrates a Quantum-Inspired Evolutionary Algorithm (QEA) with surrogate modeling techniques. Three types of metamodels were applied—Artificial Neural Networks (ANN), Kriging, and Polynomial Regression (PNR)—using datasets generated via Latin Hypercube Sampling and from prior QEA iterations. The hyperparameters tuning methods are the main part of the paper. Two fitness functions were analyzed, including a logarithmically scaled variant designed to compress the output range for damaged cases and enhance classification accuracy near the damage/no-damage boundary. A dual-model strategy was employed for ANN with model switching determined by a plastic strain threshold. Across datasets, ANN more consistently identified superior individuals compared to Kriging, while PNR occasionally exhibited instability. Two hybrid schemes were implemented: HYBRID1, which enforces finite element model re-evaluation of the best candidate in each iteration, resulting in the lowest minima but with increased variability; and HYBRID2, which minimizes mandatory Finite Element Method (FEM) evaluations and retraining cycles, thereby improving runtime and stability at a slight cost to solution quality. Overall, the combination of QEA with ANN and the proper objective function reduced FEM computational time by an order of magnitude while maintaining decision-making effectiveness, supporting its feasibility for application in industrial design workflows.
Keywords:
quantum-inspired evolutionary algorithm, metamodel, surrogate modeling, artificial neural network, Kriging, polynomial regression, multiple drop test, battery housingReferences
[1] P. Sebastjan, W. Kuś, Method for Parameter Tuning of Hybrid Optimization Algorithms for Problems with High Computational Costs of Objective Function Evaluations, Applied Sciences, 13(10), p. 6307, 2023. https://doi.org/10.3390/app13106307
[2] P. Sebastjan, W. Kuś, For forged automotive components using hybrid optimization techniques, Computer Methods in Materials Science, 21(2), pp. 63–74, 2021. https://doi.org/10.7494/cmms.2021.2.0746
[3] T. Burczyński, W. Kuś, W. Beluch, A. Długosz, A. Poteralski, M. Szczepanik, Intelligent Computing in Optimal Design, Springer International Publishing, Cham, 2020. https://doi.org/10.1007/978-3-030-34161-9
[4] J. Jarosz, A. Długosz, Shape Optimization of the Muffler Shield with Regard to Strength Properties, Engineering Transactions, 71(3), pp. 351–366, 2023. https://doi.org/10.24423/ENGTRANS.3093.20230727
[5] H.-S. Park, X.-P. Dang, Structural optimization based on CAD–CAE integration and metamodeling techniques, Computer-Aided Design, 42(10), pp. 889–902, 2010. https://doi.org/10.1016/j.cad.2010.06.003
[6] I. C. Fatiha, S. P. Santosa, D. Widagdo, A. N. Pratomo, Design Optimisation of Metastructure Configuration for Lithium-Ion Battery Protection Using Machine Learning Methodology, Batteries, 10(2), p. 52, 2024. https://doi.org/10.3390/batteries10020052
[7] S. P. S. Rajput, S. Datta, A review on optimization techniques used in civil engineering material and structure design, Materials Today: Proceedings, 26, pp. 1482–1491, 2020. https://doi.org/10.1016/j.matpr.2020.02.305
[8] W. Kuś, W. Mucha, Memetic Inverse Problem Solution in Cyber-physical Systems, [in:] Advances in Technical Diagnostics, Springer International Publishing, Cham, 2018, pp. 335–341. https://doi.org/10.1007/978-3-319-62042-8_30
[9] A. J. Keane, J. P. Scanlan, Design search and optimization in aerospace engineering, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 365(1859), pp. 2501–2529, 2007. https://doi.org/10.1098/rsta.2007.2019
[10] AI and Machine Learning in Simulation, Dassault Systèmes, 2024. Available: https://www.3ds.com/products/simulia/ai-and-machine-learning-simulation
[11] Ansys AI - AI-Augmented Simulation Technology. Available: https://www.ansys.com/ai
[12] AI and Machine Learning for Engineering Design Generation and Optimization, Default. Available: https://altair.com/resource/ai-and-machine-learning-for-engineering-design-generation-and-optimization
[13] C. Ma, C. Xu, M. Souri, E. Hosseinzadeh, M. Jabbari, Multi-Objective Optimisation of the Battery Box in a Racing Car, Technologies, 12(7), p. 93, 2024. https://doi.org/10.3390/technologies12070093
[14] W. Mucha, Application of dynamic condensation for model order reduction in real-time hybrid simulations, Meccanica, 58(7), pp. 1409–1425, 2023. https://doi.org/10.1007/s11012-023-01675-0
[15] R. Jin, W. Chen, T. W. Simpson, Comparative studies of metamodelling techniques under multiple modelling criteria, Structural and Multidisciplinary Optimization, 23(1), pp. 1–13, 2001. https://doi.org/10.1007/s00158-001-0160-4
[16] A. Rurański, W. Kuś, The Quantum-Inspired Evolutionary Algorithm in the Parametric Optimization of Lithium-Ion Battery Housing in the Multiple-Drop Test, Batteries, 10(9), p. 308, 2024. https://doi.org/10.3390/batteries10090308
[17] Y. Bai, T. Wierzbicki, A new model of metal plasticity and fracture with pressure and Lode dependence, International Journal of Plasticity, 24(6), pp. 1071–1096, 2008. https://doi.org/10.1016/j.ijplas.2007.09.004
[18] A. Dean, M. Morris, J. Stufken, D. Bingham, Latin Hypercubes and Space-Filling Designs, Chapman and Hall/CRC, 2015, pp. 613–646. https://doi.org/10.1201/b18619-27
[19] H. Zhu, L. Liu, T. Long, L. Peng, A novel algorithm of maximin Latin hypercube design using successive local enumeration, Engineering Optimization, 44(5), pp. 551–564, 2012. https://doi.org/10.1080/0305215X.2011.591790
[20] H. Zhong, M. L. Brandeau, G. E. Yazdi, J. Wang, S. Nolen, L. Hagan, W. W. Thompson, S. A. Assoumou, B. P. Linas, J. A. Salomon, Metamodeling for Policy Simulations with Multivariate Outcomes, Medical Decision Making, 42(7), pp. 872–884, 2022. https://doi.org/10.1177/0272989X221105079
[21] B. Iooss, L. Boussouf, V. Feuillard, A. Marrel, Numerical studies of the metamodel fitting and validation processes, International Journal on Advances in Systems and Measurements, 3(1 & 2), pp. 11–21, 2010.
[22] K. Kalita, S. Chakraborty, S. Madhu, M. Ramachandran, X.-Z. Gao, Performance Analysis of Radial Basis Function Metamodels for Predictive Modelling of Laminated Composites, Materials, 14(12), p. 3306, 2021. https://doi.org/10.3390/ma14123306
[23] Novel Tool for Selecting Surrogate Modeling Techniques for Surface Approximation, Elsevier, 2021, pp. 451–456. https://doi.org/10.1016/B978-0-323-88506-5.50071-1
[24] T. Akiba, S. Sano, T. Yanase, T. Ohta, M. Koyama, Optuna: A Next-generation Hyperparameter Optimization Framework, [in:] KDD ’19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, ACM, Anchorage AK USA, 2019, pp. 2623–2631. https://doi.org/10.1145/3292500.3330701
[25] S. Lee, S. Park, T. Kim, Q. X. Lieu, J. Lee, Damage quantification in truss structures by limited sensor-based surrogate model, Applied Acoustics, 172, p. 107547, 2021. https://doi.org/10.1016/j.apacoust.2020.107547
[26] M. Torzoni, A. Manzoni, S. Mariani, A multi-fidelity surrogate model for structural health monitoring exploiting model order reduction and artificial neural networks, Mechanical Systems and Signal Processing, 197, p. 110376, 2023. https://doi.org/10.1016/j.ymssp.2023.110376
[27] M. A. K. Raiaan, S. Sakib, N. M. Fahad, A. A. Mamun, Md. A. Rahman, S. Shatabda, Md. S. H. Mukta, A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks, Decision Analytics Journal, 11, p. 100470, 2024. https://doi.org/10.1016/j.dajour.2024.100470
[28] S. Hanifi, A. Cammarono, H. Zare-Behtash, Advanced hyperparameter optimization of deep learning models for wind power prediction, Renewable Energy, 221, p. 119700, 2024. https://doi.org/10.1016/j.renene.2023.119700
[29] J. Sacks, W. J. Welch, T. J. Mitchell, H. P. Wynn, Design and Analysis of Computer Experiments, Statistical Science, 4(4), 1989. https://doi.org/10.1214/ss/1177012413
[30] M. Hutter, The Loss Rank Principle for Model Selection, N. H. Bshouty, C. Gentile, Eds, Springer Berlin Heidelberg, Berlin, Heidelberg, 2007, pp. 589–603. https://doi.org/10.1007/978-3-540-72927-3_42
[31] B. Wang, X. Ding, F.-Y. Wang, Determination of polynomial degree in the regression of drug combinations, IEEE/CAA Journal of Automatica Sinica, 4(1), pp. 41–47, 2017. https://doi.org/10.1109/JAS.2017.7510319
[32] D. P. Kingma, J. Ba, Adam: A Method for Stochastic Optimization, [in:] Proceedings of the International Conference on Learning Representations (ICLR) 2015, 2015.
