Cost-Normalized Constrained Surrogate Search for a Fed-Batch Model: Reported Sequential and Batch Comparisons
Downloads
Abstract
Sequential surrogate search can help allocate limited evaluations of a constrained bioprocess model. This study reports SURA, a cost-normalized feasible-improvement heuristic with greedy batches and a training-feasibility audit. The numerical record compares five methods on a deterministic four-variable fed-batch surrogate and two constrained analytic problems, using 150 evaluations and ten seeds per configured method–problem pair. On the bioprocess problem, SURA’s best feasible endpoint titer is 18.804 ± 0.176 g/L, compared with 19.152 ± 0.193 g/L for sequential GP-EI and 14.678 ± 2.244 g/L for budget-matched random search. The reported signed-rank comparisons favor GP-EI over SURA and SURA over random search (Holm p = 0.0078 for each). Disabling batching gives a reported finite-reference difference of −1.172 ± 0.191 g/L versus −0.756 ± 0.176 for the full method, but aggregate ablations do not uniquely identify model staleness as the cause. The audit did not trigger, and its fallback was not validated. The implemented kernel is RBF plus a white-noise term; there are no biological interaction contexts, assay-noise observations or cross-program portfolio decisions in these tests. Budgets are evaluation counts rather than equal cumulative costs. Negative reference differences indicate exceeding a finite random-search sample, not a certified optimum. Original simulator, random-stream, acquisition and plot-generation records remain necessary for reproducibility verification.
Keywords
Constrained optimization Gaussian processes Fed-batch simulation Feasible improvement Cost normalization Batch searchReferences (39)
- [1] Ro, D. K., Paradise, E. M., Ouellet, M., Fisher, K. J., Newman, K. L., Ndungu, J. M., ... & Keasling, J. D. (2006). Production of the antimalarial drug precursor artemisinic acid in engineered yeast. Nature, 440(7086), 940-943. https://doi.org/10.1038/nature04640.
- [2] Peralta-Yahya, P. P., Zhang, F., Del Cardayre, S. B., & Keasling, J. D. (2012). Microbial engineering for the production of advanced biofuels. Nature, 488(7411), 320-328. https://doi.org/10.1038/nature11478.
- [3] Nielsen, J., & Keasling, J. D. (2016). Engineering cellular metabolism. Cell, 164(6), 1185-1197. https://doi.org/10.1016/j.cell.2016.02.004.
- [4] Jones, D. R., Schonlau, M., & Welch, W. J. (1998). Efficient global optimization of expensive black-box functions. Journal of global optimization, 13(4), 455-492. https://doi.org/10.1023/a:1008306431147.
- [5] Snoek, J., Larochelle, H., & Adams, R. (2012). Practical bayesian optimization of machine learning algorithms. Advances in neural information processing systems, 25, 2951–2959. https://doi.org/10.5555/2999325.2999464
- [6] Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & De Freitas, N. (2015). Taking the human out of the loop: A review of Bayesian optimization. Proceedings of the IEEE, 104(1), 148-175. https://doi.org/10.1109/jproc.2015.2494218.
- [7] Knowles, J. (2006). ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE transactions on evolutionary computation, 10(1), 50-66. https://doi.org/10.1109/tevc.2005.851274.
- [8] Box, G. E., Hunter, W. H., & Hunter, S. (1978). Statistics for experimenters (Vol. 664). New York: John Wiley and sons. https://hwbdocs.env.nm.gov/Los%20Alamos%20National%20Labs/TA%2054/11528.pdf
- [9] Montgomery, D. C. (2005). Design and analysis of experiments. Hoboken. https://books.google.com/books/about/Design_and_Analysis_of_Experiments_8th_E.html?id=XQAcAAAAQBAJ
- [10] Kennedy, M. C., & O'Hagan, A. (2000). Predicting the output from a complex computer code when fast approximations are available. Biometrika, 87(1), 1-13. https://doi.org/10.1093/biomet/87.1.1
- [11] Swersky, K., Snoek, J., & Adams, R. (2013). Multi-task bayesian optimization. Advances in neural information processing systems, 26, 2004–2012. https://doi.org/10.5555/2999792.2999836
- [12] Forrester, A. I., Sóbester, A., & Keane, A. J. (2007). Multi-fidelity optimization via surrogate modelling. Proceedings: Mathematical, physical and engineering sciences, 463(2088), 3251-3269. https://doi.org/10.1098/rspa.2007.1900.
- [13] Rasmussen, C. E., & Williams, C. K. (2006). Gaussian processes for machine learning, ser. Adaptive computation and machine learning. Cambridge, MA, UsA: MIT press, 38, 715-719. https://doi.org/10.7551/mitpress/3206.001.0001
- [14] Forrester, A., Sobester, A., & Keane, A. (2008). Engineering design via surrogate modelling: A practical guide. John Wiley & Sons. https://doi.org/10.1002/9780470770801.
- [15] MacKay, D. J. (1992). Information-based objective functions for active data selection. Neural computation, 4(4), 590-604. https://doi.org/10.1162/neco.1992.4.4.590.
- [16] Settles, B. (2012). Active learning. Springer Cham. https://doi.org/10.2200/S00429ED1V01Y201207AIM018.
- [17] Bull, A. D. (2011). Convergence rates of efficient global optimization algorithms. Journal of machine learning research, 12(10), 2879–2904. https://www.jmlr.org/papers/volume12/bull11a/bull11a.pdf
- [18] Gardner, J. R., Kusner, M. J., Xu, Z. E., Weinberger, K. Q., & Cunningham, J. P. (2014). Bayesian optimization with inequality constraints. Proceedings of the 31st international conference on international conference on machine learning (Vol. 2014, pp. 937-945). JMLR.org. https://doi.org/10.5555/3044805.3044997
- [19] González, J., Dai, Z., Hennig, P., & Lawrence, N. (2016). Batch Bayesian optimization via local penalization. https://doi.org/10.48550/arXiv.1505.08052
- [20] Desautels, T., Krause, A., & Burdick, J. W. (2014). Parallelizing exploration-exploitation tradeoffs in gaussian process bandit optimization. The journal of machine learning research, 15(1), 3873-3923. https://www.jmlr.org/papers/volume15/desautels14a/desautels14a.pdf
- [21] Bubeck, S., & Cesa-Bianchi, N. (2012). Regret analysis of stochastic and nonstochastic multi-armed bandit problems. Foundations and trends® in machine learning, 5(1), 1-122. https://doi.org/10.1561/2200000024.
- [22] Monod, J. (1949). The growth of bacterial cultures. Annual review of microbiology, 3, 371–394. https://doi.org/10.1146/annurev.mi.03.100149.002103.
- [23] Andrews, J., F. (1968). A mathematical model for the continuous culture of microorganisms utilizing inhibitory substrates. Biotechnology and bioengineering 10(6), 707–723. https://doi.org/10.1002/bit.260100602.
- [24] Bailey, J. E., & Ollis, D. F. (2018). Biochemical engineering fundamentals. McGraw-Hill. https://modps71.lib.kmutt.ac.th/xmlui/handle/123456789/324
- [25] Doran, P. M. (1995). Bioprocess engineering principles. Academic Press, London. https://books.google.com/books/about/Bioprocess_Engineering_Principles.html?id=PZaEAQAACAAJ
- [26] Bastin, G., & Dochain, D. (1990). On-line estimation and adaptive control of bioreactors (Vol. 1, p. 379). Amsterdam: Elsevier. https://d1wqtxts1xzle7.cloudfront.net/54061539/G._Bastin_Auth._On-line_Estimation_and_Adaptive_Control_of_Bioreactors-libre.pdf?1501895262
- [27] Orth, J. D., Thiele, I., & Palsson, B. Ø. (2010). What is flux balance analysis?. Nature biotechnology, 28(3), 245-248. https://doi.org/10.1038/nbt.1614.
- [28] Zomorrodi, A. R., & Maranas, C. D. (2012). OptCom: A multi-level optimization framework for the metabolic modeling and analysis of microbial communities. PLoS computational biology, 8(2), e1002363. https://doi.org/10.1371/journal.pcbi.1002363.
- [29] Zomorrodi, A. R., & Segrè, D. (2016). Synthetic ecology of microbes: mathematical models and applications. Journal of molecular biology, 428(5), 837-8 61. https://doi.org/10.1016/j.jmb.2015.10.019.
- [30] Mahadevan, R., Edwards, J. S., & Doyle, F. J. (2002). Dynamic flux balance analysis of diauxic growth in Escherichia coli. Biophysical journal, 83(3), 1331-1340. https://doi.org/10.1016/S0006-3495(02)73903-9.
- [31] Lamtar Gholipoor, M., Alimoradi, M., & Fakheri, S. (2024). A novel metaheuristic approach inspired by trees social relationships and models for fermentation medium. Metaheuristic algorithms with applications, 1 (1), 1-11. https://doi.org/10.22105/maa.v1i1.17.
- [32] Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., ... & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. the journal of machine learning research, 12, 2825-2830. https://doi.org/10.5555/1953048.2078195
- [33] McKay, M. D., Beckman, R. J., & Conover, W. J. (2000). A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics, 42(1), 55-61. https://doi.org/10.1080/00401706.1979.10489755.
- [34] Nelder, J. A., & Mead, R. (1965). A simplex method for function minimization. The computer journal, 7(4), 308-313. https://doi.org/10.1093/comjnl/7.4.308.
- [35] Močkus, J. (1974). On Bayesian methods for seeking the extremum. IFIP technical conference on optimization techniques (pp. 400-404). Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-07165-2_55.
- [36] M. Friedman. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association 32(200), 675–701 (1937). https://doi.org/10.1080/01621459.1937.10503522.
- [37] Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin 1(6), 80–83. https://doi.org/10.2307/3001968.
- [38] S. Holm. (1979). A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics 6(2), 65–70. https://scispace.com/pdf/a-simple-sequentially-rejective-multiple-test-procedure-458rh2uo9s.pdf
- [39] Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of machine learning research, 7, 1-30. https://doi.org/10.5555/1248547.1248548
