Abstract: We introduce a stochastic interacting particle consensus system for global optimization of high dimensional non-convex functions. This algorithm does not use gradient of the function thus is suitable for non-smooth functions. We prove, for fully discrete systems, that under dimension-independent conditions on the parameters, with suitable initial data, the algorithms converge to the neighborhood of the global minimum almost surely. We also introduce an Adaptive Moment Estimation (ADAM) based version to significantly improve its performance in high-space dimension.
Consensus-based High Dimensional Global Non-convex Optimization in Machine Learning
07.02.2023 14:30 - 15:30
Organiser:
N. Mauser
Location: