Research Brief

For genetic programming-based symbolic regression, the choice of population initialization method has a negligible effect on solution accuracy and complexity after a few generations, provided initial diversity is similar.

This research investigates how different initial setups for an AI technique called Genetic Programming (GP), when applied to finding mathematical formulas (Symbolic Regression or SR), influence the final quality and simplicity of the derived solutions. The study compared standard random starting methods against a more sophisticated approach using pre-optimized small solutions. Employing a multi-objective optimization algorithm, NSGA-II, the team tested these methods across a range of synthetic and one real-world dataset. The surprising finding was that, despite an initial boost from the 'optimized' starting points, all methods converged to similar outcomes in terms of accuracy and model complexity after just a few evolutionary steps. This suggests that the specific way a GP population is initialized matters very little in the long run, as long as the initial population is sufficiently diverse.

• Optimizing resource allocation in developing new symbolic regression algorithms by avoiding unnecessary complexity in initial population generation.
• Streamlining machine learning workflows for scientists and engineers who use symbolic regression to discover governing equations from experimental data.
• Guiding the design of more efficient evolutionary algorithms for other optimization problems, potentially simplifying initialization phases.
• Enhancing the robustness of AI systems that rely on symbolic regression for tasks like predictive modeling or system identification in engineering and finance.