Advancing State Space Search for Static and Dynamic Optimization by Parallelization and Learning