Fix re-execution not being done when replan specified