Fix deadlock in test, caused by setting jobs to finished before they have been started.