Use exceptions to hold errors even in the keep_going case.